-- Logs begin at Thu 2022-06-02 15:08:57 UTC, end at Thu 2022-06-02 16:58:17 UTC. -- Jun 02 15:44:42.597605 dv-cinder-797608-27-iscsi systemd[1]: Starting Devstack devstack@keystone.service... Jun 02 15:44:42.604841 dv-cinder-797608-27-iscsi devstack@keystone.service[80382]: [uWSGI] getting INI configuration from /etc/keystone/keystone-uwsgi-public.ini Jun 02 15:44:42.607393 dv-cinder-797608-27-iscsi devstack@keystone.service[80382]: *** Starting uWSGI 2.0.18-debian (64bit) on [Thu Jun 2 15:44:42 2022] *** Jun 02 15:44:42.607529 dv-cinder-797608-27-iscsi devstack@keystone.service[80382]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Jun 02 15:44:42.607627 dv-cinder-797608-27-iscsi devstack@keystone.service[80382]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Jun 02 15:44:42.607715 dv-cinder-797608-27-iscsi devstack@keystone.service[80382]: nodename: dv-cinder-797608-27-iscsi Jun 02 15:44:42.607800 dv-cinder-797608-27-iscsi devstack@keystone.service[80382]: machine: x86_64 Jun 02 15:44:42.607886 dv-cinder-797608-27-iscsi devstack@keystone.service[80382]: clock source: unix Jun 02 15:44:42.607977 dv-cinder-797608-27-iscsi devstack@keystone.service[80382]: pcre jit disabled Jun 02 15:44:42.608063 dv-cinder-797608-27-iscsi devstack@keystone.service[80382]: detected number of CPU cores: 4 Jun 02 15:44:42.608147 dv-cinder-797608-27-iscsi devstack@keystone.service[80382]: current working directory: / Jun 02 15:44:42.608232 dv-cinder-797608-27-iscsi devstack@keystone.service[80382]: detected binary path: /usr/bin/uwsgi-core Jun 02 15:44:42.608323 dv-cinder-797608-27-iscsi devstack@keystone.service[80382]: your processes number limit is 47680 Jun 02 15:44:42.608410 dv-cinder-797608-27-iscsi devstack@keystone.service[80382]: your memory page size is 4096 bytes Jun 02 15:44:42.608497 dv-cinder-797608-27-iscsi devstack@keystone.service[80382]: detected max file descriptor number: 2048 Jun 02 15:44:42.608591 dv-cinder-797608-27-iscsi devstack@keystone.service[80382]: lock engine: pthread robust mutexes Jun 02 15:44:42.608826 dv-cinder-797608-27-iscsi devstack@keystone.service[80382]: thunder lock: enabled Jun 02 15:44:42.609149 dv-cinder-797608-27-iscsi devstack@keystone.service[80382]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/keystone-wsgi-public.socket fd 4 Jun 02 15:44:42.609335 dv-cinder-797608-27-iscsi devstack@keystone.service[80382]: Python version: 3.8.10 (default, Mar 15 2022, 12:22:08) [GCC 9.4.0] Jun 02 15:44:42.654584 dv-cinder-797608-27-iscsi devstack@keystone.service[80382]: Python main interpreter initialized at 0x55a31aa739c0 Jun 02 15:44:42.654584 dv-cinder-797608-27-iscsi devstack@keystone.service[80382]: python threads support enabled Jun 02 15:44:42.654584 dv-cinder-797608-27-iscsi devstack@keystone.service[80382]: your server socket listen backlog is limited to 100 connections Jun 02 15:44:42.654584 dv-cinder-797608-27-iscsi devstack@keystone.service[80382]: your mercy for graceful operations on workers is 90 seconds Jun 02 15:44:42.654953 dv-cinder-797608-27-iscsi devstack@keystone.service[80382]: mapped 403077 bytes (393 KB) for 2 cores Jun 02 15:44:42.655030 dv-cinder-797608-27-iscsi devstack@keystone.service[80382]: *** Operational MODE: preforking *** Jun 02 15:44:42.655281 dv-cinder-797608-27-iscsi devstack@keystone.service[80382]: *** uWSGI is running in multiple interpreter mode *** Jun 02 15:44:42.655281 dv-cinder-797608-27-iscsi devstack@keystone.service[80382]: spawned uWSGI master process (pid: 80382) Jun 02 15:44:42.655486 dv-cinder-797608-27-iscsi systemd[1]: Started Devstack devstack@keystone.service. Jun 02 15:44:42.656843 dv-cinder-797608-27-iscsi devstack@keystone.service[80382]: spawned uWSGI worker 1 (pid: 80395, cores: 1) Jun 02 15:44:42.656843 dv-cinder-797608-27-iscsi devstack@keystone.service[80382]: spawned uWSGI worker 2 (pid: 80396, cores: 1) Jun 02 15:44:42.656843 dv-cinder-797608-27-iscsi devstack@keystone.service[80382]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Jun 02 15:44:48.445037 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 02 15:44:48.445037 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: from cryptography.utils import int_from_bytes Jun 02 15:44:48.445778 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 02 15:44:48.445778 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: from cryptography.utils import int_from_bytes Jun 02 15:44:48.447157 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 02 15:44:48.447157 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: from cryptography.utils import int_from_bytes Jun 02 15:44:48.447637 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 02 15:44:48.447637 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: from cryptography.utils import int_from_bytes Jun 02 15:44:48.496148 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jun 02 15:44:48.496336 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=80395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jun 02 15:44:48.496528 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG uwsgi [-] command line args: [] {{(pid=80395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jun 02 15:44:48.496792 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=80395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jun 02 15:44:48.496967 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG uwsgi [-] ================================================================================ {{(pid=80395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jun 02 15:44:48.497250 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG uwsgi [-] admin_token = **** {{(pid=80395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 15:44:48.498032 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG uwsgi [-] config_dir = [] {{(pid=80395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 15:44:48.498452 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=80395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 15:44:48.498594 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jun 02 15:44:48.498687 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG uwsgi [-] config_source = [] {{(pid=80395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 15:44:48.498792 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=80396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jun 02 15:44:48.498870 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG uwsgi [-] debug = True {{(pid=80395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 15:44:48.498991 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG uwsgi [-] command line args: [] {{(pid=80396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jun 02 15:44:48.499069 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=80395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 15:44:48.499258 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=80396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jun 02 15:44:48.499389 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=80395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 15:44:48.499491 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG uwsgi [-] ================================================================================ {{(pid=80396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jun 02 15:44:48.499597 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG uwsgi [-] insecure_debug = False {{(pid=80395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 15:44:48.499699 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG uwsgi [-] admin_token = **** {{(pid=80396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 15:44:48.499801 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=80395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 15:44:48.499905 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG uwsgi [-] config_dir = [] {{(pid=80396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 15:44:48.500013 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=80395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 15:44:48.500118 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=80396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 15:44:48.500216 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG uwsgi [-] list_limit = None {{(pid=80395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 15:44:48.500316 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG uwsgi [-] config_source = [] {{(pid=80396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 15:44:48.500423 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG uwsgi [-] log_config_append = None {{(pid=80395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 15:44:48.500526 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG uwsgi [-] debug = True {{(pid=80396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 15:44:48.500628 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=80395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 15:44:48.500730 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=80396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 15:44:48.500857 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG uwsgi [-] log_dir = None {{(pid=80395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 15:44:48.500966 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=80396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 15:44:48.501069 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG uwsgi [-] log_file = None {{(pid=80395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 15:44:48.501166 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG uwsgi [-] insecure_debug = False {{(pid=80396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 15:44:48.501245 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=80395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 15:44:48.501361 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=80396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 15:44:48.501435 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=80395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 15:44:48.501560 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=80396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 15:44:48.501636 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=80395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 15:44:48.501751 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG uwsgi [-] list_limit = None {{(pid=80396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 15:44:48.501832 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=80395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 15:44:48.501906 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG uwsgi [-] log_config_append = None {{(pid=80396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 15:44:48.501971 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=80395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 15:44:48.502134 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=80396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 15:44:48.502216 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=80395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 15:44:48.502289 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG uwsgi [-] log_dir = None {{(pid=80396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 15:44:48.502406 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=80395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 15:44:48.502489 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG uwsgi [-] log_file = None {{(pid=80396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 15:44:48.502566 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=80395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 15:44:48.502646 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=80396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 15:44:48.502762 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=80395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 15:44:48.502837 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=80396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 15:44:48.502999 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=80395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 15:44:48.503124 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=80396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 15:44:48.503266 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=80395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 15:44:48.503347 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=80396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 15:44:48.503426 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=80395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 15:44:48.503503 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=80396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 15:44:48.503649 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=80396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 15:44:48.503730 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=80395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 15:44:48.503897 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=80396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 15:44:48.503976 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG uwsgi [-] notification_format = cadf {{(pid=80395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 15:44:48.504148 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=80396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 15:44:48.504284 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=80395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 15:44:48.504391 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=80396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 15:44:48.504607 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=80396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 15:44:48.504739 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.59/identity {{(pid=80395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 15:44:48.504862 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG uwsgi [-] publish_errors = False {{(pid=80395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 15:44:48.504974 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=80396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 15:44:48.505086 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=80395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 15:44:48.505206 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=80396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 15:44:48.505320 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=80395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 15:44:48.505438 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=80396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 15:44:48.505551 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=80395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 15:44:48.505670 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG uwsgi [-] notification_format = cadf {{(pid=80396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 15:44:48.505786 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=80395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 15:44:48.505910 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=80396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 15:44:48.506031 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=80395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 15:44:48.506031 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG uwsgi [-] standard_threads = False {{(pid=80395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 15:44:48.506283 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG uwsgi [-] strict_password_check = False {{(pid=80395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 15:44:48.506402 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.59/identity {{(pid=80396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 15:44:48.506526 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG uwsgi [-] publish_errors = False {{(pid=80396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 15:44:48.506720 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=80395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 15:44:48.506720 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG uwsgi [-] use_eventlog = False {{(pid=80395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 15:44:48.506953 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=80396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 15:44:48.507067 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG uwsgi [-] use_journal = False {{(pid=80395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 15:44:48.507185 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=80396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 15:44:48.507299 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG uwsgi [-] use_json = False {{(pid=80395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 15:44:48.507413 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=80396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 15:44:48.507537 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG uwsgi [-] use_stderr = False {{(pid=80395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 15:44:48.507537 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG uwsgi [-] use_syslog = False {{(pid=80395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 15:44:48.507766 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=80396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 15:44:48.507886 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG uwsgi [-] watch_log_file = False {{(pid=80395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 15:44:48.508000 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=80396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 15:44:48.508000 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG uwsgi [-] standard_threads = False {{(pid=80396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 15:44:48.508223 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=80395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:44:48.508345 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG uwsgi [-] strict_password_check = False {{(pid=80396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 15:44:48.508460 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=80395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:44:48.508578 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=80396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 15:44:48.508692 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=80395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:44:48.508804 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG uwsgi [-] use_eventlog = False {{(pid=80396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 15:44:48.508916 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=80395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:44:48.509038 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG uwsgi [-] use_journal = False {{(pid=80396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 15:44:48.509158 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=80395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:44:48.509277 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG uwsgi [-] use_json = False {{(pid=80396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 15:44:48.509277 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG uwsgi [-] use_stderr = False {{(pid=80396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 15:44:48.509488 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=80395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:44:48.509602 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG uwsgi [-] use_syslog = False {{(pid=80396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 15:44:48.509723 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=80395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:44:48.509837 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG uwsgi [-] watch_log_file = False {{(pid=80396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 15:44:48.509949 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=80395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:44:48.510062 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=80396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:44:48.510208 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=80395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:44:48.510324 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=80396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:44:48.510445 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=80395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:44:48.510567 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=80396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:44:48.510681 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=80395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:44:48.510799 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=80396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:44:48.510919 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=80395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:44:48.511032 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=80396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:44:48.511156 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=80395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:44:48.511270 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=80396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:44:48.511383 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=80395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:44:48.511495 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=80396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:44:48.511608 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=80395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:44:48.511720 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=80396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:44:48.511910 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=80395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:44:48.512034 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=80396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:44:48.512148 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=80395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:44:48.512261 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=80396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:44:48.512385 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=80395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:44:48.512512 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=80396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:44:48.512637 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=80395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:44:48.512753 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=80396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:44:48.512865 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=80395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:44:48.512984 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=80396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:44:48.513104 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=80395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:44:48.513217 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=80396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:44:48.513463 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=80395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:44:48.513585 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=80396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:44:48.513700 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=80395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:44:48.513820 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=80396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:44:48.513935 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=80395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:44:48.514060 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=80396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:44:48.514223 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=80395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:44:48.514340 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=80396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:44:48.514454 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=80395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:44:48.514573 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=80396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:44:48.514687 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=80395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:44:48.514813 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=80396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:44:48.514928 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=80395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:44:48.515041 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=80396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:44:48.515154 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=80395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:44:48.515273 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=80396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:44:48.515387 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=80395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:44:48.515511 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=80396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:44:48.515632 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=80395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:44:48.515753 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=80396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:44:48.515868 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=80395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:44:48.515986 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=80396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:44:48.516099 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=80395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:44:48.516221 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=80396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:44:48.516326 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=80395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:44:48.516423 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=80396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:44:48.516519 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=80395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:44:48.516614 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=80396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:44:48.516709 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=80395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:44:48.516812 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=80396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:44:48.516910 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=80395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:44:48.517011 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=80396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:44:48.517108 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=80395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:44:48.517209 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=80396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:44:48.517324 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=80395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:44:48.517449 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=80396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:44:48.517595 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=80395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:44:48.517719 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=80396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:44:48.517840 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=80395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:44:48.517957 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=80396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:44:48.518089 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=80395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:44:48.518089 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=80395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:44:48.518320 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=80396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:44:48.518435 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=80395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:44:48.518539 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=80396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:44:48.518650 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=80395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:44:48.518763 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=80396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:44:48.518889 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=80395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:44:48.519011 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=80396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:44:48.519126 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=80395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:44:48.519254 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=80396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:44:48.519435 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=80395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:44:48.519616 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=80396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:44:48.519749 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=80395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:44:48.519749 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=80395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:44:48.519976 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=80396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:44:48.520093 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=80395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:44:48.520198 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=80396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:44:48.520300 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=80395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:44:48.520421 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=80396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:44:48.520544 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=80395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:44:48.520544 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=80395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:44:48.520759 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=80396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:44:48.520879 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=80395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:44:48.520984 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=80396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:44:48.521098 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=80395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:44:48.521225 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=80396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:44:48.521332 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=80395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:44:48.521448 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=80396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:44:48.521562 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=80395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:44:48.521682 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=80396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:44:48.521796 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=80395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:44:48.521918 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=80396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:44:48.522040 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=80395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:44:48.522204 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=80396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:44:48.522330 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=80395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:44:48.522453 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=80396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:44:48.522568 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=80395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:44:48.522691 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=80396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:44:48.522806 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=80395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:44:48.522932 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=80396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:44:48.523055 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=80395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:44:48.523172 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=80396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:44:48.523296 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=80395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:44:48.523420 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=80396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:44:48.523541 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=80395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:44:48.523656 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=80396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:44:48.523775 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=80395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:44:48.523890 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=80396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:44:48.524004 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=80395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:44:48.524188 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=80396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:44:48.524313 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=80395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:44:48.524428 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=80396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:44:48.524541 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=80395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:44:48.524655 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=80396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:44:48.524769 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=80395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:44:48.524892 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=80396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:44:48.525013 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=80395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:44:48.525128 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=80396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:44:48.525243 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=80395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:44:48.525358 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=80396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:44:48.525481 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=80395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:44:48.525605 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=80396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:44:48.525721 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=80395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:44:48.525835 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=80396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:44:48.525952 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG uwsgi [-] cache.enabled = True {{(pid=80395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:44:48.526123 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=80396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:44:48.526239 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=80395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:44:48.526367 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=80396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:44:48.526484 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=80395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:44:48.526603 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=80396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:44:48.526724 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=80395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:44:48.526724 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=80395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:44:48.526937 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=80396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:44:48.527064 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=80395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:44:48.527192 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=80396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:44:48.527309 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=80395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:44:48.527424 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=80396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:44:48.527537 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=80395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:44:48.527650 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=80396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:44:48.527764 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=80395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:44:48.527886 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=80396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:44:48.528001 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=80395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:44:48.528115 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=80396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:44:48.528229 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=80395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:44:48.528342 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=80396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:44:48.528503 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=80395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:44:48.528635 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG uwsgi [-] cache.enabled = True {{(pid=80396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:44:48.528926 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=80395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:44:48.529078 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=80396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:44:48.529221 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=80395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:44:48.529338 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=80396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:44:48.529454 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=80395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:44:48.529578 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=80396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:44:48.529711 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=80395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:44:48.529876 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=80396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:44:48.530002 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=80395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:44:48.530160 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=80396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:44:48.530277 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=80395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:44:48.530406 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=80396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:44:48.530524 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=80395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:44:48.530639 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=80396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:44:48.530753 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=80395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:44:48.530867 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=80396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:44:48.530982 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=80395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:44:48.531105 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=80396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:44:48.531222 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=80395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:44:48.531345 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=80396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:44:48.531461 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=80395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:44:48.531576 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=80396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:44:48.531697 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=80395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:44:48.531823 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=80396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:44:48.531940 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=80395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:44:48.532055 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=80396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:44:48.532169 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=80395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:44:48.532283 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=80396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:44:48.532397 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=80395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:44:48.532518 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=80396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:44:48.532635 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=80395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:44:48.532749 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=80396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:44:48.532864 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=80395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:44:48.532978 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=80396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:44:48.533092 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG uwsgi [-] auth.external = None {{(pid=80395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:44:48.533215 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=80396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:44:48.533331 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG uwsgi [-] auth.mapped = None {{(pid=80395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:44:48.533446 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=80396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:44:48.533560 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=80395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:44:48.533677 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=80396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:44:48.533791 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=80395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:44:48.533913 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=80396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:44:48.534029 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG uwsgi [-] auth.password = None {{(pid=80395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:44:48.534156 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=80396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:44:48.534272 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG uwsgi [-] auth.token = None {{(pid=80395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:44:48.534386 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=80396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:44:48.534499 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=80395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:44:48.534625 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=80396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:44:48.534743 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG uwsgi [-] catalog.caching = True {{(pid=80395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:44:48.534863 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=80396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:44:48.535005 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=80395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:44:48.535130 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=80396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:44:48.535253 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=80395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:44:48.535376 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=80396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:44:48.535492 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=80395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:44:48.535615 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=80396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:44:48.535733 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=80395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:44:48.535849 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG uwsgi [-] auth.external = None {{(pid=80396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:44:48.535963 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=80395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:44:48.536082 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG uwsgi [-] auth.mapped = None {{(pid=80396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:44:48.536206 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG uwsgi [-] credential.caching = True {{(pid=80395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:44:48.536331 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=80396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:44:48.536450 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG uwsgi [-] credential.driver = sql {{(pid=80395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:44:48.536565 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=80396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:44:48.536679 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=80395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:44:48.536796 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG uwsgi [-] auth.password = None {{(pid=80396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:44:48.536911 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=80395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:44:48.537035 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG uwsgi [-] auth.token = None {{(pid=80396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:44:48.537152 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=80395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:44:48.537272 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=80396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:44:48.537394 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=80395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:44:48.537510 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG uwsgi [-] catalog.caching = True {{(pid=80396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:44:48.537625 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=80395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:44:48.537815 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=80396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:44:48.537936 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=80395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:44:48.538057 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=80396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:44:48.538207 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=80395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:44:48.538323 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=80396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:44:48.538438 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=80395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:44:48.538566 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=80396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:44:48.538696 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=80395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:44:48.538813 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=80396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:44:48.538929 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=80395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:44:48.539044 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG uwsgi [-] credential.caching = True {{(pid=80396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:44:48.539158 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=80395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:44:48.539282 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG uwsgi [-] credential.driver = sql {{(pid=80396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:44:48.539407 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=80395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:44:48.539531 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=80396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:44:48.539647 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=80395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:44:48.539762 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=80396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:44:48.539877 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=80395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:44:48.540002 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=80396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:44:48.540118 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG uwsgi [-] federation.caching = True {{(pid=80395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:44:48.540233 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=80396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:44:48.540347 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=80395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:44:48.540461 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=80396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:44:48.540575 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG uwsgi [-] federation.driver = sql {{(pid=80395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:44:48.540699 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=80396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:44:48.540815 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=80395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:44:48.540936 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=80396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:44:48.541054 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=80395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:44:48.541169 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=80396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:44:48.541293 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=80395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:44:48.541409 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=80396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:44:48.541525 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=80395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:44:48.541525 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=80395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:44:48.541740 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=80396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:44:48.541855 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=80395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:44:48.541979 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=80396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:44:48.542113 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=80395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:44:48.542231 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=80396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:44:48.542346 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=80395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:44:48.542461 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=80396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:44:48.542574 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=80395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:44:48.542702 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=80396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:44:48.542825 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG uwsgi [-] identity.caching = True {{(pid=80395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:44:48.542941 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG uwsgi [-] federation.caching = True {{(pid=80396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:44:48.543063 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=80395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:44:48.543179 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=80396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:44:48.543302 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=80395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:44:48.543427 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG uwsgi [-] federation.driver = sql {{(pid=80396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:44:48.543542 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=80395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:44:48.543657 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=80396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:44:48.543773 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=80395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:44:48.543887 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=80396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:44:48.544002 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG uwsgi [-] identity.driver = sql {{(pid=80395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:44:48.544636 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=80396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:44:48.544757 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=80395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:44:48.544929 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=80396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:44:48.545084 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=80395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:44:48.545212 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=80396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:44:48.545330 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=80395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:44:48.545454 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=80396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:44:48.545571 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=80395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:44:48.545686 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=80396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:44:48.545810 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=80395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:44:48.545999 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=80396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:44:48.546137 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=80395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:44:48.546275 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=80396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:44:48.546392 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=80395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:44:48.546507 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG uwsgi [-] identity.caching = True {{(pid=80396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:44:48.546623 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=80395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:44:48.546623 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=80395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:44:48.546839 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=80396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:44:48.546839 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=80396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:44:48.547066 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=80395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:44:48.547181 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=80396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:44:48.547297 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=80395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:44:48.547412 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=80396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:44:48.547526 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=80395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:44:48.547650 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG uwsgi [-] identity.driver = sql {{(pid=80396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:44:48.547766 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=80395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:44:48.547881 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=80396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:44:48.547995 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=80395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:44:48.548110 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=80396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:44:48.548224 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=80395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:44:48.548349 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=80396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:44:48.548465 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=80395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:44:48.548580 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=80396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:44:48.548700 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=80395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:44:48.548816 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=80396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:44:48.548929 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=80395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:44:48.549053 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=80396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:44:48.549169 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=80395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:44:48.549291 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=80396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:44:48.549671 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=80395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:44:48.549790 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=80396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:44:48.549905 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=80395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:44:48.550029 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=80396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:44:48.550191 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=80395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:44:48.550308 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=80396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:44:48.550424 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=80395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:44:48.550539 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=80396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:44:48.550653 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=80395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:44:48.550781 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=80396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:44:48.550899 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=80395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:44:48.551020 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=80396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:44:48.551136 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=80395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:44:48.551251 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=80396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:44:48.551374 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=80395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:44:48.551491 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=80396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:44:48.551606 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=80395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:44:48.551720 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=80396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:44:48.551834 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=80395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:44:48.551949 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=80396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:44:48.552073 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=80395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:44:48.552197 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=80396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:44:48.552313 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG uwsgi [-] ldap.password = **** {{(pid=80395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:44:48.552429 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=80396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:44:48.552544 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=80395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:44:48.552659 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=80396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:44:48.552782 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=80395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:44:48.552899 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=80396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:44:48.553014 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=80395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:44:48.553129 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=80396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:44:48.553244 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=80395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:44:48.553365 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=80396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:44:48.553489 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=80395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:44:48.553608 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=80396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:44:48.553724 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=80395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:44:48.553839 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=80396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:44:48.553953 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=80395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:44:48.553953 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=80395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:44:48.554226 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=80396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:44:48.554344 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=80395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:44:48.554458 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=80396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:44:48.554573 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=80395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:44:48.554688 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=80396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:44:48.554802 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=80395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:44:48.554926 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=80396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:44:48.555042 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=80395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:44:48.555157 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=80396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:44:48.555271 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=80395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:44:48.555386 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG uwsgi [-] ldap.password = **** {{(pid=80396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:44:48.555500 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=80395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:44:48.555624 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=80396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:44:48.555741 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG uwsgi [-] ldap.user = None {{(pid=80395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:44:48.555863 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=80396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:44:48.555979 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=80395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:44:48.556098 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=80396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:44:48.556098 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=80396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:44:48.556322 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=80395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:44:48.556438 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=80396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:44:48.556553 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=80395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:44:48.556668 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=80396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:44:48.556783 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=80395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:44:48.556897 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=80396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:44:48.557020 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=80395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:44:48.557136 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=80396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:44:48.557251 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=80395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:44:48.557365 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=80396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:44:48.557480 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=80395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:44:48.557595 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=80396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:44:48.557718 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=80395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:44:48.557718 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=80395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:44:48.557934 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=80396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:44:48.558049 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=80395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:44:48.558181 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=80396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:44:48.558287 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=80395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:44:48.558413 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=80396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:44:48.558530 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=80395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:44:48.558645 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=80396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:44:48.558760 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=80395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:44:48.558875 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG uwsgi [-] ldap.user = None {{(pid=80396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:44:48.558996 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=80395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:44:48.559120 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=80396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:44:48.559236 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=80395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:44:48.559351 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=80396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:44:48.559466 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=80395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:44:48.559580 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=80396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:44:48.559695 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=80395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:44:48.560389 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=80396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:44:48.560512 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=80395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:44:48.560627 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=80396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:44:48.560752 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=80395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:44:48.560922 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=80396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:44:48.561041 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=80395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:44:48.561166 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=80396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:44:48.561282 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=80395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:44:48.561396 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=80396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:44:48.561511 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=80395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:44:48.561625 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=80396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:44:48.561749 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=80395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:44:48.561939 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=80396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:44:48.562064 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=80395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:44:48.562207 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=80396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:44:48.562324 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=80395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:44:48.562438 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=80396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:44:48.562564 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=80395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:44:48.562690 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=80396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:44:48.562806 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG uwsgi [-] policy.driver = sql {{(pid=80395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:44:48.562920 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=80396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:44:48.563036 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=80395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:44:48.563036 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=80395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:44:48.563250 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=80396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:44:48.563250 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=80396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:44:48.563478 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=80395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:44:48.563592 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=80396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:44:48.563706 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG uwsgi [-] receipt.caching = True {{(pid=80395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:44:48.563821 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=80396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:44:48.563935 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=80395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:44:48.564059 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=80396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:44:48.564175 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=80395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:44:48.564289 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=80396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:44:48.564403 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=80395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:44:48.564518 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=80396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:44:48.564632 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=80395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:44:48.564755 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=80396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:44:48.564870 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=80395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:44:48.564984 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=80396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:44:48.565098 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG uwsgi [-] resource.caching = True {{(pid=80395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:44:48.565212 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=80396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:44:48.565326 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=80395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:44:48.565452 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=80396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:44:48.565569 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG uwsgi [-] resource.driver = sql {{(pid=80395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:44:48.565683 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=80396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:44:48.565797 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=80395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:44:48.565911 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG uwsgi [-] policy.driver = sql {{(pid=80396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:44:48.566025 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=80395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:44:48.566215 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=80396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:44:48.566334 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=80395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:44:48.566449 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=80396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:44:48.566564 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG uwsgi [-] revoke.caching = True {{(pid=80395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:44:48.566678 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=80396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:44:48.566802 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=80395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:44:48.566918 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG uwsgi [-] receipt.caching = True {{(pid=80396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:44:48.567033 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=80395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:44:48.567148 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=80396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:44:48.567264 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG uwsgi [-] role.cache_time = None {{(pid=80395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:44:48.567379 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=80396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:44:48.567502 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG uwsgi [-] role.caching = True {{(pid=80395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:44:48.567618 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=80396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:44:48.567734 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG uwsgi [-] role.driver = sql {{(pid=80395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:44:48.567848 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=80396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:44:48.567963 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG uwsgi [-] role.list_limit = None {{(pid=80395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:44:48.568077 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=80396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:44:48.568201 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=80395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:44:48.568319 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG uwsgi [-] resource.caching = True {{(pid=80396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:44:48.568434 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=80395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:44:48.568549 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=80396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:44:48.568664 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=80395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:44:48.568779 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG uwsgi [-] resource.driver = sql {{(pid=80396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:44:48.568902 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=80395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:44:48.569018 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=80396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:44:48.569133 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=80395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:44:48.569249 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=80396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:44:48.569365 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=80395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:44:48.569480 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=80396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:44:48.569604 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=80395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:44:48.569604 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=80395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:44:48.569820 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG uwsgi [-] revoke.caching = True {{(pid=80396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:44:48.569935 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=80395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:44:48.570049 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=80396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:44:48.570183 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=80395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:44:48.570310 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=80396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:44:48.570427 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=80395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:44:48.570542 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG uwsgi [-] role.cache_time = None {{(pid=80396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:44:48.570656 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=80395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:44:48.570770 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG uwsgi [-] role.caching = True {{(pid=80396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:44:48.570884 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=80395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:44:48.571008 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG uwsgi [-] role.driver = sql {{(pid=80396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:44:48.571008 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG uwsgi [-] role.list_limit = None {{(pid=80396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:44:48.571223 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=80395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:44:48.571337 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=80396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:44:48.571470 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=80395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:44:48.571582 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=80396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:44:48.571705 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=80395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:44:48.571821 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=80396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:44:48.571936 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=80395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:44:48.572050 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=80396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:44:48.572164 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=80395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:44:48.572278 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=80396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:44:48.572401 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=80395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:44:48.572518 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=80396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:44:48.572632 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=80395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:44:48.572746 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=80396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:44:48.572859 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=80395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:44:48.572973 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=80396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:44:48.573151 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=80395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:44:48.573270 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=80396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:44:48.573385 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=80395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:44:48.573501 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=80396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:44:48.573616 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=80395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:44:48.573739 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=80396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:44:48.573856 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=80395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:44:48.573856 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=80395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:44:48.574113 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=80396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:44:48.574231 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=80395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:44:48.574346 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=80396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:44:48.574475 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=80395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:44:48.574593 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=80396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:44:48.574708 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=80395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:44:48.574822 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=80396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:44:48.574936 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=80395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:44:48.575051 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=80396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:44:48.575175 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=80395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:44:48.575291 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=80396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:44:48.575421 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG uwsgi [-] token.cache_time = None {{(pid=80395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:44:48.575421 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG uwsgi [-] token.caching = True {{(pid=80395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:44:48.575687 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=80396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:44:48.575831 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=80395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:44:48.575958 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=80396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:44:48.576079 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG uwsgi [-] token.provider = fernet {{(pid=80395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:44:48.576194 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=80396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:44:48.576310 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=80395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:44:48.576425 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=80396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:44:48.576540 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=80395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:44:48.576664 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=80396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:44:48.576781 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=80395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:44:48.576896 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=80396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:44:48.577011 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=80395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:44:48.577126 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=80396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:44:48.577242 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=80395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:44:48.577366 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=80396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:44:48.577490 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=80395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:44:48.577606 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=80396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:44:48.577723 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG uwsgi [-] trust.driver = sql {{(pid=80395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:44:48.577838 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=80396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:44:48.577953 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=80395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:44:48.578095 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=80396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:44:48.578214 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=80395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:44:48.578329 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=80396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:44:48.578455 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=80395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:44:48.578572 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=80396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:44:48.578687 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=80395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:44:48.578811 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=80396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:44:48.578928 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=80395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:44:48.579043 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG uwsgi [-] token.cache_time = None {{(pid=80396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:44:48.579158 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=80395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:44:48.579272 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG uwsgi [-] token.caching = True {{(pid=80396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:44:48.579388 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=80395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:44:48.579511 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=80396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:44:48.579628 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=80395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:44:48.579743 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG uwsgi [-] token.provider = fernet {{(pid=80396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:44:48.579743 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=80396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:44:48.579958 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG uwsgi [-] database.connection = **** {{(pid=80395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:44:48.579958 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=80395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:44:48.580193 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=80396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:44:48.580318 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=80395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:44:48.580434 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=80396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:44:48.580549 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=80395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:44:48.580664 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=80396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:44:48.580779 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=80395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:44:48.580894 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=80396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:44:48.581018 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=80395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:44:48.581134 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=80396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:44:48.581249 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=80395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:44:48.581363 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG uwsgi [-] trust.driver = sql {{(pid=80396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:44:48.581478 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=80395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:44:48.581599 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=80396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:44:48.581723 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=80395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:44:48.581838 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=80396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:44:48.581954 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=80395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:44:48.582085 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=80396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:44:48.582203 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=80395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:44:48.582318 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=80396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:44:48.582511 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=80395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:44:48.582631 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=80396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:44:48.582746 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=80395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:44:48.582867 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=80396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:44:48.582984 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=80395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:44:48.583099 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=80396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:44:48.583224 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=80395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:44:48.583340 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=80396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:44:48.583455 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=80395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:44:48.583570 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG uwsgi [-] database.connection = **** {{(pid=80396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:44:48.583694 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=80395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:44:48.583818 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=80396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:44:48.583950 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=80395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:44:48.583950 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=80395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:44:48.584223 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=80396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:44:48.584340 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jun 02 15:44:48.584456 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=80396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:44:48.584456 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=80396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:44:48.584456 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=80396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:44:48.584456 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=80396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:44:48.584456 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=80396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:44:48.584456 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=80396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:44:48.584456 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=80396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:44:48.584456 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=80396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:44:48.584456 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=80396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:44:48.585386 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=80396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:44:48.585386 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=80396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:44:48.585386 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=80396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:44:48.585386 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=80396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:44:48.585386 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=80396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:44:48.585386 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=80396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:44:48.585386 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=80396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:44:48.585386 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jun 02 15:44:48.611157 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=80395) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 02 15:44:48.611384 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=80395) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 02 15:44:48.611606 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=80395) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 02 15:44:48.614616 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=80396) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 02 15:44:48.614853 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=80396) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 02 15:44:48.615078 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=80396) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 02 15:44:48.620146 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=80395) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 02 15:44:48.623833 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=80396) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 02 15:44:48.648526 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=80395) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 02 15:44:48.648753 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=80395) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 02 15:44:48.650462 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=80396) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 02 15:44:48.650694 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=80396) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 02 15:44:48.703102 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=80395) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 02 15:44:48.704342 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=80396) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 02 15:44:48.752825 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=80395) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 02 15:44:48.753049 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=80395) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 02 15:44:48.754266 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=80396) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 02 15:44:48.754508 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=80396) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 02 15:44:48.819564 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80395) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 02 15:44:48.819788 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=80395) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 02 15:44:48.820008 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80396) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 02 15:44:48.820093 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=80395) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 02 15:44:48.820219 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=80395) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 02 15:44:48.820301 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=80396) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 02 15:44:48.820432 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=80395) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 02 15:44:48.820532 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=80396) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 02 15:44:48.820643 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=80395) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 02 15:44:48.820725 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=80396) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 02 15:44:48.820874 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=80396) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 02 15:44:48.821094 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=80396) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 02 15:44:48.844458 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80395) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 02 15:44:48.844687 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=80395) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 02 15:44:48.844784 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80396) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 02 15:44:48.844913 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=80395) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 02 15:44:48.844996 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=80396) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 02 15:44:48.845138 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=80396) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 02 15:44:48.845218 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=80395) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 02 15:44:48.845352 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=80395) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 02 15:44:48.845439 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=80396) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 02 15:44:48.845566 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=80395) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 02 15:44:48.845648 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=80396) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 02 15:44:48.845778 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80395) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 02 15:44:48.845865 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=80396) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 02 15:44:48.845994 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80396) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 02 15:44:48.857378 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=80395) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 02 15:44:48.857606 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=80396) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 02 15:44:48.869854 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80395) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 02 15:44:48.870105 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=80395) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 02 15:44:48.870330 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=80395) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 02 15:44:48.870414 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80396) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 02 15:44:48.870551 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=80395) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 02 15:44:48.870651 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=80396) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 02 15:44:48.870767 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=80395) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 02 15:44:48.870850 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=80396) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 02 15:44:48.870980 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=80395) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 02 15:44:48.871062 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=80396) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 02 15:44:48.871193 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80395) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 02 15:44:48.871277 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=80396) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 02 15:44:48.871451 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=80396) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 02 15:44:48.871678 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80396) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 02 15:44:48.889073 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=80395) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 15:44:48.889276 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=80395) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jun 02 15:44:48.889387 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=80396) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 15:44:48.889519 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=80396) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jun 02 15:44:48.889604 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=80395) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 15:44:48.889790 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=80395) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jun 02 15:44:48.889874 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=80396) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 15:44:48.890040 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=80396) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jun 02 15:44:48.890147 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=80395) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 15:44:48.890319 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=80395) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 15:44:48.890401 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=80396) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 15:44:48.890572 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=80395) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 15:44:48.890654 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=80396) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 15:44:48.890824 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=80395) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 15:44:48.890907 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=80396) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 15:44:48.891078 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=80396) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 15:44:48.901716 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=80395) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 15:44:48.901984 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=80395) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 15:44:48.902180 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=80396) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 15:44:48.902266 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=80395) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 15:44:48.902456 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=80396) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 15:44:48.902539 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=80395) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 15:44:48.902724 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=80396) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 15:44:48.903007 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=80396) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 15:44:48.912098 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=80396) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 02 15:44:48.912212 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=80395) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 02 15:44:48.915388 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=80395) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 02 15:44:48.915537 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=80396) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 02 15:44:48.915664 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=80395) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 15:44:48.915816 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=80396) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 15:44:48.915940 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=80395) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 15:44:48.916095 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=80396) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 15:44:48.916215 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=80395) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 15:44:48.916374 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=80396) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 15:44:48.916491 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=80395) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 15:44:48.916654 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=80396) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 15:44:48.916861 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=80395) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 15:44:48.917029 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=80396) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 15:44:48.917130 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=80395) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 15:44:48.917301 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=80396) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 15:44:48.917391 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=80395) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 15:44:48.917578 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=80396) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 15:44:48.917659 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=80395) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 15:44:48.917850 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=80396) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 15:44:48.917931 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=80395) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 15:44:48.918149 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=80396) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 15:44:48.918233 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=80395) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 15:44:48.918419 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=80396) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 15:44:48.945225 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=80395) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 15:44:48.945758 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=80396) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 15:44:48.946959 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=80395) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 02 15:44:48.947232 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=80395) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 15:44:48.947526 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=80396) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 02 15:44:48.947807 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=80396) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 15:44:48.952520 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=80395) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 02 15:44:48.952793 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=80395) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 15:44:48.953072 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=80395) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 15:44:48.953379 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=80396) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 02 15:44:48.953627 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=80396) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 15:44:48.953906 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=80396) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 15:44:48.960285 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=80395) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 02 15:44:48.960563 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=80395) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 15:44:48.961263 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=80396) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 02 15:44:48.961554 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=80396) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 15:44:48.965278 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=80395) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 02 15:44:48.965665 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=80395) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 15:44:48.966058 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=80395) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 15:44:48.966363 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=80395) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 15:44:48.966668 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=80396) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 02 15:44:48.966759 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=80395) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 15:44:48.966985 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=80395) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 15:44:48.967079 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=80396) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 15:44:48.967253 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=80395) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 15:44:48.967366 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=80396) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 15:44:48.967520 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=80395) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 15:44:48.967650 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=80396) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 15:44:48.967932 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=80396) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 15:44:48.968218 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=80396) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 15:44:48.968485 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=80396) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 15:44:48.968763 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=80396) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 15:44:48.986659 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=80395) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 15:44:48.986930 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=80395) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 15:44:48.987890 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=80396) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 15:44:48.988166 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=80396) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 15:44:48.991555 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=80395) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 02 15:44:48.992775 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=80396) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 02 15:44:48.995180 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=80395) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 15:44:48.995469 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=80395) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 15:44:48.996439 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=80396) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 15:44:48.996763 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=80396) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 15:44:49.001050 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=80395) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 02 15:44:49.002553 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=80396) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 02 15:44:49.004647 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=80395) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 02 15:44:49.006133 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=80396) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 02 15:44:49.009744 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=80395) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 15:44:49.010044 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=80395) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 15:44:49.010351 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=80395) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 15:44:49.010627 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=80395) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 15:44:49.010898 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=80395) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 15:44:49.011169 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=80395) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 15:44:49.011294 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=80396) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 15:44:49.011597 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=80396) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 15:44:49.011886 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=80396) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 15:44:49.012180 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=80396) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 15:44:49.012462 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=80396) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 15:44:49.012741 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=80396) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 15:44:49.030065 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=80395) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 02 15:44:49.030362 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=80395) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 15:44:49.030635 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=80395) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 15:44:49.030900 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=80395) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 15:44:49.032247 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=80396) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 02 15:44:49.032529 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=80396) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 15:44:49.032806 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=80396) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 15:44:49.033071 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=80396) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 15:44:49.038802 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=80395) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 15:44:49.040512 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=80395) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 15:44:49.040780 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=80395) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 15:44:49.041190 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=80396) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 15:44:49.043071 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=80396) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 15:44:49.043346 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=80396) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 15:44:49.043816 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=80395) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 02 15:44:49.044621 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=80395) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 15:44:49.044896 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=80395) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 15:44:49.045177 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=80395) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 15:44:49.045456 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=80395) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 15:44:49.047392 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=80396) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 02 15:44:49.047674 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=80396) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 15:44:49.047956 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=80396) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 15:44:49.048244 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=80396) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 15:44:49.048546 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=80396) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 15:44:49.058793 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=80395) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 02 15:44:49.059067 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=80395) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 15:44:49.059339 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=80395) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 15:44:49.059610 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=80395) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 15:44:49.059952 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=80395) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 15:44:49.060222 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=80395) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 15:44:49.060492 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=80395) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 15:44:49.062166 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=80396) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 02 15:44:49.062447 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=80396) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 15:44:49.062726 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=80396) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 15:44:49.063003 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=80396) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 15:44:49.063282 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=80396) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 15:44:49.063553 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=80396) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 15:44:49.063827 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=80396) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 15:44:49.079029 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=80395) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 02 15:44:49.082293 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=80395) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 02 15:44:49.082459 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=80396) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 02 15:44:49.085555 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=80395) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 15:44:49.085716 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=80396) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 02 15:44:49.087182 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=80395) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 15:44:49.088822 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=80395) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 02 15:44:49.089065 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=80396) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 15:44:49.089148 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=80395) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 15:44:49.089357 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=80395) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 15:44:49.091013 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=80396) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 15:44:49.092810 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=80396) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 02 15:44:49.093090 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=80396) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 15:44:49.093369 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=80396) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 15:44:49.097040 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=80395) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 15:44:49.098678 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=80395) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 02 15:44:49.100809 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=80396) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 15:44:49.101836 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=80395) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 15:44:49.102138 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=80395) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 15:44:49.102419 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=80395) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 15:44:49.102513 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=80396) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 02 15:44:49.102690 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=80395) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 15:44:49.105664 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=80396) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 15:44:49.105952 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=80396) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 15:44:49.106259 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=80396) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 15:44:49.107060 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=80396) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 15:44:49.112216 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=80395) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 02 15:44:49.112496 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=80395) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 15:44:49.112869 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=80395) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 15:44:49.116178 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=80396) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 02 15:44:49.116463 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=80396) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 15:44:49.116844 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=80396) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 15:44:49.120740 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=80395) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 02 15:44:49.121014 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=80395) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 15:44:49.121288 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=80395) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 15:44:49.121555 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=80395) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 15:44:49.121820 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=80395) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 15:44:49.122193 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=80395) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 15:44:49.122550 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=80395) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 15:44:49.122992 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=80395) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 15:44:49.123263 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=80395) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 15:44:49.123529 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=80395) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 15:44:49.123796 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=80395) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 15:44:49.124064 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=80395) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 15:44:49.124326 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=80395) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 15:44:49.124589 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=80395) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 15:44:49.125256 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=80396) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 02 15:44:49.125536 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=80396) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 15:44:49.125815 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=80396) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 15:44:49.126104 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=80396) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 15:44:49.126377 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=80396) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 15:44:49.126661 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=80396) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 15:44:49.126933 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=80396) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 15:44:49.127212 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=80396) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 15:44:49.127515 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=80396) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 15:44:49.127815 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=80396) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 15:44:49.128106 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=80396) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 15:44:49.128389 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=80396) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 15:44:49.128673 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=80396) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 15:44:49.128931 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=80396) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 15:44:49.162820 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: WSGI app 0 (mountpoint='') ready in 7 seconds on interpreter 0x55a31aa739c0 pid: 80395 (default app) Jun 02 15:44:49.166014 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2318c67-5b18-4378-830a-857cfc68a7fc None None] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:44:49.166575 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2318c67-5b18-4378-830a-857cfc68a7fc None None] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:44:49.166575 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2318c67-5b18-4378-830a-857cfc68a7fc None None] PATH_INFO: `/v3` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:44:49.167315 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: WSGI app 0 (mountpoint='') ready in 7 seconds on interpreter 0x55a31aa739c0 pid: 80396 (default app) Jun 02 15:44:49.171917 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 1/1] 10.222.0.59 () {50 vars in 791 bytes} [Thu Jun 2 15:44:49 2022] GET /identity/v3/ => generated 255 bytes in 8 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 15:44:58.111275 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6408cf9-f855-4bb4-8900-349b44bf457e None None] REQUEST_METHOD: `GET` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:44:58.111819 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6408cf9-f855-4bb4-8900-349b44bf457e None None] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:44:58.111819 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6408cf9-f855-4bb4-8900-349b44bf457e None None] PATH_INFO: `/` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:44:58.116361 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 1/2] 10.222.0.59 () {54 vars in 926 bytes} [Thu Jun 2 15:44:58 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 15:44:58.121538 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd6e713-aa57-49de-8860-262dadc0c5c2 None None] REQUEST_METHOD: `POST` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:44:58.122554 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd6e713-aa57-49de-8860-262dadc0c5c2 None None] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:44:58.123009 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd6e713-aa57-49de-8860-262dadc0c5c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:44:58.192488 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: INFO dbcounter [None req-5dd6e713-aa57-49de-8860-262dadc0c5c2 None None] Registered counter for database keystone Jun 02 15:44:58.214646 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG oslo_db.sqlalchemy.engines [None req-5dd6e713-aa57-49de-8860-262dadc0c5c2 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=80395) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 02 15:44:58.221275 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writer thread running {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 02 15:44:58.506690 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG passlib.handlers.bcrypt [None req-5dd6e713-aa57-49de-8860-262dadc0c5c2 None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=80395) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Jun 02 15:44:58.507102 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG passlib.handlers.bcrypt [None req-5dd6e713-aa57-49de-8860-262dadc0c5c2 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=80395) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Jun 02 15:44:58.562668 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.auth.core [None req-5dd6e713-aa57-49de-8860-262dadc0c5c2 None None] MFA Rules not processed for user `400d1f4db9de49638549e5db29a041e1`. Rule list: `[]` (Enabled: `True`). {{(pid=80395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 15:44:58.564279 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.fernet_utils [None req-5dd6e713-aa57-49de-8860-262dadc0c5c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 15:44:58.690252 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 2/3] 10.222.0.59 () {58 vars in 1023 bytes} [Thu Jun 2 15:44:58 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 570 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Jun 02 15:44:58.728412 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6408cf9-f855-4bb4-8900-349b44bf457e None None] Authenticating user token {{(pid=80396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:44:58.797443 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: INFO dbcounter [None req-f6408cf9-f855-4bb4-8900-349b44bf457e None None] Registered counter for database keystone Jun 02 15:44:58.816764 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG oslo_db.sqlalchemy.engines [None req-f6408cf9-f855-4bb4-8900-349b44bf457e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=80396) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 02 15:44:58.822918 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG dbcounter [-] [80396] Writer thread running {{(pid=80396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 02 15:44:59.053001 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6408cf9-f855-4bb4-8900-349b44bf457e None None] Validating token access rules against request {{(pid=80396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:44:59.057135 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b060ebae-4955-459f-8db0-80f8854f5257 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f73d5a98be74242b45222df39fb6213', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:44:59.057799 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b060ebae-4955-459f-8db0-80f8854f5257 admin admin] REQUEST_METHOD: `GET` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:44:59.058098 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b060ebae-4955-459f-8db0-80f8854f5257 admin admin] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:44:59.058439 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b060ebae-4955-459f-8db0-80f8854f5257 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:44:59.066791 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b060ebae-4955-459f-8db0-80f8854f5257 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:44:59.119076 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: WARNING keystone.common.rbac_enforcer.enforcer [None req-b060ebae-4955-459f-8db0-80f8854f5257 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Jun 02 15:44:59.119645 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b060ebae-4955-459f-8db0-80f8854f5257 admin admin] RBAC: Authorization granted {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:44:59.129396 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 2/4] 10.222.0.59 () {58 vars in 1324 bytes} [Thu Jun 2 15:44:58 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 401 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 02 15:44:59.135399 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd6e713-aa57-49de-8860-262dadc0c5c2 None None] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:44:59.150241 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd6e713-aa57-49de-8860-262dadc0c5c2 None None] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:44:59.155134 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-119e275a-127b-4267-904b-d2d87d561a0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f73d5a98be74242b45222df39fb6213', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:44:59.156244 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-119e275a-127b-4267-904b-d2d87d561a0c admin admin] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:44:59.156533 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-119e275a-127b-4267-904b-d2d87d561a0c admin admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:44:59.156812 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-119e275a-127b-4267-904b-d2d87d561a0c admin admin] PATH_INFO: `/v3/projects/4f73d5a98be74242b45222df39fb6213` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:44:59.158350 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-119e275a-127b-4267-904b-d2d87d561a0c admin admin] RBAC: Authorizing `identity:get_project(project_id=4f73d5a98be74242b45222df39fb6213)` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:44:59.210275 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: WARNING keystone.common.rbac_enforcer.enforcer [None req-119e275a-127b-4267-904b-d2d87d561a0c admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Jun 02 15:44:59.210621 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-119e275a-127b-4267-904b-d2d87d561a0c admin admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:44:59.216202 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 3/5] 10.222.0.59 () {56 vars in 1207 bytes} [Thu Jun 2 15:44:59 2022] GET /identity/v3/projects/4f73d5a98be74242b45222df39fb6213 => generated 344 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 15:45:01.428462 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07fd859a-6d5f-44b1-aedc-04484e737914 None None] REQUEST_METHOD: `GET` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:45:01.429015 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07fd859a-6d5f-44b1-aedc-04484e737914 None None] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:45:01.429015 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07fd859a-6d5f-44b1-aedc-04484e737914 None None] PATH_INFO: `/` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:45:01.433088 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 3/6] 10.222.0.59 () {54 vars in 926 bytes} [Thu Jun 2 15:45:01 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 15:45:01.439087 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a66952-8cb4-45b2-a214-f386773c1c36 None None] REQUEST_METHOD: `POST` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:45:01.439502 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a66952-8cb4-45b2-a214-f386773c1c36 None None] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:45:01.439643 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a66952-8cb4-45b2-a214-f386773c1c36 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:45:01.458541 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.auth.core [None req-89a66952-8cb4-45b2-a214-f386773c1c36 None None] MFA Rules not processed for user `400d1f4db9de49638549e5db29a041e1`. Rule list: `[]` (Enabled: `True`). {{(pid=80395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 15:45:01.460046 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.fernet_utils [None req-89a66952-8cb4-45b2-a214-f386773c1c36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 15:45:01.468121 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 4/7] 10.222.0.59 () {58 vars in 1023 bytes} [Thu Jun 2 15:45:01 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Jun 02 15:45:01.490259 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07fd859a-6d5f-44b1-aedc-04484e737914 None None] Authenticating user token {{(pid=80396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:45:01.503103 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07fd859a-6d5f-44b1-aedc-04484e737914 None None] Validating token access rules against request {{(pid=80396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:45:01.507301 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e0e4f77-c4c9-462f-88ba-19231d40ac4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f73d5a98be74242b45222df39fb6213', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:45:01.507926 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0e4f77-c4c9-462f-88ba-19231d40ac4c admin admin] REQUEST_METHOD: `GET` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:45:01.508214 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0e4f77-c4c9-462f-88ba-19231d40ac4c admin admin] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:45:01.508498 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0e4f77-c4c9-462f-88ba-19231d40ac4c admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:45:01.516516 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e0e4f77-c4c9-462f-88ba-19231d40ac4c admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:45:01.518325 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e0e4f77-c4c9-462f-88ba-19231d40ac4c admin admin] RBAC: Authorization granted {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:45:01.526966 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 4/8] 10.222.0.59 () {58 vars in 1324 bytes} [Thu Jun 2 15:45:01 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 02 15:45:01.532775 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89a66952-8cb4-45b2-a214-f386773c1c36 None None] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:45:01.541441 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89a66952-8cb4-45b2-a214-f386773c1c36 None None] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:45:01.546341 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-add834de-47c0-44e4-88b3-c81e866ffb8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f73d5a98be74242b45222df39fb6213', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:45:01.547183 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add834de-47c0-44e4-88b3-c81e866ffb8c admin admin] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:45:01.547467 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add834de-47c0-44e4-88b3-c81e866ffb8c admin admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:45:01.547742 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add834de-47c0-44e4-88b3-c81e866ffb8c admin admin] PATH_INFO: `/v3/users/400d1f4db9de49638549e5db29a041e1` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:45:01.549106 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-add834de-47c0-44e4-88b3-c81e866ffb8c admin admin] RBAC: Authorizing `identity:get_user(user_id=400d1f4db9de49638549e5db29a041e1)` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:45:01.550977 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-add834de-47c0-44e4-88b3-c81e866ffb8c admin admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:45:01.552509 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 5/9] 10.222.0.59 () {56 vars in 1198 bytes} [Thu Jun 2 15:45:01 2022] GET /identity/v3/users/400d1f4db9de49638549e5db29a041e1 => generated 247 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 15:45:03.829148 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e886fb57-9dc5-49f4-8fbc-e729e8490dae None None] REQUEST_METHOD: `GET` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:45:03.829705 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e886fb57-9dc5-49f4-8fbc-e729e8490dae None None] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:45:03.829705 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e886fb57-9dc5-49f4-8fbc-e729e8490dae None None] PATH_INFO: `/` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:45:03.831242 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 5/10] 10.222.0.59 () {54 vars in 926 bytes} [Thu Jun 2 15:45:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 15:45:03.836222 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9841e05-b077-4027-a904-11921033fe10 None None] REQUEST_METHOD: `POST` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:45:03.836615 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9841e05-b077-4027-a904-11921033fe10 None None] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:45:03.836902 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9841e05-b077-4027-a904-11921033fe10 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:45:03.853970 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.auth.core [None req-d9841e05-b077-4027-a904-11921033fe10 None None] MFA Rules not processed for user `400d1f4db9de49638549e5db29a041e1`. Rule list: `[]` (Enabled: `True`). {{(pid=80395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 15:45:03.855187 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.fernet_utils [None req-d9841e05-b077-4027-a904-11921033fe10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 15:45:03.912049 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1a0a58-f2d0-4929-b368-c2d5f1ccc26f None None] REQUEST_METHOD: `GET` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:45:03.912595 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1a0a58-f2d0-4929-b368-c2d5f1ccc26f None None] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:45:03.912881 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1a0a58-f2d0-4929-b368-c2d5f1ccc26f None None] PATH_INFO: `/` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:45:03.914276 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 6/11] 10.222.0.59 () {54 vars in 926 bytes} [Thu Jun 2 15:45:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 02 15:45:03.919509 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b1f5d8-af6f-451a-a66b-7fcfdf8537b6 None None] REQUEST_METHOD: `POST` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:45:03.919802 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b1f5d8-af6f-451a-a66b-7fcfdf8537b6 None None] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:45:03.920082 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b1f5d8-af6f-451a-a66b-7fcfdf8537b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:45:03.936971 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 6/12] 10.222.0.59 () {58 vars in 1023 bytes} [Thu Jun 2 15:45:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 02 15:45:03.960415 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9841e05-b077-4027-a904-11921033fe10 None None] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:45:03.961300 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG passlib.handlers.bcrypt [None req-c6b1f5d8-af6f-451a-a66b-7fcfdf8537b6 None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=80396) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Jun 02 15:45:03.961756 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG passlib.handlers.bcrypt [None req-c6b1f5d8-af6f-451a-a66b-7fcfdf8537b6 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=80396) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Jun 02 15:45:03.984164 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writing DB stats keystone:SELECT=100 {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:45:04.008912 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.auth.core [None req-c6b1f5d8-af6f-451a-a66b-7fcfdf8537b6 None None] MFA Rules not processed for user `400d1f4db9de49638549e5db29a041e1`. Rule list: `[]` (Enabled: `True`). {{(pid=80396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 15:45:04.010565 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.fernet_utils [None req-c6b1f5d8-af6f-451a-a66b-7fcfdf8537b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 15:45:04.062139 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9841e05-b077-4027-a904-11921033fe10 None None] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:45:04.095201 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ad83cb5-84bb-4ad8-8eb5-edf3ba056aec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:45:04.095920 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad83cb5-84bb-4ad8-8eb5-edf3ba056aec None admin] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:45:04.096203 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad83cb5-84bb-4ad8-8eb5-edf3ba056aec None admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:45:04.096479 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad83cb5-84bb-4ad8-8eb5-edf3ba056aec None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:45:04.108048 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ad83cb5-84bb-4ad8-8eb5-edf3ba056aec None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 02 15:45:04.110874 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 7/13] 10.222.0.59 () {58 vars in 1023 bytes} [Thu Jun 2 15:45:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 02 15:45:04.119109 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application [None req-5ad83cb5-84bb-4ad8-8eb5-edf3ba056aec None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 02 15:45:04.119109 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 15:45:04.119109 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 15:45:04.119109 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 15:45:04.119109 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 15:45:04.119109 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 15:45:04.119109 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 15:45:04.119109 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 15:45:04.119109 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 15:45:04.119109 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 15:45:04.119109 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 15:45:04.119109 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 15:45:04.119109 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 02 15:45:04.119109 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 02 15:45:04.119109 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 02 15:45:04.119109 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 02 15:45:04.120086 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 02 15:45:04.120086 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 02 15:45:04.120086 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 02 15:45:04.120086 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 02 15:45:04.120086 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 15:45:04.120086 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 15:45:04.120086 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 15:45:04.120086 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 15:45:04.120086 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 15:45:04.120086 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 15:45:04.120086 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 15:45:04.120086 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application with Lock( Jun 02 15:45:04.120086 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 15:45:04.120086 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self._enter() Jun 02 15:45:04.120086 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 15:45:04.120086 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 15:45:04.121157 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 15:45:04.121157 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self.creator() Jun 02 15:45:04.121157 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 15:45:04.121157 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application created_value = creator( Jun 02 15:45:04.121157 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 02 15:45:04.121157 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 02 15:45:04.121157 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 02 15:45:04.121157 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 02 15:45:04.121157 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 02 15:45:04.121157 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 02 15:45:04.121157 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 02 15:45:04.121157 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application Jun 02 15:45:04.121157 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 7/14] 10.222.0.59 () {56 vars in 1096 bytes} [Thu Jun 2 15:45:03 2022] GET /identity/v3/roles/admin => generated 83 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 02 15:45:04.126661 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6b1f5d8-af6f-451a-a66b-7fcfdf8537b6 None None] Authenticating user token {{(pid=80396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:45:04.133330 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ad83cb5-84bb-4ad8-8eb5-edf3ba056aec None admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:45:04.225880 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writing DB stats keystone:SELECT=100 {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:45:04.234499 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6b1f5d8-af6f-451a-a66b-7fcfdf8537b6 None None] Validating token access rules against request {{(pid=80396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:45:04.236877 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG dbcounter [-] [80396] Writing DB stats keystone:SELECT=100 {{(pid=80396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:45:04.244178 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ad83cb5-84bb-4ad8-8eb5-edf3ba056aec None admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:45:04.272668 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-364f3ecb-97bd-49d1-9b22-30391742b5e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:45:04.273610 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364f3ecb-97bd-49d1-9b22-30391742b5e5 None admin] REQUEST_METHOD: `GET` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:45:04.273902 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364f3ecb-97bd-49d1-9b22-30391742b5e5 None admin] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:45:04.274216 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364f3ecb-97bd-49d1-9b22-30391742b5e5 None admin] PATH_INFO: `/v3/roles` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:45:04.275140 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-364f3ecb-97bd-49d1-9b22-30391742b5e5 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80396) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 15:45:04.276064 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-364f3ecb-97bd-49d1-9b22-30391742b5e5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:45:04.276892 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-364f3ecb-97bd-49d1-9b22-30391742b5e5 None admin] RBAC: Authorization granted {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:45:04.281312 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76a4f35e-639e-44fd-8d10-895ec040cdb0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:45:04.281960 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a4f35e-639e-44fd-8d10-895ec040cdb0 None admin] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:45:04.282278 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a4f35e-639e-44fd-8d10-895ec040cdb0 None admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:45:04.282560 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a4f35e-639e-44fd-8d10-895ec040cdb0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:45:04.290650 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 8/15] 10.222.0.59 () {56 vars in 1099 bytes} [Thu Jun 2 15:45:04 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 15:45:04.296715 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-364f3ecb-97bd-49d1-9b22-30391742b5e5 None admin] Authenticating user token {{(pid=80396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:45:04.350946 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76a4f35e-639e-44fd-8d10-895ec040cdb0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:45:04.352367 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76a4f35e-639e-44fd-8d10-895ec040cdb0 None admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:45:04.394769 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-364f3ecb-97bd-49d1-9b22-30391742b5e5 None admin] Validating token access rules against request {{(pid=80396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:45:04.428145 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dd8a6e0-8879-4220-adbf-eab209c5885e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:45:04.429008 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd8a6e0-8879-4220-adbf-eab209c5885e None admin] REQUEST_METHOD: `GET` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:45:04.429293 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd8a6e0-8879-4220-adbf-eab209c5885e None admin] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:45:04.429568 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd8a6e0-8879-4220-adbf-eab209c5885e None admin] PATH_INFO: `/v3/users/400d1f4db9de49638549e5db29a041e1` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:45:04.430950 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writing DB stats keystone:SELECT=100 {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:45:04.431125 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dd8a6e0-8879-4220-adbf-eab209c5885e None admin] RBAC: Authorizing `identity:get_user(user_id=400d1f4db9de49638549e5db29a041e1)` {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:45:04.432574 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dd8a6e0-8879-4220-adbf-eab209c5885e None admin] RBAC: Authorization granted {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:45:04.434771 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 9/16] 10.222.0.59 () {56 vars in 1177 bytes} [Thu Jun 2 15:45:04 2022] GET /identity/v3/users/400d1f4db9de49638549e5db29a041e1 => generated 247 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 15:45:04.440111 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dd8a6e0-8879-4220-adbf-eab209c5885e None admin] Authenticating user token {{(pid=80396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:45:04.450970 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 8/17] 10.222.0.59 () {58 vars in 1282 bytes} [Thu Jun 2 15:45:04 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 318 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jun 02 15:45:04.456348 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76a4f35e-639e-44fd-8d10-895ec040cdb0 None admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:45:04.473979 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG dbcounter [-] [80396] Writing DB stats keystone:SELECT=100 {{(pid=80396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:45:04.538238 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dd8a6e0-8879-4220-adbf-eab209c5885e None admin] Validating token access rules against request {{(pid=80396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:45:04.554368 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76a4f35e-639e-44fd-8d10-895ec040cdb0 None admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:45:04.571402 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e39ac046-7ea4-48a2-81b6-f958b7ce5aff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:45:04.572185 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e39ac046-7ea4-48a2-81b6-f958b7ce5aff None admin] REQUEST_METHOD: `GET` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:45:04.572471 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e39ac046-7ea4-48a2-81b6-f958b7ce5aff None admin] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:45:04.572751 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e39ac046-7ea4-48a2-81b6-f958b7ce5aff None admin] PATH_INFO: `/v3/domains/default` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:45:04.573940 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e39ac046-7ea4-48a2-81b6-f958b7ce5aff None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:45:04.576333 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e39ac046-7ea4-48a2-81b6-f958b7ce5aff None admin] RBAC: Authorization granted {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:45:04.578101 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 10/18] 10.222.0.59 () {56 vars in 1108 bytes} [Thu Jun 2 15:45:04 2022] GET /identity/v3/domains/default => generated 199 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 15:45:04.583822 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e39ac046-7ea4-48a2-81b6-f958b7ce5aff None admin] Authenticating user token {{(pid=80396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:45:04.588873 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c5e3910-c4bf-46d5-bb6d-7e4790595a4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:45:04.589924 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5e3910-c4bf-46d5-bb6d-7e4790595a4c None admin] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:45:04.590302 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5e3910-c4bf-46d5-bb6d-7e4790595a4c None admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:45:04.590771 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5e3910-c4bf-46d5-bb6d-7e4790595a4c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:45:04.601177 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c5e3910-c4bf-46d5-bb6d-7e4790595a4c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:45:04.602625 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c5e3910-c4bf-46d5-bb6d-7e4790595a4c None admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:45:04.620712 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application [None req-2c5e3910-c4bf-46d5-bb6d-7e4790595a4c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 15:45:04.620712 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 15:45:04.620712 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 15:45:04.620712 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 15:45:04.620712 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 15:45:04.620712 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 15:45:04.620712 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 15:45:04.620712 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 15:45:04.620712 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 15:45:04.620712 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 15:45:04.620712 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 15:45:04.620712 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 15:45:04.620712 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 02 15:45:04.620712 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 02 15:45:04.620712 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 02 15:45:04.622464 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 02 15:45:04.622464 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 15:45:04.622464 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 15:45:04.622464 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 15:45:04.622464 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 15:45:04.622464 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 15:45:04.622464 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 15:45:04.622464 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 15:45:04.622464 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application with Lock( Jun 02 15:45:04.622464 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 15:45:04.622464 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self._enter() Jun 02 15:45:04.622464 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 15:45:04.622464 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 15:45:04.622464 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 15:45:04.622464 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self.creator() Jun 02 15:45:04.622464 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 15:45:04.622464 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application created_value = creator( Jun 02 15:45:04.623285 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 02 15:45:04.623285 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 02 15:45:04.623285 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 15:45:04.623285 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application Jun 02 15:45:04.623285 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 9/19] 10.222.0.59 () {56 vars in 1108 bytes} [Thu Jun 2 15:45:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 15:45:04.628242 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c5e3910-c4bf-46d5-bb6d-7e4790595a4c None admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:45:04.661672 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writing DB stats keystone:SELECT=100 {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:45:04.682892 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e39ac046-7ea4-48a2-81b6-f958b7ce5aff None admin] Validating token access rules against request {{(pid=80396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:45:04.684927 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG dbcounter [-] [80396] Writing DB stats keystone:SELECT=100 {{(pid=80396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:45:04.716965 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e18aaefa-ffe7-4c30-a71b-b443942d70ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:45:04.717618 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18aaefa-ffe7-4c30-a71b-b443942d70ad None admin] REQUEST_METHOD: `GET` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:45:04.717907 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18aaefa-ffe7-4c30-a71b-b443942d70ad None admin] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:45:04.718229 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18aaefa-ffe7-4c30-a71b-b443942d70ad None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:45:04.719105 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e18aaefa-ffe7-4c30-a71b-b443942d70ad None admin] RBAC: Adding query filter params (role.id=f1e0c25f6e9049e897cb7350c7e54ab3, scope.domain.id=default, user.id=400d1f4db9de49638549e5db29a041e1) {{(pid=80396) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 15:45:04.719418 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e18aaefa-ffe7-4c30-a71b-b443942d70ad None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:45:04.720864 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e18aaefa-ffe7-4c30-a71b-b443942d70ad None admin] RBAC: Authorization granted {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:45:04.726600 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c5e3910-c4bf-46d5-bb6d-7e4790595a4c None admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:45:04.729366 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 11/20] 10.222.0.59 () {56 vars in 1322 bytes} [Thu Jun 2 15:45:04 2022] GET /identity/v3/role_assignments?user.id=400d1f4db9de49638549e5db29a041e1&scope.domain.id=default&role.id=f1e0c25f6e9049e897cb7350c7e54ab3 => generated 233 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 15:45:04.763685 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13ffe490-3c99-46ec-b689-ccfadc70af95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:45:04.764376 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ffe490-3c99-46ec-b689-ccfadc70af95 None admin] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:45:04.764664 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ffe490-3c99-46ec-b689-ccfadc70af95 None admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:45:04.764943 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ffe490-3c99-46ec-b689-ccfadc70af95 None admin] PATH_INFO: `/v3/domains` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:45:04.765697 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13ffe490-3c99-46ec-b689-ccfadc70af95 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80395) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 15:45:04.766009 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13ffe490-3c99-46ec-b689-ccfadc70af95 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:45:04.767491 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13ffe490-3c99-46ec-b689-ccfadc70af95 None admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:45:04.786783 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 10/21] 10.222.0.59 () {56 vars in 1109 bytes} [Thu Jun 2 15:45:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 15:45:07.268299 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df2f19c8-90b7-4961-affc-e03a978c3f37 None None] REQUEST_METHOD: `GET` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:45:07.269211 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df2f19c8-90b7-4961-affc-e03a978c3f37 None None] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:45:07.269639 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df2f19c8-90b7-4961-affc-e03a978c3f37 None None] PATH_INFO: `/` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:45:07.271231 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 12/22] 10.222.0.59 () {54 vars in 926 bytes} [Thu Jun 2 15:45:07 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 15:45:07.278947 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dae4e38-fd56-409e-b601-cd0c2633822e None None] REQUEST_METHOD: `POST` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:45:07.279700 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dae4e38-fd56-409e-b601-cd0c2633822e None None] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:45:07.280158 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dae4e38-fd56-409e-b601-cd0c2633822e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:45:07.302239 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.auth.core [None req-8dae4e38-fd56-409e-b601-cd0c2633822e None None] MFA Rules not processed for user `400d1f4db9de49638549e5db29a041e1`. Rule list: `[]` (Enabled: `True`). {{(pid=80395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 15:45:07.303628 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.fernet_utils [None req-8dae4e38-fd56-409e-b601-cd0c2633822e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 15:45:07.386832 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 11/23] 10.222.0.59 () {58 vars in 1023 bytes} [Thu Jun 2 15:45:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 02 15:45:07.421495 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df2f19c8-90b7-4961-affc-e03a978c3f37 None None] Authenticating user token {{(pid=80396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:45:07.567484 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df2f19c8-90b7-4961-affc-e03a978c3f37 None None] Validating token access rules against request {{(pid=80396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:45:07.572646 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1794f55-679b-47e8-9c9b-dcf9870cc248 None None] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:45:07.573115 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1794f55-679b-47e8-9c9b-dcf9870cc248 None None] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:45:07.573508 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1794f55-679b-47e8-9c9b-dcf9870cc248 None None] PATH_INFO: `/` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:45:07.575124 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 12/24] 10.222.0.59 () {54 vars in 926 bytes} [Thu Jun 2 15:45:07 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 02 15:45:07.581224 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e1f6de-b5f7-4700-9338-ab3fd80ac325 None None] REQUEST_METHOD: `POST` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:45:07.581777 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e1f6de-b5f7-4700-9338-ab3fd80ac325 None None] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:45:07.582709 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e1f6de-b5f7-4700-9338-ab3fd80ac325 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:45:07.613779 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.auth.core [None req-46e1f6de-b5f7-4700-9338-ab3fd80ac325 None None] MFA Rules not processed for user `400d1f4db9de49638549e5db29a041e1`. Rule list: `[]` (Enabled: `True`). {{(pid=80395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 15:45:07.615339 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.fernet_utils [None req-46e1f6de-b5f7-4700-9338-ab3fd80ac325 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 15:45:07.639080 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a72729d0-5be2-4753-b1c2-69e50fa26d7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:45:07.640249 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a72729d0-5be2-4753-b1c2-69e50fa26d7a None admin] REQUEST_METHOD: `GET` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:45:07.640826 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a72729d0-5be2-4753-b1c2-69e50fa26d7a None admin] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:45:07.641317 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a72729d0-5be2-4753-b1c2-69e50fa26d7a None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:45:07.671381 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writing DB stats keystone:SELECT=100 {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:45:07.672716 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a72729d0-5be2-4753-b1c2-69e50fa26d7a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 02 15:45:07.705150 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application [None req-a72729d0-5be2-4753-b1c2-69e50fa26d7a None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 02 15:45:07.705150 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 15:45:07.705150 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 15:45:07.705150 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 15:45:07.705150 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 15:45:07.705150 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 15:45:07.705150 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 15:45:07.705150 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 15:45:07.705150 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 15:45:07.705150 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 15:45:07.705150 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 15:45:07.705150 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 15:45:07.705150 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 02 15:45:07.705150 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 02 15:45:07.705150 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 02 15:45:07.705150 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 02 15:45:07.706133 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 02 15:45:07.706133 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 02 15:45:07.706133 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 02 15:45:07.706133 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 02 15:45:07.706133 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 15:45:07.706133 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 15:45:07.706133 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 15:45:07.706133 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 15:45:07.706133 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 15:45:07.706133 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 15:45:07.706133 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 15:45:07.706133 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application with Lock( Jun 02 15:45:07.706133 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 15:45:07.706133 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application return self._enter() Jun 02 15:45:07.706133 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 15:45:07.706133 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 15:45:07.706908 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 15:45:07.706908 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application return self.creator() Jun 02 15:45:07.706908 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 15:45:07.706908 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application created_value = creator( Jun 02 15:45:07.706908 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 02 15:45:07.706908 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 02 15:45:07.706908 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 02 15:45:07.706908 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 02 15:45:07.706908 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 02 15:45:07.706908 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 02 15:45:07.706908 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 02 15:45:07.706908 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application Jun 02 15:45:07.710602 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 13/25] 10.222.0.59 () {56 vars in 1096 bytes} [Thu Jun 2 15:45:07 2022] GET /identity/v3/roles/admin => generated 83 bytes in 289 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 15:45:07.716672 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a72729d0-5be2-4753-b1c2-69e50fa26d7a None admin] Authenticating user token {{(pid=80396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:45:07.770454 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG dbcounter [-] [80396] Writing DB stats keystone:SELECT=100 {{(pid=80396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:45:07.791072 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 13/26] 10.222.0.59 () {58 vars in 1023 bytes} [Thu Jun 2 15:45:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 210 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 02 15:45:07.792450 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6402f16e-07bb-4520-b3fd-4d25a27438f4 None None] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:45:07.792752 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6402f16e-07bb-4520-b3fd-4d25a27438f4 None None] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:45:07.793561 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6402f16e-07bb-4520-b3fd-4d25a27438f4 None None] PATH_INFO: `/` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:45:07.794868 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 14/27] 10.222.0.59 () {54 vars in 926 bytes} [Thu Jun 2 15:45:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 15:45:07.803719 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d39fdb1-72bf-4677-8481-61a302dde653 None None] REQUEST_METHOD: `POST` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:45:07.804009 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d39fdb1-72bf-4677-8481-61a302dde653 None None] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:45:07.804290 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d39fdb1-72bf-4677-8481-61a302dde653 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:45:07.832110 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.auth.core [None req-0d39fdb1-72bf-4677-8481-61a302dde653 None None] MFA Rules not processed for user `400d1f4db9de49638549e5db29a041e1`. Rule list: `[]` (Enabled: `True`). {{(pid=80395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 15:45:07.833316 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.fernet_utils [None req-0d39fdb1-72bf-4677-8481-61a302dde653 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 15:45:07.891115 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a72729d0-5be2-4753-b1c2-69e50fa26d7a None admin] Validating token access rules against request {{(pid=80396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:45:07.911181 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 15/28] 10.222.0.59 () {58 vars in 1023 bytes} [Thu Jun 2 15:45:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 02 15:45:07.911819 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d39fdb1-72bf-4677-8481-61a302dde653 None None] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:45:07.936400 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00f0b10f-3468-4239-a566-3bc5621b41b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:45:07.937147 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f0b10f-3468-4239-a566-3bc5621b41b0 None admin] REQUEST_METHOD: `GET` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:45:07.937445 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f0b10f-3468-4239-a566-3bc5621b41b0 None admin] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:45:07.937726 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f0b10f-3468-4239-a566-3bc5621b41b0 None admin] PATH_INFO: `/v3/roles` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:45:07.938520 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00f0b10f-3468-4239-a566-3bc5621b41b0 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80396) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 15:45:07.938891 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00f0b10f-3468-4239-a566-3bc5621b41b0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:45:07.940361 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00f0b10f-3468-4239-a566-3bc5621b41b0 None admin] RBAC: Authorization granted {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:45:07.958101 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 14/29] 10.222.0.59 () {56 vars in 1099 bytes} [Thu Jun 2 15:45:07 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 15:45:07.964806 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00f0b10f-3468-4239-a566-3bc5621b41b0 None admin] Authenticating user token {{(pid=80396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:45:08.028010 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writing DB stats keystone:SELECT=100 {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:45:08.044651 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d39fdb1-72bf-4677-8481-61a302dde653 None None] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:45:08.090825 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-766f403b-7045-4070-aa0c-4e0f0dc9f1f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:45:08.091652 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766f403b-7045-4070-aa0c-4e0f0dc9f1f9 None admin] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:45:08.091936 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766f403b-7045-4070-aa0c-4e0f0dc9f1f9 None admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:45:08.092215 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766f403b-7045-4070-aa0c-4e0f0dc9f1f9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:45:08.109755 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-766f403b-7045-4070-aa0c-4e0f0dc9f1f9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:45:08.112647 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-766f403b-7045-4070-aa0c-4e0f0dc9f1f9 None admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:45:08.141794 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application [None req-766f403b-7045-4070-aa0c-4e0f0dc9f1f9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 15:45:08.141794 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 15:45:08.141794 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 15:45:08.141794 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 15:45:08.141794 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 15:45:08.141794 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 15:45:08.141794 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 15:45:08.141794 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 15:45:08.141794 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 15:45:08.141794 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 15:45:08.141794 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 15:45:08.141794 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 15:45:08.141794 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 02 15:45:08.141794 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 02 15:45:08.141794 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 02 15:45:08.142696 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 02 15:45:08.142696 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 15:45:08.142696 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 15:45:08.142696 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 15:45:08.142696 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 15:45:08.142696 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 15:45:08.142696 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 15:45:08.142696 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 15:45:08.142696 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application with Lock( Jun 02 15:45:08.142696 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 15:45:08.142696 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self._enter() Jun 02 15:45:08.142696 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 15:45:08.142696 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 15:45:08.142696 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 15:45:08.142696 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self.creator() Jun 02 15:45:08.142696 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 15:45:08.142696 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application created_value = creator( Jun 02 15:45:08.143506 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 02 15:45:08.143506 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 02 15:45:08.143506 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 15:45:08.143506 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application Jun 02 15:45:08.150607 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 16/30] 10.222.0.59 () {56 vars in 1108 bytes} [Thu Jun 2 15:45:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 239 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 15:45:08.153012 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-766f403b-7045-4070-aa0c-4e0f0dc9f1f9 None admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:45:08.154487 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG dbcounter [-] [80396] Writing DB stats keystone:SELECT=100 {{(pid=80396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:45:08.170990 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00f0b10f-3468-4239-a566-3bc5621b41b0 None admin] Validating token access rules against request {{(pid=80396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:45:08.239988 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cbd9cfa-a6bb-4b89-a612-c08f8527d4cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:45:08.240789 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cbd9cfa-a6bb-4b89-a612-c08f8527d4cf None admin] REQUEST_METHOD: `GET` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:45:08.241074 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cbd9cfa-a6bb-4b89-a612-c08f8527d4cf None admin] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:45:08.241352 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cbd9cfa-a6bb-4b89-a612-c08f8527d4cf None admin] PATH_INFO: `/v3/users/400d1f4db9de49638549e5db29a041e1` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:45:08.242782 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cbd9cfa-a6bb-4b89-a612-c08f8527d4cf None admin] RBAC: Authorizing `identity:get_user(user_id=400d1f4db9de49638549e5db29a041e1)` {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:45:08.248289 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cbd9cfa-a6bb-4b89-a612-c08f8527d4cf None admin] RBAC: Authorization granted {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:45:08.248289 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 15/31] 10.222.0.59 () {56 vars in 1177 bytes} [Thu Jun 2 15:45:07 2022] GET /identity/v3/users/400d1f4db9de49638549e5db29a041e1 => generated 247 bytes in 282 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 15:45:08.248289 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cbd9cfa-a6bb-4b89-a612-c08f8527d4cf None admin] Authenticating user token {{(pid=80396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:45:08.356825 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-766f403b-7045-4070-aa0c-4e0f0dc9f1f9 None admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:45:08.428131 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c480470d-e1fa-46b8-9ddd-f369787b0c6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:45:08.429086 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c480470d-e1fa-46b8-9ddd-f369787b0c6e None admin] REQUEST_METHOD: `POST` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:45:08.429566 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c480470d-e1fa-46b8-9ddd-f369787b0c6e None admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:45:08.430030 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c480470d-e1fa-46b8-9ddd-f369787b0c6e None admin] PATH_INFO: `/v3/roles` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:45:08.430964 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c480470d-e1fa-46b8-9ddd-f369787b0c6e None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:45:08.433152 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c480470d-e1fa-46b8-9ddd-f369787b0c6e None admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:45:08.444457 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cbd9cfa-a6bb-4b89-a612-c08f8527d4cf None admin] Validating token access rules against request {{(pid=80396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:45:08.447505 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:45:08.482610 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22a0ddfc-2d06-4206-b781-42a19c642c9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:45:08.483250 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a0ddfc-2d06-4206-b781-42a19c642c9e None admin] REQUEST_METHOD: `GET` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:45:08.483531 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a0ddfc-2d06-4206-b781-42a19c642c9e None admin] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:45:08.483807 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a0ddfc-2d06-4206-b781-42a19c642c9e None admin] PATH_INFO: `/v3/domains` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:45:08.484535 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22a0ddfc-2d06-4206-b781-42a19c642c9e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80396) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 15:45:08.484841 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22a0ddfc-2d06-4206-b781-42a19c642c9e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:45:08.486297 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22a0ddfc-2d06-4206-b781-42a19c642c9e None admin] RBAC: Authorization granted {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:45:08.508429 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 16/32] 10.222.0.59 () {56 vars in 1109 bytes} [Thu Jun 2 15:45:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 262 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 15:45:08.509200 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22a0ddfc-2d06-4206-b781-42a19c642c9e None admin] Authenticating user token {{(pid=80396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:45:08.532128 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG dbcounter [-] [80396] Writing DB stats keystone:SELECT=100 {{(pid=80396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:45:08.608565 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 17/33] 10.222.0.59 () {60 vars in 1131 bytes} [Thu Jun 2 15:45:08 2022] POST /identity/v3/roles => generated 219 bytes in 457 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 15:45:08.615444 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce23fd7-324a-4c57-9e4d-f4cbec86ec4c None None] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:45:08.615852 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce23fd7-324a-4c57-9e4d-f4cbec86ec4c None None] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:45:08.616144 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce23fd7-324a-4c57-9e4d-f4cbec86ec4c None None] PATH_INFO: `/` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:45:08.618037 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 18/34] 10.222.0.59 () {54 vars in 926 bytes} [Thu Jun 2 15:45:08 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 15:45:08.618708 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ce23fd7-324a-4c57-9e4d-f4cbec86ec4c None None] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:45:08.630369 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22a0ddfc-2d06-4206-b781-42a19c642c9e None admin] Validating token access rules against request {{(pid=80396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:45:08.669029 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-487cbd2f-6605-4998-bc87-7a8edb26d9c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:45:08.670106 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487cbd2f-6605-4998-bc87-7a8edb26d9c4 None admin] REQUEST_METHOD: `GET` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:45:08.670426 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487cbd2f-6605-4998-bc87-7a8edb26d9c4 None admin] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:45:08.670705 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487cbd2f-6605-4998-bc87-7a8edb26d9c4 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:45:08.672069 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-487cbd2f-6605-4998-bc87-7a8edb26d9c4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:45:08.673572 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-487cbd2f-6605-4998-bc87-7a8edb26d9c4 None admin] RBAC: Authorization granted {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:45:08.675685 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 17/35] 10.222.0.59 () {56 vars in 1108 bytes} [Thu Jun 2 15:45:08 2022] GET /identity/v3/domains/default => generated 199 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 15:45:08.677073 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f122407-bc72-4b07-9460-2c166a9ba6f0 None None] REQUEST_METHOD: `POST` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:45:08.677368 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f122407-bc72-4b07-9460-2c166a9ba6f0 None None] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:45:08.677652 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f122407-bc72-4b07-9460-2c166a9ba6f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:45:08.696897 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.auth.core [None req-7f122407-bc72-4b07-9460-2c166a9ba6f0 None None] MFA Rules not processed for user `400d1f4db9de49638549e5db29a041e1`. Rule list: `[]` (Enabled: `True`). {{(pid=80396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 15:45:08.698245 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.fernet_utils [None req-7f122407-bc72-4b07-9460-2c166a9ba6f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 15:45:08.829360 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ce23fd7-324a-4c57-9e4d-f4cbec86ec4c None None] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:45:08.849115 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 18/36] 10.222.0.59 () {58 vars in 1023 bytes} [Thu Jun 2 15:45:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 02 15:45:08.850007 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f122407-bc72-4b07-9460-2c166a9ba6f0 None None] Authenticating user token {{(pid=80396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:45:08.883232 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG dbcounter [-] [80396] Writing DB stats keystone:SELECT=100 {{(pid=80396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:45:08.905229 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c7242a1-b3a9-4800-8afd-f7582a42235a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:45:08.905940 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7242a1-b3a9-4800-8afd-f7582a42235a None admin] REQUEST_METHOD: `POST` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:45:08.906257 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7242a1-b3a9-4800-8afd-f7582a42235a None admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:45:08.906546 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7242a1-b3a9-4800-8afd-f7582a42235a None admin] PATH_INFO: `/v3/projects` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:45:08.907273 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c7242a1-b3a9-4800-8afd-f7582a42235a None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:45:08.908881 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c7242a1-b3a9-4800-8afd-f7582a42235a None admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:45:09.007341 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f122407-bc72-4b07-9460-2c166a9ba6f0 None None] Validating token access rules against request {{(pid=80396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:45:09.043051 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d75a7a5-f1e7-43e4-a6b7-fff8a3241b25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:45:09.044184 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d75a7a5-f1e7-43e4-a6b7-fff8a3241b25 None admin] REQUEST_METHOD: `PUT` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:45:09.044471 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d75a7a5-f1e7-43e4-a6b7-fff8a3241b25 None admin] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:45:09.044751 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d75a7a5-f1e7-43e4-a6b7-fff8a3241b25 None admin] PATH_INFO: `/v3/domains/default/users/400d1f4db9de49638549e5db29a041e1/roles/f1e0c25f6e9049e897cb7350c7e54ab3` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:45:09.047055 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d75a7a5-f1e7-43e4-a6b7-fff8a3241b25 None admin] RBAC: Authorizing `identity:create_grant(domain_id=default, user_id=400d1f4db9de49638549e5db29a041e1, role_id=f1e0c25f6e9049e897cb7350c7e54ab3)` {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:45:09.048520 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d75a7a5-f1e7-43e4-a6b7-fff8a3241b25 None admin] RBAC: Authorization granted {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:45:09.060942 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 19/37] 10.222.0.59 () {60 vars in 1141 bytes} [Thu Jun 2 15:45:08 2022] POST /identity/v3/projects => generated 301 bytes in 443 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 15:45:09.061750 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c7242a1-b3a9-4800-8afd-f7582a42235a None admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:45:09.117148 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:45:09.179786 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c7242a1-b3a9-4800-8afd-f7582a42235a None admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:45:09.219704 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebd21b28-d752-4521-870c-ea472cdfa758 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:45:09.220389 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd21b28-d752-4521-870c-ea472cdfa758 None admin] REQUEST_METHOD: `POST` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:45:09.220677 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd21b28-d752-4521-870c-ea472cdfa758 None admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:45:09.220955 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd21b28-d752-4521-870c-ea472cdfa758 None admin] PATH_INFO: `/v3/roles` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:45:09.221773 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebd21b28-d752-4521-870c-ea472cdfa758 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:45:09.223415 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebd21b28-d752-4521-870c-ea472cdfa758 None admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:45:09.255077 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 19/38] 10.222.0.59 () {58 vars in 1361 bytes} [Thu Jun 2 15:45:08 2022] PUT /identity/v3/domains/default/users/400d1f4db9de49638549e5db29a041e1/roles/f1e0c25f6e9049e897cb7350c7e54ab3 => generated 0 bytes in 405 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 15:45:09.256860 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b064e13-25df-40bf-984e-0e50d83cdb34 None None] REQUEST_METHOD: `GET` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:45:09.257154 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b064e13-25df-40bf-984e-0e50d83cdb34 None None] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:45:09.257438 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b064e13-25df-40bf-984e-0e50d83cdb34 None None] PATH_INFO: `/` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:45:09.262457 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 20/39] 10.222.0.59 () {54 vars in 926 bytes} [Thu Jun 2 15:45:09 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 15:45:09.263717 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a17fe3-506f-47c2-833c-2b4dc5190833 None None] REQUEST_METHOD: `GET` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:45:09.264103 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a17fe3-506f-47c2-833c-2b4dc5190833 None None] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:45:09.264387 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a17fe3-506f-47c2-833c-2b4dc5190833 None None] PATH_INFO: `/` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:45:09.265981 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 21/40] 10.222.0.59 () {54 vars in 926 bytes} [Thu Jun 2 15:45:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 15:45:09.268168 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4091ff2-a10d-44ec-91ea-24459b15718a None None] REQUEST_METHOD: `POST` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:45:09.268455 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4091ff2-a10d-44ec-91ea-24459b15718a None None] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:45:09.268732 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4091ff2-a10d-44ec-91ea-24459b15718a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:45:09.290280 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.auth.core [None req-e4091ff2-a10d-44ec-91ea-24459b15718a None None] MFA Rules not processed for user `400d1f4db9de49638549e5db29a041e1`. Rule list: `[]` (Enabled: `True`). {{(pid=80396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 15:45:09.291856 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.fernet_utils [None req-e4091ff2-a10d-44ec-91ea-24459b15718a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 15:45:09.311906 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 20/41] 10.222.0.59 () {60 vars in 1131 bytes} [Thu Jun 2 15:45:09 2022] POST /identity/v3/roles => generated 225 bytes in 250 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 15:45:09.315763 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d12cea-c2eb-4d12-b132-988a5170df90 None None] REQUEST_METHOD: `POST` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:45:09.315763 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d12cea-c2eb-4d12-b132-988a5170df90 None None] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:45:09.315763 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d12cea-c2eb-4d12-b132-988a5170df90 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:45:09.358538 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.auth.core [None req-25d12cea-c2eb-4d12-b132-988a5170df90 None None] MFA Rules not processed for user `400d1f4db9de49638549e5db29a041e1`. Rule list: `[]` (Enabled: `True`). {{(pid=80395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 15:45:09.360090 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.fernet_utils [None req-25d12cea-c2eb-4d12-b132-988a5170df90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 15:45:09.388119 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 22/42] 10.222.0.59 () {58 vars in 1023 bytes} [Thu Jun 2 15:45:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 02 15:45:09.413940 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4091ff2-a10d-44ec-91ea-24459b15718a None None] Authenticating user token {{(pid=80396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:45:09.418376 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG dbcounter [-] [80396] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:45:09.465167 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 21/43] 10.222.0.59 () {58 vars in 1023 bytes} [Thu Jun 2 15:45:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 02 15:45:09.489289 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25d12cea-c2eb-4d12-b132-988a5170df90 None None] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:45:09.542645 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:45:09.546471 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4091ff2-a10d-44ec-91ea-24459b15718a None None] Validating token access rules against request {{(pid=80396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:45:09.590750 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9439251a-9a23-47c1-bfc3-814ed20ed756 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:45:09.591664 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9439251a-9a23-47c1-bfc3-814ed20ed756 None admin] REQUEST_METHOD: `GET` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:45:09.591957 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9439251a-9a23-47c1-bfc3-814ed20ed756 None admin] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:45:09.592233 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9439251a-9a23-47c1-bfc3-814ed20ed756 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:45:09.593462 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9439251a-9a23-47c1-bfc3-814ed20ed756 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:45:09.595133 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9439251a-9a23-47c1-bfc3-814ed20ed756 None admin] RBAC: Authorization granted {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:45:09.596911 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 23/44] 10.222.0.59 () {56 vars in 1108 bytes} [Thu Jun 2 15:45:09 2022] GET /identity/v3/domains/default => generated 199 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 15:45:09.602292 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9439251a-9a23-47c1-bfc3-814ed20ed756 None admin] Authenticating user token {{(pid=80396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:45:09.616857 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25d12cea-c2eb-4d12-b132-988a5170df90 None None] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:45:09.656712 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c53b6076-e88e-42df-b221-5ef86c448ab1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:45:09.657315 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c53b6076-e88e-42df-b221-5ef86c448ab1 None admin] REQUEST_METHOD: `POST` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:45:09.657605 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c53b6076-e88e-42df-b221-5ef86c448ab1 None admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:45:09.657887 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c53b6076-e88e-42df-b221-5ef86c448ab1 None admin] PATH_INFO: `/v3/roles` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:45:09.658712 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c53b6076-e88e-42df-b221-5ef86c448ab1 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:45:09.660135 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c53b6076-e88e-42df-b221-5ef86c448ab1 None admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:45:09.680136 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG dbcounter [-] [80396] Writing DB stats keystone:SELECT=100 {{(pid=80396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:45:09.708806 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9439251a-9a23-47c1-bfc3-814ed20ed756 None admin] Validating token access rules against request {{(pid=80396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:45:09.724057 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 22/45] 10.222.0.59 () {60 vars in 1131 bytes} [Thu Jun 2 15:45:09 2022] POST /identity/v3/roles => generated 223 bytes in 235 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 02 15:45:09.750908 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2425341-a17f-4cba-bab7-738f4078b81f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:45:09.751604 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2425341-a17f-4cba-bab7-738f4078b81f None admin] REQUEST_METHOD: `POST` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:45:09.751903 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2425341-a17f-4cba-bab7-738f4078b81f None admin] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:45:09.752197 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2425341-a17f-4cba-bab7-738f4078b81f None admin] PATH_INFO: `/v3/projects` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:45:09.752924 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2425341-a17f-4cba-bab7-738f4078b81f None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:45:09.754478 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2425341-a17f-4cba-bab7-738f4078b81f None admin] RBAC: Authorization granted {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:45:09.860554 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 24/46] 10.222.0.59 () {60 vars in 1141 bytes} [Thu Jun 2 15:45:09 2022] POST /identity/v3/projects => generated 312 bytes in 259 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 02 15:45:11.595806 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ed94d5-9f32-4f2e-ab41-235df6caab97 None None] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:45:11.596302 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ed94d5-9f32-4f2e-ab41-235df6caab97 None None] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:45:11.596388 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ed94d5-9f32-4f2e-ab41-235df6caab97 None None] PATH_INFO: `/` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:45:11.597786 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 23/47] 10.222.0.59 () {54 vars in 926 bytes} [Thu Jun 2 15:45:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 15:45:11.603070 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3c59c8-8c70-44cd-b5c2-60c239b41ee5 None None] REQUEST_METHOD: `POST` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:45:11.603439 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3c59c8-8c70-44cd-b5c2-60c239b41ee5 None None] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:45:11.603751 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3c59c8-8c70-44cd-b5c2-60c239b41ee5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:45:11.621769 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.auth.core [None req-ca3c59c8-8c70-44cd-b5c2-60c239b41ee5 None None] MFA Rules not processed for user `400d1f4db9de49638549e5db29a041e1`. Rule list: `[]` (Enabled: `True`). {{(pid=80396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 15:45:11.623217 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.fernet_utils [None req-ca3c59c8-8c70-44cd-b5c2-60c239b41ee5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 15:45:11.689726 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 25/48] 10.222.0.59 () {58 vars in 1023 bytes} [Thu Jun 2 15:45:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 02 15:45:11.712982 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29ed94d5-9f32-4f2e-ab41-235df6caab97 None None] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:45:11.812511 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:45:11.816969 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29ed94d5-9f32-4f2e-ab41-235df6caab97 None None] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:45:11.850647 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1e40b24-2fb8-439a-bb51-e6f5a6cfe836 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:45:11.851360 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e40b24-2fb8-439a-bb51-e6f5a6cfe836 None admin] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:45:11.851643 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e40b24-2fb8-439a-bb51-e6f5a6cfe836 None admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:45:11.851985 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e40b24-2fb8-439a-bb51-e6f5a6cfe836 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:45:11.863077 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1e40b24-2fb8-439a-bb51-e6f5a6cfe836 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 02 15:45:11.870652 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application [None req-c1e40b24-2fb8-439a-bb51-e6f5a6cfe836 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 02 15:45:11.870652 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 15:45:11.870652 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 15:45:11.870652 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 15:45:11.870652 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 15:45:11.870652 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 15:45:11.870652 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 15:45:11.870652 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 15:45:11.870652 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 15:45:11.870652 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 15:45:11.870652 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 15:45:11.870652 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 15:45:11.870652 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 02 15:45:11.870652 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 02 15:45:11.870652 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 02 15:45:11.870652 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 02 15:45:11.871546 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 02 15:45:11.871546 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 02 15:45:11.871546 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 02 15:45:11.871546 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 02 15:45:11.871546 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 15:45:11.871546 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 15:45:11.871546 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 15:45:11.871546 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 15:45:11.871546 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 15:45:11.871546 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 15:45:11.871546 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 15:45:11.871546 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application with Lock( Jun 02 15:45:11.871546 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 15:45:11.871546 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self._enter() Jun 02 15:45:11.871546 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 15:45:11.871546 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 15:45:11.872298 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 15:45:11.872298 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self.creator() Jun 02 15:45:11.872298 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 15:45:11.872298 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application created_value = creator( Jun 02 15:45:11.872298 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 02 15:45:11.872298 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 02 15:45:11.872298 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 02 15:45:11.872298 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 02 15:45:11.872298 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 02 15:45:11.872298 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 02 15:45:11.872298 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 02 15:45:11.872298 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application Jun 02 15:45:11.872298 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 24/49] 10.222.0.59 () {56 vars in 1096 bytes} [Thu Jun 2 15:45:11 2022] GET /identity/v3/roles/admin => generated 83 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 15:45:11.879177 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca3c59c8-8c70-44cd-b5c2-60c239b41ee5 None None] Authenticating user token {{(pid=80396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:45:11.932668 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG dbcounter [-] [80396] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:45:11.977326 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca3c59c8-8c70-44cd-b5c2-60c239b41ee5 None None] Validating token access rules against request {{(pid=80396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:45:12.012164 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81ff9ab5-122f-442b-8ed2-88edf81f3d4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:45:12.012844 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ff9ab5-122f-442b-8ed2-88edf81f3d4d None admin] REQUEST_METHOD: `GET` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:45:12.013692 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ff9ab5-122f-442b-8ed2-88edf81f3d4d None admin] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:45:12.013978 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ff9ab5-122f-442b-8ed2-88edf81f3d4d None admin] PATH_INFO: `/v3/roles` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:45:12.014776 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81ff9ab5-122f-442b-8ed2-88edf81f3d4d None admin] RBAC: Adding query filter params (name=admin) {{(pid=80396) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 15:45:12.015113 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81ff9ab5-122f-442b-8ed2-88edf81f3d4d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:45:12.016505 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81ff9ab5-122f-442b-8ed2-88edf81f3d4d None admin] RBAC: Authorization granted {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:45:12.024659 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 26/50] 10.222.0.59 () {56 vars in 1099 bytes} [Thu Jun 2 15:45:11 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 15:45:12.030972 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1e40b24-2fb8-439a-bb51-e6f5a6cfe836 None admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:45:12.129187 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1164341-c293-46e8-8002-d4a360cd2726 None None] REQUEST_METHOD: `GET` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:45:12.129398 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1164341-c293-46e8-8002-d4a360cd2726 None None] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:45:12.129685 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1164341-c293-46e8-8002-d4a360cd2726 None None] PATH_INFO: `/` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:45:12.130348 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1e40b24-2fb8-439a-bb51-e6f5a6cfe836 None admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:45:12.131098 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 27/51] 10.222.0.59 () {54 vars in 926 bytes} [Thu Jun 2 15:45:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 02 15:45:12.135849 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4cf39f0-0980-4763-9953-bf9460b1e3c6 None None] REQUEST_METHOD: `POST` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:45:12.136140 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4cf39f0-0980-4763-9953-bf9460b1e3c6 None None] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:45:12.136468 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4cf39f0-0980-4763-9953-bf9460b1e3c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:45:12.154516 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.auth.core [None req-b4cf39f0-0980-4763-9953-bf9460b1e3c6 None None] MFA Rules not processed for user `400d1f4db9de49638549e5db29a041e1`. Rule list: `[]` (Enabled: `True`). {{(pid=80396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 15:45:12.155811 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.fernet_utils [None req-b4cf39f0-0980-4763-9953-bf9460b1e3c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 15:45:12.163792 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43aba653-ca15-4bbd-ab06-e636efd33043 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:45:12.164730 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43aba653-ca15-4bbd-ab06-e636efd33043 None admin] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:45:12.165049 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43aba653-ca15-4bbd-ab06-e636efd33043 None admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:45:12.165310 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43aba653-ca15-4bbd-ab06-e636efd33043 None admin] PATH_INFO: `/v3/users/400d1f4db9de49638549e5db29a041e1` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:45:12.166543 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43aba653-ca15-4bbd-ab06-e636efd33043 None admin] RBAC: Authorizing `identity:get_user(user_id=400d1f4db9de49638549e5db29a041e1)` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:45:12.168742 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43aba653-ca15-4bbd-ab06-e636efd33043 None admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:45:12.170338 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 25/52] 10.222.0.59 () {56 vars in 1177 bytes} [Thu Jun 2 15:45:12 2022] GET /identity/v3/users/400d1f4db9de49638549e5db29a041e1 => generated 247 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 15:45:12.175636 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43aba653-ca15-4bbd-ab06-e636efd33043 None admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:45:12.204864 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writing DB stats keystone:SELECT=100 {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:45:12.228477 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 28/53] 10.222.0.59 () {58 vars in 1023 bytes} [Thu Jun 2 15:45:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 02 15:45:12.252945 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4cf39f0-0980-4763-9953-bf9460b1e3c6 None None] Authenticating user token {{(pid=80396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:45:12.275937 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43aba653-ca15-4bbd-ab06-e636efd33043 None admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:45:12.299908 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG dbcounter [-] [80396] Writing DB stats keystone:SELECT=100 {{(pid=80396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:45:12.310037 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-697bf288-b0ee-4e86-a2ba-564730b98ceb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:45:12.310854 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697bf288-b0ee-4e86-a2ba-564730b98ceb None admin] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:45:12.311140 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697bf288-b0ee-4e86-a2ba-564730b98ceb None admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:45:12.311419 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697bf288-b0ee-4e86-a2ba-564730b98ceb None admin] PATH_INFO: `/v3/domains/default` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:45:12.312688 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-697bf288-b0ee-4e86-a2ba-564730b98ceb None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:45:12.314164 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-697bf288-b0ee-4e86-a2ba-564730b98ceb None admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:45:12.315922 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 26/54] 10.222.0.59 () {56 vars in 1108 bytes} [Thu Jun 2 15:45:12 2022] GET /identity/v3/domains/default => generated 199 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 15:45:12.321375 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-697bf288-b0ee-4e86-a2ba-564730b98ceb None admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:45:12.354262 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4cf39f0-0980-4763-9953-bf9460b1e3c6 None None] Validating token access rules against request {{(pid=80396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:45:12.389787 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eb062f5-6e27-4868-b0ad-d8cdd593b9a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:45:12.390548 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb062f5-6e27-4868-b0ad-d8cdd593b9a5 None admin] REQUEST_METHOD: `GET` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:45:12.390832 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb062f5-6e27-4868-b0ad-d8cdd593b9a5 None admin] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:45:12.391116 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb062f5-6e27-4868-b0ad-d8cdd593b9a5 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:45:12.392303 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eb062f5-6e27-4868-b0ad-d8cdd593b9a5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:45:12.393765 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eb062f5-6e27-4868-b0ad-d8cdd593b9a5 None admin] RBAC: Authorization granted {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:45:12.395400 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 29/55] 10.222.0.59 () {56 vars in 1108 bytes} [Thu Jun 2 15:45:12 2022] GET /identity/v3/domains/default => generated 199 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 15:45:12.400775 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eb062f5-6e27-4868-b0ad-d8cdd593b9a5 None admin] Authenticating user token {{(pid=80396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:45:12.417168 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writing DB stats keystone:SELECT=100 {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:45:12.424403 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-697bf288-b0ee-4e86-a2ba-564730b98ceb None admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:45:12.459369 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e306d88a-3044-4eaa-a2d2-cd277e1dfc54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:45:12.460022 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e306d88a-3044-4eaa-a2d2-cd277e1dfc54 None admin] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:45:12.460318 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e306d88a-3044-4eaa-a2d2-cd277e1dfc54 None admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:45:12.460596 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e306d88a-3044-4eaa-a2d2-cd277e1dfc54 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:45:12.461433 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e306d88a-3044-4eaa-a2d2-cd277e1dfc54 None admin] RBAC: Adding query filter params (role.id=f1e0c25f6e9049e897cb7350c7e54ab3, scope.domain.id=default, user.id=400d1f4db9de49638549e5db29a041e1) {{(pid=80395) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 15:45:12.461753 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e306d88a-3044-4eaa-a2d2-cd277e1dfc54 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:45:12.463332 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e306d88a-3044-4eaa-a2d2-cd277e1dfc54 None admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:45:12.471361 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 27/56] 10.222.0.59 () {56 vars in 1322 bytes} [Thu Jun 2 15:45:12 2022] GET /identity/v3/role_assignments?user.id=400d1f4db9de49638549e5db29a041e1&scope.domain.id=default&role.id=f1e0c25f6e9049e897cb7350c7e54ab3 => generated 530 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 15:45:12.501326 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eb062f5-6e27-4868-b0ad-d8cdd593b9a5 None admin] Validating token access rules against request {{(pid=80396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:45:12.516874 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG dbcounter [-] [80396] Writing DB stats keystone:SELECT=100 {{(pid=80396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:45:12.537426 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81956524-f390-4ec0-8ea2-1088acf4990f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:45:12.538123 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81956524-f390-4ec0-8ea2-1088acf4990f None admin] REQUEST_METHOD: `POST` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:45:12.538412 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81956524-f390-4ec0-8ea2-1088acf4990f None admin] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:45:12.538687 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81956524-f390-4ec0-8ea2-1088acf4990f None admin] PATH_INFO: `/v3/projects` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:45:12.539419 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81956524-f390-4ec0-8ea2-1088acf4990f None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:45:12.540904 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81956524-f390-4ec0-8ea2-1088acf4990f None admin] RBAC: Authorization granted {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:45:12.624601 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 30/57] 10.222.0.59 () {60 vars in 1140 bytes} [Thu Jun 2 15:45:12 2022] POST /identity/v3/projects => generated 298 bytes in 224 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 02 15:45:14.841913 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41feb6b9-f4ff-403f-8ca3-017f6d856141 None None] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:45:14.842487 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41feb6b9-f4ff-403f-8ca3-017f6d856141 None None] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:45:14.842487 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41feb6b9-f4ff-403f-8ca3-017f6d856141 None None] PATH_INFO: `/` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:45:14.843879 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 28/58] 10.222.0.59 () {54 vars in 926 bytes} [Thu Jun 2 15:45:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 15:45:14.849256 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b3a501-a059-47cf-900b-de8a2a686058 None None] REQUEST_METHOD: `POST` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:45:14.849655 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b3a501-a059-47cf-900b-de8a2a686058 None None] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:45:14.849813 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b3a501-a059-47cf-900b-de8a2a686058 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:45:14.866092 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.auth.core [None req-19b3a501-a059-47cf-900b-de8a2a686058 None None] MFA Rules not processed for user `400d1f4db9de49638549e5db29a041e1`. Rule list: `[]` (Enabled: `True`). {{(pid=80396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 15:45:14.867288 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.fernet_utils [None req-19b3a501-a059-47cf-900b-de8a2a686058 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 15:45:14.930720 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 31/59] 10.222.0.59 () {58 vars in 1023 bytes} [Thu Jun 2 15:45:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 02 15:45:14.957047 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41feb6b9-f4ff-403f-8ca3-017f6d856141 None None] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:45:15.056985 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41feb6b9-f4ff-403f-8ca3-017f6d856141 None None] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:45:15.090819 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fea4a293-aa6c-4c6a-b6d8-b132bdaeda43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:45:15.091595 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea4a293-aa6c-4c6a-b6d8-b132bdaeda43 None admin] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:45:15.091884 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea4a293-aa6c-4c6a-b6d8-b132bdaeda43 None admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:45:15.092214 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea4a293-aa6c-4c6a-b6d8-b132bdaeda43 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:45:15.093344 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fea4a293-aa6c-4c6a-b6d8-b132bdaeda43 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:45:15.094827 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fea4a293-aa6c-4c6a-b6d8-b132bdaeda43 None admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:45:15.096414 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 29/60] 10.222.0.59 () {56 vars in 1108 bytes} [Thu Jun 2 15:45:14 2022] GET /identity/v3/domains/default => generated 199 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 15:45:15.101890 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19b3a501-a059-47cf-900b-de8a2a686058 None None] Authenticating user token {{(pid=80396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:45:15.197613 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG dbcounter [-] [80396] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:45:15.204724 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19b3a501-a059-47cf-900b-de8a2a686058 None None] Validating token access rules against request {{(pid=80396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:45:15.239734 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3e77cbe-5b85-44ee-8969-92325f4b3ed8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:45:15.240397 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e77cbe-5b85-44ee-8969-92325f4b3ed8 None admin] REQUEST_METHOD: `POST` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:45:15.240686 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e77cbe-5b85-44ee-8969-92325f4b3ed8 None admin] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:45:15.240969 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e77cbe-5b85-44ee-8969-92325f4b3ed8 None admin] PATH_INFO: `/v3/users` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:45:15.241729 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3e77cbe-5b85-44ee-8969-92325f4b3ed8 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:45:15.243228 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3e77cbe-5b85-44ee-8969-92325f4b3ed8 None admin] RBAC: Authorization granted {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:45:15.367407 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 32/61] 10.222.0.59 () {60 vars in 1132 bytes} [Thu Jun 2 15:45:15 2022] POST /identity/v3/users => generated 275 bytes in 266 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 15:45:18.826135 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9df35b9-0a32-466a-bd16-fbb2adc06bed None None] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:45:18.826667 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9df35b9-0a32-466a-bd16-fbb2adc06bed None None] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:45:18.826841 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9df35b9-0a32-466a-bd16-fbb2adc06bed None None] PATH_INFO: `/` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:45:18.828084 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 30/62] 10.222.0.59 () {54 vars in 926 bytes} [Thu Jun 2 15:45:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 15:45:18.841080 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c750685-dc5c-4e62-b979-679926fe00d8 None None] REQUEST_METHOD: `POST` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:45:18.841612 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c750685-dc5c-4e62-b979-679926fe00d8 None None] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:45:18.841684 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c750685-dc5c-4e62-b979-679926fe00d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:45:18.872077 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.auth.core [None req-6c750685-dc5c-4e62-b979-679926fe00d8 None None] MFA Rules not processed for user `400d1f4db9de49638549e5db29a041e1`. Rule list: `[]` (Enabled: `True`). {{(pid=80396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 15:45:18.873526 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.fernet_utils [None req-6c750685-dc5c-4e62-b979-679926fe00d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 15:45:18.884662 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d7f8a2-5841-40de-b6e1-501e2bd55fc0 None None] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:45:18.884953 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d7f8a2-5841-40de-b6e1-501e2bd55fc0 None None] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:45:18.885231 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d7f8a2-5841-40de-b6e1-501e2bd55fc0 None None] PATH_INFO: `/` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:45:18.887010 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 31/63] 10.222.0.59 () {54 vars in 926 bytes} [Thu Jun 2 15:45:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 15:45:18.895004 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f86a9c-3d60-4946-b39c-c74479af0ccd None None] REQUEST_METHOD: `POST` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:45:18.895569 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f86a9c-3d60-4946-b39c-c74479af0ccd None None] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:45:18.896040 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f86a9c-3d60-4946-b39c-c74479af0ccd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:45:18.923331 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.auth.core [None req-73f86a9c-3d60-4946-b39c-c74479af0ccd None None] MFA Rules not processed for user `400d1f4db9de49638549e5db29a041e1`. Rule list: `[]` (Enabled: `True`). {{(pid=80395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 15:45:18.924998 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.fernet_utils [None req-73f86a9c-3d60-4946-b39c-c74479af0ccd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 15:45:18.963404 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writing DB stats keystone:SELECT=100 {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:45:18.990683 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 33/64] 10.222.0.59 () {58 vars in 1023 bytes} [Thu Jun 2 15:45:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 02 15:45:18.992032 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b531a7-a505-42e7-8655-56d9e1662423 None None] REQUEST_METHOD: `GET` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:45:18.992324 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b531a7-a505-42e7-8655-56d9e1662423 None None] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:45:18.992608 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b531a7-a505-42e7-8655-56d9e1662423 None None] PATH_INFO: `/` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:45:18.993895 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 34/65] 10.222.0.59 () {54 vars in 926 bytes} [Thu Jun 2 15:45:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 15:45:19.005946 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc87cd24-37a8-436a-b866-679b99e244ba None None] REQUEST_METHOD: `POST` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:45:19.006617 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc87cd24-37a8-436a-b866-679b99e244ba None None] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:45:19.006806 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc87cd24-37a8-436a-b866-679b99e244ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:45:19.030807 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 32/66] 10.222.0.59 () {58 vars in 1023 bytes} [Thu Jun 2 15:45:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 02 15:45:19.034825 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.auth.core [None req-fc87cd24-37a8-436a-b866-679b99e244ba None None] MFA Rules not processed for user `400d1f4db9de49638549e5db29a041e1`. Rule list: `[]` (Enabled: `True`). {{(pid=80396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 15:45:19.036094 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.fernet_utils [None req-fc87cd24-37a8-436a-b866-679b99e244ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 15:45:19.041213 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f86a9c-3d60-4946-b39c-c74479af0ccd None None] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:45:19.112280 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 35/67] 10.222.0.59 () {58 vars in 1023 bytes} [Thu Jun 2 15:45:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 02 15:45:19.118503 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc87cd24-37a8-436a-b866-679b99e244ba None None] Authenticating user token {{(pid=80396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:45:19.130838 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG dbcounter [-] [80396] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:45:19.203945 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f86a9c-3d60-4946-b39c-c74479af0ccd None None] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:45:19.229406 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc87cd24-37a8-436a-b866-679b99e244ba None None] Validating token access rules against request {{(pid=80396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:45:19.239206 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2544311-8862-4194-aed8-8035af71f6eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:45:19.239996 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2544311-8862-4194-aed8-8035af71f6eb None admin] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:45:19.240287 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2544311-8862-4194-aed8-8035af71f6eb None admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:45:19.240564 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2544311-8862-4194-aed8-8035af71f6eb None admin] PATH_INFO: `/v3/roles/member` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:45:19.250916 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2544311-8862-4194-aed8-8035af71f6eb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 02 15:45:19.258440 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application [None req-c2544311-8862-4194-aed8-8035af71f6eb None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 02 15:45:19.258440 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 15:45:19.258440 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 15:45:19.258440 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 15:45:19.258440 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 15:45:19.258440 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 15:45:19.258440 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 15:45:19.258440 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 15:45:19.258440 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 15:45:19.258440 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 15:45:19.258440 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 15:45:19.258440 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 15:45:19.258440 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 02 15:45:19.258440 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 02 15:45:19.258440 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 02 15:45:19.258440 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 02 15:45:19.259266 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 02 15:45:19.259266 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 02 15:45:19.259266 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 02 15:45:19.259266 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 02 15:45:19.259266 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 15:45:19.259266 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 15:45:19.259266 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 15:45:19.259266 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 15:45:19.259266 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 15:45:19.259266 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 15:45:19.259266 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 15:45:19.259266 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application with Lock( Jun 02 15:45:19.259266 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 15:45:19.259266 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self._enter() Jun 02 15:45:19.259266 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 15:45:19.259266 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 15:45:19.260008 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 15:45:19.260008 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self.creator() Jun 02 15:45:19.260008 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 15:45:19.260008 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application created_value = creator( Jun 02 15:45:19.260008 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 02 15:45:19.260008 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 02 15:45:19.260008 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 02 15:45:19.260008 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 02 15:45:19.260008 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 02 15:45:19.260008 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 02 15:45:19.260008 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 02 15:45:19.260008 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application Jun 02 15:45:19.260008 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 33/68] 10.222.0.59 () {56 vars in 1099 bytes} [Thu Jun 2 15:45:19 2022] GET /identity/v3/roles/member => generated 84 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 02 15:45:19.260613 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2544311-8862-4194-aed8-8035af71f6eb None admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:45:19.269085 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e71a5cb-7b05-471b-a73b-5138ddeda3b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:45:19.269877 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e71a5cb-7b05-471b-a73b-5138ddeda3b5 None admin] REQUEST_METHOD: `GET` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:45:19.270185 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e71a5cb-7b05-471b-a73b-5138ddeda3b5 None admin] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:45:19.270466 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e71a5cb-7b05-471b-a73b-5138ddeda3b5 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:45:19.281590 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e71a5cb-7b05-471b-a73b-5138ddeda3b5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 02 15:45:19.284784 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writing DB stats keystone:SELECT=100 {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:45:19.290211 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application [None req-4e71a5cb-7b05-471b-a73b-5138ddeda3b5 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 02 15:45:19.290211 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 15:45:19.290211 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 15:45:19.290211 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 15:45:19.290211 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 15:45:19.290211 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 15:45:19.290211 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 15:45:19.290211 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 15:45:19.290211 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 15:45:19.290211 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 15:45:19.290211 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 15:45:19.290211 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 15:45:19.290211 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 02 15:45:19.290211 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 02 15:45:19.290211 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 02 15:45:19.290211 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 02 15:45:19.296678 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 02 15:45:19.296678 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 02 15:45:19.296678 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 02 15:45:19.296678 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 02 15:45:19.296678 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 15:45:19.296678 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 15:45:19.296678 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 15:45:19.296678 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 15:45:19.296678 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 15:45:19.296678 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 15:45:19.296678 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 15:45:19.296678 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application with Lock( Jun 02 15:45:19.296678 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 15:45:19.296678 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application return self._enter() Jun 02 15:45:19.296678 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 15:45:19.296678 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 15:45:19.297437 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 15:45:19.297437 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application return self.creator() Jun 02 15:45:19.297437 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 15:45:19.297437 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application created_value = creator( Jun 02 15:45:19.297437 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 02 15:45:19.297437 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 02 15:45:19.297437 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 02 15:45:19.297437 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 02 15:45:19.297437 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 02 15:45:19.297437 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 02 15:45:19.297437 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 02 15:45:19.297437 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application Jun 02 15:45:19.297437 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 36/69] 10.222.0.59 () {56 vars in 1096 bytes} [Thu Jun 2 15:45:19 2022] GET /identity/v3/roles/admin => generated 83 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 15:45:19.298777 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28867432-be85-4832-8bd6-cccbe53baa56 None None] REQUEST_METHOD: `GET` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:45:19.299071 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28867432-be85-4832-8bd6-cccbe53baa56 None None] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:45:19.299471 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28867432-be85-4832-8bd6-cccbe53baa56 None None] PATH_INFO: `/` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:45:19.300795 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 37/70] 10.222.0.59 () {54 vars in 926 bytes} [Thu Jun 2 15:45:19 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 15:45:19.301377 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28867432-be85-4832-8bd6-cccbe53baa56 None None] Authenticating user token {{(pid=80396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:45:19.377452 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG dbcounter [-] [80396] Writing DB stats keystone:SELECT=100 {{(pid=80396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:45:19.380396 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2544311-8862-4194-aed8-8035af71f6eb None admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:45:19.409491 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28867432-be85-4832-8bd6-cccbe53baa56 None None] Validating token access rules against request {{(pid=80396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:45:19.415427 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f4ffd5c-65da-4601-8ed9-38d0807ead00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:45:19.416232 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4ffd5c-65da-4601-8ed9-38d0807ead00 None admin] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:45:19.416516 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4ffd5c-65da-4601-8ed9-38d0807ead00 None admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:45:19.416803 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4ffd5c-65da-4601-8ed9-38d0807ead00 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:45:19.427448 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f4ffd5c-65da-4601-8ed9-38d0807ead00 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 02 15:45:19.436197 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application [None req-4f4ffd5c-65da-4601-8ed9-38d0807ead00 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 02 15:45:19.436197 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 15:45:19.436197 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 15:45:19.436197 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 15:45:19.436197 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 15:45:19.436197 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 15:45:19.436197 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 15:45:19.436197 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 15:45:19.436197 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 15:45:19.436197 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 15:45:19.436197 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 15:45:19.436197 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 15:45:19.436197 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 02 15:45:19.436197 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 02 15:45:19.436197 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 02 15:45:19.436197 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 02 15:45:19.437047 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 02 15:45:19.437047 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 02 15:45:19.437047 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 02 15:45:19.437047 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 02 15:45:19.437047 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 15:45:19.437047 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 15:45:19.437047 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 15:45:19.437047 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 15:45:19.437047 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 15:45:19.437047 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 15:45:19.437047 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 15:45:19.437047 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application with Lock( Jun 02 15:45:19.437047 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 15:45:19.437047 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self._enter() Jun 02 15:45:19.437047 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 15:45:19.437047 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 15:45:19.437793 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 15:45:19.437793 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self.creator() Jun 02 15:45:19.437793 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 15:45:19.437793 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application created_value = creator( Jun 02 15:45:19.437793 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 02 15:45:19.437793 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 02 15:45:19.437793 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 02 15:45:19.437793 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 02 15:45:19.437793 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 02 15:45:19.437793 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 02 15:45:19.437793 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 02 15:45:19.437793 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application Jun 02 15:45:19.437793 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 34/71] 10.222.0.59 () {56 vars in 1114 bytes} [Thu Jun 2 15:45:19 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 15:45:19.439051 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f4ffd5c-65da-4601-8ed9-38d0807ead00 None admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:45:19.449046 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6a6ce2d-829e-4094-9748-3448645ced70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:45:19.449713 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a6ce2d-829e-4094-9748-3448645ced70 None admin] REQUEST_METHOD: `GET` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:45:19.450000 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a6ce2d-829e-4094-9748-3448645ced70 None admin] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:45:19.450310 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a6ce2d-829e-4094-9748-3448645ced70 None admin] PATH_INFO: `/v3/roles` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:45:19.451073 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6a6ce2d-829e-4094-9748-3448645ced70 None admin] RBAC: Adding query filter params (name=member) {{(pid=80396) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 15:45:19.451383 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6a6ce2d-829e-4094-9748-3448645ced70 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:45:19.452785 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6a6ce2d-829e-4094-9748-3448645ced70 None admin] RBAC: Authorization granted {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:45:19.462267 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 38/72] 10.222.0.59 () {56 vars in 1101 bytes} [Thu Jun 2 15:45:19 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 15:45:19.468261 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-080ec1da-a350-4c3f-a95b-3d7e2be8627a None None] REQUEST_METHOD: `POST` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:45:19.468561 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-080ec1da-a350-4c3f-a95b-3d7e2be8627a None None] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:45:19.469118 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-080ec1da-a350-4c3f-a95b-3d7e2be8627a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:45:19.485389 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.auth.core [None req-080ec1da-a350-4c3f-a95b-3d7e2be8627a None None] MFA Rules not processed for user `400d1f4db9de49638549e5db29a041e1`. Rule list: `[]` (Enabled: `True`). {{(pid=80396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 15:45:19.486628 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.fernet_utils [None req-080ec1da-a350-4c3f-a95b-3d7e2be8627a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 15:45:19.521433 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writing DB stats keystone:SELECT=100 {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:45:19.544221 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f4ffd5c-65da-4601-8ed9-38d0807ead00 None admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:45:19.552228 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 39/73] 10.222.0.59 () {58 vars in 1023 bytes} [Thu Jun 2 15:45:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 02 15:45:19.553133 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-080ec1da-a350-4c3f-a95b-3d7e2be8627a None None] Authenticating user token {{(pid=80396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:45:19.579429 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12843d58-99ac-4cc8-a497-54ee453ebca1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:45:19.580152 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12843d58-99ac-4cc8-a497-54ee453ebca1 None admin] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:45:19.580442 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12843d58-99ac-4cc8-a497-54ee453ebca1 None admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:45:19.580751 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12843d58-99ac-4cc8-a497-54ee453ebca1 None admin] PATH_INFO: `/v3/roles` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:45:19.581515 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12843d58-99ac-4cc8-a497-54ee453ebca1 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80395) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 15:45:19.581824 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12843d58-99ac-4cc8-a497-54ee453ebca1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:45:19.583257 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12843d58-99ac-4cc8-a497-54ee453ebca1 None admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:45:19.596131 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 35/74] 10.222.0.59 () {56 vars in 1099 bytes} [Thu Jun 2 15:45:19 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 15:45:19.596926 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12843d58-99ac-4cc8-a497-54ee453ebca1 None admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:45:19.623309 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG dbcounter [-] [80396] Writing DB stats keystone:SELECT=100 {{(pid=80396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:45:19.660169 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-080ec1da-a350-4c3f-a95b-3d7e2be8627a None None] Validating token access rules against request {{(pid=80396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:45:19.693310 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85cad05e-e371-4ac7-a67a-1e6046131006 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:45:19.693972 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85cad05e-e371-4ac7-a67a-1e6046131006 None admin] REQUEST_METHOD: `GET` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:45:19.694291 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85cad05e-e371-4ac7-a67a-1e6046131006 None admin] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:45:19.694570 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85cad05e-e371-4ac7-a67a-1e6046131006 None admin] PATH_INFO: `/v3/roles` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:45:19.694655 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12843d58-99ac-4cc8-a497-54ee453ebca1 None admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:45:19.695323 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85cad05e-e371-4ac7-a67a-1e6046131006 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80396) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 15:45:19.695634 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85cad05e-e371-4ac7-a67a-1e6046131006 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:45:19.697060 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85cad05e-e371-4ac7-a67a-1e6046131006 None admin] RBAC: Authorization granted {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:45:19.705462 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 40/75] 10.222.0.59 () {56 vars in 1111 bytes} [Thu Jun 2 15:45:19 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 15:45:19.706868 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c561bc80-4379-4245-8780-075da9b2504e None None] REQUEST_METHOD: `GET` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:45:19.707162 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c561bc80-4379-4245-8780-075da9b2504e None None] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:45:19.707443 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c561bc80-4379-4245-8780-075da9b2504e None None] PATH_INFO: `/` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:45:19.708676 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 41/76] 10.222.0.59 () {54 vars in 926 bytes} [Thu Jun 2 15:45:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 15:45:19.711201 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c561bc80-4379-4245-8780-075da9b2504e None None] Authenticating user token {{(pid=80396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:45:19.734419 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9f9d623-353a-4ccb-a781-233e5bd16976 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:45:19.735284 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f9d623-353a-4ccb-a781-233e5bd16976 None admin] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:45:19.735568 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f9d623-353a-4ccb-a781-233e5bd16976 None admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:45:19.735845 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f9d623-353a-4ccb-a781-233e5bd16976 None admin] PATH_INFO: `/v3/users/8defb7300e7949f180b3f6ccd787ddf9` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:45:19.743602 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writing DB stats keystone:SELECT=100 {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:45:19.749684 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9f9d623-353a-4ccb-a781-233e5bd16976 None admin] RBAC: Authorizing `identity:get_user(user_id=8defb7300e7949f180b3f6ccd787ddf9)` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:45:19.751190 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9f9d623-353a-4ccb-a781-233e5bd16976 None admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:45:19.752853 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 36/77] 10.222.0.59 () {56 vars in 1177 bytes} [Thu Jun 2 15:45:19 2022] GET /identity/v3/users/8defb7300e7949f180b3f6ccd787ddf9 => generated 275 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 15:45:19.756014 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9f9d623-353a-4ccb-a781-233e5bd16976 None admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:45:19.813255 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c561bc80-4379-4245-8780-075da9b2504e None None] Validating token access rules against request {{(pid=80396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:45:19.837633 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG dbcounter [-] [80396] Writing DB stats keystone:SELECT=100 {{(pid=80396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:45:19.846817 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be4d0d58-6e6b-4785-8be8-ba8da7f8a04c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:45:19.847607 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be4d0d58-6e6b-4785-8be8-ba8da7f8a04c None admin] REQUEST_METHOD: `GET` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:45:19.850571 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be4d0d58-6e6b-4785-8be8-ba8da7f8a04c None admin] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:45:19.850571 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be4d0d58-6e6b-4785-8be8-ba8da7f8a04c None admin] PATH_INFO: `/v3/roles/member` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:45:19.853062 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9f9d623-353a-4ccb-a781-233e5bd16976 None admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:45:19.858567 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be4d0d58-6e6b-4785-8be8-ba8da7f8a04c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 02 15:45:19.866202 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application [None req-be4d0d58-6e6b-4785-8be8-ba8da7f8a04c None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 02 15:45:19.866202 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 15:45:19.866202 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 15:45:19.866202 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 15:45:19.866202 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 15:45:19.866202 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 15:45:19.866202 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 15:45:19.866202 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 15:45:19.866202 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 15:45:19.866202 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 15:45:19.866202 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 15:45:19.866202 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 15:45:19.866202 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 02 15:45:19.866202 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 02 15:45:19.866202 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 02 15:45:19.866202 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 02 15:45:19.867214 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 02 15:45:19.867214 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 02 15:45:19.867214 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 02 15:45:19.867214 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 02 15:45:19.867214 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 15:45:19.867214 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 15:45:19.867214 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 15:45:19.867214 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 15:45:19.867214 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 15:45:19.867214 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 15:45:19.867214 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 15:45:19.867214 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application with Lock( Jun 02 15:45:19.867214 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 15:45:19.867214 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application return self._enter() Jun 02 15:45:19.867214 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 15:45:19.867214 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 15:45:19.873242 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 15:45:19.873242 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application return self.creator() Jun 02 15:45:19.873242 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 15:45:19.873242 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application created_value = creator( Jun 02 15:45:19.873242 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 02 15:45:19.873242 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 02 15:45:19.873242 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 02 15:45:19.873242 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 02 15:45:19.873242 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 02 15:45:19.873242 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 02 15:45:19.873242 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 02 15:45:19.873242 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application Jun 02 15:45:19.873242 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 42/78] 10.222.0.59 () {56 vars in 1099 bytes} [Thu Jun 2 15:45:19 2022] GET /identity/v3/roles/member => generated 84 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 15:45:19.873242 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be4d0d58-6e6b-4785-8be8-ba8da7f8a04c None admin] Authenticating user token {{(pid=80396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:45:19.890095 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d410938c-bb5d-465e-b105-af846320e4ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:45:19.890976 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d410938c-bb5d-465e-b105-af846320e4ee None admin] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:45:19.891264 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d410938c-bb5d-465e-b105-af846320e4ee None admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:45:19.891544 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d410938c-bb5d-465e-b105-af846320e4ee None admin] PATH_INFO: `/v3/users/400d1f4db9de49638549e5db29a041e1` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:45:19.892749 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d410938c-bb5d-465e-b105-af846320e4ee None admin] RBAC: Authorizing `identity:get_user(user_id=400d1f4db9de49638549e5db29a041e1)` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:45:19.894242 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d410938c-bb5d-465e-b105-af846320e4ee None admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:45:19.896043 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 37/79] 10.222.0.59 () {56 vars in 1177 bytes} [Thu Jun 2 15:45:19 2022] GET /identity/v3/users/400d1f4db9de49638549e5db29a041e1 => generated 247 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 15:45:19.896999 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162574d2-d63e-499d-b121-0800428ae9fa None None] REQUEST_METHOD: `POST` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:45:19.897290 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162574d2-d63e-499d-b121-0800428ae9fa None None] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:45:19.897573 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162574d2-d63e-499d-b121-0800428ae9fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:45:19.914513 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.auth.core [None req-162574d2-d63e-499d-b121-0800428ae9fa None None] MFA Rules not processed for user `400d1f4db9de49638549e5db29a041e1`. Rule list: `[]` (Enabled: `True`). {{(pid=80395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 15:45:19.915631 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.fernet_utils [None req-162574d2-d63e-499d-b121-0800428ae9fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 15:45:19.973371 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be4d0d58-6e6b-4785-8be8-ba8da7f8a04c None admin] Validating token access rules against request {{(pid=80396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:45:19.973754 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writing DB stats keystone:SELECT=100 {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:45:19.982432 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 38/80] 10.222.0.59 () {58 vars in 1023 bytes} [Thu Jun 2 15:45:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 02 15:45:19.998286 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-162574d2-d63e-499d-b121-0800428ae9fa None None] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:45:20.023469 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb8843be-1631-4176-8749-7448cce08d6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:45:20.024339 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8843be-1631-4176-8749-7448cce08d6f None admin] REQUEST_METHOD: `GET` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:45:20.024627 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8843be-1631-4176-8749-7448cce08d6f None admin] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:45:20.024907 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8843be-1631-4176-8749-7448cce08d6f None admin] PATH_INFO: `/v3/users/8defb7300e7949f180b3f6ccd787ddf9` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:45:20.026180 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb8843be-1631-4176-8749-7448cce08d6f None admin] RBAC: Authorizing `identity:get_user(user_id=8defb7300e7949f180b3f6ccd787ddf9)` {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:45:20.027914 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb8843be-1631-4176-8749-7448cce08d6f None admin] RBAC: Authorization granted {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:45:20.029549 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 43/81] 10.222.0.59 () {56 vars in 1177 bytes} [Thu Jun 2 15:45:19 2022] GET /identity/v3/users/8defb7300e7949f180b3f6ccd787ddf9 => generated 275 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 15:45:20.030408 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb8843be-1631-4176-8749-7448cce08d6f None admin] Authenticating user token {{(pid=80396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:45:20.080866 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-162574d2-d63e-499d-b121-0800428ae9fa None None] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:45:20.086368 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG dbcounter [-] [80396] Writing DB stats keystone:SELECT=100 {{(pid=80396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:45:20.113984 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71530007-c945-4b1d-ac9b-aa34cdf19495 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:45:20.114680 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71530007-c945-4b1d-ac9b-aa34cdf19495 None admin] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:45:20.114964 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71530007-c945-4b1d-ac9b-aa34cdf19495 None admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:45:20.115237 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71530007-c945-4b1d-ac9b-aa34cdf19495 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:45:20.132300 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb8843be-1631-4176-8749-7448cce08d6f None admin] Validating token access rules against request {{(pid=80396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:45:20.166638 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0d4ab57-87b4-45c9-bb7c-b34166140fc9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:45:20.167531 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d4ab57-87b4-45c9-bb7c-b34166140fc9 None admin] REQUEST_METHOD: `GET` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:45:20.167813 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d4ab57-87b4-45c9-bb7c-b34166140fc9 None admin] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:45:20.168090 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d4ab57-87b4-45c9-bb7c-b34166140fc9 None admin] PATH_INFO: `/v3/roles` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:45:20.169321 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0d4ab57-87b4-45c9-bb7c-b34166140fc9 None admin] RBAC: Adding query filter params (name=member) {{(pid=80396) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 15:45:20.169641 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0d4ab57-87b4-45c9-bb7c-b34166140fc9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:45:20.171198 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0d4ab57-87b4-45c9-bb7c-b34166140fc9 None admin] RBAC: Authorization granted {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:45:20.174281 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writing DB stats keystone:SELECT=100 {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:45:20.179692 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 44/82] 10.222.0.59 () {56 vars in 1101 bytes} [Thu Jun 2 15:45:20 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 15:45:20.180478 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0d4ab57-87b4-45c9-bb7c-b34166140fc9 None admin] Authenticating user token {{(pid=80396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:45:20.182539 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71530007-c945-4b1d-ac9b-aa34cdf19495 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:45:20.185014 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71530007-c945-4b1d-ac9b-aa34cdf19495 None admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:45:20.279964 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0d4ab57-87b4-45c9-bb7c-b34166140fc9 None admin] Validating token access rules against request {{(pid=80396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:45:20.282772 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 39/83] 10.222.0.59 () {58 vars in 1282 bytes} [Thu Jun 2 15:45:19 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 300 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 02 15:45:20.283689 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71530007-c945-4b1d-ac9b-aa34cdf19495 None admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:45:20.299446 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG dbcounter [-] [80396] Writing DB stats keystone:SELECT=100 {{(pid=80396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:45:20.317464 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad647ef8-44e3-4855-ac35-3d7153644f13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:45:20.318177 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad647ef8-44e3-4855-ac35-3d7153644f13 None admin] REQUEST_METHOD: `GET` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:45:20.318469 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad647ef8-44e3-4855-ac35-3d7153644f13 None admin] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:45:20.318751 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad647ef8-44e3-4855-ac35-3d7153644f13 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:45:20.375408 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writing DB stats keystone:SELECT=100 {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:45:20.382027 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71530007-c945-4b1d-ac9b-aa34cdf19495 None admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:45:20.385458 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad647ef8-44e3-4855-ac35-3d7153644f13 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:45:20.387200 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad647ef8-44e3-4855-ac35-3d7153644f13 None admin] RBAC: Authorization granted {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:45:20.417391 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7ca2053-8810-4829-b348-6f9442279659 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:45:20.418133 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ca2053-8810-4829-b348-6f9442279659 None admin] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:45:20.418419 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ca2053-8810-4829-b348-6f9442279659 None admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:45:20.418696 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ca2053-8810-4829-b348-6f9442279659 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:45:20.419858 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7ca2053-8810-4829-b348-6f9442279659 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:45:20.421283 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7ca2053-8810-4829-b348-6f9442279659 None admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:45:20.422915 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 40/84] 10.222.0.59 () {56 vars in 1108 bytes} [Thu Jun 2 15:45:20 2022] GET /identity/v3/domains/default => generated 199 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 15:45:20.427545 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7ca2053-8810-4829-b348-6f9442279659 None admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:45:20.488054 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 45/85] 10.222.0.59 () {58 vars in 1282 bytes} [Thu Jun 2 15:45:20 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 02 15:45:20.489217 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad647ef8-44e3-4855-ac35-3d7153644f13 None admin] Authenticating user token {{(pid=80396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:45:20.508376 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG dbcounter [-] [80396] Writing DB stats keystone:SELECT=100 {{(pid=80396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:45:20.522255 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7ca2053-8810-4829-b348-6f9442279659 None admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:45:20.555555 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e817790d-5686-466c-b2cc-d7176ba76249 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:45:20.556196 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e817790d-5686-466c-b2cc-d7176ba76249 None admin] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:45:20.556489 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e817790d-5686-466c-b2cc-d7176ba76249 None admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:45:20.556760 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e817790d-5686-466c-b2cc-d7176ba76249 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:45:20.585678 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writing DB stats keystone:SELECT=100 {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:45:20.590569 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad647ef8-44e3-4855-ac35-3d7153644f13 None admin] Validating token access rules against request {{(pid=80396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:45:20.623565 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e817790d-5686-466c-b2cc-d7176ba76249 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:45:20.625046 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e817790d-5686-466c-b2cc-d7176ba76249 None admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:45:20.625595 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09f1aab8-9e5d-477a-ad2d-53d0a390e8dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:45:20.626488 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f1aab8-9e5d-477a-ad2d-53d0a390e8dd None admin] REQUEST_METHOD: `GET` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:45:20.626801 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f1aab8-9e5d-477a-ad2d-53d0a390e8dd None admin] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:45:20.627173 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f1aab8-9e5d-477a-ad2d-53d0a390e8dd None admin] PATH_INFO: `/v3/users/8defb7300e7949f180b3f6ccd787ddf9` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:45:20.628364 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09f1aab8-9e5d-477a-ad2d-53d0a390e8dd None admin] RBAC: Authorizing `identity:get_user(user_id=8defb7300e7949f180b3f6ccd787ddf9)` {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:45:20.629784 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09f1aab8-9e5d-477a-ad2d-53d0a390e8dd None admin] RBAC: Authorization granted {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:45:20.631596 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 46/86] 10.222.0.59 () {56 vars in 1177 bytes} [Thu Jun 2 15:45:20 2022] GET /identity/v3/users/8defb7300e7949f180b3f6ccd787ddf9 => generated 275 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 15:45:20.632192 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09f1aab8-9e5d-477a-ad2d-53d0a390e8dd None admin] Authenticating user token {{(pid=80396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:45:20.717964 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG dbcounter [-] [80396] Writing DB stats keystone:SELECT=100 {{(pid=80396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:45:20.727315 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 41/87] 10.222.0.59 () {58 vars in 1282 bytes} [Thu Jun 2 15:45:20 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 304 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 02 15:45:20.728126 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e817790d-5686-466c-b2cc-d7176ba76249 None admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:45:20.737170 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09f1aab8-9e5d-477a-ad2d-53d0a390e8dd None admin] Validating token access rules against request {{(pid=80396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:45:20.771264 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04791f0e-5dc0-46a8-9b1d-2cd779126fc4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:45:20.772122 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04791f0e-5dc0-46a8-9b1d-2cd779126fc4 None admin] REQUEST_METHOD: `GET` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:45:20.772405 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04791f0e-5dc0-46a8-9b1d-2cd779126fc4 None admin] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:45:20.772683 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04791f0e-5dc0-46a8-9b1d-2cd779126fc4 None admin] PATH_INFO: `/v3/projects/06e0633a47e74dcfaeccc8794206da96` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:45:20.773883 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04791f0e-5dc0-46a8-9b1d-2cd779126fc4 None admin] RBAC: Authorizing `identity:get_project(project_id=06e0633a47e74dcfaeccc8794206da96)` {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:45:20.775363 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04791f0e-5dc0-46a8-9b1d-2cd779126fc4 None admin] RBAC: Authorization granted {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:45:20.778053 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 47/88] 10.222.0.59 () {56 vars in 1186 bytes} [Thu Jun 2 15:45:20 2022] GET /identity/v3/projects/06e0633a47e74dcfaeccc8794206da96 => generated 298 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 15:45:20.778905 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04791f0e-5dc0-46a8-9b1d-2cd779126fc4 None admin] Authenticating user token {{(pid=80396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:45:20.796435 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writing DB stats keystone:SELECT=100 {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:45:20.834169 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e817790d-5686-466c-b2cc-d7176ba76249 None admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:45:20.868328 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb057db-580f-4ee8-a1a4-53a21a487393 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:45:20.868994 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb057db-580f-4ee8-a1a4-53a21a487393 None admin] REQUEST_METHOD: `POST` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:45:20.869275 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb057db-580f-4ee8-a1a4-53a21a487393 None admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:45:20.869549 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb057db-580f-4ee8-a1a4-53a21a487393 None admin] PATH_INFO: `/v3/users` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:45:20.870855 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fb057db-580f-4ee8-a1a4-53a21a487393 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:45:20.872307 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fb057db-580f-4ee8-a1a4-53a21a487393 None admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:45:20.877605 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04791f0e-5dc0-46a8-9b1d-2cd779126fc4 None admin] Validating token access rules against request {{(pid=80396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:45:20.911470 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c19ba5cd-be38-4809-aa36-87156eab869e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:45:20.912354 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19ba5cd-be38-4809-aa36-87156eab869e None admin] REQUEST_METHOD: `GET` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:45:20.912682 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19ba5cd-be38-4809-aa36-87156eab869e None admin] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:45:20.913193 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19ba5cd-be38-4809-aa36-87156eab869e None admin] PATH_INFO: `/v3/projects/06e0633a47e74dcfaeccc8794206da96` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:45:20.914601 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c19ba5cd-be38-4809-aa36-87156eab869e None admin] RBAC: Authorizing `identity:get_project(project_id=06e0633a47e74dcfaeccc8794206da96)` {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:45:20.916218 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c19ba5cd-be38-4809-aa36-87156eab869e None admin] RBAC: Authorization granted {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:45:20.918176 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 48/89] 10.222.0.59 () {56 vars in 1186 bytes} [Thu Jun 2 15:45:20 2022] GET /identity/v3/projects/06e0633a47e74dcfaeccc8794206da96 => generated 298 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 15:45:20.918940 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c19ba5cd-be38-4809-aa36-87156eab869e None admin] Authenticating user token {{(pid=80396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:45:20.940065 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG dbcounter [-] [80396] Writing DB stats keystone:SELECT=100 {{(pid=80396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:45:21.017375 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 42/90] 10.222.0.59 () {60 vars in 1132 bytes} [Thu Jun 2 15:45:20 2022] POST /identity/v3/users => generated 289 bytes in 289 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 15:45:21.017914 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c19ba5cd-be38-4809-aa36-87156eab869e None admin] Validating token access rules against request {{(pid=80396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:45:21.031229 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb057db-580f-4ee8-a1a4-53a21a487393 None admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:45:21.057326 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6070defd-2bad-4e45-b474-6231db6e85d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:45:21.058554 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6070defd-2bad-4e45-b474-6231db6e85d9 None admin] REQUEST_METHOD: `GET` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:45:21.058843 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6070defd-2bad-4e45-b474-6231db6e85d9 None admin] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:45:21.059124 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6070defd-2bad-4e45-b474-6231db6e85d9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:45:21.139799 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6070defd-2bad-4e45-b474-6231db6e85d9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:45:21.141756 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6070defd-2bad-4e45-b474-6231db6e85d9 None admin] RBAC: Authorization granted {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:45:21.145920 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb057db-580f-4ee8-a1a4-53a21a487393 None admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:45:21.164938 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:45:21.172711 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG dbcounter [-] [80396] Writing DB stats keystone:SELECT=100 {{(pid=80396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:45:21.190719 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cb0b01e-cf2d-40e8-8687-d69a52a1ff28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:45:21.191880 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb0b01e-cf2d-40e8-8687-d69a52a1ff28 None admin] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:45:21.192324 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb0b01e-cf2d-40e8-8687-d69a52a1ff28 None admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:45:21.192765 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb0b01e-cf2d-40e8-8687-d69a52a1ff28 None admin] PATH_INFO: `/v3/projects/06e0633a47e74dcfaeccc8794206da96` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:45:21.194453 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cb0b01e-cf2d-40e8-8687-d69a52a1ff28 None admin] RBAC: Authorizing `identity:get_project(project_id=06e0633a47e74dcfaeccc8794206da96)` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:45:21.195953 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cb0b01e-cf2d-40e8-8687-d69a52a1ff28 None admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:45:21.197884 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 43/91] 10.222.0.59 () {56 vars in 1186 bytes} [Thu Jun 2 15:45:21 2022] GET /identity/v3/projects/06e0633a47e74dcfaeccc8794206da96 => generated 298 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 15:45:21.198727 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cb0b01e-cf2d-40e8-8687-d69a52a1ff28 None admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:45:21.267744 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 49/92] 10.222.0.59 () {58 vars in 1282 bytes} [Thu Jun 2 15:45:20 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 349 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 02 15:45:21.268803 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6070defd-2bad-4e45-b474-6231db6e85d9 None admin] Authenticating user token {{(pid=80396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:45:21.329001 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cb0b01e-cf2d-40e8-8687-d69a52a1ff28 None admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:45:21.376701 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64fb1eff-a605-4e16-8678-5faef0c23674 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:45:21.378019 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64fb1eff-a605-4e16-8678-5faef0c23674 None admin] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:45:21.378335 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64fb1eff-a605-4e16-8678-5faef0c23674 None admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:45:21.378642 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64fb1eff-a605-4e16-8678-5faef0c23674 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:45:21.379508 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64fb1eff-a605-4e16-8678-5faef0c23674 None admin] RBAC: Adding query filter params (role.id=649e0f2b5a264c419ea6a1441f123a03, scope.project.id=06e0633a47e74dcfaeccc8794206da96, user.id=8defb7300e7949f180b3f6ccd787ddf9) {{(pid=80395) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 15:45:21.379828 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64fb1eff-a605-4e16-8678-5faef0c23674 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:45:21.381566 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64fb1eff-a605-4e16-8678-5faef0c23674 None admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:45:21.390534 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 44/93] 10.222.0.59 () {56 vars in 1374 bytes} [Thu Jun 2 15:45:21 2022] GET /identity/v3/role_assignments?user.id=8defb7300e7949f180b3f6ccd787ddf9&scope.project.id=06e0633a47e74dcfaeccc8794206da96&role.id=649e0f2b5a264c419ea6a1441f123a03 => generated 259 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 15:45:21.391222 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64fb1eff-a605-4e16-8678-5faef0c23674 None admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:45:21.396485 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6070defd-2bad-4e45-b474-6231db6e85d9 None admin] Validating token access rules against request {{(pid=80396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:45:21.431304 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG dbcounter [-] [80396] Writing DB stats keystone:SELECT=100 {{(pid=80396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:45:21.447711 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e79e4ffd-4e70-47cc-a1d5-eb474a5d0afc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:45:21.449404 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79e4ffd-4e70-47cc-a1d5-eb474a5d0afc None admin] REQUEST_METHOD: `GET` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:45:21.449901 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79e4ffd-4e70-47cc-a1d5-eb474a5d0afc None admin] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:45:21.450409 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79e4ffd-4e70-47cc-a1d5-eb474a5d0afc None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:45:21.451471 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e79e4ffd-4e70-47cc-a1d5-eb474a5d0afc None admin] RBAC: Adding query filter params (role.id=f1e0c25f6e9049e897cb7350c7e54ab3, scope.project.id=06e0633a47e74dcfaeccc8794206da96, user.id=400d1f4db9de49638549e5db29a041e1) {{(pid=80396) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 15:45:21.452022 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e79e4ffd-4e70-47cc-a1d5-eb474a5d0afc None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:45:21.453745 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e79e4ffd-4e70-47cc-a1d5-eb474a5d0afc None admin] RBAC: Authorization granted {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:45:21.460454 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 50/94] 10.222.0.59 () {56 vars in 1374 bytes} [Thu Jun 2 15:45:21 2022] GET /identity/v3/role_assignments?user.id=400d1f4db9de49638549e5db29a041e1&scope.project.id=06e0633a47e74dcfaeccc8794206da96&role.id=f1e0c25f6e9049e897cb7350c7e54ab3 => generated 259 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 15:45:21.461661 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e79e4ffd-4e70-47cc-a1d5-eb474a5d0afc None admin] Authenticating user token {{(pid=80396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:45:21.473383 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writing DB stats keystone:SELECT=100 {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:45:21.587889 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64fb1eff-a605-4e16-8678-5faef0c23674 None admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:45:21.658085 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3e9982b-b105-417d-bc1e-8974b16275c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:45:21.658765 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e9982b-b105-417d-bc1e-8974b16275c7 None admin] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:45:21.659051 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e9982b-b105-417d-bc1e-8974b16275c7 None admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:45:21.659481 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e9982b-b105-417d-bc1e-8974b16275c7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:45:21.661184 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3e9982b-b105-417d-bc1e-8974b16275c7 None admin] RBAC: Adding query filter params (role.id=21f49b1aa1e64120b7ef6fcf4667a641, scope.project.id=06e0633a47e74dcfaeccc8794206da96, user.id=8defb7300e7949f180b3f6ccd787ddf9) {{(pid=80395) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 15:45:21.661508 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3e9982b-b105-417d-bc1e-8974b16275c7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:45:21.663731 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3e9982b-b105-417d-bc1e-8974b16275c7 None admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:45:21.683753 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 45/95] 10.222.0.59 () {56 vars in 1374 bytes} [Thu Jun 2 15:45:21 2022] GET /identity/v3/role_assignments?user.id=8defb7300e7949f180b3f6ccd787ddf9&scope.project.id=06e0633a47e74dcfaeccc8794206da96&role.id=21f49b1aa1e64120b7ef6fcf4667a641 => generated 259 bytes in 285 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 15:45:21.687622 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e79e4ffd-4e70-47cc-a1d5-eb474a5d0afc None admin] Validating token access rules against request {{(pid=80396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:45:21.754429 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a820690f-ae1a-4548-b636-b7660394cf02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:45:21.755321 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a820690f-ae1a-4548-b636-b7660394cf02 None admin] REQUEST_METHOD: `GET` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:45:21.755610 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a820690f-ae1a-4548-b636-b7660394cf02 None admin] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:45:21.755887 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a820690f-ae1a-4548-b636-b7660394cf02 None admin] PATH_INFO: `/v3/projects/5163f93e22c4458ab0ec98d8dc486c1f` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:45:21.763154 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a820690f-ae1a-4548-b636-b7660394cf02 None admin] RBAC: Authorizing `identity:get_project(project_id=5163f93e22c4458ab0ec98d8dc486c1f)` {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:45:21.764694 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a820690f-ae1a-4548-b636-b7660394cf02 None admin] RBAC: Authorization granted {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:45:21.766817 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 51/96] 10.222.0.59 () {56 vars in 1186 bytes} [Thu Jun 2 15:45:21 2022] GET /identity/v3/projects/5163f93e22c4458ab0ec98d8dc486c1f => generated 312 bytes in 305 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 15:45:21.772766 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3e9982b-b105-417d-bc1e-8974b16275c7 None admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:45:21.938687 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3e9982b-b105-417d-bc1e-8974b16275c7 None admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:45:21.957229 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writing DB stats keystone:SELECT=100 {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:45:21.984749 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-745ec56a-90d5-4ddf-a1ab-d198fe36bbb9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:45:21.985438 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-745ec56a-90d5-4ddf-a1ab-d198fe36bbb9 None admin] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:45:21.985726 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-745ec56a-90d5-4ddf-a1ab-d198fe36bbb9 None admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:45:21.986007 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-745ec56a-90d5-4ddf-a1ab-d198fe36bbb9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:45:21.986890 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-745ec56a-90d5-4ddf-a1ab-d198fe36bbb9 None admin] RBAC: Adding query filter params (role.id=649e0f2b5a264c419ea6a1441f123a03, scope.project.id=5163f93e22c4458ab0ec98d8dc486c1f, user.id=8defb7300e7949f180b3f6ccd787ddf9) {{(pid=80395) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 15:45:21.987206 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-745ec56a-90d5-4ddf-a1ab-d198fe36bbb9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:45:21.989162 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-745ec56a-90d5-4ddf-a1ab-d198fe36bbb9 None admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:45:22.000197 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 46/97] 10.222.0.59 () {56 vars in 1374 bytes} [Thu Jun 2 15:45:21 2022] GET /identity/v3/role_assignments?user.id=8defb7300e7949f180b3f6ccd787ddf9&scope.project.id=5163f93e22c4458ab0ec98d8dc486c1f&role.id=649e0f2b5a264c419ea6a1441f123a03 => generated 259 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 15:45:24.140375 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d4986a-00af-499e-ad98-08b24c45e1e8 None None] REQUEST_METHOD: `GET` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:45:24.140941 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d4986a-00af-499e-ad98-08b24c45e1e8 None None] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:45:24.140941 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d4986a-00af-499e-ad98-08b24c45e1e8 None None] PATH_INFO: `/` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:45:24.142610 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 52/98] 10.222.0.59 () {54 vars in 926 bytes} [Thu Jun 2 15:45:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 15:45:24.148375 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5596439-73a3-4f75-964b-f9492a167bcd None None] REQUEST_METHOD: `POST` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:45:24.148900 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5596439-73a3-4f75-964b-f9492a167bcd None None] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:45:24.148986 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5596439-73a3-4f75-964b-f9492a167bcd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:45:24.172854 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.auth.core [None req-a5596439-73a3-4f75-964b-f9492a167bcd None None] MFA Rules not processed for user `400d1f4db9de49638549e5db29a041e1`. Rule list: `[]` (Enabled: `True`). {{(pid=80395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 15:45:24.173342 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.fernet_utils [None req-a5596439-73a3-4f75-964b-f9492a167bcd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 15:45:24.337692 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 47/99] 10.222.0.59 () {58 vars in 1023 bytes} [Thu Jun 2 15:45:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 02 15:45:24.369284 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41d4986a-00af-499e-ad98-08b24c45e1e8 None None] Authenticating user token {{(pid=80396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:45:24.440420 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG dbcounter [-] [80396] Writing DB stats keystone:SELECT=100 {{(pid=80396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:45:24.506217 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41d4986a-00af-499e-ad98-08b24c45e1e8 None None] Validating token access rules against request {{(pid=80396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:45:24.550794 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c7ea04c-661d-4b74-8833-165e92fa9f9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:45:24.551593 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7ea04c-661d-4b74-8833-165e92fa9f9f None admin] REQUEST_METHOD: `GET` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:45:24.551880 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7ea04c-661d-4b74-8833-165e92fa9f9f None admin] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:45:24.552159 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7ea04c-661d-4b74-8833-165e92fa9f9f None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:45:24.571015 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c7ea04c-661d-4b74-8833-165e92fa9f9f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 02 15:45:24.579707 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application [None req-8c7ea04c-661d-4b74-8833-165e92fa9f9f None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 02 15:45:24.579707 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 15:45:24.579707 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 15:45:24.579707 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 15:45:24.579707 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 15:45:24.579707 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 15:45:24.579707 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 15:45:24.579707 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 15:45:24.579707 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 15:45:24.579707 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 15:45:24.579707 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 15:45:24.579707 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 15:45:24.579707 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 02 15:45:24.579707 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 02 15:45:24.579707 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 02 15:45:24.579707 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 02 15:45:24.580582 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 02 15:45:24.580582 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 02 15:45:24.580582 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 02 15:45:24.580582 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 02 15:45:24.580582 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 15:45:24.580582 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 15:45:24.580582 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 15:45:24.580582 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 15:45:24.580582 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 15:45:24.580582 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 15:45:24.580582 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 15:45:24.580582 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application with Lock( Jun 02 15:45:24.580582 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 15:45:24.580582 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application return self._enter() Jun 02 15:45:24.580582 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 15:45:24.580582 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 15:45:24.581340 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 15:45:24.581340 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application return self.creator() Jun 02 15:45:24.581340 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 15:45:24.581340 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application created_value = creator( Jun 02 15:45:24.581340 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 02 15:45:24.581340 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 02 15:45:24.581340 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 02 15:45:24.581340 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 02 15:45:24.581340 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 02 15:45:24.581340 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 02 15:45:24.581340 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 02 15:45:24.581340 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application Jun 02 15:45:24.581340 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 53/100] 10.222.0.59 () {56 vars in 1099 bytes} [Thu Jun 2 15:45:24 2022] GET /identity/v3/roles/reader => generated 84 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 15:45:24.586693 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5596439-73a3-4f75-964b-f9492a167bcd None None] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:45:24.712161 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5596439-73a3-4f75-964b-f9492a167bcd None None] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:45:24.728052 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writing DB stats keystone:SELECT=100 {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:45:24.761234 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-564b194b-e91f-4b44-8ae6-39bc9d6ff6b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:45:24.761919 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564b194b-e91f-4b44-8ae6-39bc9d6ff6b0 None admin] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:45:24.762232 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564b194b-e91f-4b44-8ae6-39bc9d6ff6b0 None admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:45:24.762566 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564b194b-e91f-4b44-8ae6-39bc9d6ff6b0 None admin] PATH_INFO: `/v3/roles` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:45:24.763269 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-564b194b-e91f-4b44-8ae6-39bc9d6ff6b0 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80395) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 15:45:24.763577 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-564b194b-e91f-4b44-8ae6-39bc9d6ff6b0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:45:24.764963 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-564b194b-e91f-4b44-8ae6-39bc9d6ff6b0 None admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:45:24.778599 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 48/101] 10.222.0.59 () {56 vars in 1101 bytes} [Thu Jun 2 15:45:24 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 15:45:24.784240 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c7ea04c-661d-4b74-8833-165e92fa9f9f None admin] Authenticating user token {{(pid=80396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:45:24.810952 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8725e0-9bb6-4c81-85a2-22b1de9be745 None None] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:45:24.811261 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8725e0-9bb6-4c81-85a2-22b1de9be745 None None] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:45:24.811516 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8725e0-9bb6-4c81-85a2-22b1de9be745 None None] PATH_INFO: `/` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:45:24.812897 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 49/102] 10.222.0.59 () {54 vars in 926 bytes} [Thu Jun 2 15:45:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 02 15:45:24.823729 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f387e1-2e78-402b-8a1e-58133e869393 None None] REQUEST_METHOD: `POST` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:45:24.824091 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f387e1-2e78-402b-8a1e-58133e869393 None None] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:45:24.824378 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f387e1-2e78-402b-8a1e-58133e869393 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:45:24.841660 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.auth.core [None req-c5f387e1-2e78-402b-8a1e-58133e869393 None None] MFA Rules not processed for user `400d1f4db9de49638549e5db29a041e1`. Rule list: `[]` (Enabled: `True`). {{(pid=80395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 15:45:24.845872 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.fernet_utils [None req-c5f387e1-2e78-402b-8a1e-58133e869393 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 15:45:24.944840 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 50/103] 10.222.0.59 () {58 vars in 1023 bytes} [Thu Jun 2 15:45:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 02 15:45:24.946341 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc196f8-7795-414c-aaa2-7980af214ae1 None None] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:45:24.946639 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc196f8-7795-414c-aaa2-7980af214ae1 None None] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:45:24.946920 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc196f8-7795-414c-aaa2-7980af214ae1 None None] PATH_INFO: `/` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:45:24.948594 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 51/104] 10.222.0.59 () {54 vars in 926 bytes} [Thu Jun 2 15:45:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 15:45:24.949815 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f615db9-bad2-4a29-9eec-d243e3e1f4af None None] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:45:24.950120 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f615db9-bad2-4a29-9eec-d243e3e1f4af None None] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:45:24.950406 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f615db9-bad2-4a29-9eec-d243e3e1f4af None None] PATH_INFO: `/` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:45:24.952391 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 52/105] 10.222.0.59 () {54 vars in 926 bytes} [Thu Jun 2 15:45:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 15:45:24.957837 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5753ad4e-4b12-43ca-a5de-8d96ed453fcc None None] REQUEST_METHOD: `POST` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:45:24.958161 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5753ad4e-4b12-43ca-a5de-8d96ed453fcc None None] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:45:24.958448 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5753ad4e-4b12-43ca-a5de-8d96ed453fcc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:45:24.976138 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c7ea04c-661d-4b74-8833-165e92fa9f9f None admin] Validating token access rules against request {{(pid=80396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:45:24.980244 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.auth.core [None req-5753ad4e-4b12-43ca-a5de-8d96ed453fcc None None] MFA Rules not processed for user `400d1f4db9de49638549e5db29a041e1`. Rule list: `[]` (Enabled: `True`). {{(pid=80395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 15:45:24.981436 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.fernet_utils [None req-5753ad4e-4b12-43ca-a5de-8d96ed453fcc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 15:45:24.991520 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG dbcounter [-] [80396] Writing DB stats keystone:SELECT=100 {{(pid=80396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:45:25.015838 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0caadc80-219d-42be-b881-bc26a6f1169b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:45:25.016908 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0caadc80-219d-42be-b881-bc26a6f1169b None admin] REQUEST_METHOD: `GET` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:45:25.017197 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0caadc80-219d-42be-b881-bc26a6f1169b None admin] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:45:25.017474 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0caadc80-219d-42be-b881-bc26a6f1169b None admin] PATH_INFO: `/v3/users/1629872dae1a4839b87027263d77e419` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:45:25.034956 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0caadc80-219d-42be-b881-bc26a6f1169b None admin] RBAC: Authorizing `identity:get_user(user_id=1629872dae1a4839b87027263d77e419)` {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:45:25.036522 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0caadc80-219d-42be-b881-bc26a6f1169b None admin] RBAC: Authorization granted {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:45:25.038386 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 54/106] 10.222.0.59 () {56 vars in 1177 bytes} [Thu Jun 2 15:45:24 2022] GET /identity/v3/users/1629872dae1a4839b87027263d77e419 => generated 289 bytes in 255 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 15:45:25.039669 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf1fef5e-20ae-4939-9971-07d0428a20c5 None None] REQUEST_METHOD: `POST` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:45:25.040071 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf1fef5e-20ae-4939-9971-07d0428a20c5 None None] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:45:25.040359 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf1fef5e-20ae-4939-9971-07d0428a20c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:45:25.059127 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.auth.core [None req-cf1fef5e-20ae-4939-9971-07d0428a20c5 None None] MFA Rules not processed for user `400d1f4db9de49638549e5db29a041e1`. Rule list: `[]` (Enabled: `True`). {{(pid=80396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 15:45:25.060342 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.fernet_utils [None req-cf1fef5e-20ae-4939-9971-07d0428a20c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 15:45:25.078151 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 53/107] 10.222.0.59 () {58 vars in 1023 bytes} [Thu Jun 2 15:45:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 02 15:45:25.079086 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5753ad4e-4b12-43ca-a5de-8d96ed453fcc None None] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:45:25.126896 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writing DB stats keystone:SELECT=100 {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:45:25.138132 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 55/108] 10.222.0.59 () {58 vars in 1023 bytes} [Thu Jun 2 15:45:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 02 15:45:25.139003 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf1fef5e-20ae-4939-9971-07d0428a20c5 None None] Authenticating user token {{(pid=80396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:45:25.202751 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5753ad4e-4b12-43ca-a5de-8d96ed453fcc None None] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:45:25.237574 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-050b8625-f69b-4799-b7cc-195fe613403c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:45:25.238326 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-050b8625-f69b-4799-b7cc-195fe613403c None admin] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:45:25.238615 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-050b8625-f69b-4799-b7cc-195fe613403c None admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:45:25.238894 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-050b8625-f69b-4799-b7cc-195fe613403c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:45:25.250089 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-050b8625-f69b-4799-b7cc-195fe613403c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 02 15:45:25.257955 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application [None req-050b8625-f69b-4799-b7cc-195fe613403c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 02 15:45:25.257955 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 15:45:25.257955 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 15:45:25.257955 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 15:45:25.257955 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 15:45:25.257955 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 15:45:25.257955 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 15:45:25.257955 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 15:45:25.257955 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 15:45:25.257955 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 15:45:25.257955 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 15:45:25.257955 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 15:45:25.257955 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 02 15:45:25.257955 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 02 15:45:25.257955 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 02 15:45:25.257955 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 02 15:45:25.258829 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 02 15:45:25.258829 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 02 15:45:25.258829 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 02 15:45:25.258829 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 02 15:45:25.258829 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 15:45:25.258829 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 15:45:25.258829 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 15:45:25.258829 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 15:45:25.258829 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 15:45:25.258829 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 15:45:25.258829 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 15:45:25.258829 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application with Lock( Jun 02 15:45:25.258829 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 15:45:25.258829 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self._enter() Jun 02 15:45:25.258829 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 15:45:25.258829 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 15:45:25.259584 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 15:45:25.259584 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self.creator() Jun 02 15:45:25.259584 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 15:45:25.259584 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application created_value = creator( Jun 02 15:45:25.259584 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 02 15:45:25.259584 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 02 15:45:25.259584 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 02 15:45:25.259584 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 02 15:45:25.259584 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 02 15:45:25.259584 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 02 15:45:25.259584 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 02 15:45:25.259584 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application Jun 02 15:45:25.260157 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 54/109] 10.222.0.59 () {56 vars in 1096 bytes} [Thu Jun 2 15:45:25 2022] GET /identity/v3/roles/admin => generated 83 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 15:45:25.262183 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3aaadb1-8448-4f44-91b0-4ba17487f2dd None None] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:45:25.262529 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3aaadb1-8448-4f44-91b0-4ba17487f2dd None None] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:45:25.262817 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3aaadb1-8448-4f44-91b0-4ba17487f2dd None None] PATH_INFO: `/` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:45:25.264271 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 55/110] 10.222.0.59 () {54 vars in 926 bytes} [Thu Jun 2 15:45:25 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 15:45:25.265048 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3aaadb1-8448-4f44-91b0-4ba17487f2dd None None] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:45:25.276072 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG dbcounter [-] [80396] Writing DB stats keystone:SELECT=100 {{(pid=80396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:45:25.281092 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf1fef5e-20ae-4939-9971-07d0428a20c5 None None] Validating token access rules against request {{(pid=80396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:45:25.322433 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47a3685f-6e95-4b6e-bee8-d5d1340dc3dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:45:25.323673 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a3685f-6e95-4b6e-bee8-d5d1340dc3dd None admin] REQUEST_METHOD: `GET` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:45:25.324148 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a3685f-6e95-4b6e-bee8-d5d1340dc3dd None admin] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:45:25.324436 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a3685f-6e95-4b6e-bee8-d5d1340dc3dd None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:45:25.369298 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writing DB stats keystone:SELECT=100 {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:45:25.380952 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3aaadb1-8448-4f44-91b0-4ba17487f2dd None None] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:45:25.399684 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47a3685f-6e95-4b6e-bee8-d5d1340dc3dd None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:45:25.401687 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47a3685f-6e95-4b6e-bee8-d5d1340dc3dd None admin] RBAC: Authorization granted {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:45:25.419129 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8d03c64-d67b-4c26-8ec4-82e4ca2558b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:45:25.419934 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d03c64-d67b-4c26-8ec4-82e4ca2558b5 None admin] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:45:25.420217 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d03c64-d67b-4c26-8ec4-82e4ca2558b5 None admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:45:25.420494 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d03c64-d67b-4c26-8ec4-82e4ca2558b5 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:45:25.432408 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8d03c64-d67b-4c26-8ec4-82e4ca2558b5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 02 15:45:25.441433 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application [None req-b8d03c64-d67b-4c26-8ec4-82e4ca2558b5 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 02 15:45:25.441433 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 15:45:25.441433 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 15:45:25.441433 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 15:45:25.441433 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 15:45:25.441433 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 15:45:25.441433 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 15:45:25.441433 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 15:45:25.441433 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 15:45:25.441433 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 15:45:25.441433 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 15:45:25.441433 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 15:45:25.441433 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 02 15:45:25.441433 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 02 15:45:25.441433 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 02 15:45:25.441433 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 02 15:45:25.442339 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 02 15:45:25.442339 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 02 15:45:25.442339 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 02 15:45:25.442339 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 02 15:45:25.442339 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 15:45:25.442339 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 15:45:25.442339 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 15:45:25.442339 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 15:45:25.442339 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 15:45:25.442339 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 15:45:25.442339 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 15:45:25.442339 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application with Lock( Jun 02 15:45:25.442339 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 15:45:25.442339 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self._enter() Jun 02 15:45:25.442339 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 15:45:25.442339 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 15:45:25.443110 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 15:45:25.443110 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self.creator() Jun 02 15:45:25.443110 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 15:45:25.443110 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application created_value = creator( Jun 02 15:45:25.443110 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 02 15:45:25.443110 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 02 15:45:25.443110 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 02 15:45:25.443110 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 02 15:45:25.443110 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 02 15:45:25.443110 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 02 15:45:25.443110 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 02 15:45:25.443110 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application Jun 02 15:45:25.443110 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 56/111] 10.222.0.59 () {56 vars in 1114 bytes} [Thu Jun 2 15:45:25 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 15:45:25.443814 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8d03c64-d67b-4c26-8ec4-82e4ca2558b5 None admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:45:25.515572 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG dbcounter [-] [80396] Writing DB stats keystone:SELECT=100 {{(pid=80396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:45:25.520077 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 56/112] 10.222.0.59 () {58 vars in 1282 bytes} [Thu Jun 2 15:45:25 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 381 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 02 15:45:25.525085 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47a3685f-6e95-4b6e-bee8-d5d1340dc3dd None admin] Authenticating user token {{(pid=80396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:45:25.552845 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8d03c64-d67b-4c26-8ec4-82e4ca2558b5 None admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:45:25.590863 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11ef549c-5514-4b62-82d7-794e1046ab43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:45:25.591781 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ef549c-5514-4b62-82d7-794e1046ab43 None admin] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:45:25.592070 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ef549c-5514-4b62-82d7-794e1046ab43 None admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:45:25.592352 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ef549c-5514-4b62-82d7-794e1046ab43 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:45:25.602912 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11ef549c-5514-4b62-82d7-794e1046ab43 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 02 15:45:25.610793 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application [None req-11ef549c-5514-4b62-82d7-794e1046ab43 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 02 15:45:25.610793 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 15:45:25.610793 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 15:45:25.610793 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 15:45:25.610793 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 15:45:25.610793 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 15:45:25.610793 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 15:45:25.610793 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 15:45:25.610793 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 15:45:25.610793 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 15:45:25.610793 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 15:45:25.610793 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 15:45:25.610793 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 02 15:45:25.610793 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 02 15:45:25.610793 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 02 15:45:25.610793 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 02 15:45:25.611657 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 02 15:45:25.611657 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 02 15:45:25.611657 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 02 15:45:25.611657 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 02 15:45:25.611657 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 15:45:25.611657 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 15:45:25.611657 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 15:45:25.611657 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 15:45:25.611657 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 15:45:25.611657 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 15:45:25.611657 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 15:45:25.611657 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application with Lock( Jun 02 15:45:25.611657 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 15:45:25.611657 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self._enter() Jun 02 15:45:25.611657 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 15:45:25.611657 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 15:45:25.612417 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 15:45:25.612417 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self.creator() Jun 02 15:45:25.612417 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 15:45:25.612417 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application created_value = creator( Jun 02 15:45:25.612417 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 02 15:45:25.612417 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 02 15:45:25.612417 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 02 15:45:25.612417 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 02 15:45:25.612417 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 02 15:45:25.612417 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 02 15:45:25.612417 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 02 15:45:25.612417 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application Jun 02 15:45:25.612417 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 57/113] 10.222.0.59 () {56 vars in 1099 bytes} [Thu Jun 2 15:45:25 2022] GET /identity/v3/roles/member => generated 84 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 15:45:25.613043 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-babcf39d-7a13-4928-9089-90aa6a255aa0 None None] REQUEST_METHOD: `POST` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:45:25.613877 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-babcf39d-7a13-4928-9089-90aa6a255aa0 None None] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:45:25.613877 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-babcf39d-7a13-4928-9089-90aa6a255aa0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:45:25.630039 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.auth.core [None req-babcf39d-7a13-4928-9089-90aa6a255aa0 None None] MFA Rules not processed for user `400d1f4db9de49638549e5db29a041e1`. Rule list: `[]` (Enabled: `True`). {{(pid=80395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 15:45:25.631232 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.fernet_utils [None req-babcf39d-7a13-4928-9089-90aa6a255aa0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 15:45:25.633453 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47a3685f-6e95-4b6e-bee8-d5d1340dc3dd None admin] Validating token access rules against request {{(pid=80396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:45:25.634531 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writing DB stats keystone:SELECT=100 {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:45:25.667827 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cee68e2-585d-4641-9c2e-f3f2284426d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:45:25.668497 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cee68e2-585d-4641-9c2e-f3f2284426d5 None admin] REQUEST_METHOD: `GET` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:45:25.668767 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cee68e2-585d-4641-9c2e-f3f2284426d5 None admin] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:45:25.669040 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cee68e2-585d-4641-9c2e-f3f2284426d5 None admin] PATH_INFO: `/v3/roles` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:45:25.669786 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cee68e2-585d-4641-9c2e-f3f2284426d5 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80396) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 15:45:25.670115 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cee68e2-585d-4641-9c2e-f3f2284426d5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:45:25.671501 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cee68e2-585d-4641-9c2e-f3f2284426d5 None admin] RBAC: Authorization granted {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:45:25.679621 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 57/114] 10.222.0.59 () {56 vars in 1099 bytes} [Thu Jun 2 15:45:25 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 15:45:25.680488 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cee68e2-585d-4641-9c2e-f3f2284426d5 None admin] Authenticating user token {{(pid=80396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:45:25.701086 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 58/115] 10.222.0.59 () {58 vars in 1023 bytes} [Thu Jun 2 15:45:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 02 15:45:25.702121 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-babcf39d-7a13-4928-9089-90aa6a255aa0 None None] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:45:25.742736 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG dbcounter [-] [80396] Writing DB stats keystone:SELECT=100 {{(pid=80396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:45:25.781394 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cee68e2-585d-4641-9c2e-f3f2284426d5 None admin] Validating token access rules against request {{(pid=80396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:45:25.809671 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-babcf39d-7a13-4928-9089-90aa6a255aa0 None None] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:45:25.812999 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47bbd96b-ef6f-4c7f-91ca-cffaf9edec65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:45:25.813659 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47bbd96b-ef6f-4c7f-91ca-cffaf9edec65 None admin] REQUEST_METHOD: `GET` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:45:25.813942 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47bbd96b-ef6f-4c7f-91ca-cffaf9edec65 None admin] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:45:25.814253 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47bbd96b-ef6f-4c7f-91ca-cffaf9edec65 None admin] PATH_INFO: `/v3/roles` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:45:25.814991 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47bbd96b-ef6f-4c7f-91ca-cffaf9edec65 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80396) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 15:45:25.815296 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47bbd96b-ef6f-4c7f-91ca-cffaf9edec65 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:45:25.816660 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47bbd96b-ef6f-4c7f-91ca-cffaf9edec65 None admin] RBAC: Authorization granted {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:45:25.825453 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 58/116] 10.222.0.59 () {56 vars in 1111 bytes} [Thu Jun 2 15:45:25 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 15:45:25.827039 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a8df9c-c87f-4db2-b7eb-c439b0796298 None None] REQUEST_METHOD: `GET` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:45:25.827337 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a8df9c-c87f-4db2-b7eb-c439b0796298 None None] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:45:25.827619 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a8df9c-c87f-4db2-b7eb-c439b0796298 None None] PATH_INFO: `/` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:45:25.829059 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 59/117] 10.222.0.59 () {54 vars in 926 bytes} [Thu Jun 2 15:45:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 15:45:25.829578 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13a8df9c-c87f-4db2-b7eb-c439b0796298 None None] Authenticating user token {{(pid=80396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:45:25.847106 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53d7cd5a-1164-44f7-90e4-8274e634d5c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:45:25.847963 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d7cd5a-1164-44f7-90e4-8274e634d5c3 None admin] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:45:25.848244 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d7cd5a-1164-44f7-90e4-8274e634d5c3 None admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:45:25.848515 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d7cd5a-1164-44f7-90e4-8274e634d5c3 None admin] PATH_INFO: `/v3/projects/06e0633a47e74dcfaeccc8794206da96` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:45:25.849677 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53d7cd5a-1164-44f7-90e4-8274e634d5c3 None admin] RBAC: Authorizing `identity:get_project(project_id=06e0633a47e74dcfaeccc8794206da96)` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:45:25.851163 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53d7cd5a-1164-44f7-90e4-8274e634d5c3 None admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:45:25.852844 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 59/118] 10.222.0.59 () {56 vars in 1186 bytes} [Thu Jun 2 15:45:25 2022] GET /identity/v3/projects/06e0633a47e74dcfaeccc8794206da96 => generated 298 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 15:45:25.853590 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53d7cd5a-1164-44f7-90e4-8274e634d5c3 None admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:45:25.865884 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writing DB stats keystone:SELECT=100 {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:45:25.934196 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13a8df9c-c87f-4db2-b7eb-c439b0796298 None None] Validating token access rules against request {{(pid=80396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:45:25.957019 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53d7cd5a-1164-44f7-90e4-8274e634d5c3 None admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:45:25.957748 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG dbcounter [-] [80396] Writing DB stats keystone:SELECT=100 {{(pid=80396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:45:25.968696 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a606b7f9-3303-46d5-9ced-13926816b35b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:45:25.969363 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a606b7f9-3303-46d5-9ced-13926816b35b None admin] REQUEST_METHOD: `GET` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:45:25.969934 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a606b7f9-3303-46d5-9ced-13926816b35b None admin] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:45:25.969934 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a606b7f9-3303-46d5-9ced-13926816b35b None admin] PATH_INFO: `/v3/roles` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:45:25.970753 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a606b7f9-3303-46d5-9ced-13926816b35b None admin] RBAC: Adding query filter params (name=member) {{(pid=80396) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 15:45:25.971064 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a606b7f9-3303-46d5-9ced-13926816b35b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:45:25.972432 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a606b7f9-3303-46d5-9ced-13926816b35b None admin] RBAC: Authorization granted {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:45:25.980675 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 60/119] 10.222.0.59 () {56 vars in 1101 bytes} [Thu Jun 2 15:45:25 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 15:45:25.983060 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a606b7f9-3303-46d5-9ced-13926816b35b None admin] Authenticating user token {{(pid=80396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:45:25.990939 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a7e2fc3-ba19-4475-b73f-e5d90737ee68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:45:25.991812 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a7e2fc3-ba19-4475-b73f-e5d90737ee68 None admin] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:45:25.992097 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a7e2fc3-ba19-4475-b73f-e5d90737ee68 None admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:45:25.992374 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a7e2fc3-ba19-4475-b73f-e5d90737ee68 None admin] PATH_INFO: `/v3/users/400d1f4db9de49638549e5db29a041e1` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:45:25.993564 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a7e2fc3-ba19-4475-b73f-e5d90737ee68 None admin] RBAC: Authorizing `identity:get_user(user_id=400d1f4db9de49638549e5db29a041e1)` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:45:25.995088 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a7e2fc3-ba19-4475-b73f-e5d90737ee68 None admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:45:25.996708 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 60/120] 10.222.0.59 () {56 vars in 1177 bytes} [Thu Jun 2 15:45:25 2022] GET /identity/v3/users/400d1f4db9de49638549e5db29a041e1 => generated 247 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 15:45:25.997458 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a7e2fc3-ba19-4475-b73f-e5d90737ee68 None admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:45:26.074505 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writing DB stats keystone:SELECT=100 {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:45:26.084754 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a606b7f9-3303-46d5-9ced-13926816b35b None admin] Validating token access rules against request {{(pid=80396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:45:26.096967 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a7e2fc3-ba19-4475-b73f-e5d90737ee68 None admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:45:26.118450 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7668c1a0-3b9a-49b0-b234-07089b1bbb98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:45:26.119238 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7668c1a0-3b9a-49b0-b234-07089b1bbb98 None admin] REQUEST_METHOD: `GET` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:45:26.119525 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7668c1a0-3b9a-49b0-b234-07089b1bbb98 None admin] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:45:26.119800 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7668c1a0-3b9a-49b0-b234-07089b1bbb98 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:45:26.121574 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7668c1a0-3b9a-49b0-b234-07089b1bbb98 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:45:26.123061 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7668c1a0-3b9a-49b0-b234-07089b1bbb98 None admin] RBAC: Authorization granted {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:45:26.124883 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 61/121] 10.222.0.59 () {56 vars in 1108 bytes} [Thu Jun 2 15:45:25 2022] GET /identity/v3/domains/default => generated 199 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 15:45:26.125802 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0edb280-834d-47e7-92ac-df0c578684c0 None None] REQUEST_METHOD: `POST` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:45:26.126108 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0edb280-834d-47e7-92ac-df0c578684c0 None None] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:45:26.126398 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0edb280-834d-47e7-92ac-df0c578684c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:45:26.131192 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c82e0d8-aca2-41dd-a5c1-7fc83c660354 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:45:26.132067 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c82e0d8-aca2-41dd-a5c1-7fc83c660354 None admin] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:45:26.132351 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c82e0d8-aca2-41dd-a5c1-7fc83c660354 None admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:45:26.132631 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c82e0d8-aca2-41dd-a5c1-7fc83c660354 None admin] PATH_INFO: `/v3/users/8defb7300e7949f180b3f6ccd787ddf9` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:45:26.133827 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c82e0d8-aca2-41dd-a5c1-7fc83c660354 None admin] RBAC: Authorizing `identity:get_user(user_id=8defb7300e7949f180b3f6ccd787ddf9)` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:45:26.135405 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c82e0d8-aca2-41dd-a5c1-7fc83c660354 None admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:45:26.138014 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 61/122] 10.222.0.59 () {56 vars in 1177 bytes} [Thu Jun 2 15:45:25 2022] GET /identity/v3/users/8defb7300e7949f180b3f6ccd787ddf9 => generated 275 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 15:45:26.138672 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c82e0d8-aca2-41dd-a5c1-7fc83c660354 None admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:45:26.144433 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.auth.core [None req-e0edb280-834d-47e7-92ac-df0c578684c0 None None] MFA Rules not processed for user `400d1f4db9de49638549e5db29a041e1`. Rule list: `[]` (Enabled: `True`). {{(pid=80396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 15:45:26.145650 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.fernet_utils [None req-e0edb280-834d-47e7-92ac-df0c578684c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 15:45:26.197380 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG dbcounter [-] [80396] Writing DB stats keystone:SELECT=100 {{(pid=80396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:45:26.216463 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 62/123] 10.222.0.59 () {58 vars in 1023 bytes} [Thu Jun 2 15:45:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 02 15:45:26.217353 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0edb280-834d-47e7-92ac-df0c578684c0 None None] Authenticating user token {{(pid=80396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:45:26.247197 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c82e0d8-aca2-41dd-a5c1-7fc83c660354 None admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:45:26.279801 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0889a6c-5ae6-42cc-9df1-77cc2ca1fafb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:45:26.280451 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0889a6c-5ae6-42cc-9df1-77cc2ca1fafb None admin] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:45:26.280738 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0889a6c-5ae6-42cc-9df1-77cc2ca1fafb None admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:45:26.281016 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0889a6c-5ae6-42cc-9df1-77cc2ca1fafb None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:45:26.281842 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0889a6c-5ae6-42cc-9df1-77cc2ca1fafb None admin] RBAC: Adding query filter params (role.id=67885c18a3dc47718e9197097185f65d, scope.project.id=06e0633a47e74dcfaeccc8794206da96, user.id=1629872dae1a4839b87027263d77e419) {{(pid=80395) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 15:45:26.282190 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0889a6c-5ae6-42cc-9df1-77cc2ca1fafb None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:45:26.283679 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0889a6c-5ae6-42cc-9df1-77cc2ca1fafb None admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:45:26.288993 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 62/124] 10.222.0.59 () {56 vars in 1374 bytes} [Thu Jun 2 15:45:26 2022] GET /identity/v3/role_assignments?user.id=1629872dae1a4839b87027263d77e419&scope.project.id=06e0633a47e74dcfaeccc8794206da96&role.id=67885c18a3dc47718e9197097185f65d => generated 259 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 15:45:26.290888 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0889a6c-5ae6-42cc-9df1-77cc2ca1fafb None admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:45:26.306502 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writing DB stats keystone:SELECT=100 {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:45:26.319881 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0edb280-834d-47e7-92ac-df0c578684c0 None None] Validating token access rules against request {{(pid=80396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:45:26.365210 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8bc8088-4533-4bd6-a0cd-0268b8003847 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:45:26.366035 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8bc8088-4533-4bd6-a0cd-0268b8003847 None admin] REQUEST_METHOD: `GET` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:45:26.366335 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8bc8088-4533-4bd6-a0cd-0268b8003847 None admin] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:45:26.366615 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8bc8088-4533-4bd6-a0cd-0268b8003847 None admin] PATH_INFO: `/v3/users/8defb7300e7949f180b3f6ccd787ddf9` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:45:26.368383 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8bc8088-4533-4bd6-a0cd-0268b8003847 None admin] RBAC: Authorizing `identity:get_user(user_id=8defb7300e7949f180b3f6ccd787ddf9)` {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:45:26.370160 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8bc8088-4533-4bd6-a0cd-0268b8003847 None admin] RBAC: Authorization granted {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:45:26.372392 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 63/125] 10.222.0.59 () {56 vars in 1177 bytes} [Thu Jun 2 15:45:26 2022] GET /identity/v3/users/8defb7300e7949f180b3f6ccd787ddf9 => generated 275 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 15:45:26.377991 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8bc8088-4533-4bd6-a0cd-0268b8003847 None admin] Authenticating user token {{(pid=80396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:45:26.405531 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0889a6c-5ae6-42cc-9df1-77cc2ca1fafb None admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:45:26.441956 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG dbcounter [-] [80396] Writing DB stats keystone:SELECT=100 {{(pid=80396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:45:26.442204 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b1b2e04-3f34-4e4d-af08-ef4cd0ee4ae9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:45:26.442935 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1b2e04-3f34-4e4d-af08-ef4cd0ee4ae9 None admin] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:45:26.443220 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1b2e04-3f34-4e4d-af08-ef4cd0ee4ae9 None admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:45:26.443494 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1b2e04-3f34-4e4d-af08-ef4cd0ee4ae9 None admin] PATH_INFO: `/v3/projects/06e0633a47e74dcfaeccc8794206da96` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:45:26.444745 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b1b2e04-3f34-4e4d-af08-ef4cd0ee4ae9 None admin] RBAC: Authorizing `identity:get_project(project_id=06e0633a47e74dcfaeccc8794206da96)` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:45:26.446266 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b1b2e04-3f34-4e4d-af08-ef4cd0ee4ae9 None admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:45:26.454130 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 63/126] 10.222.0.59 () {56 vars in 1186 bytes} [Thu Jun 2 15:45:26 2022] GET /identity/v3/projects/06e0633a47e74dcfaeccc8794206da96 => generated 298 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 15:45:26.454130 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b1b2e04-3f34-4e4d-af08-ef4cd0ee4ae9 None admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:45:26.511445 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8bc8088-4533-4bd6-a0cd-0268b8003847 None admin] Validating token access rules against request {{(pid=80396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:45:26.534018 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writing DB stats keystone:SELECT=100 {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:45:26.548636 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a75439d1-feea-434e-b420-9c4ec4baa544 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:45:26.549168 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a75439d1-feea-434e-b420-9c4ec4baa544 None admin] REQUEST_METHOD: `POST` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:45:26.549457 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a75439d1-feea-434e-b420-9c4ec4baa544 None admin] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:45:26.549745 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a75439d1-feea-434e-b420-9c4ec4baa544 None admin] PATH_INFO: `/v3/projects` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:45:26.550498 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a75439d1-feea-434e-b420-9c4ec4baa544 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:45:26.551956 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a75439d1-feea-434e-b420-9c4ec4baa544 None admin] RBAC: Authorization granted {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:45:26.559187 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b1b2e04-3f34-4e4d-af08-ef4cd0ee4ae9 None admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:45:26.594748 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a593a15-3336-4966-8499-5cc893a9889c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:45:26.595599 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a593a15-3336-4966-8499-5cc893a9889c None admin] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:45:26.595884 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a593a15-3336-4966-8499-5cc893a9889c None admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:45:26.596161 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a593a15-3336-4966-8499-5cc893a9889c None admin] PATH_INFO: `/v3/projects/06e0633a47e74dcfaeccc8794206da96` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:45:26.597330 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a593a15-3336-4966-8499-5cc893a9889c None admin] RBAC: Authorizing `identity:get_project(project_id=06e0633a47e74dcfaeccc8794206da96)` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:45:26.598803 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a593a15-3336-4966-8499-5cc893a9889c None admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:45:26.600471 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 64/127] 10.222.0.59 () {56 vars in 1186 bytes} [Thu Jun 2 15:45:26 2022] GET /identity/v3/projects/06e0633a47e74dcfaeccc8794206da96 => generated 298 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 15:45:26.601227 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a593a15-3336-4966-8499-5cc893a9889c None admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:45:26.643209 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 64/128] 10.222.0.59 () {60 vars in 1141 bytes} [Thu Jun 2 15:45:26 2022] POST /identity/v3/projects => generated 302 bytes in 265 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 15:45:26.643783 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a75439d1-feea-434e-b420-9c4ec4baa544 None admin] Authenticating user token {{(pid=80396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:45:26.744683 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a593a15-3336-4966-8499-5cc893a9889c None admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:45:26.764311 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a75439d1-feea-434e-b420-9c4ec4baa544 None admin] Validating token access rules against request {{(pid=80396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:45:26.767924 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG dbcounter [-] [80396] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:45:26.799857 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffc5d49c-212d-4ef9-9fd9-f967e0fd3efa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:45:26.801658 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc5d49c-212d-4ef9-9fd9-f967e0fd3efa None admin] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:45:26.802370 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc5d49c-212d-4ef9-9fd9-f967e0fd3efa None admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:45:26.803009 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc5d49c-212d-4ef9-9fd9-f967e0fd3efa None admin] PATH_INFO: `/v3/roles/member` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:45:26.805132 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c599ba0-791b-4535-9baf-8ed3d312d91a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:45:26.806001 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c599ba0-791b-4535-9baf-8ed3d312d91a None admin] REQUEST_METHOD: `GET` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:45:26.806357 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c599ba0-791b-4535-9baf-8ed3d312d91a None admin] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:45:26.806638 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c599ba0-791b-4535-9baf-8ed3d312d91a None admin] PATH_INFO: `/v3/projects/06e0633a47e74dcfaeccc8794206da96` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:45:26.808089 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c599ba0-791b-4535-9baf-8ed3d312d91a None admin] RBAC: Authorizing `identity:get_project(project_id=06e0633a47e74dcfaeccc8794206da96)` {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:45:26.809585 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c599ba0-791b-4535-9baf-8ed3d312d91a None admin] RBAC: Authorization granted {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:45:26.816468 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 65/129] 10.222.0.59 () {56 vars in 1186 bytes} [Thu Jun 2 15:45:26 2022] GET /identity/v3/projects/06e0633a47e74dcfaeccc8794206da96 => generated 298 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 15:45:26.816468 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c599ba0-791b-4535-9baf-8ed3d312d91a None admin] Authenticating user token {{(pid=80396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:45:26.827240 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffc5d49c-212d-4ef9-9fd9-f967e0fd3efa None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 02 15:45:26.839644 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application [None req-ffc5d49c-212d-4ef9-9fd9-f967e0fd3efa None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 02 15:45:26.839644 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 15:45:26.839644 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 15:45:26.839644 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 15:45:26.839644 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 15:45:26.839644 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 15:45:26.839644 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 15:45:26.839644 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 15:45:26.839644 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 15:45:26.839644 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 15:45:26.839644 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 15:45:26.839644 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 15:45:26.839644 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 02 15:45:26.839644 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 02 15:45:26.839644 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 02 15:45:26.839644 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 02 15:45:26.840750 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 02 15:45:26.840750 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 02 15:45:26.840750 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 02 15:45:26.840750 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 02 15:45:26.840750 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 15:45:26.840750 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 15:45:26.840750 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 15:45:26.840750 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 15:45:26.840750 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 15:45:26.840750 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 15:45:26.840750 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 15:45:26.840750 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application with Lock( Jun 02 15:45:26.840750 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 15:45:26.840750 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self._enter() Jun 02 15:45:26.840750 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 15:45:26.840750 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 15:45:26.841714 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 15:45:26.841714 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self.creator() Jun 02 15:45:26.841714 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 15:45:26.841714 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application created_value = creator( Jun 02 15:45:26.841714 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 02 15:45:26.841714 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 02 15:45:26.841714 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 02 15:45:26.841714 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 02 15:45:26.841714 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 02 15:45:26.841714 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 02 15:45:26.841714 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 02 15:45:26.841714 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application Jun 02 15:45:26.848351 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 65/130] 10.222.0.59 () {56 vars in 1099 bytes} [Thu Jun 2 15:45:26 2022] GET /identity/v3/roles/member => generated 84 bytes in 243 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 15:45:26.848351 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffc5d49c-212d-4ef9-9fd9-f967e0fd3efa None admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:45:26.854436 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writing DB stats keystone:SELECT=100 {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:45:26.963547 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c599ba0-791b-4535-9baf-8ed3d312d91a None admin] Validating token access rules against request {{(pid=80396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:45:26.968697 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffc5d49c-212d-4ef9-9fd9-f967e0fd3efa None admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:45:27.006024 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-695f8890-00bc-4bea-a77d-b039018ac364 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:45:27.007136 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-695f8890-00bc-4bea-a77d-b039018ac364 None admin] REQUEST_METHOD: `PUT` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:45:27.007539 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-695f8890-00bc-4bea-a77d-b039018ac364 None admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:45:27.007925 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-695f8890-00bc-4bea-a77d-b039018ac364 None admin] PATH_INFO: `/v3/projects/06e0633a47e74dcfaeccc8794206da96/users/8defb7300e7949f180b3f6ccd787ddf9/roles/21f49b1aa1e64120b7ef6fcf4667a641` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:45:27.010409 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-695f8890-00bc-4bea-a77d-b039018ac364 None admin] RBAC: Authorizing `identity:create_grant(project_id=06e0633a47e74dcfaeccc8794206da96, user_id=8defb7300e7949f180b3f6ccd787ddf9, role_id=21f49b1aa1e64120b7ef6fcf4667a641)` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:45:27.011483 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-618f59e6-711e-4c0f-a670-35ace6f0d62c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:45:27.012258 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-695f8890-00bc-4bea-a77d-b039018ac364 None admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:45:27.012742 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618f59e6-711e-4c0f-a670-35ace6f0d62c None admin] REQUEST_METHOD: `PUT` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:45:27.013172 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618f59e6-711e-4c0f-a670-35ace6f0d62c None admin] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:45:27.013603 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618f59e6-711e-4c0f-a670-35ace6f0d62c None admin] PATH_INFO: `/v3/projects/06e0633a47e74dcfaeccc8794206da96/users/400d1f4db9de49638549e5db29a041e1/roles/f1e0c25f6e9049e897cb7350c7e54ab3` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:45:27.016237 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-618f59e6-711e-4c0f-a670-35ace6f0d62c None admin] RBAC: Authorizing `identity:create_grant(project_id=06e0633a47e74dcfaeccc8794206da96, user_id=400d1f4db9de49638549e5db29a041e1, role_id=f1e0c25f6e9049e897cb7350c7e54ab3)` {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:45:27.019104 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-618f59e6-711e-4c0f-a670-35ace6f0d62c None admin] RBAC: Authorization granted {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:45:27.098907 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 66/131] 10.222.0.59 () {58 vars in 1439 bytes} [Thu Jun 2 15:45:26 2022] PUT /identity/v3/projects/06e0633a47e74dcfaeccc8794206da96/users/8defb7300e7949f180b3f6ccd787ddf9/roles/21f49b1aa1e64120b7ef6fcf4667a641 => generated 0 bytes in 252 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 15:45:27.100061 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-695f8890-00bc-4bea-a77d-b039018ac364 None admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:45:27.128447 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 66/132] 10.222.0.59 () {58 vars in 1439 bytes} [Thu Jun 2 15:45:26 2022] PUT /identity/v3/projects/06e0633a47e74dcfaeccc8794206da96/users/400d1f4db9de49638549e5db29a041e1/roles/f1e0c25f6e9049e897cb7350c7e54ab3 => generated 0 bytes in 316 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 15:45:27.129380 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-618f59e6-711e-4c0f-a670-35ace6f0d62c None admin] Authenticating user token {{(pid=80396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:45:27.201287 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG dbcounter [-] [80396] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:45:27.275447 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:45:27.346571 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-618f59e6-711e-4c0f-a670-35ace6f0d62c None admin] Validating token access rules against request {{(pid=80396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:45:27.359697 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-695f8890-00bc-4bea-a77d-b039018ac364 None admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:45:27.417277 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1af3862e-e6e7-472c-8525-5b1e06fc1baf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:45:27.418968 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af3862e-e6e7-472c-8525-5b1e06fc1baf None admin] REQUEST_METHOD: `GET` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:45:27.419415 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af3862e-e6e7-472c-8525-5b1e06fc1baf None admin] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:45:27.419843 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af3862e-e6e7-472c-8525-5b1e06fc1baf None admin] PATH_INFO: `/v3/roles` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:45:27.420769 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1af3862e-e6e7-472c-8525-5b1e06fc1baf None admin] RBAC: Adding query filter params (name=member) {{(pid=80396) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 15:45:27.421284 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1af3862e-e6e7-472c-8525-5b1e06fc1baf None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:45:27.425645 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1af3862e-e6e7-472c-8525-5b1e06fc1baf None admin] RBAC: Authorization granted {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:45:27.428001 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a97f68b7-37f0-401c-ae75-cfa6b3fd41da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:45:27.429131 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97f68b7-37f0-401c-ae75-cfa6b3fd41da None admin] REQUEST_METHOD: `PUT` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:45:27.429516 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97f68b7-37f0-401c-ae75-cfa6b3fd41da None admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:45:27.429899 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97f68b7-37f0-401c-ae75-cfa6b3fd41da None admin] PATH_INFO: `/v3/projects/06e0633a47e74dcfaeccc8794206da96/users/8defb7300e7949f180b3f6ccd787ddf9/roles/649e0f2b5a264c419ea6a1441f123a03` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:45:27.435711 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a97f68b7-37f0-401c-ae75-cfa6b3fd41da None admin] RBAC: Authorizing `identity:create_grant(project_id=06e0633a47e74dcfaeccc8794206da96, user_id=8defb7300e7949f180b3f6ccd787ddf9, role_id=649e0f2b5a264c419ea6a1441f123a03)` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:45:27.436916 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 67/133] 10.222.0.59 () {56 vars in 1101 bytes} [Thu Jun 2 15:45:27 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 308 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 15:45:27.437454 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a97f68b7-37f0-401c-ae75-cfa6b3fd41da None admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:45:27.443085 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1af3862e-e6e7-472c-8525-5b1e06fc1baf None admin] Authenticating user token {{(pid=80396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:45:27.505901 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 67/134] 10.222.0.59 () {58 vars in 1439 bytes} [Thu Jun 2 15:45:27 2022] PUT /identity/v3/projects/06e0633a47e74dcfaeccc8794206da96/users/8defb7300e7949f180b3f6ccd787ddf9/roles/649e0f2b5a264c419ea6a1441f123a03 => generated 0 bytes in 406 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 15:45:27.565603 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG dbcounter [-] [80396] Writing DB stats keystone:SELECT=100 {{(pid=80396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:45:27.574396 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1af3862e-e6e7-472c-8525-5b1e06fc1baf None admin] Validating token access rules against request {{(pid=80396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:45:27.622328 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c73661ca-1b43-4b51-8d7b-e690c2d3ebab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:45:27.623234 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73661ca-1b43-4b51-8d7b-e690c2d3ebab None admin] REQUEST_METHOD: `GET` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:45:27.623523 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73661ca-1b43-4b51-8d7b-e690c2d3ebab None admin] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:45:27.623801 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73661ca-1b43-4b51-8d7b-e690c2d3ebab None admin] PATH_INFO: `/v3/users/8defb7300e7949f180b3f6ccd787ddf9` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:45:27.625114 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c73661ca-1b43-4b51-8d7b-e690c2d3ebab None admin] RBAC: Authorizing `identity:get_user(user_id=8defb7300e7949f180b3f6ccd787ddf9)` {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:45:27.626632 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c73661ca-1b43-4b51-8d7b-e690c2d3ebab None admin] RBAC: Authorization granted {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:45:27.628305 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 68/135] 10.222.0.59 () {56 vars in 1177 bytes} [Thu Jun 2 15:45:27 2022] GET /identity/v3/users/8defb7300e7949f180b3f6ccd787ddf9 => generated 275 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 15:45:27.634055 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a97f68b7-37f0-401c-ae75-cfa6b3fd41da None admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:45:27.778471 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a97f68b7-37f0-401c-ae75-cfa6b3fd41da None admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:45:27.815078 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:45:27.830793 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50ccb6b1-672c-45e5-8e65-581d3eb79aa4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:45:27.831980 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ccb6b1-672c-45e5-8e65-581d3eb79aa4 None admin] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:45:27.832460 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ccb6b1-672c-45e5-8e65-581d3eb79aa4 None admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:45:27.833006 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ccb6b1-672c-45e5-8e65-581d3eb79aa4 None admin] PATH_INFO: `/v3/projects/5163f93e22c4458ab0ec98d8dc486c1f` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:45:27.836048 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50ccb6b1-672c-45e5-8e65-581d3eb79aa4 None admin] RBAC: Authorizing `identity:get_project(project_id=5163f93e22c4458ab0ec98d8dc486c1f)` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:45:27.837552 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50ccb6b1-672c-45e5-8e65-581d3eb79aa4 None admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:45:27.840526 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 68/136] 10.222.0.59 () {56 vars in 1186 bytes} [Thu Jun 2 15:45:27 2022] GET /identity/v3/projects/5163f93e22c4458ab0ec98d8dc486c1f => generated 312 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 15:45:27.846272 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c73661ca-1b43-4b51-8d7b-e690c2d3ebab None admin] Authenticating user token {{(pid=80396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:45:27.954288 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c73661ca-1b43-4b51-8d7b-e690c2d3ebab None admin] Validating token access rules against request {{(pid=80396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:45:27.989755 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b37f2f58-4448-4d64-b7d0-b4521c9fa7c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:45:27.990683 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b37f2f58-4448-4d64-b7d0-b4521c9fa7c9 None admin] REQUEST_METHOD: `PUT` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:45:27.990969 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b37f2f58-4448-4d64-b7d0-b4521c9fa7c9 None admin] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:45:27.991247 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b37f2f58-4448-4d64-b7d0-b4521c9fa7c9 None admin] PATH_INFO: `/v3/projects/5163f93e22c4458ab0ec98d8dc486c1f/users/8defb7300e7949f180b3f6ccd787ddf9/roles/649e0f2b5a264c419ea6a1441f123a03` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:45:27.993219 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b37f2f58-4448-4d64-b7d0-b4521c9fa7c9 None admin] RBAC: Authorizing `identity:create_grant(project_id=5163f93e22c4458ab0ec98d8dc486c1f, user_id=8defb7300e7949f180b3f6ccd787ddf9, role_id=649e0f2b5a264c419ea6a1441f123a03)` {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:45:27.994688 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b37f2f58-4448-4d64-b7d0-b4521c9fa7c9 None admin] RBAC: Authorization granted {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:45:28.075977 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 69/137] 10.222.0.59 () {58 vars in 1439 bytes} [Thu Jun 2 15:45:27 2022] PUT /identity/v3/projects/5163f93e22c4458ab0ec98d8dc486c1f/users/8defb7300e7949f180b3f6ccd787ddf9/roles/649e0f2b5a264c419ea6a1441f123a03 => generated 0 bytes in 230 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 15:45:29.369078 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9419fe57-0bab-4ead-a630-334b8a1af4ee None None] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:45:29.369607 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9419fe57-0bab-4ead-a630-334b8a1af4ee None None] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:45:29.370222 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9419fe57-0bab-4ead-a630-334b8a1af4ee None None] PATH_INFO: `/` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:45:29.371811 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 69/138] 10.222.0.59 () {54 vars in 926 bytes} [Thu Jun 2 15:45:29 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 15:45:29.388520 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259f8431-d303-400c-861c-1cb682020bc0 None None] REQUEST_METHOD: `POST` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:45:29.389087 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259f8431-d303-400c-861c-1cb682020bc0 None None] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:45:29.389087 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259f8431-d303-400c-861c-1cb682020bc0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:45:29.410184 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.auth.core [None req-259f8431-d303-400c-861c-1cb682020bc0 None None] MFA Rules not processed for user `400d1f4db9de49638549e5db29a041e1`. Rule list: `[]` (Enabled: `True`). {{(pid=80396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 15:45:29.411387 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.fernet_utils [None req-259f8431-d303-400c-861c-1cb682020bc0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 15:45:29.428967 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG dbcounter [-] [80396] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:45:29.504260 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 70/139] 10.222.0.59 () {58 vars in 1023 bytes} [Thu Jun 2 15:45:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 02 15:45:29.546812 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9419fe57-0bab-4ead-a630-334b8a1af4ee None None] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:45:29.667219 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9419fe57-0bab-4ead-a630-334b8a1af4ee None None] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:45:29.704149 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70563276-a73b-4d8a-ac76-5cb5c10d7be4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:45:29.704881 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70563276-a73b-4d8a-ac76-5cb5c10d7be4 None admin] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:45:29.705163 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70563276-a73b-4d8a-ac76-5cb5c10d7be4 None admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:45:29.705440 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70563276-a73b-4d8a-ac76-5cb5c10d7be4 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:45:29.717991 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70563276-a73b-4d8a-ac76-5cb5c10d7be4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 02 15:45:29.725846 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application [None req-70563276-a73b-4d8a-ac76-5cb5c10d7be4 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 02 15:45:29.725846 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 15:45:29.725846 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 15:45:29.725846 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 15:45:29.725846 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 15:45:29.725846 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 15:45:29.725846 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 15:45:29.725846 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 15:45:29.725846 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 15:45:29.725846 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 15:45:29.725846 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 15:45:29.725846 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 15:45:29.725846 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 02 15:45:29.725846 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 02 15:45:29.725846 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 02 15:45:29.725846 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 02 15:45:29.726728 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 02 15:45:29.726728 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 02 15:45:29.726728 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 02 15:45:29.726728 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 02 15:45:29.726728 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 15:45:29.726728 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 15:45:29.726728 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 15:45:29.726728 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 15:45:29.726728 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 15:45:29.726728 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 15:45:29.726728 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 15:45:29.726728 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application with Lock( Jun 02 15:45:29.726728 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 15:45:29.726728 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self._enter() Jun 02 15:45:29.726728 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 15:45:29.726728 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 15:45:29.727469 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 15:45:29.727469 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self.creator() Jun 02 15:45:29.727469 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 15:45:29.727469 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application created_value = creator( Jun 02 15:45:29.727469 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 02 15:45:29.727469 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 02 15:45:29.727469 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 02 15:45:29.727469 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 02 15:45:29.727469 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 02 15:45:29.727469 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 02 15:45:29.727469 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 02 15:45:29.727469 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application Jun 02 15:45:29.727469 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 70/140] 10.222.0.59 () {56 vars in 1099 bytes} [Thu Jun 2 15:45:29 2022] GET /identity/v3/roles/reader => generated 84 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 15:45:29.733432 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-259f8431-d303-400c-861c-1cb682020bc0 None None] Authenticating user token {{(pid=80396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:45:29.874001 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-259f8431-d303-400c-861c-1cb682020bc0 None None] Validating token access rules against request {{(pid=80396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:45:29.909418 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b80c2430-7b43-400f-8738-7e5a2b912979 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:45:29.910109 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b80c2430-7b43-400f-8738-7e5a2b912979 None admin] REQUEST_METHOD: `GET` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:45:29.910405 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b80c2430-7b43-400f-8738-7e5a2b912979 None admin] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:45:29.910684 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b80c2430-7b43-400f-8738-7e5a2b912979 None admin] PATH_INFO: `/v3/roles` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:45:29.911453 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b80c2430-7b43-400f-8738-7e5a2b912979 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80396) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 15:45:29.911762 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b80c2430-7b43-400f-8738-7e5a2b912979 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:45:29.913143 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b80c2430-7b43-400f-8738-7e5a2b912979 None admin] RBAC: Authorization granted {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:45:29.926383 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 71/141] 10.222.0.59 () {56 vars in 1101 bytes} [Thu Jun 2 15:45:29 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 15:45:29.928104 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70563276-a73b-4d8a-ac76-5cb5c10d7be4 None admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:45:30.012296 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writing DB stats keystone:SELECT=100 {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:45:30.028858 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09829ef2-e19a-4ebf-996c-a7fb3aa6d98c None None] REQUEST_METHOD: `GET` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:45:30.029168 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09829ef2-e19a-4ebf-996c-a7fb3aa6d98c None None] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:45:30.029451 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09829ef2-e19a-4ebf-996c-a7fb3aa6d98c None None] PATH_INFO: `/` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:45:30.030997 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 72/142] 10.222.0.59 () {54 vars in 926 bytes} [Thu Jun 2 15:45:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 02 15:45:30.039365 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcbaf9d5-212c-4ba9-ad9d-f40c0296686e None None] REQUEST_METHOD: `POST` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:45:30.039654 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcbaf9d5-212c-4ba9-ad9d-f40c0296686e None None] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:45:30.039938 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcbaf9d5-212c-4ba9-ad9d-f40c0296686e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:45:30.067945 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.auth.core [None req-fcbaf9d5-212c-4ba9-ad9d-f40c0296686e None None] MFA Rules not processed for user `400d1f4db9de49638549e5db29a041e1`. Rule list: `[]` (Enabled: `True`). {{(pid=80396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 15:45:30.069170 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.fernet_utils [None req-fcbaf9d5-212c-4ba9-ad9d-f40c0296686e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 15:45:30.078846 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70563276-a73b-4d8a-ac76-5cb5c10d7be4 None admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:45:30.090200 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG dbcounter [-] [80396] Writing DB stats keystone:SELECT=100 {{(pid=80396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:45:30.154380 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b0d2f82-5fe8-44b8-a152-bd2aefda0438 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:45:30.155258 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0d2f82-5fe8-44b8-a152-bd2aefda0438 None admin] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:45:30.155645 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0d2f82-5fe8-44b8-a152-bd2aefda0438 None admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:45:30.155938 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0d2f82-5fe8-44b8-a152-bd2aefda0438 None admin] PATH_INFO: `/v3/users/1629872dae1a4839b87027263d77e419` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:45:30.157225 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b0d2f82-5fe8-44b8-a152-bd2aefda0438 None admin] RBAC: Authorizing `identity:get_user(user_id=1629872dae1a4839b87027263d77e419)` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:45:30.158749 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b0d2f82-5fe8-44b8-a152-bd2aefda0438 None admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:45:30.162687 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 71/143] 10.222.0.59 () {56 vars in 1177 bytes} [Thu Jun 2 15:45:29 2022] GET /identity/v3/users/1629872dae1a4839b87027263d77e419 => generated 289 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 15:45:30.171611 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b0d2f82-5fe8-44b8-a152-bd2aefda0438 None admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:45:30.196399 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 73/144] 10.222.0.59 () {58 vars in 1023 bytes} [Thu Jun 2 15:45:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 363 bytes (3 switches on core 0) Jun 02 15:45:30.247612 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c02894-c75b-4f44-bbc6-fbc521d9d331 None None] REQUEST_METHOD: `GET` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:45:30.247917 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c02894-c75b-4f44-bbc6-fbc521d9d331 None None] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:45:30.248178 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c02894-c75b-4f44-bbc6-fbc521d9d331 None None] PATH_INFO: `/` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:45:30.249681 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 74/145] 10.222.0.59 () {54 vars in 926 bytes} [Thu Jun 2 15:45:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 02 15:45:30.255210 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303fc23c-f051-491d-b200-5317d8db3957 None None] REQUEST_METHOD: `POST` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:45:30.255804 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303fc23c-f051-491d-b200-5317d8db3957 None None] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:45:30.256371 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303fc23c-f051-491d-b200-5317d8db3957 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:45:30.277063 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.auth.core [None req-303fc23c-f051-491d-b200-5317d8db3957 None None] MFA Rules not processed for user `400d1f4db9de49638549e5db29a041e1`. Rule list: `[]` (Enabled: `True`). {{(pid=80396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 15:45:30.278652 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.fernet_utils [None req-303fc23c-f051-491d-b200-5317d8db3957 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 15:45:30.311198 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b0d2f82-5fe8-44b8-a152-bd2aefda0438 None admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:45:30.333589 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writing DB stats keystone:SELECT=100 {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:45:30.349155 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a7fd84-7224-47e9-b55d-d7bb4d11bd8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:45:30.350307 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a7fd84-7224-47e9-b55d-d7bb4d11bd8b None admin] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:45:30.350731 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a7fd84-7224-47e9-b55d-d7bb4d11bd8b None admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:45:30.351169 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a7fd84-7224-47e9-b55d-d7bb4d11bd8b None admin] PATH_INFO: `/v3/projects/06e0633a47e74dcfaeccc8794206da96` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:45:30.352821 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86a7fd84-7224-47e9-b55d-d7bb4d11bd8b None admin] RBAC: Authorizing `identity:get_project(project_id=06e0633a47e74dcfaeccc8794206da96)` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:45:30.355130 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86a7fd84-7224-47e9-b55d-d7bb4d11bd8b None admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:45:30.357304 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 72/146] 10.222.0.59 () {56 vars in 1186 bytes} [Thu Jun 2 15:45:30 2022] GET /identity/v3/projects/06e0633a47e74dcfaeccc8794206da96 => generated 298 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 15:45:30.358535 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a7fd84-7224-47e9-b55d-d7bb4d11bd8b None admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:45:30.364691 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 75/147] 10.222.0.59 () {58 vars in 1023 bytes} [Thu Jun 2 15:45:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 02 15:45:30.374105 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-303fc23c-f051-491d-b200-5317d8db3957 None None] Authenticating user token {{(pid=80396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:45:30.460954 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG dbcounter [-] [80396] Writing DB stats keystone:SELECT=100 {{(pid=80396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:45:30.492762 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-303fc23c-f051-491d-b200-5317d8db3957 None None] Validating token access rules against request {{(pid=80396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:45:30.548917 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bc486ac-4ab8-40af-928d-26ae49462853 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:45:30.549730 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc486ac-4ab8-40af-928d-26ae49462853 None admin] REQUEST_METHOD: `PUT` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:45:30.550008 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc486ac-4ab8-40af-928d-26ae49462853 None admin] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:45:30.550303 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc486ac-4ab8-40af-928d-26ae49462853 None admin] PATH_INFO: `/v3/projects/06e0633a47e74dcfaeccc8794206da96/users/1629872dae1a4839b87027263d77e419/roles/67885c18a3dc47718e9197097185f65d` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:45:30.553435 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bc486ac-4ab8-40af-928d-26ae49462853 None admin] RBAC: Authorizing `identity:create_grant(project_id=06e0633a47e74dcfaeccc8794206da96, user_id=1629872dae1a4839b87027263d77e419, role_id=67885c18a3dc47718e9197097185f65d)` {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:45:30.554902 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bc486ac-4ab8-40af-928d-26ae49462853 None admin] RBAC: Authorization granted {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:45:30.559278 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a7fd84-7224-47e9-b55d-d7bb4d11bd8b None admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:45:30.595702 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55974d87-8a4b-4a8b-8b60-84965aa519b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:45:30.596538 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55974d87-8a4b-4a8b-8b60-84965aa519b0 None admin] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:45:30.596825 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55974d87-8a4b-4a8b-8b60-84965aa519b0 None admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:45:30.597098 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55974d87-8a4b-4a8b-8b60-84965aa519b0 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:45:30.598406 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55974d87-8a4b-4a8b-8b60-84965aa519b0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:45:30.599902 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55974d87-8a4b-4a8b-8b60-84965aa519b0 None admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:45:30.601765 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 73/148] 10.222.0.59 () {56 vars in 1108 bytes} [Thu Jun 2 15:45:30 2022] GET /identity/v3/domains/default => generated 199 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 15:45:30.602380 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55974d87-8a4b-4a8b-8b60-84965aa519b0 None admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:45:30.651003 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 76/149] 10.222.0.59 () {58 vars in 1439 bytes} [Thu Jun 2 15:45:30 2022] PUT /identity/v3/projects/06e0633a47e74dcfaeccc8794206da96/users/1629872dae1a4839b87027263d77e419/roles/67885c18a3dc47718e9197097185f65d => generated 0 bytes in 284 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 15:45:30.658229 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1945f01-70c5-43be-b539-43197d833982 None None] REQUEST_METHOD: `GET` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:45:30.660813 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1945f01-70c5-43be-b539-43197d833982 None None] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:45:30.661411 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1945f01-70c5-43be-b539-43197d833982 None None] PATH_INFO: `/` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:45:30.670463 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 77/150] 10.222.0.59 () {54 vars in 926 bytes} [Thu Jun 2 15:45:30 2022] GET /identity => generated 270 bytes in 19 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 15:45:30.671785 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1945f01-70c5-43be-b539-43197d833982 None None] Authenticating user token {{(pid=80396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:45:30.700205 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writing DB stats keystone:SELECT=100 {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:45:30.786368 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55974d87-8a4b-4a8b-8b60-84965aa519b0 None admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:45:30.858682 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-094aede6-2c07-448f-b6be-971ecc3a963f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:45:30.859419 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-094aede6-2c07-448f-b6be-971ecc3a963f None admin] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:45:30.859695 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-094aede6-2c07-448f-b6be-971ecc3a963f None admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:45:30.859968 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-094aede6-2c07-448f-b6be-971ecc3a963f None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:45:30.878857 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-094aede6-2c07-448f-b6be-971ecc3a963f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 02 15:45:30.887502 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1945f01-70c5-43be-b539-43197d833982 None None] Validating token access rules against request {{(pid=80396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:45:30.896030 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application [None req-094aede6-2c07-448f-b6be-971ecc3a963f None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 02 15:45:30.896030 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 15:45:30.896030 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 15:45:30.896030 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 15:45:30.896030 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 15:45:30.896030 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 15:45:30.896030 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 15:45:30.896030 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 15:45:30.896030 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 15:45:30.896030 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 15:45:30.896030 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 15:45:30.896030 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 15:45:30.896030 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 02 15:45:30.896030 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 02 15:45:30.896030 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 02 15:45:30.896030 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 02 15:45:30.902791 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 02 15:45:30.902791 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 02 15:45:30.902791 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 02 15:45:30.902791 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 02 15:45:30.902791 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 15:45:30.902791 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 15:45:30.902791 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 15:45:30.902791 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 15:45:30.902791 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 15:45:30.902791 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 15:45:30.902791 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 15:45:30.902791 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application with Lock( Jun 02 15:45:30.902791 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 15:45:30.902791 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self._enter() Jun 02 15:45:30.902791 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 15:45:30.902791 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 15:45:30.903557 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 15:45:30.903557 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self.creator() Jun 02 15:45:30.903557 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 15:45:30.903557 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application created_value = creator( Jun 02 15:45:30.903557 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 02 15:45:30.903557 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 02 15:45:30.903557 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 02 15:45:30.903557 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 02 15:45:30.903557 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 02 15:45:30.903557 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 02 15:45:30.903557 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 02 15:45:30.903557 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application Jun 02 15:45:30.903557 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 74/151] 10.222.0.59 () {56 vars in 1114 bytes} [Thu Jun 2 15:45:30 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 297 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 15:45:30.903557 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54675a8e-c6da-446f-9e15-dbcc13e71c54 None None] REQUEST_METHOD: `POST` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:45:30.904239 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54675a8e-c6da-446f-9e15-dbcc13e71c54 None None] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:45:30.907990 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54675a8e-c6da-446f-9e15-dbcc13e71c54 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:45:30.939026 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.auth.core [None req-54675a8e-c6da-446f-9e15-dbcc13e71c54 None None] MFA Rules not processed for user `400d1f4db9de49638549e5db29a041e1`. Rule list: `[]` (Enabled: `True`). {{(pid=80395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 15:45:30.940217 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.fernet_utils [None req-54675a8e-c6da-446f-9e15-dbcc13e71c54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 15:45:30.953496 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-048212c4-b37a-42eb-8f58-37c523d462a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:45:30.954626 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048212c4-b37a-42eb-8f58-37c523d462a1 None admin] REQUEST_METHOD: `POST` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:45:30.955119 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048212c4-b37a-42eb-8f58-37c523d462a1 None admin] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:45:30.955810 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048212c4-b37a-42eb-8f58-37c523d462a1 None admin] PATH_INFO: `/v3/users` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:45:30.957198 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-048212c4-b37a-42eb-8f58-37c523d462a1 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:45:30.959402 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-048212c4-b37a-42eb-8f58-37c523d462a1 None admin] RBAC: Authorization granted {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:45:30.971667 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG dbcounter [-] [80396] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:45:31.027513 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 75/152] 10.222.0.59 () {58 vars in 1023 bytes} [Thu Jun 2 15:45:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 02 15:45:31.028727 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54675a8e-c6da-446f-9e15-dbcc13e71c54 None None] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:45:31.085739 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writing DB stats keystone:SELECT=100 {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:45:31.125478 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 78/153] 10.222.0.59 () {60 vars in 1132 bytes} [Thu Jun 2 15:45:30 2022] POST /identity/v3/users => generated 283 bytes in 454 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 15:45:31.126640 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-048212c4-b37a-42eb-8f58-37c523d462a1 None admin] Authenticating user token {{(pid=80396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:45:31.150787 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54675a8e-c6da-446f-9e15-dbcc13e71c54 None None] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:45:31.203793 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-339d088c-3a6c-4eec-9848-b929f6652a31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:45:31.204485 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339d088c-3a6c-4eec-9848-b929f6652a31 None admin] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:45:31.205483 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339d088c-3a6c-4eec-9848-b929f6652a31 None admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:45:31.205760 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339d088c-3a6c-4eec-9848-b929f6652a31 None admin] PATH_INFO: `/v3/roles` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:45:31.206802 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-339d088c-3a6c-4eec-9848-b929f6652a31 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80395) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 15:45:31.207113 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-339d088c-3a6c-4eec-9848-b929f6652a31 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:45:31.208577 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-339d088c-3a6c-4eec-9848-b929f6652a31 None admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:45:31.231491 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 76/154] 10.222.0.59 () {56 vars in 1111 bytes} [Thu Jun 2 15:45:31 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 15:45:31.232716 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d26f713b-dc1b-4db6-9fd6-71e0f60b95c9 None None] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:45:31.233004 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d26f713b-dc1b-4db6-9fd6-71e0f60b95c9 None None] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:45:31.233279 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d26f713b-dc1b-4db6-9fd6-71e0f60b95c9 None None] PATH_INFO: `/` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:45:31.236847 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 77/155] 10.222.0.59 () {54 vars in 926 bytes} [Thu Jun 2 15:45:31 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 15:45:31.238646 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d26f713b-dc1b-4db6-9fd6-71e0f60b95c9 None None] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:45:31.370481 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d26f713b-dc1b-4db6-9fd6-71e0f60b95c9 None None] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:45:31.376225 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-048212c4-b37a-42eb-8f58-37c523d462a1 None admin] Validating token access rules against request {{(pid=80396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:45:31.388105 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writing DB stats keystone:SELECT=100 {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:45:31.420794 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f894e08-edae-48f2-b632-102573e32cd7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:45:31.422141 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f894e08-edae-48f2-b632-102573e32cd7 None admin] REQUEST_METHOD: `GET` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:45:31.422756 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f894e08-edae-48f2-b632-102573e32cd7 None admin] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:45:31.423253 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f894e08-edae-48f2-b632-102573e32cd7 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:45:31.436282 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f894e08-edae-48f2-b632-102573e32cd7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 02 15:45:31.444914 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application [None req-0f894e08-edae-48f2-b632-102573e32cd7 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 02 15:45:31.444914 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 15:45:31.444914 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 15:45:31.444914 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 15:45:31.444914 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 15:45:31.444914 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 15:45:31.444914 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 15:45:31.444914 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 15:45:31.444914 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 15:45:31.444914 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 15:45:31.444914 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 15:45:31.444914 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 15:45:31.444914 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 02 15:45:31.444914 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 02 15:45:31.444914 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 02 15:45:31.444914 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 02 15:45:31.445747 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 02 15:45:31.445747 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 02 15:45:31.445747 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 02 15:45:31.445747 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 02 15:45:31.445747 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 15:45:31.445747 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 15:45:31.445747 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 15:45:31.445747 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 15:45:31.445747 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 15:45:31.445747 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 15:45:31.445747 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 15:45:31.445747 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application with Lock( Jun 02 15:45:31.445747 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 15:45:31.445747 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application return self._enter() Jun 02 15:45:31.445747 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 15:45:31.445747 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 15:45:31.446616 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 15:45:31.446616 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application return self.creator() Jun 02 15:45:31.446616 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 15:45:31.446616 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application created_value = creator( Jun 02 15:45:31.446616 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 02 15:45:31.446616 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 02 15:45:31.446616 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 02 15:45:31.446616 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 02 15:45:31.446616 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 02 15:45:31.446616 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 02 15:45:31.446616 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 02 15:45:31.446616 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application Jun 02 15:45:31.449118 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 79/156] 10.222.0.59 () {56 vars in 1096 bytes} [Thu Jun 2 15:45:31 2022] GET /identity/v3/roles/admin => generated 83 bytes in 323 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 15:45:31.455099 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b8a01ea-3a8d-4f0b-afec-abfc1c8935c7 None None] REQUEST_METHOD: `POST` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:45:31.455225 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5dd6120-ed8a-4729-b995-e4657f164aa2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:45:31.455764 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b8a01ea-3a8d-4f0b-afec-abfc1c8935c7 None None] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:45:31.456013 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5dd6120-ed8a-4729-b995-e4657f164aa2 None admin] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:45:31.456301 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5dd6120-ed8a-4729-b995-e4657f164aa2 None admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:45:31.456582 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5dd6120-ed8a-4729-b995-e4657f164aa2 None admin] PATH_INFO: `/v3/users/8defb7300e7949f180b3f6ccd787ddf9` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:45:31.456850 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b8a01ea-3a8d-4f0b-afec-abfc1c8935c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:45:31.460366 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5dd6120-ed8a-4729-b995-e4657f164aa2 None admin] RBAC: Authorizing `identity:get_user(user_id=8defb7300e7949f180b3f6ccd787ddf9)` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:45:31.461974 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5dd6120-ed8a-4729-b995-e4657f164aa2 None admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:45:31.464914 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 78/157] 10.222.0.59 () {56 vars in 1177 bytes} [Thu Jun 2 15:45:31 2022] GET /identity/v3/users/8defb7300e7949f180b3f6ccd787ddf9 => generated 275 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 15:45:31.466323 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5dd6120-ed8a-4729-b995-e4657f164aa2 None admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:45:31.486713 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.auth.core [None req-9b8a01ea-3a8d-4f0b-afec-abfc1c8935c7 None None] MFA Rules not processed for user `400d1f4db9de49638549e5db29a041e1`. Rule list: `[]` (Enabled: `True`). {{(pid=80396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 15:45:31.488777 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.fernet_utils [None req-9b8a01ea-3a8d-4f0b-afec-abfc1c8935c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 15:45:31.547378 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG dbcounter [-] [80396] Writing DB stats keystone:INSERT=3,keystone:SELECT=97 {{(pid=80396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:45:31.580337 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 80/158] 10.222.0.59 () {58 vars in 1023 bytes} [Thu Jun 2 15:45:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 02 15:45:31.586099 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b8a01ea-3a8d-4f0b-afec-abfc1c8935c7 None None] Authenticating user token {{(pid=80396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:45:31.632198 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5dd6120-ed8a-4729-b995-e4657f164aa2 None admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:45:31.695653 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f702cda-ca98-42d9-b472-c81cfb3763ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:45:31.696334 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f702cda-ca98-42d9-b472-c81cfb3763ee None admin] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:45:31.696620 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f702cda-ca98-42d9-b472-c81cfb3763ee None admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:45:31.696899 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f702cda-ca98-42d9-b472-c81cfb3763ee None admin] PATH_INFO: `/v3/roles` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:45:31.697712 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f702cda-ca98-42d9-b472-c81cfb3763ee None admin] RBAC: Adding query filter params (name=admin) {{(pid=80395) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 15:45:31.698678 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f702cda-ca98-42d9-b472-c81cfb3763ee None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:45:31.700146 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f702cda-ca98-42d9-b472-c81cfb3763ee None admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:45:31.711003 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b8a01ea-3a8d-4f0b-afec-abfc1c8935c7 None None] Validating token access rules against request {{(pid=80396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:45:31.715437 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 79/159] 10.222.0.59 () {56 vars in 1099 bytes} [Thu Jun 2 15:45:31 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 15:45:31.716133 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f702cda-ca98-42d9-b472-c81cfb3763ee None admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:45:31.761285 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f383a8d1-b730-4035-995b-7dc74d9703cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:45:31.762000 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f383a8d1-b730-4035-995b-7dc74d9703cd None admin] REQUEST_METHOD: `GET` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:45:31.762413 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f383a8d1-b730-4035-995b-7dc74d9703cd None admin] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:45:31.762567 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f383a8d1-b730-4035-995b-7dc74d9703cd None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:45:31.785468 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writing DB stats keystone:SELECT=100 {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:45:31.829294 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG dbcounter [-] [80396] Writing DB stats keystone:SELECT=100 {{(pid=80396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:45:31.853557 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f383a8d1-b730-4035-995b-7dc74d9703cd None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:45:31.856741 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f383a8d1-b730-4035-995b-7dc74d9703cd None admin] RBAC: Authorization granted {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:45:31.865813 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f702cda-ca98-42d9-b472-c81cfb3763ee None admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:45:31.914792 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4461e9f8-73d0-4512-830b-c933cbab0a69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:45:31.915883 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4461e9f8-73d0-4512-830b-c933cbab0a69 None admin] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:45:31.916171 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4461e9f8-73d0-4512-830b-c933cbab0a69 None admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:45:31.916512 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4461e9f8-73d0-4512-830b-c933cbab0a69 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:45:31.930434 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4461e9f8-73d0-4512-830b-c933cbab0a69 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 02 15:45:31.941007 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application [None req-4461e9f8-73d0-4512-830b-c933cbab0a69 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 02 15:45:31.941007 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 15:45:31.941007 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 15:45:31.941007 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 15:45:31.941007 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 15:45:31.941007 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 15:45:31.941007 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 15:45:31.941007 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 15:45:31.941007 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 15:45:31.941007 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 15:45:31.941007 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 15:45:31.941007 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 15:45:31.941007 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 02 15:45:31.941007 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 02 15:45:31.941007 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 02 15:45:31.941007 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 02 15:45:31.941890 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 02 15:45:31.941890 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 02 15:45:31.941890 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 02 15:45:31.941890 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 02 15:45:31.941890 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 15:45:31.941890 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 15:45:31.941890 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 15:45:31.941890 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 15:45:31.941890 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 15:45:31.941890 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 15:45:31.941890 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 15:45:31.941890 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application with Lock( Jun 02 15:45:31.941890 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 15:45:31.941890 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self._enter() Jun 02 15:45:31.941890 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 15:45:31.941890 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 15:45:31.943105 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 15:45:31.943105 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self.creator() Jun 02 15:45:31.943105 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 15:45:31.943105 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application created_value = creator( Jun 02 15:45:31.943105 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 02 15:45:31.943105 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 02 15:45:31.943105 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 02 15:45:31.943105 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 02 15:45:31.943105 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 02 15:45:31.943105 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 02 15:45:31.943105 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 02 15:45:31.943105 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application Jun 02 15:45:31.943105 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 80/160] 10.222.0.59 () {56 vars in 1099 bytes} [Thu Jun 2 15:45:31 2022] GET /identity/v3/roles/member => generated 84 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 15:45:31.943737 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdfa44e0-4ba1-4123-862a-90f1ed0e5bff None None] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:45:31.943813 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdfa44e0-4ba1-4123-862a-90f1ed0e5bff None None] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:45:31.944110 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdfa44e0-4ba1-4123-862a-90f1ed0e5bff None None] PATH_INFO: `/` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:45:31.950164 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 81/161] 10.222.0.59 () {54 vars in 926 bytes} [Thu Jun 2 15:45:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 15:45:31.950164 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdfa44e0-4ba1-4123-862a-90f1ed0e5bff None None] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:45:31.991996 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 81/162] 10.222.0.59 () {58 vars in 1282 bytes} [Thu Jun 2 15:45:31 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 411 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 02 15:45:31.993804 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a470d745-b99e-43c4-9ba9-a61d2685bb11 None None] REQUEST_METHOD: `POST` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:45:31.994311 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a470d745-b99e-43c4-9ba9-a61d2685bb11 None None] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:45:31.995391 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a470d745-b99e-43c4-9ba9-a61d2685bb11 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:45:32.013715 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.auth.core [None req-a470d745-b99e-43c4-9ba9-a61d2685bb11 None None] MFA Rules not processed for user `400d1f4db9de49638549e5db29a041e1`. Rule list: `[]` (Enabled: `True`). {{(pid=80396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 15:45:32.015311 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.fernet_utils [None req-a470d745-b99e-43c4-9ba9-a61d2685bb11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 15:45:32.097845 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writing DB stats keystone:SELECT=100 {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:45:32.100515 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 82/163] 10.222.0.59 () {58 vars in 1023 bytes} [Thu Jun 2 15:45:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 02 15:45:32.102614 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a470d745-b99e-43c4-9ba9-a61d2685bb11 None None] Authenticating user token {{(pid=80396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:45:32.106182 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdfa44e0-4ba1-4123-862a-90f1ed0e5bff None None] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:45:32.134454 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG dbcounter [-] [80396] Writing DB stats keystone:SELECT=100 {{(pid=80396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:45:32.166490 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e35d5a30-eb17-4582-9d4d-2189acf1bc55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:45:32.167788 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e35d5a30-eb17-4582-9d4d-2189acf1bc55 None admin] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:45:32.168270 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e35d5a30-eb17-4582-9d4d-2189acf1bc55 None admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:45:32.168757 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e35d5a30-eb17-4582-9d4d-2189acf1bc55 None admin] PATH_INFO: `/v3/users/400d1f4db9de49638549e5db29a041e1` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:45:32.170382 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e35d5a30-eb17-4582-9d4d-2189acf1bc55 None admin] RBAC: Authorizing `identity:get_user(user_id=400d1f4db9de49638549e5db29a041e1)` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:45:32.172190 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e35d5a30-eb17-4582-9d4d-2189acf1bc55 None admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:45:32.174406 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 82/164] 10.222.0.59 () {56 vars in 1177 bytes} [Thu Jun 2 15:45:31 2022] GET /identity/v3/users/400d1f4db9de49638549e5db29a041e1 => generated 247 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 15:45:32.176272 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e35d5a30-eb17-4582-9d4d-2189acf1bc55 None admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:45:32.272275 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a470d745-b99e-43c4-9ba9-a61d2685bb11 None None] Validating token access rules against request {{(pid=80396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:45:32.289615 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e35d5a30-eb17-4582-9d4d-2189acf1bc55 None admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:45:32.331929 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a27640ec-66c2-4f34-842a-6a76a6e97dd1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:45:32.333351 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27640ec-66c2-4f34-842a-6a76a6e97dd1 None admin] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:45:32.334514 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27640ec-66c2-4f34-842a-6a76a6e97dd1 None admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:45:32.335143 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27640ec-66c2-4f34-842a-6a76a6e97dd1 None admin] PATH_INFO: `/v3/projects/06e0633a47e74dcfaeccc8794206da96` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:45:32.339508 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a27640ec-66c2-4f34-842a-6a76a6e97dd1 None admin] RBAC: Authorizing `identity:get_project(project_id=06e0633a47e74dcfaeccc8794206da96)` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:45:32.341251 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a27640ec-66c2-4f34-842a-6a76a6e97dd1 None admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:45:32.343978 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 83/165] 10.222.0.59 () {56 vars in 1186 bytes} [Thu Jun 2 15:45:32 2022] GET /identity/v3/projects/06e0633a47e74dcfaeccc8794206da96 => generated 298 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 15:45:32.350089 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a27640ec-66c2-4f34-842a-6a76a6e97dd1 None admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:45:32.357468 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ceff6f3-3d9b-496f-8a89-fd9a0983aa7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:45:32.358546 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ceff6f3-3d9b-496f-8a89-fd9a0983aa7b None admin] REQUEST_METHOD: `GET` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:45:32.359025 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ceff6f3-3d9b-496f-8a89-fd9a0983aa7b None admin] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:45:32.359523 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ceff6f3-3d9b-496f-8a89-fd9a0983aa7b None admin] PATH_INFO: `/v3/roles` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:45:32.360480 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ceff6f3-3d9b-496f-8a89-fd9a0983aa7b None admin] RBAC: Adding query filter params (name=member) {{(pid=80396) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 15:45:32.361008 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ceff6f3-3d9b-496f-8a89-fd9a0983aa7b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:45:32.363422 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ceff6f3-3d9b-496f-8a89-fd9a0983aa7b None admin] RBAC: Authorization granted {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:45:32.383733 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 83/166] 10.222.0.59 () {56 vars in 1101 bytes} [Thu Jun 2 15:45:32 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 282 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 15:45:32.388307 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ceff6f3-3d9b-496f-8a89-fd9a0983aa7b None admin] Authenticating user token {{(pid=80396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:45:32.454439 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writing DB stats keystone:SELECT=100 {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:45:32.546516 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a27640ec-66c2-4f34-842a-6a76a6e97dd1 None admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:45:32.607241 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG dbcounter [-] [80396] Writing DB stats keystone:SELECT=100 {{(pid=80396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:45:32.615728 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95344a05-0790-4ec3-bc9c-39aa71a76bb4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:45:32.616952 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95344a05-0790-4ec3-bc9c-39aa71a76bb4 None admin] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:45:32.617422 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95344a05-0790-4ec3-bc9c-39aa71a76bb4 None admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:45:32.617903 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95344a05-0790-4ec3-bc9c-39aa71a76bb4 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:45:32.651597 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95344a05-0790-4ec3-bc9c-39aa71a76bb4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 02 15:45:32.665838 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application [None req-95344a05-0790-4ec3-bc9c-39aa71a76bb4 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 02 15:45:32.665838 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 15:45:32.665838 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 15:45:32.665838 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 15:45:32.665838 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 15:45:32.665838 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 15:45:32.665838 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 15:45:32.665838 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 15:45:32.665838 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 15:45:32.665838 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 15:45:32.665838 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 15:45:32.665838 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 15:45:32.665838 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 02 15:45:32.665838 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 02 15:45:32.665838 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 02 15:45:32.665838 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 02 15:45:32.667163 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 02 15:45:32.667163 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 02 15:45:32.667163 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 02 15:45:32.667163 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 02 15:45:32.667163 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 15:45:32.667163 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 15:45:32.667163 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 15:45:32.667163 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 15:45:32.667163 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 15:45:32.667163 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 15:45:32.667163 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 15:45:32.667163 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application with Lock( Jun 02 15:45:32.667163 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 15:45:32.667163 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self._enter() Jun 02 15:45:32.667163 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 15:45:32.667163 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 15:45:32.667998 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 15:45:32.667998 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self.creator() Jun 02 15:45:32.667998 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 15:45:32.667998 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application created_value = creator( Jun 02 15:45:32.667998 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 02 15:45:32.667998 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 02 15:45:32.667998 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 02 15:45:32.667998 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 02 15:45:32.667998 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 02 15:45:32.667998 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 02 15:45:32.667998 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 02 15:45:32.667998 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application Jun 02 15:45:32.670306 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 84/167] 10.222.0.59 () {56 vars in 1099 bytes} [Thu Jun 2 15:45:32 2022] GET /identity/v3/roles/member => generated 84 bytes in 320 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 15:45:32.671266 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95344a05-0790-4ec3-bc9c-39aa71a76bb4 None admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:45:32.675995 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ceff6f3-3d9b-496f-8a89-fd9a0983aa7b None admin] Validating token access rules against request {{(pid=80396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:45:32.746896 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f117ed7-587d-4e4a-869c-bb31e0a71eda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:45:32.747514 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f117ed7-587d-4e4a-869c-bb31e0a71eda None admin] REQUEST_METHOD: `GET` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:45:32.747796 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f117ed7-587d-4e4a-869c-bb31e0a71eda None admin] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:45:32.748068 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f117ed7-587d-4e4a-869c-bb31e0a71eda None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:45:32.799487 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95344a05-0790-4ec3-bc9c-39aa71a76bb4 None admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:45:32.802434 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writing DB stats keystone:SELECT=100 {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:45:32.836150 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4af0a6d8-af10-4d3b-af49-187a50d392d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:45:32.836942 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af0a6d8-af10-4d3b-af49-187a50d392d1 None admin] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:45:32.837301 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af0a6d8-af10-4d3b-af49-187a50d392d1 None admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:45:32.837664 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af0a6d8-af10-4d3b-af49-187a50d392d1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:45:32.838773 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4af0a6d8-af10-4d3b-af49-187a50d392d1 None admin] RBAC: Adding query filter params (role.id=21f49b1aa1e64120b7ef6fcf4667a641, scope.project.id=06e0633a47e74dcfaeccc8794206da96, user.id=8defb7300e7949f180b3f6ccd787ddf9) {{(pid=80395) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 15:45:32.839353 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4af0a6d8-af10-4d3b-af49-187a50d392d1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:45:32.847822 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4af0a6d8-af10-4d3b-af49-187a50d392d1 None admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:45:32.854775 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 85/168] 10.222.0.59 () {56 vars in 1374 bytes} [Thu Jun 2 15:45:32 2022] GET /identity/v3/role_assignments?user.id=8defb7300e7949f180b3f6ccd787ddf9&scope.project.id=06e0633a47e74dcfaeccc8794206da96&role.id=21f49b1aa1e64120b7ef6fcf4667a641 => generated 608 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 15:45:32.855591 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4af0a6d8-af10-4d3b-af49-187a50d392d1 None admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:45:32.882487 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f117ed7-587d-4e4a-869c-bb31e0a71eda None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:45:32.884025 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f117ed7-587d-4e4a-869c-bb31e0a71eda None admin] RBAC: Authorization granted {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:45:33.044410 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG dbcounter [-] [80396] Writing DB stats keystone:SELECT=100 {{(pid=80396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:45:33.092641 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4af0a6d8-af10-4d3b-af49-187a50d392d1 None admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:45:33.104904 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 84/169] 10.222.0.59 () {58 vars in 1282 bytes} [Thu Jun 2 15:45:32 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 717 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 02 15:45:33.106296 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f117ed7-587d-4e4a-869c-bb31e0a71eda None admin] Authenticating user token {{(pid=80396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:45:33.155509 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-899abec8-274a-45ad-a350-dc2e67f97a7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:45:33.156405 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-899abec8-274a-45ad-a350-dc2e67f97a7e None admin] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:45:33.156690 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-899abec8-274a-45ad-a350-dc2e67f97a7e None admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:45:33.156992 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-899abec8-274a-45ad-a350-dc2e67f97a7e None admin] PATH_INFO: `/v3/users/8defb7300e7949f180b3f6ccd787ddf9` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:45:33.158368 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-899abec8-274a-45ad-a350-dc2e67f97a7e None admin] RBAC: Authorizing `identity:get_user(user_id=8defb7300e7949f180b3f6ccd787ddf9)` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:45:33.159977 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-899abec8-274a-45ad-a350-dc2e67f97a7e None admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:45:33.161769 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 86/170] 10.222.0.59 () {56 vars in 1177 bytes} [Thu Jun 2 15:45:32 2022] GET /identity/v3/users/8defb7300e7949f180b3f6ccd787ddf9 => generated 275 bytes in 306 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 15:45:33.162629 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-899abec8-274a-45ad-a350-dc2e67f97a7e None admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:45:33.201195 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writing DB stats keystone:SELECT=100 {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:45:33.295708 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f117ed7-587d-4e4a-869c-bb31e0a71eda None admin] Validating token access rules against request {{(pid=80396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:45:33.296460 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-899abec8-274a-45ad-a350-dc2e67f97a7e None admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:45:33.341683 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7ef2874-7463-4fda-81c4-1a0347c9005a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:45:33.342950 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ef2874-7463-4fda-81c4-1a0347c9005a None admin] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:45:33.343251 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0426bdf7-9f10-4a94-bea3-c793587ed712 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:45:33.343705 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ef2874-7463-4fda-81c4-1a0347c9005a None admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:45:33.343917 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0426bdf7-9f10-4a94-bea3-c793587ed712 None admin] REQUEST_METHOD: `GET` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:45:33.344207 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0426bdf7-9f10-4a94-bea3-c793587ed712 None admin] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:45:33.344485 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0426bdf7-9f10-4a94-bea3-c793587ed712 None admin] PATH_INFO: `/v3/roles` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:45:33.344856 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ef2874-7463-4fda-81c4-1a0347c9005a None admin] PATH_INFO: `/v3/projects/06e0633a47e74dcfaeccc8794206da96` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:45:33.345241 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0426bdf7-9f10-4a94-bea3-c793587ed712 None admin] RBAC: Adding query filter params (name=member) {{(pid=80396) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 15:45:33.345549 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0426bdf7-9f10-4a94-bea3-c793587ed712 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:45:33.346728 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7ef2874-7463-4fda-81c4-1a0347c9005a None admin] RBAC: Authorizing `identity:get_project(project_id=06e0633a47e74dcfaeccc8794206da96)` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:45:33.347097 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0426bdf7-9f10-4a94-bea3-c793587ed712 None admin] RBAC: Authorization granted {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:45:33.348937 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7ef2874-7463-4fda-81c4-1a0347c9005a None admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:45:33.351391 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 87/171] 10.222.0.59 () {56 vars in 1186 bytes} [Thu Jun 2 15:45:33 2022] GET /identity/v3/projects/06e0633a47e74dcfaeccc8794206da96 => generated 298 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 15:45:33.352378 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7ef2874-7463-4fda-81c4-1a0347c9005a None admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:45:33.357937 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 85/172] 10.222.0.59 () {56 vars in 1101 bytes} [Thu Jun 2 15:45:33 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 252 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 15:45:33.362886 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0426bdf7-9f10-4a94-bea3-c793587ed712 None admin] Authenticating user token {{(pid=80396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:45:33.410502 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG dbcounter [-] [80396] Writing DB stats keystone:SELECT=100 {{(pid=80396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:45:33.469644 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writing DB stats keystone:SELECT=100 {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:45:33.481837 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7ef2874-7463-4fda-81c4-1a0347c9005a None admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:45:33.500135 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0426bdf7-9f10-4a94-bea3-c793587ed712 None admin] Validating token access rules against request {{(pid=80396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:45:33.528835 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dee9295e-7f83-4e7c-b15d-6bd9007af848 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:45:33.529153 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee9295e-7f83-4e7c-b15d-6bd9007af848 None admin] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:45:33.529585 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee9295e-7f83-4e7c-b15d-6bd9007af848 None admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:45:33.529937 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee9295e-7f83-4e7c-b15d-6bd9007af848 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:45:33.546667 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e7d8214-1411-4db2-8bfb-638ec30ec16c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:45:33.547601 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e7d8214-1411-4db2-8bfb-638ec30ec16c None admin] REQUEST_METHOD: `GET` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:45:33.548069 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e7d8214-1411-4db2-8bfb-638ec30ec16c None admin] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:45:33.548510 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e7d8214-1411-4db2-8bfb-638ec30ec16c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:45:33.549514 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e7d8214-1411-4db2-8bfb-638ec30ec16c None admin] RBAC: Adding query filter params (role.id=f1e0c25f6e9049e897cb7350c7e54ab3, scope.project.id=06e0633a47e74dcfaeccc8794206da96, user.id=400d1f4db9de49638549e5db29a041e1) {{(pid=80396) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 15:45:33.549999 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e7d8214-1411-4db2-8bfb-638ec30ec16c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:45:33.552054 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e7d8214-1411-4db2-8bfb-638ec30ec16c None admin] RBAC: Authorization granted {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:45:33.560042 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 86/173] 10.222.0.59 () {56 vars in 1374 bytes} [Thu Jun 2 15:45:33 2022] GET /identity/v3/role_assignments?user.id=400d1f4db9de49638549e5db29a041e1&scope.project.id=06e0633a47e74dcfaeccc8794206da96&role.id=f1e0c25f6e9049e897cb7350c7e54ab3 => generated 608 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 15:45:33.561318 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e7d8214-1411-4db2-8bfb-638ec30ec16c None admin] Authenticating user token {{(pid=80396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:45:33.688716 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e7d8214-1411-4db2-8bfb-638ec30ec16c None admin] Validating token access rules against request {{(pid=80396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:45:33.698417 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG dbcounter [-] [80396] Writing DB stats keystone:SELECT=100 {{(pid=80396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:45:33.718957 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dee9295e-7f83-4e7c-b15d-6bd9007af848 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:45:33.723452 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dee9295e-7f83-4e7c-b15d-6bd9007af848 None admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:45:33.733191 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9d44fd3-d9f0-4c02-b452-4d7e8714d03f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:45:33.734211 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d44fd3-d9f0-4c02-b452-4d7e8714d03f None admin] REQUEST_METHOD: `GET` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:45:33.734573 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d44fd3-d9f0-4c02-b452-4d7e8714d03f None admin] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:45:33.734926 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d44fd3-d9f0-4c02-b452-4d7e8714d03f None admin] PATH_INFO: `/v3/users/8defb7300e7949f180b3f6ccd787ddf9` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:45:33.737024 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9d44fd3-d9f0-4c02-b452-4d7e8714d03f None admin] RBAC: Authorizing `identity:get_user(user_id=8defb7300e7949f180b3f6ccd787ddf9)` {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:45:33.738640 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9d44fd3-d9f0-4c02-b452-4d7e8714d03f None admin] RBAC: Authorization granted {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:45:33.741020 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 87/174] 10.222.0.59 () {56 vars in 1177 bytes} [Thu Jun 2 15:45:33 2022] GET /identity/v3/users/8defb7300e7949f180b3f6ccd787ddf9 => generated 275 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 15:45:33.747053 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2156ae4d-9629-4c7e-a4c9-7c0734a23f01 None None] REQUEST_METHOD: `GET` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:45:33.747501 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2156ae4d-9629-4c7e-a4c9-7c0734a23f01 None None] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:45:33.747789 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2156ae4d-9629-4c7e-a4c9-7c0734a23f01 None None] PATH_INFO: `/` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:45:33.749628 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 88/175] 10.222.0.59 () {54 vars in 926 bytes} [Thu Jun 2 15:45:33 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 15:45:33.750438 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2156ae4d-9629-4c7e-a4c9-7c0734a23f01 None None] Authenticating user token {{(pid=80396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:45:33.882006 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writing DB stats keystone:SELECT=100 {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:45:33.895544 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 88/176] 10.222.0.59 () {58 vars in 1282 bytes} [Thu Jun 2 15:45:33 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 543 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 02 15:45:33.896684 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f35539-82b6-4539-bf0d-92a5e0b35746 None None] REQUEST_METHOD: `POST` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:45:33.896978 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f35539-82b6-4539-bf0d-92a5e0b35746 None None] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:45:33.897257 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f35539-82b6-4539-bf0d-92a5e0b35746 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:45:33.929414 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.auth.core [None req-91f35539-82b6-4539-bf0d-92a5e0b35746 None None] MFA Rules not processed for user `400d1f4db9de49638549e5db29a041e1`. Rule list: `[]` (Enabled: `True`). {{(pid=80395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 15:45:33.931305 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.fernet_utils [None req-91f35539-82b6-4539-bf0d-92a5e0b35746 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 15:45:34.011967 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2156ae4d-9629-4c7e-a4c9-7c0734a23f01 None None] Validating token access rules against request {{(pid=80396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:45:34.076748 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 89/177] 10.222.0.59 () {58 vars in 1023 bytes} [Thu Jun 2 15:45:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 02 15:45:34.077614 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91f35539-82b6-4539-bf0d-92a5e0b35746 None None] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:45:34.081865 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3d5e459-bcde-47e8-af01-24a8c20795e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:45:34.082541 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d5e459-bcde-47e8-af01-24a8c20795e2 None admin] REQUEST_METHOD: `GET` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:45:34.082821 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d5e459-bcde-47e8-af01-24a8c20795e2 None admin] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:45:34.083093 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d5e459-bcde-47e8-af01-24a8c20795e2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:45:34.176184 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG dbcounter [-] [80396] Writing DB stats keystone:SELECT=100 {{(pid=80396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:45:34.235794 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91f35539-82b6-4539-bf0d-92a5e0b35746 None None] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:45:34.260879 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3d5e459-bcde-47e8-af01-24a8c20795e2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:45:34.262404 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3d5e459-bcde-47e8-af01-24a8c20795e2 None admin] RBAC: Authorization granted {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:45:34.268432 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writing DB stats keystone:SELECT=100 {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:45:34.284655 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b41f62d-ca07-464c-953b-dc4b1fb91e4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:45:34.285755 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b41f62d-ca07-464c-953b-dc4b1fb91e4d None admin] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:45:34.286391 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b41f62d-ca07-464c-953b-dc4b1fb91e4d None admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:45:34.286835 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b41f62d-ca07-464c-953b-dc4b1fb91e4d None admin] PATH_INFO: `/v3/projects/06e0633a47e74dcfaeccc8794206da96` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:45:34.288356 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b41f62d-ca07-464c-953b-dc4b1fb91e4d None admin] RBAC: Authorizing `identity:get_project(project_id=06e0633a47e74dcfaeccc8794206da96)` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:45:34.290241 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b41f62d-ca07-464c-953b-dc4b1fb91e4d None admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:45:34.292934 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 90/178] 10.222.0.59 () {56 vars in 1186 bytes} [Thu Jun 2 15:45:34 2022] GET /identity/v3/projects/06e0633a47e74dcfaeccc8794206da96 => generated 298 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 15:45:34.294517 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b41f62d-ca07-464c-953b-dc4b1fb91e4d None admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:45:34.432830 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b41f62d-ca07-464c-953b-dc4b1fb91e4d None admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:45:34.470422 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6992388-7d5f-4cea-b195-0a517adee000 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:45:34.471221 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6992388-7d5f-4cea-b195-0a517adee000 None admin] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:45:34.471565 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6992388-7d5f-4cea-b195-0a517adee000 None admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:45:34.471845 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6992388-7d5f-4cea-b195-0a517adee000 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:45:34.483659 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6992388-7d5f-4cea-b195-0a517adee000 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 02 15:45:34.492185 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application [None req-a6992388-7d5f-4cea-b195-0a517adee000 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 02 15:45:34.492185 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 15:45:34.492185 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 15:45:34.492185 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 15:45:34.492185 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 15:45:34.492185 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 15:45:34.492185 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 15:45:34.492185 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 15:45:34.492185 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 15:45:34.492185 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 15:45:34.492185 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 15:45:34.492185 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 15:45:34.492185 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 02 15:45:34.492185 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 02 15:45:34.492185 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 02 15:45:34.492185 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 02 15:45:34.493051 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 02 15:45:34.493051 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 02 15:45:34.493051 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 02 15:45:34.493051 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 02 15:45:34.493051 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 15:45:34.493051 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 15:45:34.493051 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 15:45:34.493051 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 15:45:34.493051 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 15:45:34.493051 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 15:45:34.493051 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 15:45:34.493051 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application with Lock( Jun 02 15:45:34.493051 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 15:45:34.493051 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self._enter() Jun 02 15:45:34.493051 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 15:45:34.493051 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 15:45:34.493827 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 15:45:34.493827 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self.creator() Jun 02 15:45:34.493827 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 15:45:34.493827 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application created_value = creator( Jun 02 15:45:34.493827 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 02 15:45:34.493827 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 02 15:45:34.493827 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 02 15:45:34.493827 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 02 15:45:34.493827 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 02 15:45:34.493827 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 02 15:45:34.493827 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 02 15:45:34.493827 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application Jun 02 15:45:34.494565 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 91/179] 10.222.0.59 () {56 vars in 1099 bytes} [Thu Jun 2 15:45:34 2022] GET /identity/v3/roles/reader => generated 84 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 15:45:34.495124 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6992388-7d5f-4cea-b195-0a517adee000 None admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:45:34.544133 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 89/180] 10.222.0.59 () {58 vars in 1282 bytes} [Thu Jun 2 15:45:33 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 794 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 02 15:45:34.545063 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3d5e459-bcde-47e8-af01-24a8c20795e2 None admin] Authenticating user token {{(pid=80396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:45:34.566445 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writing DB stats keystone:SELECT=100 {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:45:34.612867 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6992388-7d5f-4cea-b195-0a517adee000 None admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:45:34.658515 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-190b66e5-e1da-4d7f-b4be-fb3eedd0b9a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:45:34.659604 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190b66e5-e1da-4d7f-b4be-fb3eedd0b9a4 None admin] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:45:34.660155 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190b66e5-e1da-4d7f-b4be-fb3eedd0b9a4 None admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:45:34.660438 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190b66e5-e1da-4d7f-b4be-fb3eedd0b9a4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:45:34.661529 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-190b66e5-e1da-4d7f-b4be-fb3eedd0b9a4 None admin] RBAC: Adding query filter params (role.id=649e0f2b5a264c419ea6a1441f123a03, scope.project.id=06e0633a47e74dcfaeccc8794206da96, user.id=8defb7300e7949f180b3f6ccd787ddf9) {{(pid=80395) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 15:45:34.661852 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-190b66e5-e1da-4d7f-b4be-fb3eedd0b9a4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:45:34.664048 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-190b66e5-e1da-4d7f-b4be-fb3eedd0b9a4 None admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:45:34.670109 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG dbcounter [-] [80396] Writing DB stats keystone:SELECT=100 {{(pid=80396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:45:34.673503 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 92/181] 10.222.0.59 () {56 vars in 1374 bytes} [Thu Jun 2 15:45:34 2022] GET /identity/v3/role_assignments?user.id=8defb7300e7949f180b3f6ccd787ddf9&scope.project.id=06e0633a47e74dcfaeccc8794206da96&role.id=649e0f2b5a264c419ea6a1441f123a03 => generated 608 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 15:45:34.674543 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-190b66e5-e1da-4d7f-b4be-fb3eedd0b9a4 None admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:45:34.715300 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3d5e459-bcde-47e8-af01-24a8c20795e2 None admin] Validating token access rules against request {{(pid=80396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:45:34.805575 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24586a10-eb34-416d-b144-fed364b2e3cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:45:34.806288 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24586a10-eb34-416d-b144-fed364b2e3cf None admin] REQUEST_METHOD: `GET` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:45:34.806572 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24586a10-eb34-416d-b144-fed364b2e3cf None admin] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:45:34.806881 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24586a10-eb34-416d-b144-fed364b2e3cf None admin] PATH_INFO: `/v3/roles` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:45:34.808236 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24586a10-eb34-416d-b144-fed364b2e3cf None admin] RBAC: Adding query filter params (name=reader) {{(pid=80396) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 15:45:34.808550 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24586a10-eb34-416d-b144-fed364b2e3cf None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:45:34.809973 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24586a10-eb34-416d-b144-fed364b2e3cf None admin] RBAC: Authorization granted {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:45:34.826177 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-190b66e5-e1da-4d7f-b4be-fb3eedd0b9a4 None admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:45:34.833097 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 90/182] 10.222.0.59 () {56 vars in 1101 bytes} [Thu Jun 2 15:45:34 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 288 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 15:45:34.834527 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac27da8-dc57-40b6-bf1c-858bc7c02d70 None None] REQUEST_METHOD: `GET` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:45:34.834796 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac27da8-dc57-40b6-bf1c-858bc7c02d70 None None] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:45:34.835074 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac27da8-dc57-40b6-bf1c-858bc7c02d70 None None] PATH_INFO: `/` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:45:34.842233 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 91/183] 10.222.0.59 () {54 vars in 926 bytes} [Thu Jun 2 15:45:34 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 15:45:34.843177 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac27da8-dc57-40b6-bf1c-858bc7c02d70 None None] Authenticating user token {{(pid=80396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:45:34.868818 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writing DB stats keystone:SELECT=100 {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:45:34.900342 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-755bf284-d4ea-44e8-9572-9a62d9434aaa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:45:34.901673 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-755bf284-d4ea-44e8-9572-9a62d9434aaa None admin] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:45:34.901886 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-755bf284-d4ea-44e8-9572-9a62d9434aaa None admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:45:34.902199 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-755bf284-d4ea-44e8-9572-9a62d9434aaa None admin] PATH_INFO: `/v3/projects/5163f93e22c4458ab0ec98d8dc486c1f` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:45:34.903652 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-755bf284-d4ea-44e8-9572-9a62d9434aaa None admin] RBAC: Authorizing `identity:get_project(project_id=5163f93e22c4458ab0ec98d8dc486c1f)` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:45:34.905169 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-755bf284-d4ea-44e8-9572-9a62d9434aaa None admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:45:34.906981 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 93/184] 10.222.0.59 () {56 vars in 1186 bytes} [Thu Jun 2 15:45:34 2022] GET /identity/v3/projects/5163f93e22c4458ab0ec98d8dc486c1f => generated 312 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 15:45:34.908221 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb9010d-b9a4-43cc-9ab6-64df2406f58a None None] REQUEST_METHOD: `POST` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:45:34.908507 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb9010d-b9a4-43cc-9ab6-64df2406f58a None None] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:45:34.908783 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb9010d-b9a4-43cc-9ab6-64df2406f58a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:45:34.938227 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.auth.core [None req-0cb9010d-b9a4-43cc-9ab6-64df2406f58a None None] MFA Rules not processed for user `400d1f4db9de49638549e5db29a041e1`. Rule list: `[]` (Enabled: `True`). {{(pid=80395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 15:45:34.939427 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.fernet_utils [None req-0cb9010d-b9a4-43cc-9ab6-64df2406f58a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 15:45:35.026450 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac27da8-dc57-40b6-bf1c-858bc7c02d70 None None] Validating token access rules against request {{(pid=80396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:45:35.027192 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 94/185] 10.222.0.59 () {58 vars in 1023 bytes} [Thu Jun 2 15:45:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 02 15:45:35.028045 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cb9010d-b9a4-43cc-9ab6-64df2406f58a None None] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:45:35.063664 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG dbcounter [-] [80396] Writing DB stats keystone:SELECT=100 {{(pid=80396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:45:35.075062 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78029ef3-0d5c-4016-b41b-0da5eb207333 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:45:35.076448 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78029ef3-0d5c-4016-b41b-0da5eb207333 None admin] REQUEST_METHOD: `GET` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:45:35.076739 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78029ef3-0d5c-4016-b41b-0da5eb207333 None admin] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:45:35.077153 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78029ef3-0d5c-4016-b41b-0da5eb207333 None admin] PATH_INFO: `/v3/users/1629872dae1a4839b87027263d77e419` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:45:35.078594 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78029ef3-0d5c-4016-b41b-0da5eb207333 None admin] RBAC: Authorizing `identity:get_user(user_id=1629872dae1a4839b87027263d77e419)` {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:45:35.081050 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78029ef3-0d5c-4016-b41b-0da5eb207333 None admin] RBAC: Authorization granted {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:45:35.083428 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 92/186] 10.222.0.59 () {56 vars in 1177 bytes} [Thu Jun 2 15:45:34 2022] GET /identity/v3/users/1629872dae1a4839b87027263d77e419 => generated 289 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 15:45:35.084699 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78029ef3-0d5c-4016-b41b-0da5eb207333 None admin] Authenticating user token {{(pid=80396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:45:35.148470 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cb9010d-b9a4-43cc-9ab6-64df2406f58a None None] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:45:35.168428 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writing DB stats keystone:SELECT=100 {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:45:35.202720 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41d88efb-6ecf-49d3-b7b3-6aeba20fabe7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:45:35.203347 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d88efb-6ecf-49d3-b7b3-6aeba20fabe7 None admin] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:45:35.203754 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d88efb-6ecf-49d3-b7b3-6aeba20fabe7 None admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:45:35.204132 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d88efb-6ecf-49d3-b7b3-6aeba20fabe7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:45:35.205337 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41d88efb-6ecf-49d3-b7b3-6aeba20fabe7 None admin] RBAC: Adding query filter params (role.id=649e0f2b5a264c419ea6a1441f123a03, scope.project.id=5163f93e22c4458ab0ec98d8dc486c1f, user.id=8defb7300e7949f180b3f6ccd787ddf9) {{(pid=80395) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 15:45:35.205535 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41d88efb-6ecf-49d3-b7b3-6aeba20fabe7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:45:35.207237 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41d88efb-6ecf-49d3-b7b3-6aeba20fabe7 None admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:45:35.217838 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 95/187] 10.222.0.59 () {56 vars in 1374 bytes} [Thu Jun 2 15:45:35 2022] GET /identity/v3/role_assignments?user.id=8defb7300e7949f180b3f6ccd787ddf9&scope.project.id=5163f93e22c4458ab0ec98d8dc486c1f&role.id=649e0f2b5a264c419ea6a1441f123a03 => generated 608 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 15:45:35.222181 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41d88efb-6ecf-49d3-b7b3-6aeba20fabe7 None admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:45:35.251524 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78029ef3-0d5c-4016-b41b-0da5eb207333 None admin] Validating token access rules against request {{(pid=80396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:45:35.351561 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d22e54d7-5a0d-4ea1-8384-ceef38dee8ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:45:35.352248 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d22e54d7-5a0d-4ea1-8384-ceef38dee8ac None admin] REQUEST_METHOD: `GET` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:45:35.352531 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d22e54d7-5a0d-4ea1-8384-ceef38dee8ac None admin] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:45:35.352806 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d22e54d7-5a0d-4ea1-8384-ceef38dee8ac None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:45:35.363212 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41d88efb-6ecf-49d3-b7b3-6aeba20fabe7 None admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:45:35.387181 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d22e54d7-5a0d-4ea1-8384-ceef38dee8ac None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 02 15:45:35.405276 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-069804e1-50bb-454c-ade0-eb34d29f6af0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:45:35.406353 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-069804e1-50bb-454c-ade0-eb34d29f6af0 None admin] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:45:35.406845 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-069804e1-50bb-454c-ade0-eb34d29f6af0 None admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:45:35.407157 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application [None req-d22e54d7-5a0d-4ea1-8384-ceef38dee8ac None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 02 15:45:35.407157 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 15:45:35.407157 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 15:45:35.407157 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 15:45:35.407157 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 15:45:35.407157 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 15:45:35.407157 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 15:45:35.407157 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 15:45:35.407157 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 15:45:35.407157 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 15:45:35.407157 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 15:45:35.407157 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 15:45:35.407157 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 02 15:45:35.407157 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 02 15:45:35.407157 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 02 15:45:35.407157 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 02 15:45:35.407990 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 02 15:45:35.407990 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 02 15:45:35.407990 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 02 15:45:35.407990 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 02 15:45:35.407990 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 15:45:35.407990 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 15:45:35.407990 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 15:45:35.407990 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 15:45:35.407990 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 15:45:35.407990 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 15:45:35.407990 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 15:45:35.407990 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application with Lock( Jun 02 15:45:35.407990 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 15:45:35.407990 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application return self._enter() Jun 02 15:45:35.407990 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 15:45:35.407990 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 15:45:35.408780 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 15:45:35.408780 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application return self.creator() Jun 02 15:45:35.408780 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 15:45:35.408780 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application created_value = creator( Jun 02 15:45:35.408780 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 02 15:45:35.408780 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 02 15:45:35.408780 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 02 15:45:35.408780 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 02 15:45:35.408780 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 02 15:45:35.408780 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 02 15:45:35.408780 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 02 15:45:35.408780 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application Jun 02 15:45:35.409363 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 93/188] 10.222.0.59 () {56 vars in 1096 bytes} [Thu Jun 2 15:45:35 2022] GET /identity/v3/roles/admin => generated 83 bytes in 325 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 15:45:35.410204 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-069804e1-50bb-454c-ade0-eb34d29f6af0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:45:35.415491 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d22e54d7-5a0d-4ea1-8384-ceef38dee8ac None admin] Authenticating user token {{(pid=80396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:45:35.465755 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writing DB stats keystone:SELECT=100 {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:45:35.491729 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-069804e1-50bb-454c-ade0-eb34d29f6af0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:45:35.493716 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-069804e1-50bb-454c-ade0-eb34d29f6af0 None admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:45:35.506397 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG dbcounter [-] [80396] Writing DB stats keystone:SELECT=100 {{(pid=80396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:45:35.567943 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d22e54d7-5a0d-4ea1-8384-ceef38dee8ac None admin] Validating token access rules against request {{(pid=80396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:45:35.606863 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cc5c914-bb70-4575-8b23-cdd9320eb004 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:45:35.607452 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc5c914-bb70-4575-8b23-cdd9320eb004 None admin] REQUEST_METHOD: `GET` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:45:35.607736 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc5c914-bb70-4575-8b23-cdd9320eb004 None admin] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:45:35.608011 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc5c914-bb70-4575-8b23-cdd9320eb004 None admin] PATH_INFO: `/v3/roles` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:45:35.608760 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cc5c914-bb70-4575-8b23-cdd9320eb004 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80396) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 15:45:35.609069 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cc5c914-bb70-4575-8b23-cdd9320eb004 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:45:35.610484 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cc5c914-bb70-4575-8b23-cdd9320eb004 None admin] RBAC: Authorization granted {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:45:35.613893 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 96/189] 10.222.0.59 () {58 vars in 1282 bytes} [Thu Jun 2 15:45:35 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 396 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 02 15:45:35.616874 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ea49d2-b146-49bb-bd68-56e22a1fc1d4 None None] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:45:35.617173 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ea49d2-b146-49bb-bd68-56e22a1fc1d4 None None] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:45:35.617454 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ea49d2-b146-49bb-bd68-56e22a1fc1d4 None None] PATH_INFO: `/` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:45:35.618629 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 94/190] 10.222.0.59 () {56 vars in 1099 bytes} [Thu Jun 2 15:45:35 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 15:45:35.619161 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 97/191] 10.222.0.59 () {54 vars in 926 bytes} [Thu Jun 2 15:45:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 15:45:35.620316 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70ea49d2-b146-49bb-bd68-56e22a1fc1d4 None None] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:45:35.621600 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-571f0cdb-d791-4520-9bce-b1248ba4de5a None None] REQUEST_METHOD: `GET` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:45:35.621886 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-571f0cdb-d791-4520-9bce-b1248ba4de5a None None] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:45:35.622188 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-571f0cdb-d791-4520-9bce-b1248ba4de5a None None] PATH_INFO: `/` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:45:35.623653 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 95/192] 10.222.0.59 () {54 vars in 926 bytes} [Thu Jun 2 15:45:35 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 15:45:35.624987 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b8f84c-f595-458a-863c-2c7a54457a91 None None] REQUEST_METHOD: `POST` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:45:35.625269 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b8f84c-f595-458a-863c-2c7a54457a91 None None] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:45:35.625545 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b8f84c-f595-458a-863c-2c7a54457a91 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:45:35.641654 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.auth.core [None req-e1b8f84c-f595-458a-863c-2c7a54457a91 None None] MFA Rules not processed for user `400d1f4db9de49638549e5db29a041e1`. Rule list: `[]` (Enabled: `True`). {{(pid=80396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 15:45:35.642866 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.fernet_utils [None req-e1b8f84c-f595-458a-863c-2c7a54457a91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 15:45:35.700720 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writing DB stats keystone:SELECT=100 {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:45:35.708801 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 96/193] 10.222.0.59 () {58 vars in 1023 bytes} [Thu Jun 2 15:45:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 02 15:45:35.719549 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1b8f84c-f595-458a-863c-2c7a54457a91 None None] Authenticating user token {{(pid=80396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:45:35.723665 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70ea49d2-b146-49bb-bd68-56e22a1fc1d4 None None] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:45:35.758939 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1e1d6f7-25fa-4aa2-bce7-f449a595a006 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:45:35.759465 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG dbcounter [-] [80396] Writing DB stats keystone:SELECT=100 {{(pid=80396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:45:35.759792 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e1d6f7-25fa-4aa2-bce7-f449a595a006 None admin] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:45:35.760690 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e1d6f7-25fa-4aa2-bce7-f449a595a006 None admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:45:35.761269 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e1d6f7-25fa-4aa2-bce7-f449a595a006 None admin] PATH_INFO: `/v3/projects/06e0633a47e74dcfaeccc8794206da96` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:45:35.762813 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1e1d6f7-25fa-4aa2-bce7-f449a595a006 None admin] RBAC: Authorizing `identity:get_project(project_id=06e0633a47e74dcfaeccc8794206da96)` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:45:35.764278 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1e1d6f7-25fa-4aa2-bce7-f449a595a006 None admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:45:35.765969 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 98/194] 10.222.0.59 () {56 vars in 1186 bytes} [Thu Jun 2 15:45:35 2022] GET /identity/v3/projects/06e0633a47e74dcfaeccc8794206da96 => generated 298 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 15:45:35.767173 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf167d9-5627-4e79-8254-7d2b15b4ba0c None None] REQUEST_METHOD: `POST` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:45:35.767454 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf167d9-5627-4e79-8254-7d2b15b4ba0c None None] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:45:35.767726 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf167d9-5627-4e79-8254-7d2b15b4ba0c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:45:35.783583 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.auth.core [None req-aaf167d9-5627-4e79-8254-7d2b15b4ba0c None None] MFA Rules not processed for user `400d1f4db9de49638549e5db29a041e1`. Rule list: `[]` (Enabled: `True`). {{(pid=80395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 15:45:35.784770 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.fernet_utils [None req-aaf167d9-5627-4e79-8254-7d2b15b4ba0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 15:45:35.810150 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1b8f84c-f595-458a-863c-2c7a54457a91 None None] Validating token access rules against request {{(pid=80396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:45:35.845649 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5b80778-aa7d-4ee8-b8fd-f5106fc72255 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:45:35.846690 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b80778-aa7d-4ee8-b8fd-f5106fc72255 None admin] REQUEST_METHOD: `GET` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:45:35.846974 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b80778-aa7d-4ee8-b8fd-f5106fc72255 None admin] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:45:35.847256 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b80778-aa7d-4ee8-b8fd-f5106fc72255 None admin] PATH_INFO: `/v3/users/6afcdf3ec3674ab887fc7347902b583f` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:45:35.854009 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 99/195] 10.222.0.59 () {58 vars in 1023 bytes} [Thu Jun 2 15:45:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 02 15:45:35.855231 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaf167d9-5627-4e79-8254-7d2b15b4ba0c None None] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:45:35.861242 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5b80778-aa7d-4ee8-b8fd-f5106fc72255 None admin] RBAC: Authorizing `identity:get_user(user_id=6afcdf3ec3674ab887fc7347902b583f)` {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:45:35.862668 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5b80778-aa7d-4ee8-b8fd-f5106fc72255 None admin] RBAC: Authorization granted {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:45:35.864322 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 97/196] 10.222.0.59 () {56 vars in 1177 bytes} [Thu Jun 2 15:45:35 2022] GET /identity/v3/users/6afcdf3ec3674ab887fc7347902b583f => generated 283 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 15:45:35.865067 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5b80778-aa7d-4ee8-b8fd-f5106fc72255 None admin] Authenticating user token {{(pid=80396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:45:35.938378 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writing DB stats keystone:SELECT=100 {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:45:35.960193 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaf167d9-5627-4e79-8254-7d2b15b4ba0c None None] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:45:35.967025 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5b80778-aa7d-4ee8-b8fd-f5106fc72255 None admin] Validating token access rules against request {{(pid=80396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:45:35.974301 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG dbcounter [-] [80396] Writing DB stats keystone:SELECT=100 {{(pid=80396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:45:35.995295 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc11ef64-9c7b-4cbb-87ff-5348d8c29b93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:45:35.996095 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc11ef64-9c7b-4cbb-87ff-5348d8c29b93 None admin] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:45:35.996381 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc11ef64-9c7b-4cbb-87ff-5348d8c29b93 None admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:45:35.996657 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc11ef64-9c7b-4cbb-87ff-5348d8c29b93 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:45:36.000240 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa28909a-fbcf-4909-9d28-91b23ed1b94d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:45:36.001067 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa28909a-fbcf-4909-9d28-91b23ed1b94d None admin] REQUEST_METHOD: `GET` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:45:36.001564 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa28909a-fbcf-4909-9d28-91b23ed1b94d None admin] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:45:36.002163 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa28909a-fbcf-4909-9d28-91b23ed1b94d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:45:36.003009 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa28909a-fbcf-4909-9d28-91b23ed1b94d None admin] RBAC: Adding query filter params (role.id=67885c18a3dc47718e9197097185f65d, scope.project.id=06e0633a47e74dcfaeccc8794206da96, user.id=1629872dae1a4839b87027263d77e419) {{(pid=80396) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 15:45:36.003323 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa28909a-fbcf-4909-9d28-91b23ed1b94d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:45:36.004769 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa28909a-fbcf-4909-9d28-91b23ed1b94d None admin] RBAC: Authorization granted {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:45:36.006926 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc11ef64-9c7b-4cbb-87ff-5348d8c29b93 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 02 15:45:36.010843 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 98/197] 10.222.0.59 () {56 vars in 1374 bytes} [Thu Jun 2 15:45:35 2022] GET /identity/v3/role_assignments?user.id=1629872dae1a4839b87027263d77e419&scope.project.id=06e0633a47e74dcfaeccc8794206da96&role.id=67885c18a3dc47718e9197097185f65d => generated 608 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 15:45:36.011659 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa28909a-fbcf-4909-9d28-91b23ed1b94d None admin] Authenticating user token {{(pid=80396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:45:36.015568 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application [None req-bc11ef64-9c7b-4cbb-87ff-5348d8c29b93 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 02 15:45:36.015568 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 15:45:36.015568 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 15:45:36.015568 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 15:45:36.015568 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 15:45:36.015568 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 15:45:36.015568 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 15:45:36.015568 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 15:45:36.015568 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 15:45:36.015568 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 15:45:36.015568 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 15:45:36.015568 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 15:45:36.015568 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 02 15:45:36.015568 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 02 15:45:36.015568 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 02 15:45:36.015568 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 02 15:45:36.016629 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 02 15:45:36.016629 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 02 15:45:36.016629 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 02 15:45:36.016629 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 02 15:45:36.016629 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 15:45:36.016629 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 15:45:36.016629 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 15:45:36.016629 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 15:45:36.016629 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 15:45:36.016629 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 15:45:36.016629 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 15:45:36.016629 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application with Lock( Jun 02 15:45:36.016629 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 15:45:36.016629 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self._enter() Jun 02 15:45:36.016629 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 15:45:36.016629 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 15:45:36.017520 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 15:45:36.017520 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self.creator() Jun 02 15:45:36.017520 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 15:45:36.017520 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application created_value = creator( Jun 02 15:45:36.017520 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 02 15:45:36.017520 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 02 15:45:36.017520 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 02 15:45:36.017520 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 02 15:45:36.017520 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 02 15:45:36.017520 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 02 15:45:36.017520 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 02 15:45:36.017520 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application Jun 02 15:45:36.017520 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 100/198] 10.222.0.59 () {56 vars in 1114 bytes} [Thu Jun 2 15:45:35 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 15:45:36.022563 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc11ef64-9c7b-4cbb-87ff-5348d8c29b93 None admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:45:36.140696 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc11ef64-9c7b-4cbb-87ff-5348d8c29b93 None admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:45:36.147741 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa28909a-fbcf-4909-9d28-91b23ed1b94d None admin] Validating token access rules against request {{(pid=80396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:45:36.183163 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0267e9a-df4e-48ab-bea9-7fcf21e7df6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:45:36.183962 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0267e9a-df4e-48ab-bea9-7fcf21e7df6a None admin] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:45:36.184238 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0267e9a-df4e-48ab-bea9-7fcf21e7df6a None admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:45:36.184590 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0267e9a-df4e-48ab-bea9-7fcf21e7df6a None admin] PATH_INFO: `/v3/domains/default` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:45:36.185748 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0267e9a-df4e-48ab-bea9-7fcf21e7df6a None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:45:36.187305 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0267e9a-df4e-48ab-bea9-7fcf21e7df6a None admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:45:36.189264 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 101/199] 10.222.0.59 () {56 vars in 1108 bytes} [Thu Jun 2 15:45:36 2022] GET /identity/v3/domains/default => generated 199 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 15:45:36.189827 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0267e9a-df4e-48ab-bea9-7fcf21e7df6a None admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:45:36.194434 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d73efcc0-4cf7-477b-a9b0-49ce423621e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:45:36.194629 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writing DB stats keystone:SELECT=100 {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:45:36.195110 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d73efcc0-4cf7-477b-a9b0-49ce423621e9 None admin] REQUEST_METHOD: `GET` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:45:36.195395 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d73efcc0-4cf7-477b-a9b0-49ce423621e9 None admin] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:45:36.195669 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d73efcc0-4cf7-477b-a9b0-49ce423621e9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:45:36.256103 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG dbcounter [-] [80396] Writing DB stats keystone:SELECT=100 {{(pid=80396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:45:36.287830 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d73efcc0-4cf7-477b-a9b0-49ce423621e9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:45:36.289327 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d73efcc0-4cf7-477b-a9b0-49ce423621e9 None admin] RBAC: Authorization granted {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:45:36.318384 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0267e9a-df4e-48ab-bea9-7fcf21e7df6a None admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:45:36.351305 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cdb9d11-a407-4502-a6f4-b114722dbebf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:45:36.351969 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cdb9d11-a407-4502-a6f4-b114722dbebf None admin] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:45:36.352251 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cdb9d11-a407-4502-a6f4-b114722dbebf None admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:45:36.352528 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cdb9d11-a407-4502-a6f4-b114722dbebf None admin] PATH_INFO: `/v3/roles` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:45:36.353281 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cdb9d11-a407-4502-a6f4-b114722dbebf None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80395) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 15:45:36.353601 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cdb9d11-a407-4502-a6f4-b114722dbebf None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:45:36.355563 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cdb9d11-a407-4502-a6f4-b114722dbebf None admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:45:36.363354 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 102/200] 10.222.0.59 () {56 vars in 1111 bytes} [Thu Jun 2 15:45:36 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 15:45:36.364118 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cdb9d11-a407-4502-a6f4-b114722dbebf None admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:45:36.390115 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 99/201] 10.222.0.59 () {58 vars in 1282 bytes} [Thu Jun 2 15:45:36 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 379 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 02 15:45:36.391055 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d73efcc0-4cf7-477b-a9b0-49ce423621e9 None admin] Authenticating user token {{(pid=80396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:45:36.429760 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writing DB stats keystone:SELECT=100 {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:45:36.458618 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG dbcounter [-] [80396] Writing DB stats keystone:SELECT=100 {{(pid=80396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:45:36.463656 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cdb9d11-a407-4502-a6f4-b114722dbebf None admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:45:36.488417 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d73efcc0-4cf7-477b-a9b0-49ce423621e9 None admin] Validating token access rules against request {{(pid=80396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:45:36.497532 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-112f3573-125a-44dd-98b7-0608d81a52c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:45:36.498318 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-112f3573-125a-44dd-98b7-0608d81a52c3 None admin] REQUEST_METHOD: `POST` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:45:36.498606 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-112f3573-125a-44dd-98b7-0608d81a52c3 None admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:45:36.498886 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-112f3573-125a-44dd-98b7-0608d81a52c3 None admin] PATH_INFO: `/v3/users` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:45:36.499608 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-112f3573-125a-44dd-98b7-0608d81a52c3 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:45:36.501058 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-112f3573-125a-44dd-98b7-0608d81a52c3 None admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:45:36.521472 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6886eec6-a89f-48f8-856b-7456647a2a05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:45:36.523471 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6886eec6-a89f-48f8-856b-7456647a2a05 None admin] REQUEST_METHOD: `GET` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:45:36.523471 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6886eec6-a89f-48f8-856b-7456647a2a05 None admin] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:45:36.523471 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6886eec6-a89f-48f8-856b-7456647a2a05 None admin] PATH_INFO: `/v3/users/6afcdf3ec3674ab887fc7347902b583f` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:45:36.524408 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6886eec6-a89f-48f8-856b-7456647a2a05 None admin] RBAC: Authorizing `identity:get_user(user_id=6afcdf3ec3674ab887fc7347902b583f)` {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:45:36.526478 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6886eec6-a89f-48f8-856b-7456647a2a05 None admin] RBAC: Authorization granted {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:45:36.528087 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 100/202] 10.222.0.59 () {56 vars in 1177 bytes} [Thu Jun 2 15:45:36 2022] GET /identity/v3/users/6afcdf3ec3674ab887fc7347902b583f => generated 283 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 15:45:36.528829 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6886eec6-a89f-48f8-856b-7456647a2a05 None admin] Authenticating user token {{(pid=80396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:45:36.595718 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 103/203] 10.222.0.59 () {60 vars in 1132 bytes} [Thu Jun 2 15:45:36 2022] POST /identity/v3/users => generated 297 bytes in 232 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 15:45:36.610480 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-112f3573-125a-44dd-98b7-0608d81a52c3 None admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:45:36.630148 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6886eec6-a89f-48f8-856b-7456647a2a05 None admin] Validating token access rules against request {{(pid=80396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:45:36.671549 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f7765ac-7418-4496-9a89-4a704c83bd30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:45:36.672423 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f7765ac-7418-4496-9a89-4a704c83bd30 None admin] REQUEST_METHOD: `GET` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:45:36.673211 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f7765ac-7418-4496-9a89-4a704c83bd30 None admin] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:45:36.673495 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f7765ac-7418-4496-9a89-4a704c83bd30 None admin] PATH_INFO: `/v3/projects/576f2a66e24a468b921fa6cb1e5ff6db` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:45:36.674875 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f7765ac-7418-4496-9a89-4a704c83bd30 None admin] RBAC: Authorizing `identity:get_project(project_id=576f2a66e24a468b921fa6cb1e5ff6db)` {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:45:36.676632 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f7765ac-7418-4496-9a89-4a704c83bd30 None admin] RBAC: Authorization granted {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:45:36.678369 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 101/204] 10.222.0.59 () {56 vars in 1186 bytes} [Thu Jun 2 15:45:36 2022] GET /identity/v3/projects/576f2a66e24a468b921fa6cb1e5ff6db => generated 302 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 15:45:36.684923 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f7765ac-7418-4496-9a89-4a704c83bd30 None admin] Authenticating user token {{(pid=80396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:45:36.696376 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG dbcounter [-] [80396] Writing DB stats keystone:SELECT=100 {{(pid=80396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:45:36.725858 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-112f3573-125a-44dd-98b7-0608d81a52c3 None admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:45:36.752876 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:45:36.767002 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e177271e-553f-4d31-8a75-740f8162700c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:45:36.767762 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e177271e-553f-4d31-8a75-740f8162700c None admin] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:45:36.768057 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e177271e-553f-4d31-8a75-740f8162700c None admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:45:36.768339 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e177271e-553f-4d31-8a75-740f8162700c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:45:36.805360 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f7765ac-7418-4496-9a89-4a704c83bd30 None admin] Validating token access rules against request {{(pid=80396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:45:36.848309 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e177271e-553f-4d31-8a75-740f8162700c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:45:36.848309 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e177271e-553f-4d31-8a75-740f8162700c None admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:45:36.852740 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac806a96-9ba1-4ed9-b33c-886ebb5c1500 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:45:36.853400 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac806a96-9ba1-4ed9-b33c-886ebb5c1500 None admin] REQUEST_METHOD: `GET` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:45:36.853719 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac806a96-9ba1-4ed9-b33c-886ebb5c1500 None admin] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:45:36.854006 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac806a96-9ba1-4ed9-b33c-886ebb5c1500 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:45:36.855017 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac806a96-9ba1-4ed9-b33c-886ebb5c1500 None admin] RBAC: Adding query filter params (role.id=f1e0c25f6e9049e897cb7350c7e54ab3, scope.project.id=576f2a66e24a468b921fa6cb1e5ff6db, user.id=6afcdf3ec3674ab887fc7347902b583f) {{(pid=80396) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 15:45:36.855331 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac806a96-9ba1-4ed9-b33c-886ebb5c1500 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:45:36.857254 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac806a96-9ba1-4ed9-b33c-886ebb5c1500 None admin] RBAC: Authorization granted {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:45:36.864555 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 102/205] 10.222.0.59 () {56 vars in 1374 bytes} [Thu Jun 2 15:45:36 2022] GET /identity/v3/role_assignments?user.id=6afcdf3ec3674ab887fc7347902b583f&scope.project.id=576f2a66e24a468b921fa6cb1e5ff6db&role.id=f1e0c25f6e9049e897cb7350c7e54ab3 => generated 259 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 15:45:36.967193 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 104/206] 10.222.0.59 () {58 vars in 1282 bytes} [Thu Jun 2 15:45:36 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 357 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 02 15:45:36.972888 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac806a96-9ba1-4ed9-b33c-886ebb5c1500 None admin] Authenticating user token {{(pid=80396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:45:37.054115 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG dbcounter [-] [80396] Writing DB stats keystone:SELECT=100 {{(pid=80396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:45:37.089052 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac806a96-9ba1-4ed9-b33c-886ebb5c1500 None admin] Validating token access rules against request {{(pid=80396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:45:37.126800 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-800c9b42-34cd-4dde-a744-dfc33d67e57f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:45:37.130658 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800c9b42-34cd-4dde-a744-dfc33d67e57f None admin] REQUEST_METHOD: `GET` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:45:37.130658 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800c9b42-34cd-4dde-a744-dfc33d67e57f None admin] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:45:37.130658 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800c9b42-34cd-4dde-a744-dfc33d67e57f None admin] PATH_INFO: `/v3/projects/576f2a66e24a468b921fa6cb1e5ff6db` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:45:37.130658 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-800c9b42-34cd-4dde-a744-dfc33d67e57f None admin] RBAC: Authorizing `identity:get_project(project_id=576f2a66e24a468b921fa6cb1e5ff6db)` {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:45:37.130963 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-800c9b42-34cd-4dde-a744-dfc33d67e57f None admin] RBAC: Authorization granted {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:45:37.133088 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 103/207] 10.222.0.59 () {56 vars in 1186 bytes} [Thu Jun 2 15:45:36 2022] GET /identity/v3/projects/576f2a66e24a468b921fa6cb1e5ff6db => generated 302 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 15:45:37.138914 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e177271e-553f-4d31-8a75-740f8162700c None admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:45:37.169555 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writing DB stats keystone:SELECT=100 {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:45:37.247340 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e177271e-553f-4d31-8a75-740f8162700c None admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:45:37.282265 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ad2e9e8-0850-46ab-8981-86aaa3441010 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:45:37.282920 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad2e9e8-0850-46ab-8981-86aaa3441010 None admin] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:45:37.283197 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad2e9e8-0850-46ab-8981-86aaa3441010 None admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:45:37.283469 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad2e9e8-0850-46ab-8981-86aaa3441010 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:45:37.284306 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ad2e9e8-0850-46ab-8981-86aaa3441010 None admin] RBAC: Adding query filter params (role.id=21f49b1aa1e64120b7ef6fcf4667a641, scope.project.id=576f2a66e24a468b921fa6cb1e5ff6db, user.id=6afcdf3ec3674ab887fc7347902b583f) {{(pid=80395) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 15:45:37.284613 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ad2e9e8-0850-46ab-8981-86aaa3441010 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:45:37.286110 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ad2e9e8-0850-46ab-8981-86aaa3441010 None admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:45:37.294423 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 105/208] 10.222.0.59 () {56 vars in 1374 bytes} [Thu Jun 2 15:45:37 2022] GET /identity/v3/role_assignments?user.id=6afcdf3ec3674ab887fc7347902b583f&scope.project.id=576f2a66e24a468b921fa6cb1e5ff6db&role.id=21f49b1aa1e64120b7ef6fcf4667a641 => generated 259 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 15:45:39.061431 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98fea868-7691-44fd-800d-840d1c435015 None None] REQUEST_METHOD: `GET` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:45:39.061984 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98fea868-7691-44fd-800d-840d1c435015 None None] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:45:39.061984 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98fea868-7691-44fd-800d-840d1c435015 None None] PATH_INFO: `/` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:45:39.063656 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 104/209] 10.222.0.59 () {54 vars in 926 bytes} [Thu Jun 2 15:45:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 15:45:39.069266 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b342337-34b7-4e7e-a57f-98de1570d52e None None] REQUEST_METHOD: `POST` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:45:39.069772 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b342337-34b7-4e7e-a57f-98de1570d52e None None] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:45:39.069881 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b342337-34b7-4e7e-a57f-98de1570d52e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:45:39.086918 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.auth.core [None req-2b342337-34b7-4e7e-a57f-98de1570d52e None None] MFA Rules not processed for user `400d1f4db9de49638549e5db29a041e1`. Rule list: `[]` (Enabled: `True`). {{(pid=80395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 15:45:39.088643 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.fernet_utils [None req-2b342337-34b7-4e7e-a57f-98de1570d52e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 15:45:39.115123 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a811a1a-edc5-41c4-ba93-d45839ef1f13 None None] REQUEST_METHOD: `GET` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:45:39.115423 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a811a1a-edc5-41c4-ba93-d45839ef1f13 None None] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:45:39.115685 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a811a1a-edc5-41c4-ba93-d45839ef1f13 None None] PATH_INFO: `/` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:45:39.117055 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 105/210] 10.222.0.59 () {54 vars in 926 bytes} [Thu Jun 2 15:45:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 15:45:39.122651 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c02b2343-c61f-496f-b956-fef9188837e1 None None] REQUEST_METHOD: `POST` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:45:39.122938 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c02b2343-c61f-496f-b956-fef9188837e1 None None] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:45:39.123216 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c02b2343-c61f-496f-b956-fef9188837e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:45:39.142241 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.auth.core [None req-c02b2343-c61f-496f-b956-fef9188837e1 None None] MFA Rules not processed for user `400d1f4db9de49638549e5db29a041e1`. Rule list: `[]` (Enabled: `True`). {{(pid=80396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 15:45:39.143433 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.fernet_utils [None req-c02b2343-c61f-496f-b956-fef9188837e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 15:45:39.162171 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 106/211] 10.222.0.59 () {58 vars in 1023 bytes} [Thu Jun 2 15:45:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 02 15:45:39.192184 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b342337-34b7-4e7e-a57f-98de1570d52e None None] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:45:39.249721 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writing DB stats keystone:SELECT=100 {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:45:39.269776 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 106/212] 10.222.0.59 () {58 vars in 1023 bytes} [Thu Jun 2 15:45:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 02 15:45:39.270985 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf093e42-50eb-4915-a429-ccd47621e5b1 None None] REQUEST_METHOD: `GET` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:45:39.271277 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf093e42-50eb-4915-a429-ccd47621e5b1 None None] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:45:39.271557 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf093e42-50eb-4915-a429-ccd47621e5b1 None None] PATH_INFO: `/` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:45:39.273080 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 107/213] 10.222.0.59 () {54 vars in 926 bytes} [Thu Jun 2 15:45:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 15:45:39.278960 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a91258d-4074-4e6b-8df4-8a5c9d4a1bbf None None] REQUEST_METHOD: `POST` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:45:39.279602 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a91258d-4074-4e6b-8df4-8a5c9d4a1bbf None None] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:45:39.280082 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a91258d-4074-4e6b-8df4-8a5c9d4a1bbf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:45:39.297796 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.auth.core [None req-1a91258d-4074-4e6b-8df4-8a5c9d4a1bbf None None] MFA Rules not processed for user `400d1f4db9de49638549e5db29a041e1`. Rule list: `[]` (Enabled: `True`). {{(pid=80396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 15:45:39.299328 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.fernet_utils [None req-1a91258d-4074-4e6b-8df4-8a5c9d4a1bbf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 15:45:39.350254 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b342337-34b7-4e7e-a57f-98de1570d52e None None] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:45:39.371033 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG dbcounter [-] [80396] Writing DB stats keystone:SELECT=100 {{(pid=80396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:45:39.378212 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 108/214] 10.222.0.59 () {58 vars in 1023 bytes} [Thu Jun 2 15:45:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 02 15:45:39.379382 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a91258d-4074-4e6b-8df4-8a5c9d4a1bbf None None] Authenticating user token {{(pid=80396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:45:39.388715 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f1758d4-9823-4b9b-8a34-afb5656fc08b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:45:39.389520 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1758d4-9823-4b9b-8a34-afb5656fc08b None admin] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:45:39.389802 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1758d4-9823-4b9b-8a34-afb5656fc08b None admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:45:39.390160 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1758d4-9823-4b9b-8a34-afb5656fc08b None admin] PATH_INFO: `/v3/roles/member` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:45:39.401549 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f1758d4-9823-4b9b-8a34-afb5656fc08b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 02 15:45:39.409294 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application [None req-1f1758d4-9823-4b9b-8a34-afb5656fc08b None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 02 15:45:39.409294 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 15:45:39.409294 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 15:45:39.409294 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 15:45:39.409294 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 15:45:39.409294 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 15:45:39.409294 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 15:45:39.409294 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 15:45:39.409294 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 15:45:39.409294 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 15:45:39.409294 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 15:45:39.409294 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 15:45:39.409294 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 02 15:45:39.409294 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 02 15:45:39.409294 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 02 15:45:39.409294 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 02 15:45:39.410720 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 02 15:45:39.410720 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 02 15:45:39.410720 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 02 15:45:39.410720 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 02 15:45:39.410720 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 15:45:39.410720 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 15:45:39.410720 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 15:45:39.410720 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 15:45:39.410720 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 15:45:39.410720 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 15:45:39.410720 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 15:45:39.410720 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application with Lock( Jun 02 15:45:39.410720 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 15:45:39.410720 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self._enter() Jun 02 15:45:39.410720 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 15:45:39.410720 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 15:45:39.411517 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 15:45:39.411517 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self.creator() Jun 02 15:45:39.411517 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 15:45:39.411517 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application created_value = creator( Jun 02 15:45:39.411517 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 02 15:45:39.411517 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 02 15:45:39.411517 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 02 15:45:39.411517 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 02 15:45:39.411517 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 02 15:45:39.411517 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 02 15:45:39.411517 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 02 15:45:39.411517 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application Jun 02 15:45:39.411517 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 107/215] 10.222.0.59 () {56 vars in 1099 bytes} [Thu Jun 2 15:45:39 2022] GET /identity/v3/roles/member => generated 84 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 02 15:45:39.415033 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f1758d4-9823-4b9b-8a34-afb5656fc08b None admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:45:39.489666 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a91258d-4074-4e6b-8df4-8a5c9d4a1bbf None None] Validating token access rules against request {{(pid=80396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:45:39.495403 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writing DB stats keystone:SELECT=100 {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:45:39.519664 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f1758d4-9823-4b9b-8a34-afb5656fc08b None admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:45:39.530573 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3523f700-af85-4151-bc1e-27c97b1c4f4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:45:39.531604 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3523f700-af85-4151-bc1e-27c97b1c4f4a None admin] REQUEST_METHOD: `GET` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:45:39.531886 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3523f700-af85-4151-bc1e-27c97b1c4f4a None admin] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:45:39.532166 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3523f700-af85-4151-bc1e-27c97b1c4f4a None admin] PATH_INFO: `/v3/domains/default` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:45:39.533331 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3523f700-af85-4151-bc1e-27c97b1c4f4a None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:45:39.534819 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3523f700-af85-4151-bc1e-27c97b1c4f4a None admin] RBAC: Authorization granted {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:45:39.536426 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 109/216] 10.222.0.59 () {56 vars in 1108 bytes} [Thu Jun 2 15:45:39 2022] GET /identity/v3/domains/default => generated 199 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 15:45:39.537384 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3523f700-af85-4151-bc1e-27c97b1c4f4a None admin] Authenticating user token {{(pid=80396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:45:39.557556 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-998cc6ad-6a00-4679-b1e2-d44c725ef24b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:45:39.558372 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998cc6ad-6a00-4679-b1e2-d44c725ef24b None admin] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:45:39.558655 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998cc6ad-6a00-4679-b1e2-d44c725ef24b None admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:45:39.558929 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998cc6ad-6a00-4679-b1e2-d44c725ef24b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:45:39.569636 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-998cc6ad-6a00-4679-b1e2-d44c725ef24b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 02 15:45:39.578367 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application [None req-998cc6ad-6a00-4679-b1e2-d44c725ef24b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 02 15:45:39.578367 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 15:45:39.578367 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 15:45:39.578367 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 15:45:39.578367 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 15:45:39.578367 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 15:45:39.578367 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 15:45:39.578367 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 15:45:39.578367 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 15:45:39.578367 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 15:45:39.578367 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 15:45:39.578367 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 15:45:39.578367 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 02 15:45:39.578367 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 02 15:45:39.578367 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 02 15:45:39.578367 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 02 15:45:39.579309 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 02 15:45:39.579309 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 02 15:45:39.579309 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 02 15:45:39.579309 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 02 15:45:39.579309 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 15:45:39.579309 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 15:45:39.579309 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 15:45:39.579309 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 15:45:39.579309 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 15:45:39.579309 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 15:45:39.579309 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 15:45:39.579309 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application with Lock( Jun 02 15:45:39.579309 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 15:45:39.579309 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self._enter() Jun 02 15:45:39.579309 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 15:45:39.579309 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 15:45:39.580078 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 15:45:39.580078 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self.creator() Jun 02 15:45:39.580078 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 15:45:39.580078 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application created_value = creator( Jun 02 15:45:39.580078 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 02 15:45:39.580078 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 02 15:45:39.580078 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 02 15:45:39.580078 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 02 15:45:39.580078 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 02 15:45:39.580078 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 02 15:45:39.580078 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 02 15:45:39.580078 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application Jun 02 15:45:39.580078 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 108/217] 10.222.0.59 () {56 vars in 1096 bytes} [Thu Jun 2 15:45:39 2022] GET /identity/v3/roles/admin => generated 83 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 15:45:39.580758 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-998cc6ad-6a00-4679-b1e2-d44c725ef24b None admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:45:39.615163 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG dbcounter [-] [80396] Writing DB stats keystone:SELECT=100 {{(pid=80396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:45:39.649453 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3523f700-af85-4151-bc1e-27c97b1c4f4a None admin] Validating token access rules against request {{(pid=80396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:45:39.680039 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-998cc6ad-6a00-4679-b1e2-d44c725ef24b None admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:45:39.683115 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1daf5e63-90db-4995-bde9-058a5cbc4ca4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:45:39.684557 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1daf5e63-90db-4995-bde9-058a5cbc4ca4 None admin] REQUEST_METHOD: `GET` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:45:39.684851 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1daf5e63-90db-4995-bde9-058a5cbc4ca4 None admin] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:45:39.685129 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1daf5e63-90db-4995-bde9-058a5cbc4ca4 None admin] PATH_INFO: `/v3/roles` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:45:39.685885 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1daf5e63-90db-4995-bde9-058a5cbc4ca4 None admin] RBAC: Adding query filter params (name=member) {{(pid=80396) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 15:45:39.686225 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1daf5e63-90db-4995-bde9-058a5cbc4ca4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:45:39.687604 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1daf5e63-90db-4995-bde9-058a5cbc4ca4 None admin] RBAC: Authorization granted {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:45:39.695840 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 110/218] 10.222.0.59 () {56 vars in 1101 bytes} [Thu Jun 2 15:45:39 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 15:45:39.696779 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1daf5e63-90db-4995-bde9-058a5cbc4ca4 None admin] Authenticating user token {{(pid=80396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:45:39.718678 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fca1ce46-a26b-48fb-af30-06db70272059 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:45:39.719339 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca1ce46-a26b-48fb-af30-06db70272059 None admin] REQUEST_METHOD: `POST` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:45:39.719622 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca1ce46-a26b-48fb-af30-06db70272059 None admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:45:39.719897 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca1ce46-a26b-48fb-af30-06db70272059 None admin] PATH_INFO: `/v3/users` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:45:39.720602 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fca1ce46-a26b-48fb-af30-06db70272059 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:45:39.722053 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fca1ce46-a26b-48fb-af30-06db70272059 None admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:45:39.729672 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:45:39.798381 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1daf5e63-90db-4995-bde9-058a5cbc4ca4 None admin] Validating token access rules against request {{(pid=80396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:45:39.810749 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 109/219] 10.222.0.59 () {60 vars in 1132 bytes} [Thu Jun 2 15:45:39 2022] POST /identity/v3/users => generated 297 bytes in 230 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 15:45:39.812038 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c026694-f349-469f-ae73-8828bb19e480 None None] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:45:39.812334 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c026694-f349-469f-ae73-8828bb19e480 None None] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:45:39.812619 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c026694-f349-469f-ae73-8828bb19e480 None None] PATH_INFO: `/` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:45:39.813892 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 110/220] 10.222.0.59 () {54 vars in 926 bytes} [Thu Jun 2 15:45:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 15:45:39.814746 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c026694-f349-469f-ae73-8828bb19e480 None None] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:45:39.837043 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG dbcounter [-] [80396] Writing DB stats keystone:SELECT=100 {{(pid=80396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:45:39.846054 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c766480-4d67-4257-b162-9c8ebd6fbd78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:45:39.846764 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c766480-4d67-4257-b162-9c8ebd6fbd78 None admin] REQUEST_METHOD: `GET` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:45:39.847046 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c766480-4d67-4257-b162-9c8ebd6fbd78 None admin] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:45:39.847322 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c766480-4d67-4257-b162-9c8ebd6fbd78 None admin] PATH_INFO: `/v3/roles` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:45:39.848096 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c766480-4d67-4257-b162-9c8ebd6fbd78 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80396) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 15:45:39.848407 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c766480-4d67-4257-b162-9c8ebd6fbd78 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:45:39.850105 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c766480-4d67-4257-b162-9c8ebd6fbd78 None admin] RBAC: Authorization granted {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:45:39.864875 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 111/221] 10.222.0.59 () {56 vars in 1099 bytes} [Thu Jun 2 15:45:39 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 15:45:39.864875 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801cbff8-0964-406a-b009-fa748f5b6acb None None] REQUEST_METHOD: `POST` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:45:39.864875 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801cbff8-0964-406a-b009-fa748f5b6acb None None] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:45:39.864875 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801cbff8-0964-406a-b009-fa748f5b6acb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:45:39.882479 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.auth.core [None req-801cbff8-0964-406a-b009-fa748f5b6acb None None] MFA Rules not processed for user `400d1f4db9de49638549e5db29a041e1`. Rule list: `[]` (Enabled: `True`). {{(pid=80396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 15:45:39.883628 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.fernet_utils [None req-801cbff8-0964-406a-b009-fa748f5b6acb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 15:45:39.935824 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c026694-f349-469f-ae73-8828bb19e480 None None] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:45:39.959472 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 112/222] 10.222.0.59 () {58 vars in 1023 bytes} [Thu Jun 2 15:45:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 02 15:45:39.960185 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-801cbff8-0964-406a-b009-fa748f5b6acb None None] Authenticating user token {{(pid=80396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:45:39.985528 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c707c3-d53d-4fba-ac90-ad46acce2de4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:45:39.986516 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c707c3-d53d-4fba-ac90-ad46acce2de4 None admin] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:45:39.987266 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c707c3-d53d-4fba-ac90-ad46acce2de4 None admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:45:39.987266 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c707c3-d53d-4fba-ac90-ad46acce2de4 None admin] PATH_INFO: `/v3/users/e94cb0088498492aacd150f494c17365` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:45:40.002806 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96c707c3-d53d-4fba-ac90-ad46acce2de4 None admin] RBAC: Authorizing `identity:get_user(user_id=e94cb0088498492aacd150f494c17365)` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:45:40.004308 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96c707c3-d53d-4fba-ac90-ad46acce2de4 None admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:45:40.006035 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 111/223] 10.222.0.59 () {56 vars in 1177 bytes} [Thu Jun 2 15:45:39 2022] GET /identity/v3/users/e94cb0088498492aacd150f494c17365 => generated 297 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 15:45:40.006817 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c707c3-d53d-4fba-ac90-ad46acce2de4 None admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:45:40.066402 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writing DB stats keystone:INSERT=2,keystone:SELECT=98 {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:45:40.086413 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-801cbff8-0964-406a-b009-fa748f5b6acb None None] Validating token access rules against request {{(pid=80396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:45:40.113911 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG dbcounter [-] [80396] Writing DB stats keystone:SELECT=100 {{(pid=80396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:45:40.125488 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c707c3-d53d-4fba-ac90-ad46acce2de4 None admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:45:40.135409 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e02a6c7-20c6-44a2-a4c7-100cd581785d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:45:40.138334 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e02a6c7-20c6-44a2-a4c7-100cd581785d None admin] REQUEST_METHOD: `GET` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:45:40.138782 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e02a6c7-20c6-44a2-a4c7-100cd581785d None admin] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:45:40.140357 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e02a6c7-20c6-44a2-a4c7-100cd581785d None admin] PATH_INFO: `/v3/users/6afcdf3ec3674ab887fc7347902b583f` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:45:40.142459 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e02a6c7-20c6-44a2-a4c7-100cd581785d None admin] RBAC: Authorizing `identity:get_user(user_id=6afcdf3ec3674ab887fc7347902b583f)` {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:45:40.143921 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e02a6c7-20c6-44a2-a4c7-100cd581785d None admin] RBAC: Authorization granted {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:45:40.145751 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 113/224] 10.222.0.59 () {56 vars in 1177 bytes} [Thu Jun 2 15:45:39 2022] GET /identity/v3/users/6afcdf3ec3674ab887fc7347902b583f => generated 283 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 15:45:40.146426 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e02a6c7-20c6-44a2-a4c7-100cd581785d None admin] Authenticating user token {{(pid=80396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:45:40.177787 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a7e4f49-4430-477b-b249-ba3707994f75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:45:40.178859 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a7e4f49-4430-477b-b249-ba3707994f75 None admin] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:45:40.179364 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a7e4f49-4430-477b-b249-ba3707994f75 None admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:45:40.179772 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a7e4f49-4430-477b-b249-ba3707994f75 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:45:40.194191 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a7e4f49-4430-477b-b249-ba3707994f75 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 02 15:45:40.205340 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application [None req-4a7e4f49-4430-477b-b249-ba3707994f75 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 02 15:45:40.205340 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 15:45:40.205340 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 15:45:40.205340 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 15:45:40.205340 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 15:45:40.205340 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 15:45:40.205340 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 15:45:40.205340 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 15:45:40.205340 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 15:45:40.205340 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 15:45:40.205340 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 15:45:40.205340 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 15:45:40.205340 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 02 15:45:40.205340 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 02 15:45:40.205340 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 02 15:45:40.205340 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 02 15:45:40.206510 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 02 15:45:40.206510 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 02 15:45:40.206510 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 02 15:45:40.206510 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 02 15:45:40.206510 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 15:45:40.206510 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 15:45:40.206510 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 15:45:40.206510 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 15:45:40.206510 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 15:45:40.206510 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 15:45:40.206510 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 15:45:40.206510 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application with Lock( Jun 02 15:45:40.206510 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 15:45:40.206510 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self._enter() Jun 02 15:45:40.206510 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 15:45:40.206510 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 15:45:40.207501 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 15:45:40.207501 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self.creator() Jun 02 15:45:40.207501 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 15:45:40.207501 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application created_value = creator( Jun 02 15:45:40.207501 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 02 15:45:40.207501 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 02 15:45:40.207501 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 02 15:45:40.207501 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 02 15:45:40.207501 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 02 15:45:40.207501 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 02 15:45:40.207501 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 02 15:45:40.207501 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application Jun 02 15:45:40.210625 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 112/225] 10.222.0.59 () {56 vars in 1114 bytes} [Thu Jun 2 15:45:40 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 15:45:40.211756 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a7e4f49-4430-477b-b249-ba3707994f75 None admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:45:40.279717 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e02a6c7-20c6-44a2-a4c7-100cd581785d None admin] Validating token access rules against request {{(pid=80396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:45:40.315554 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c543f75-cc23-4257-a4b4-38cdc76e348c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:45:40.316309 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c543f75-cc23-4257-a4b4-38cdc76e348c None admin] REQUEST_METHOD: `GET` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:45:40.316661 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c543f75-cc23-4257-a4b4-38cdc76e348c None admin] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:45:40.317003 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c543f75-cc23-4257-a4b4-38cdc76e348c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:45:40.328087 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a7e4f49-4430-477b-b249-ba3707994f75 None admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:45:40.340179 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writing DB stats keystone:SELECT=100 {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:45:40.365523 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91c5566e-05bd-4ef2-a00e-f5a09216f2a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:45:40.366695 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c5566e-05bd-4ef2-a00e-f5a09216f2a8 None admin] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:45:40.367126 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c5566e-05bd-4ef2-a00e-f5a09216f2a8 None admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:45:40.367577 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c5566e-05bd-4ef2-a00e-f5a09216f2a8 None admin] PATH_INFO: `/v3/projects/576f2a66e24a468b921fa6cb1e5ff6db` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:45:40.369524 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91c5566e-05bd-4ef2-a00e-f5a09216f2a8 None admin] RBAC: Authorizing `identity:get_project(project_id=576f2a66e24a468b921fa6cb1e5ff6db)` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:45:40.371350 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91c5566e-05bd-4ef2-a00e-f5a09216f2a8 None admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:45:40.373746 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 113/226] 10.222.0.59 () {56 vars in 1186 bytes} [Thu Jun 2 15:45:40 2022] GET /identity/v3/projects/576f2a66e24a468b921fa6cb1e5ff6db => generated 302 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 15:45:40.375338 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91c5566e-05bd-4ef2-a00e-f5a09216f2a8 None admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:45:40.380782 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG dbcounter [-] [80396] Writing DB stats keystone:SELECT=100 {{(pid=80396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:45:40.399061 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c543f75-cc23-4257-a4b4-38cdc76e348c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:45:40.399061 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c543f75-cc23-4257-a4b4-38cdc76e348c None admin] RBAC: Authorization granted {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:45:40.486945 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91c5566e-05bd-4ef2-a00e-f5a09216f2a8 None admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:45:40.501974 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 114/227] 10.222.0.59 () {58 vars in 1282 bytes} [Thu Jun 2 15:45:40 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 356 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 02 15:45:40.507140 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c543f75-cc23-4257-a4b4-38cdc76e348c None admin] Authenticating user token {{(pid=80396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:45:40.531165 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df654632-ef4d-49e3-aac6-d49fce6f3308 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:45:40.532237 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df654632-ef4d-49e3-aac6-d49fce6f3308 None admin] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:45:40.532741 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df654632-ef4d-49e3-aac6-d49fce6f3308 None admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:45:40.533326 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df654632-ef4d-49e3-aac6-d49fce6f3308 None admin] PATH_INFO: `/v3/roles` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:45:40.534749 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df654632-ef4d-49e3-aac6-d49fce6f3308 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80395) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 15:45:40.535334 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df654632-ef4d-49e3-aac6-d49fce6f3308 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:45:40.537373 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df654632-ef4d-49e3-aac6-d49fce6f3308 None admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:45:40.548588 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 114/228] 10.222.0.59 () {56 vars in 1111 bytes} [Thu Jun 2 15:45:40 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 15:45:40.549690 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df654632-ef4d-49e3-aac6-d49fce6f3308 None admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:45:40.604645 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writing DB stats keystone:SELECT=100 {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:45:40.612978 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG dbcounter [-] [80396] Writing DB stats keystone:SELECT=100 {{(pid=80396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:45:40.629782 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c543f75-cc23-4257-a4b4-38cdc76e348c None admin] Validating token access rules against request {{(pid=80396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:45:40.669792 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df654632-ef4d-49e3-aac6-d49fce6f3308 None admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:45:40.683892 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12e0c0ea-4de7-486e-817b-7b349a62a92d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:45:40.685808 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e0c0ea-4de7-486e-817b-7b349a62a92d None admin] REQUEST_METHOD: `PUT` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:45:40.686355 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e0c0ea-4de7-486e-817b-7b349a62a92d None admin] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:45:40.687088 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e0c0ea-4de7-486e-817b-7b349a62a92d None admin] PATH_INFO: `/v3/projects/576f2a66e24a468b921fa6cb1e5ff6db/users/6afcdf3ec3674ab887fc7347902b583f/roles/f1e0c25f6e9049e897cb7350c7e54ab3` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:45:40.690048 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12e0c0ea-4de7-486e-817b-7b349a62a92d None admin] RBAC: Authorizing `identity:create_grant(project_id=576f2a66e24a468b921fa6cb1e5ff6db, user_id=6afcdf3ec3674ab887fc7347902b583f, role_id=f1e0c25f6e9049e897cb7350c7e54ab3)` {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:45:40.692385 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12e0c0ea-4de7-486e-817b-7b349a62a92d None admin] RBAC: Authorization granted {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:45:40.709440 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e4458bf-8b2d-4229-aa21-710533ab1d7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:45:40.710343 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e4458bf-8b2d-4229-aa21-710533ab1d7f None admin] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:45:40.710630 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e4458bf-8b2d-4229-aa21-710533ab1d7f None admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:45:40.713181 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e4458bf-8b2d-4229-aa21-710533ab1d7f None admin] PATH_INFO: `/v3/projects/576f2a66e24a468b921fa6cb1e5ff6db` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:45:40.713181 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e4458bf-8b2d-4229-aa21-710533ab1d7f None admin] RBAC: Authorizing `identity:get_project(project_id=576f2a66e24a468b921fa6cb1e5ff6db)` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:45:40.714094 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e4458bf-8b2d-4229-aa21-710533ab1d7f None admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:45:40.716078 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 115/229] 10.222.0.59 () {56 vars in 1186 bytes} [Thu Jun 2 15:45:40 2022] GET /identity/v3/projects/576f2a66e24a468b921fa6cb1e5ff6db => generated 302 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 15:45:40.721523 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e4458bf-8b2d-4229-aa21-710533ab1d7f None admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:45:40.772437 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 115/230] 10.222.0.59 () {58 vars in 1439 bytes} [Thu Jun 2 15:45:40 2022] PUT /identity/v3/projects/576f2a66e24a468b921fa6cb1e5ff6db/users/6afcdf3ec3674ab887fc7347902b583f/roles/f1e0c25f6e9049e897cb7350c7e54ab3 => generated 0 bytes in 269 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 15:45:40.774196 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12e0c0ea-4de7-486e-817b-7b349a62a92d None admin] Authenticating user token {{(pid=80396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:45:40.862394 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e4458bf-8b2d-4229-aa21-710533ab1d7f None admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:45:40.880982 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writing DB stats keystone:SELECT=100 {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:45:40.913102 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12e0c0ea-4de7-486e-817b-7b349a62a92d None admin] Validating token access rules against request {{(pid=80396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:45:40.939537 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-060c03e0-3aee-411e-8271-197abdffd0ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:45:40.940348 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-060c03e0-3aee-411e-8271-197abdffd0ac None admin] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:45:40.941115 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-060c03e0-3aee-411e-8271-197abdffd0ac None admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:45:40.941115 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-060c03e0-3aee-411e-8271-197abdffd0ac None admin] PATH_INFO: `/v3/users/6afcdf3ec3674ab887fc7347902b583f` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:45:40.943568 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-060c03e0-3aee-411e-8271-197abdffd0ac None admin] RBAC: Authorizing `identity:get_user(user_id=6afcdf3ec3674ab887fc7347902b583f)` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:45:40.945122 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-060c03e0-3aee-411e-8271-197abdffd0ac None admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:45:40.951896 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 116/231] 10.222.0.59 () {56 vars in 1177 bytes} [Thu Jun 2 15:45:40 2022] GET /identity/v3/users/6afcdf3ec3674ab887fc7347902b583f => generated 283 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 15:45:40.962638 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d167219-f2c8-4dbf-bb51-91e4e1516c11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:45:40.964291 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d167219-f2c8-4dbf-bb51-91e4e1516c11 None admin] REQUEST_METHOD: `GET` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:45:40.964780 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d167219-f2c8-4dbf-bb51-91e4e1516c11 None admin] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:45:40.965250 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d167219-f2c8-4dbf-bb51-91e4e1516c11 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:45:40.965462 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-060c03e0-3aee-411e-8271-197abdffd0ac None admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:45:40.966839 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d167219-f2c8-4dbf-bb51-91e4e1516c11 None admin] RBAC: Adding query filter params (role.id=649e0f2b5a264c419ea6a1441f123a03, scope.project.id=576f2a66e24a468b921fa6cb1e5ff6db, user.id=e94cb0088498492aacd150f494c17365) {{(pid=80396) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 15:45:40.967375 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d167219-f2c8-4dbf-bb51-91e4e1516c11 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:45:40.969300 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d167219-f2c8-4dbf-bb51-91e4e1516c11 None admin] RBAC: Authorization granted {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:45:40.976863 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 116/232] 10.222.0.59 () {56 vars in 1374 bytes} [Thu Jun 2 15:45:40 2022] GET /identity/v3/role_assignments?user.id=e94cb0088498492aacd150f494c17365&scope.project.id=576f2a66e24a468b921fa6cb1e5ff6db&role.id=649e0f2b5a264c419ea6a1441f123a03 => generated 259 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 15:45:41.091838 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-060c03e0-3aee-411e-8271-197abdffd0ac None admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:45:41.130543 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e97f70c-742d-4b13-9e6e-72c424859482 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:45:41.132348 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e97f70c-742d-4b13-9e6e-72c424859482 None admin] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:45:41.132833 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e97f70c-742d-4b13-9e6e-72c424859482 None admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:45:41.133330 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e97f70c-742d-4b13-9e6e-72c424859482 None admin] PATH_INFO: `/v3/projects/576f2a66e24a468b921fa6cb1e5ff6db` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:45:41.135132 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e97f70c-742d-4b13-9e6e-72c424859482 None admin] RBAC: Authorizing `identity:get_project(project_id=576f2a66e24a468b921fa6cb1e5ff6db)` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:45:41.136941 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e97f70c-742d-4b13-9e6e-72c424859482 None admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:45:41.139171 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 117/233] 10.222.0.59 () {56 vars in 1186 bytes} [Thu Jun 2 15:45:40 2022] GET /identity/v3/projects/576f2a66e24a468b921fa6cb1e5ff6db => generated 302 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 15:45:41.145804 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d167219-f2c8-4dbf-bb51-91e4e1516c11 None admin] Authenticating user token {{(pid=80396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:45:41.164061 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG dbcounter [-] [80396] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:45:41.317910 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d167219-f2c8-4dbf-bb51-91e4e1516c11 None admin] Validating token access rules against request {{(pid=80396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:45:41.367750 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd61fc8c-9ab3-4620-b390-18ff4d8c5166 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:45:41.368657 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd61fc8c-9ab3-4620-b390-18ff4d8c5166 None admin] REQUEST_METHOD: `PUT` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:45:41.369451 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd61fc8c-9ab3-4620-b390-18ff4d8c5166 None admin] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:45:41.370222 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd61fc8c-9ab3-4620-b390-18ff4d8c5166 None admin] PATH_INFO: `/v3/projects/576f2a66e24a468b921fa6cb1e5ff6db/users/6afcdf3ec3674ab887fc7347902b583f/roles/21f49b1aa1e64120b7ef6fcf4667a641` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:45:41.372039 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd61fc8c-9ab3-4620-b390-18ff4d8c5166 None admin] RBAC: Authorizing `identity:create_grant(project_id=576f2a66e24a468b921fa6cb1e5ff6db, user_id=6afcdf3ec3674ab887fc7347902b583f, role_id=21f49b1aa1e64120b7ef6fcf4667a641)` {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:45:41.373504 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd61fc8c-9ab3-4620-b390-18ff4d8c5166 None admin] RBAC: Authorization granted {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:45:41.485949 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 117/234] 10.222.0.59 () {58 vars in 1439 bytes} [Thu Jun 2 15:45:41 2022] PUT /identity/v3/projects/576f2a66e24a468b921fa6cb1e5ff6db/users/6afcdf3ec3674ab887fc7347902b583f/roles/21f49b1aa1e64120b7ef6fcf4667a641 => generated 0 bytes in 341 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 15:45:42.492495 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f6cc8b6-5afc-4f54-b557-b8aa2f174846 None None] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:45:42.493037 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f6cc8b6-5afc-4f54-b557-b8aa2f174846 None None] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:45:42.493037 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f6cc8b6-5afc-4f54-b557-b8aa2f174846 None None] PATH_INFO: `/` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:45:42.494965 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 118/235] 10.222.0.59 () {54 vars in 926 bytes} [Thu Jun 2 15:45:42 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 15:45:42.499854 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea7a1bc-e716-4b95-903d-851e33eccbf2 None None] REQUEST_METHOD: `POST` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:45:42.500648 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea7a1bc-e716-4b95-903d-851e33eccbf2 None None] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:45:42.501127 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea7a1bc-e716-4b95-903d-851e33eccbf2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:45:42.519109 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.auth.core [None req-3ea7a1bc-e716-4b95-903d-851e33eccbf2 None None] MFA Rules not processed for user `400d1f4db9de49638549e5db29a041e1`. Rule list: `[]` (Enabled: `True`). {{(pid=80396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 15:45:42.520749 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.fernet_utils [None req-3ea7a1bc-e716-4b95-903d-851e33eccbf2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 15:45:42.592850 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 118/236] 10.222.0.59 () {58 vars in 1023 bytes} [Thu Jun 2 15:45:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 02 15:45:42.628888 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f6cc8b6-5afc-4f54-b557-b8aa2f174846 None None] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:45:42.667970 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c366c2c-990a-43f1-b31d-5a6eed707e59 None None] REQUEST_METHOD: `GET` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:45:42.668584 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c366c2c-990a-43f1-b31d-5a6eed707e59 None None] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:45:42.669062 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c366c2c-990a-43f1-b31d-5a6eed707e59 None None] PATH_INFO: `/` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:45:42.670944 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 119/237] 10.222.0.59 () {54 vars in 926 bytes} [Thu Jun 2 15:45:42 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 15:45:42.680329 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writing DB stats keystone:SELECT=100 {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:45:42.698254 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bbe6feb-4400-40d0-a7ea-67447c41a36a None None] REQUEST_METHOD: `POST` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:45:42.698881 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bbe6feb-4400-40d0-a7ea-67447c41a36a None None] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:45:42.699325 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bbe6feb-4400-40d0-a7ea-67447c41a36a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:45:42.724279 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG dbcounter [-] [80396] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:45:42.731100 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.auth.core [None req-9bbe6feb-4400-40d0-a7ea-67447c41a36a None None] MFA Rules not processed for user `400d1f4db9de49638549e5db29a041e1`. Rule list: `[]` (Enabled: `True`). {{(pid=80396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 15:45:42.732305 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.fernet_utils [None req-9bbe6feb-4400-40d0-a7ea-67447c41a36a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 15:45:42.740125 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f6cc8b6-5afc-4f54-b557-b8aa2f174846 None None] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:45:42.815972 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 120/238] 10.222.0.59 () {58 vars in 1023 bytes} [Thu Jun 2 15:45:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 02 15:45:42.831771 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7634ecbe-f105-45ee-b6f7-afbdc1e5e8c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:45:42.832853 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7634ecbe-f105-45ee-b6f7-afbdc1e5e8c9 None admin] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:45:42.833280 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7634ecbe-f105-45ee-b6f7-afbdc1e5e8c9 None admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:45:42.833697 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7634ecbe-f105-45ee-b6f7-afbdc1e5e8c9 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:45:42.841747 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bbe6feb-4400-40d0-a7ea-67447c41a36a None None] Authenticating user token {{(pid=80396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:45:42.855267 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7634ecbe-f105-45ee-b6f7-afbdc1e5e8c9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 02 15:45:42.873453 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application [None req-7634ecbe-f105-45ee-b6f7-afbdc1e5e8c9 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 02 15:45:42.873453 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 15:45:42.873453 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 15:45:42.873453 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 15:45:42.873453 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 15:45:42.873453 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 15:45:42.873453 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 15:45:42.873453 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 15:45:42.873453 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 15:45:42.873453 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 15:45:42.873453 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 15:45:42.873453 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 15:45:42.873453 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 02 15:45:42.873453 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 02 15:45:42.873453 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 02 15:45:42.873453 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 02 15:45:42.874378 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 02 15:45:42.874378 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 02 15:45:42.874378 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 02 15:45:42.874378 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 02 15:45:42.874378 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 15:45:42.874378 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 15:45:42.874378 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 15:45:42.874378 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 15:45:42.874378 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 15:45:42.874378 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 15:45:42.874378 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 15:45:42.874378 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application with Lock( Jun 02 15:45:42.874378 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 15:45:42.874378 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self._enter() Jun 02 15:45:42.874378 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 15:45:42.874378 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 15:45:42.875164 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 15:45:42.875164 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self.creator() Jun 02 15:45:42.875164 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 15:45:42.875164 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application created_value = creator( Jun 02 15:45:42.875164 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 02 15:45:42.875164 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 02 15:45:42.875164 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 02 15:45:42.875164 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 02 15:45:42.875164 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 02 15:45:42.875164 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 02 15:45:42.875164 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 02 15:45:42.875164 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application Jun 02 15:45:42.876994 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 119/239] 10.222.0.59 () {56 vars in 1099 bytes} [Thu Jun 2 15:45:42 2022] GET /identity/v3/roles/reader => generated 84 bytes in 249 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 15:45:42.882733 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7634ecbe-f105-45ee-b6f7-afbdc1e5e8c9 None admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:45:42.971383 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bbe6feb-4400-40d0-a7ea-67447c41a36a None None] Validating token access rules against request {{(pid=80396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:45:43.003688 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG dbcounter [-] [80396] Writing DB stats keystone:SELECT=100 {{(pid=80396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:45:43.019884 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-131cdc48-4490-4fa4-b488-c56fa68a036b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:45:43.021047 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-131cdc48-4490-4fa4-b488-c56fa68a036b None admin] REQUEST_METHOD: `GET` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:45:43.021624 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-131cdc48-4490-4fa4-b488-c56fa68a036b None admin] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:45:43.022143 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-131cdc48-4490-4fa4-b488-c56fa68a036b None admin] PATH_INFO: `/v3/domains/default` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:45:43.023887 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-131cdc48-4490-4fa4-b488-c56fa68a036b None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:45:43.025807 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-131cdc48-4490-4fa4-b488-c56fa68a036b None admin] RBAC: Authorization granted {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:45:43.028205 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 121/240] 10.222.0.59 () {56 vars in 1108 bytes} [Thu Jun 2 15:45:42 2022] GET /identity/v3/domains/default => generated 199 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 15:45:43.044043 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-131cdc48-4490-4fa4-b488-c56fa68a036b None admin] Authenticating user token {{(pid=80396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:45:43.066167 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7634ecbe-f105-45ee-b6f7-afbdc1e5e8c9 None admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:45:43.068428 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writing DB stats keystone:SELECT=100 {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:45:43.101206 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3763503-5d46-4f09-8ad1-19e92fa3f7a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:45:43.101880 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3763503-5d46-4f09-8ad1-19e92fa3f7a7 None admin] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:45:43.105032 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3763503-5d46-4f09-8ad1-19e92fa3f7a7 None admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:45:43.105393 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3763503-5d46-4f09-8ad1-19e92fa3f7a7 None admin] PATH_INFO: `/v3/roles` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:45:43.106207 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3763503-5d46-4f09-8ad1-19e92fa3f7a7 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80395) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 15:45:43.106531 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3763503-5d46-4f09-8ad1-19e92fa3f7a7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:45:43.108279 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3763503-5d46-4f09-8ad1-19e92fa3f7a7 None admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:45:43.125195 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 120/241] 10.222.0.59 () {56 vars in 1101 bytes} [Thu Jun 2 15:45:42 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 15:45:43.130653 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3763503-5d46-4f09-8ad1-19e92fa3f7a7 None admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:45:43.183642 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-131cdc48-4490-4fa4-b488-c56fa68a036b None admin] Validating token access rules against request {{(pid=80396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:45:43.221255 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-827dc82b-c3d4-4f01-a3fa-114149fdafb6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:45:43.222404 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-827dc82b-c3d4-4f01-a3fa-114149fdafb6 None admin] REQUEST_METHOD: `POST` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:45:43.222890 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-827dc82b-c3d4-4f01-a3fa-114149fdafb6 None admin] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:45:43.223440 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-827dc82b-c3d4-4f01-a3fa-114149fdafb6 None admin] PATH_INFO: `/v3/users` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:45:43.224390 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-827dc82b-c3d4-4f01-a3fa-114149fdafb6 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:45:43.226046 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-827dc82b-c3d4-4f01-a3fa-114149fdafb6 None admin] RBAC: Authorization granted {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:45:43.297360 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3763503-5d46-4f09-8ad1-19e92fa3f7a7 None admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:45:43.322513 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 122/242] 10.222.0.59 () {60 vars in 1132 bytes} [Thu Jun 2 15:45:43 2022] POST /identity/v3/users => generated 293 bytes in 272 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 02 15:45:43.333585 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef40d49e-d337-4931-b9a8-9c44596b2537 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:45:43.334518 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef40d49e-d337-4931-b9a8-9c44596b2537 None admin] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:45:43.334798 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef40d49e-d337-4931-b9a8-9c44596b2537 None admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:45:43.335068 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef40d49e-d337-4931-b9a8-9c44596b2537 None admin] PATH_INFO: `/v3/users/3ab71eb10c38404d947b371e2acaee8b` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:45:43.351397 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef40d49e-d337-4931-b9a8-9c44596b2537 None admin] RBAC: Authorizing `identity:get_user(user_id=3ab71eb10c38404d947b371e2acaee8b)` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:45:43.352914 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef40d49e-d337-4931-b9a8-9c44596b2537 None admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:45:43.355071 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 121/243] 10.222.0.59 () {56 vars in 1177 bytes} [Thu Jun 2 15:45:43 2022] GET /identity/v3/users/3ab71eb10c38404d947b371e2acaee8b => generated 297 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 15:45:43.360789 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-827dc82b-c3d4-4f01-a3fa-114149fdafb6 None admin] Authenticating user token {{(pid=80396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:45:43.454706 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG dbcounter [-] [80396] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:45:43.524340 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-827dc82b-c3d4-4f01-a3fa-114149fdafb6 None admin] Validating token access rules against request {{(pid=80396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:45:43.575893 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a5a46b1-6a85-4a6f-875a-87503d7ea063 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:45:43.576481 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a5a46b1-6a85-4a6f-875a-87503d7ea063 None admin] REQUEST_METHOD: `GET` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:45:43.576764 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a5a46b1-6a85-4a6f-875a-87503d7ea063 None admin] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:45:43.577043 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a5a46b1-6a85-4a6f-875a-87503d7ea063 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:45:43.664136 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a5a46b1-6a85-4a6f-875a-87503d7ea063 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:45:43.666752 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a5a46b1-6a85-4a6f-875a-87503d7ea063 None admin] RBAC: Authorization granted {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:45:43.726352 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG dbcounter [-] [80396] Writing DB stats keystone:SELECT=100 {{(pid=80396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:45:43.732836 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c01d76-b6c2-4ce5-970b-cadeb4235e16 None None] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:45:43.733316 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c01d76-b6c2-4ce5-970b-cadeb4235e16 None None] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:45:43.739027 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c01d76-b6c2-4ce5-970b-cadeb4235e16 None None] PATH_INFO: `/` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:45:43.739027 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 122/244] 10.222.0.59 () {54 vars in 926 bytes} [Thu Jun 2 15:45:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 02 15:45:43.739535 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceba8427-e5fd-4847-8c3e-27be1e76e182 None None] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:45:43.739820 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceba8427-e5fd-4847-8c3e-27be1e76e182 None None] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:45:43.740102 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceba8427-e5fd-4847-8c3e-27be1e76e182 None None] PATH_INFO: `/` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:45:43.741552 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 123/245] 10.222.0.59 () {54 vars in 926 bytes} [Thu Jun 2 15:45:43 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 15:45:43.746686 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f28bca2-3516-4e61-bed6-144aa583522f None None] REQUEST_METHOD: `POST` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:45:43.746968 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f28bca2-3516-4e61-bed6-144aa583522f None None] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:45:43.747248 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f28bca2-3516-4e61-bed6-144aa583522f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:45:43.770241 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.auth.core [None req-2f28bca2-3516-4e61-bed6-144aa583522f None None] MFA Rules not processed for user `400d1f4db9de49638549e5db29a041e1`. Rule list: `[]` (Enabled: `True`). {{(pid=80395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 15:45:43.771436 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.fernet_utils [None req-2f28bca2-3516-4e61-bed6-144aa583522f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 15:45:43.784748 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 123/246] 10.222.0.59 () {58 vars in 1282 bytes} [Thu Jun 2 15:45:43 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 424 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 02 15:45:43.791511 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-284ee5d8-2fc4-4348-8b66-0b7cb03b8897 None None] REQUEST_METHOD: `POST` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:45:43.791828 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-284ee5d8-2fc4-4348-8b66-0b7cb03b8897 None None] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:45:43.792073 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-284ee5d8-2fc4-4348-8b66-0b7cb03b8897 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:45:43.805837 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writing DB stats keystone:SELECT=100 {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:45:43.810531 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.auth.core [None req-284ee5d8-2fc4-4348-8b66-0b7cb03b8897 None None] MFA Rules not processed for user `400d1f4db9de49638549e5db29a041e1`. Rule list: `[]` (Enabled: `True`). {{(pid=80396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 15:45:43.811734 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.fernet_utils [None req-284ee5d8-2fc4-4348-8b66-0b7cb03b8897 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 15:45:43.878335 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 124/247] 10.222.0.59 () {58 vars in 1023 bytes} [Thu Jun 2 15:45:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 02 15:45:43.882905 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f28bca2-3516-4e61-bed6-144aa583522f None None] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:45:43.898527 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 124/248] 10.222.0.59 () {58 vars in 1023 bytes} [Thu Jun 2 15:45:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 02 15:45:43.908010 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-284ee5d8-2fc4-4348-8b66-0b7cb03b8897 None None] Authenticating user token {{(pid=80396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:45:44.013777 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f28bca2-3516-4e61-bed6-144aa583522f None None] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:45:44.038572 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG dbcounter [-] [80396] Writing DB stats keystone:SELECT=100 {{(pid=80396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:45:44.061631 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-284ee5d8-2fc4-4348-8b66-0b7cb03b8897 None None] Validating token access rules against request {{(pid=80396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:45:44.074823 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce1387f6-b719-497b-8ae2-4612b69f054b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:45:44.076005 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce1387f6-b719-497b-8ae2-4612b69f054b None admin] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:45:44.076462 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce1387f6-b719-497b-8ae2-4612b69f054b None admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:45:44.076915 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce1387f6-b719-497b-8ae2-4612b69f054b None admin] PATH_INFO: `/v3/projects/576f2a66e24a468b921fa6cb1e5ff6db` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:45:44.082878 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce1387f6-b719-497b-8ae2-4612b69f054b None admin] RBAC: Authorizing `identity:get_project(project_id=576f2a66e24a468b921fa6cb1e5ff6db)` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:45:44.085747 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce1387f6-b719-497b-8ae2-4612b69f054b None admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:45:44.088357 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 125/249] 10.222.0.59 () {56 vars in 1186 bytes} [Thu Jun 2 15:45:43 2022] GET /identity/v3/projects/576f2a66e24a468b921fa6cb1e5ff6db => generated 302 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 15:45:44.090819 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce1387f6-b719-497b-8ae2-4612b69f054b None admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:45:44.133249 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-353584e4-be52-4094-ba8a-8e5efcf91f2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:45:44.134541 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-353584e4-be52-4094-ba8a-8e5efcf91f2b None admin] REQUEST_METHOD: `GET` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:45:44.136468 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-353584e4-be52-4094-ba8a-8e5efcf91f2b None admin] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:45:44.137517 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-353584e4-be52-4094-ba8a-8e5efcf91f2b None admin] PATH_INFO: `/v3/roles/member` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:45:44.143806 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writing DB stats keystone:SELECT=100 {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:45:44.166847 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-353584e4-be52-4094-ba8a-8e5efcf91f2b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 02 15:45:44.181920 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application [None req-353584e4-be52-4094-ba8a-8e5efcf91f2b None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 02 15:45:44.181920 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 15:45:44.181920 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 15:45:44.181920 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 15:45:44.181920 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 15:45:44.181920 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 15:45:44.181920 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 15:45:44.181920 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 15:45:44.181920 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 15:45:44.181920 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 15:45:44.181920 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 15:45:44.181920 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 15:45:44.181920 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 02 15:45:44.181920 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 02 15:45:44.181920 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 02 15:45:44.181920 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 02 15:45:44.182850 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 02 15:45:44.182850 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 02 15:45:44.182850 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 02 15:45:44.182850 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 02 15:45:44.182850 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 15:45:44.182850 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 15:45:44.182850 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 15:45:44.182850 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 15:45:44.182850 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 15:45:44.182850 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 15:45:44.182850 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 15:45:44.182850 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application with Lock( Jun 02 15:45:44.182850 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 15:45:44.182850 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application return self._enter() Jun 02 15:45:44.182850 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 15:45:44.182850 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 15:45:44.183640 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 15:45:44.183640 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application return self.creator() Jun 02 15:45:44.183640 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 15:45:44.183640 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application created_value = creator( Jun 02 15:45:44.183640 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 02 15:45:44.183640 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 02 15:45:44.183640 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 02 15:45:44.183640 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 02 15:45:44.183640 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 02 15:45:44.183640 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 02 15:45:44.183640 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 02 15:45:44.183640 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application Jun 02 15:45:44.189502 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 125/250] 10.222.0.59 () {56 vars in 1099 bytes} [Thu Jun 2 15:45:43 2022] GET /identity/v3/roles/member => generated 84 bytes in 278 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 02 15:45:44.194988 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-353584e4-be52-4094-ba8a-8e5efcf91f2b None admin] Authenticating user token {{(pid=80396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:45:44.328466 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce1387f6-b719-497b-8ae2-4612b69f054b None admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:45:44.371844 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c43496e6-7088-401e-b512-dc7b0c8d77d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:45:44.372637 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43496e6-7088-401e-b512-dc7b0c8d77d3 None admin] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:45:44.372916 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43496e6-7088-401e-b512-dc7b0c8d77d3 None admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:45:44.373187 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43496e6-7088-401e-b512-dc7b0c8d77d3 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:45:44.386843 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c43496e6-7088-401e-b512-dc7b0c8d77d3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 02 15:45:44.396382 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application [None req-c43496e6-7088-401e-b512-dc7b0c8d77d3 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 02 15:45:44.396382 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 15:45:44.396382 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 15:45:44.396382 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 15:45:44.396382 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 15:45:44.396382 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 15:45:44.396382 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 15:45:44.396382 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 15:45:44.396382 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 15:45:44.396382 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 15:45:44.396382 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 15:45:44.396382 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 15:45:44.396382 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 02 15:45:44.396382 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 02 15:45:44.396382 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 02 15:45:44.396382 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 02 15:45:44.397265 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 02 15:45:44.397265 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 02 15:45:44.397265 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 02 15:45:44.397265 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 02 15:45:44.397265 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 15:45:44.397265 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 15:45:44.397265 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 15:45:44.397265 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 15:45:44.397265 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 15:45:44.397265 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 15:45:44.397265 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 15:45:44.397265 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application with Lock( Jun 02 15:45:44.397265 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 15:45:44.397265 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self._enter() Jun 02 15:45:44.397265 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 15:45:44.397265 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 15:45:44.398067 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 15:45:44.398067 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self.creator() Jun 02 15:45:44.398067 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 15:45:44.398067 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application created_value = creator( Jun 02 15:45:44.398067 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 02 15:45:44.398067 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 02 15:45:44.398067 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 02 15:45:44.398067 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 02 15:45:44.398067 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 02 15:45:44.398067 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 02 15:45:44.398067 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 02 15:45:44.398067 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application Jun 02 15:45:44.398709 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 126/251] 10.222.0.59 () {56 vars in 1096 bytes} [Thu Jun 2 15:45:44 2022] GET /identity/v3/roles/admin => generated 83 bytes in 309 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 15:45:44.402095 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c43496e6-7088-401e-b512-dc7b0c8d77d3 None admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:45:44.402217 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-353584e4-be52-4094-ba8a-8e5efcf91f2b None admin] Validating token access rules against request {{(pid=80396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:45:44.438167 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6186943-65a3-4f72-a0e5-e6f45d429159 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:45:44.438823 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6186943-65a3-4f72-a0e5-e6f45d429159 None admin] REQUEST_METHOD: `GET` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:45:44.439105 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6186943-65a3-4f72-a0e5-e6f45d429159 None admin] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:45:44.439381 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6186943-65a3-4f72-a0e5-e6f45d429159 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:45:44.440226 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6186943-65a3-4f72-a0e5-e6f45d429159 None admin] RBAC: Adding query filter params (role.id=67885c18a3dc47718e9197097185f65d, scope.project.id=576f2a66e24a468b921fa6cb1e5ff6db, user.id=3ab71eb10c38404d947b371e2acaee8b) {{(pid=80396) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 15:45:44.440537 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6186943-65a3-4f72-a0e5-e6f45d429159 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:45:44.441995 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6186943-65a3-4f72-a0e5-e6f45d429159 None admin] RBAC: Authorization granted {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:45:44.448885 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 126/252] 10.222.0.59 () {56 vars in 1374 bytes} [Thu Jun 2 15:45:44 2022] GET /identity/v3/role_assignments?user.id=3ab71eb10c38404d947b371e2acaee8b&scope.project.id=576f2a66e24a468b921fa6cb1e5ff6db&role.id=67885c18a3dc47718e9197097185f65d => generated 259 bytes in 259 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 15:45:44.450260 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f4f7b5-cbd7-4f3b-ad61-e4c46c4fa487 None None] REQUEST_METHOD: `GET` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:45:44.450548 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f4f7b5-cbd7-4f3b-ad61-e4c46c4fa487 None None] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:45:44.450828 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f4f7b5-cbd7-4f3b-ad61-e4c46c4fa487 None None] PATH_INFO: `/` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:45:44.452120 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 127/253] 10.222.0.59 () {54 vars in 926 bytes} [Thu Jun 2 15:45:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 15:45:44.452847 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03f4f7b5-cbd7-4f3b-ad61-e4c46c4fa487 None None] Authenticating user token {{(pid=80396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:45:44.471200 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG dbcounter [-] [80396] Writing DB stats keystone:SELECT=100 {{(pid=80396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:45:44.519703 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writing DB stats keystone:SELECT=100 {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:45:44.557446 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c43496e6-7088-401e-b512-dc7b0c8d77d3 None admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:45:44.647418 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03f4f7b5-cbd7-4f3b-ad61-e4c46c4fa487 None None] Validating token access rules against request {{(pid=80396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:45:44.652370 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64afdc27-b004-4645-8fe9-7d3a3bf5c845 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:45:44.653049 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64afdc27-b004-4645-8fe9-7d3a3bf5c845 None admin] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:45:44.653328 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64afdc27-b004-4645-8fe9-7d3a3bf5c845 None admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:45:44.653601 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64afdc27-b004-4645-8fe9-7d3a3bf5c845 None admin] PATH_INFO: `/v3/roles` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:45:44.654389 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64afdc27-b004-4645-8fe9-7d3a3bf5c845 None admin] RBAC: Adding query filter params (name=member) {{(pid=80395) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 15:45:44.654694 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64afdc27-b004-4645-8fe9-7d3a3bf5c845 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:45:44.656104 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64afdc27-b004-4645-8fe9-7d3a3bf5c845 None admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:45:44.681903 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 127/254] 10.222.0.59 () {56 vars in 1101 bytes} [Thu Jun 2 15:45:44 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 283 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 15:45:44.689220 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0829bf46-2793-402a-ab1d-c04834e2238f None None] REQUEST_METHOD: `POST` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:45:44.689521 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0829bf46-2793-402a-ab1d-c04834e2238f None None] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:45:44.689778 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0829bf46-2793-402a-ab1d-c04834e2238f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:45:44.715956 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28b3a6d2-d5c4-4309-8951-61a6377ea61e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:45:44.717310 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b3a6d2-d5c4-4309-8951-61a6377ea61e None admin] REQUEST_METHOD: `GET` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:45:44.717310 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b3a6d2-d5c4-4309-8951-61a6377ea61e None admin] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:45:44.717310 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b3a6d2-d5c4-4309-8951-61a6377ea61e None admin] PATH_INFO: `/v3/roles` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:45:44.717674 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28b3a6d2-d5c4-4309-8951-61a6377ea61e None admin] RBAC: Adding query filter params (name=admin) {{(pid=80396) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 15:45:44.717942 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28b3a6d2-d5c4-4309-8951-61a6377ea61e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:45:44.719361 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28b3a6d2-d5c4-4309-8951-61a6377ea61e None admin] RBAC: Authorization granted {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:45:44.724050 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.auth.core [None req-0829bf46-2793-402a-ab1d-c04834e2238f None None] MFA Rules not processed for user `400d1f4db9de49638549e5db29a041e1`. Rule list: `[]` (Enabled: `True`). {{(pid=80395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 15:45:44.725484 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.fernet_utils [None req-0829bf46-2793-402a-ab1d-c04834e2238f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 15:45:44.729693 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 128/255] 10.222.0.59 () {56 vars in 1099 bytes} [Thu Jun 2 15:45:44 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 277 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 15:45:44.730437 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28b3a6d2-d5c4-4309-8951-61a6377ea61e None admin] Authenticating user token {{(pid=80396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:45:44.854082 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 128/256] 10.222.0.59 () {58 vars in 1023 bytes} [Thu Jun 2 15:45:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 02 15:45:44.854996 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0829bf46-2793-402a-ab1d-c04834e2238f None None] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:45:44.867988 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG dbcounter [-] [80396] Writing DB stats keystone:SELECT=100 {{(pid=80396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:45:44.909933 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28b3a6d2-d5c4-4309-8951-61a6377ea61e None admin] Validating token access rules against request {{(pid=80396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:45:44.949047 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f796e837-91ce-4d4d-9090-0a61c5e9f0cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:45:44.949922 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f796e837-91ce-4d4d-9090-0a61c5e9f0cb None admin] REQUEST_METHOD: `GET` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:45:44.950244 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f796e837-91ce-4d4d-9090-0a61c5e9f0cb None admin] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:45:44.950523 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f796e837-91ce-4d4d-9090-0a61c5e9f0cb None admin] PATH_INFO: `/v3/users/e94cb0088498492aacd150f494c17365` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:45:44.952276 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f796e837-91ce-4d4d-9090-0a61c5e9f0cb None admin] RBAC: Authorizing `identity:get_user(user_id=e94cb0088498492aacd150f494c17365)` {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:45:44.953721 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f796e837-91ce-4d4d-9090-0a61c5e9f0cb None admin] RBAC: Authorization granted {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:45:44.955536 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 129/257] 10.222.0.59 () {56 vars in 1177 bytes} [Thu Jun 2 15:45:44 2022] GET /identity/v3/users/e94cb0088498492aacd150f494c17365 => generated 297 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 15:45:44.956759 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f796e837-91ce-4d4d-9090-0a61c5e9f0cb None admin] Authenticating user token {{(pid=80396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:45:45.063246 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writing DB stats keystone:SELECT=100 {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:45:45.080725 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f796e837-91ce-4d4d-9090-0a61c5e9f0cb None admin] Validating token access rules against request {{(pid=80396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:45:45.119869 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97f83246-d9b1-489f-bd61-c339431d9c0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:45:45.126113 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f83246-d9b1-489f-bd61-c339431d9c0d None admin] REQUEST_METHOD: `GET` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:45:45.126113 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f83246-d9b1-489f-bd61-c339431d9c0d None admin] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:45:45.126113 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f83246-d9b1-489f-bd61-c339431d9c0d None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:45:45.130331 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0829bf46-2793-402a-ab1d-c04834e2238f None None] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:45:45.138150 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97f83246-d9b1-489f-bd61-c339431d9c0d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 02 15:45:45.142474 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG dbcounter [-] [80396] Writing DB stats keystone:SELECT=100 {{(pid=80396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:45:45.148347 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application [None req-97f83246-d9b1-489f-bd61-c339431d9c0d None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 02 15:45:45.148347 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 15:45:45.148347 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 15:45:45.148347 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 15:45:45.148347 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 15:45:45.148347 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 15:45:45.148347 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 15:45:45.148347 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 15:45:45.148347 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 15:45:45.148347 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 15:45:45.148347 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 15:45:45.148347 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 15:45:45.148347 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 02 15:45:45.148347 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 02 15:45:45.148347 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 02 15:45:45.148347 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 02 15:45:45.149202 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 02 15:45:45.149202 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 02 15:45:45.149202 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 02 15:45:45.149202 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 02 15:45:45.149202 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 15:45:45.149202 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 15:45:45.149202 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 15:45:45.149202 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 15:45:45.149202 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 15:45:45.149202 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 15:45:45.149202 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 15:45:45.149202 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application with Lock( Jun 02 15:45:45.149202 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 15:45:45.149202 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application return self._enter() Jun 02 15:45:45.149202 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 15:45:45.149202 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 15:45:45.150040 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 15:45:45.150040 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application return self.creator() Jun 02 15:45:45.150040 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 15:45:45.150040 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application created_value = creator( Jun 02 15:45:45.150040 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 02 15:45:45.150040 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 02 15:45:45.150040 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 02 15:45:45.150040 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 02 15:45:45.150040 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 02 15:45:45.150040 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 02 15:45:45.150040 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 02 15:45:45.150040 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application Jun 02 15:45:45.151586 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 130/258] 10.222.0.59 () {56 vars in 1114 bytes} [Thu Jun 2 15:45:44 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 15:45:45.151752 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97f83246-d9b1-489f-bd61-c339431d9c0d None admin] Authenticating user token {{(pid=80396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:45:45.211480 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0471910f-d8fb-48c4-9f86-5fd2957ee064 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:45:45.212456 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0471910f-d8fb-48c4-9f86-5fd2957ee064 None admin] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:45:45.212751 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0471910f-d8fb-48c4-9f86-5fd2957ee064 None admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:45:45.213007 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0471910f-d8fb-48c4-9f86-5fd2957ee064 None admin] PATH_INFO: `/v3/users/6afcdf3ec3674ab887fc7347902b583f` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:45:45.215137 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0471910f-d8fb-48c4-9f86-5fd2957ee064 None admin] RBAC: Authorizing `identity:get_user(user_id=6afcdf3ec3674ab887fc7347902b583f)` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:45:45.216806 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0471910f-d8fb-48c4-9f86-5fd2957ee064 None admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:45:45.219301 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 129/259] 10.222.0.59 () {56 vars in 1177 bytes} [Thu Jun 2 15:45:44 2022] GET /identity/v3/users/6afcdf3ec3674ab887fc7347902b583f => generated 283 bytes in 364 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 15:45:45.219779 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0471910f-d8fb-48c4-9f86-5fd2957ee064 None admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:45:45.328374 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0471910f-d8fb-48c4-9f86-5fd2957ee064 None admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:45:45.367467 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecdbd234-08d7-4a1b-8e25-c5e00462862b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:45:45.368136 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecdbd234-08d7-4a1b-8e25-c5e00462862b None admin] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:45:45.368420 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecdbd234-08d7-4a1b-8e25-c5e00462862b None admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:45:45.368726 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecdbd234-08d7-4a1b-8e25-c5e00462862b None admin] PATH_INFO: `/v3/roles` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:45:45.370033 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecdbd234-08d7-4a1b-8e25-c5e00462862b None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80395) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 15:45:45.370388 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecdbd234-08d7-4a1b-8e25-c5e00462862b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:45:45.371916 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecdbd234-08d7-4a1b-8e25-c5e00462862b None admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:45:45.380779 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 130/260] 10.222.0.59 () {56 vars in 1111 bytes} [Thu Jun 2 15:45:45 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 15:45:45.381610 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecdbd234-08d7-4a1b-8e25-c5e00462862b None admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:45:45.422533 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writing DB stats keystone:SELECT=100 {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:45:45.469529 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97f83246-d9b1-489f-bd61-c339431d9c0d None admin] Validating token access rules against request {{(pid=80396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:45:45.494155 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecdbd234-08d7-4a1b-8e25-c5e00462862b None admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:45:45.506006 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c09ddc25-b369-48d5-8e77-9e5458fa3a38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:45:45.507027 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09ddc25-b369-48d5-8e77-9e5458fa3a38 None admin] REQUEST_METHOD: `GET` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:45:45.507407 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09ddc25-b369-48d5-8e77-9e5458fa3a38 None admin] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:45:45.507796 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09ddc25-b369-48d5-8e77-9e5458fa3a38 None admin] PATH_INFO: `/v3/projects/576f2a66e24a468b921fa6cb1e5ff6db` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:45:45.509082 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c09ddc25-b369-48d5-8e77-9e5458fa3a38 None admin] RBAC: Authorizing `identity:get_project(project_id=576f2a66e24a468b921fa6cb1e5ff6db)` {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:45:45.511186 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c09ddc25-b369-48d5-8e77-9e5458fa3a38 None admin] RBAC: Authorization granted {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:45:45.513286 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 131/261] 10.222.0.59 () {56 vars in 1186 bytes} [Thu Jun 2 15:45:45 2022] GET /identity/v3/projects/576f2a66e24a468b921fa6cb1e5ff6db => generated 302 bytes in 362 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 15:45:45.518253 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c09ddc25-b369-48d5-8e77-9e5458fa3a38 None admin] Authenticating user token {{(pid=80396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:45:45.556001 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-495ec565-247e-4132-8ea9-d7aa65818dd6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:45:45.556815 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-495ec565-247e-4132-8ea9-d7aa65818dd6 None admin] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:45:45.557110 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-495ec565-247e-4132-8ea9-d7aa65818dd6 None admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:45:45.557375 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-495ec565-247e-4132-8ea9-d7aa65818dd6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:45:45.600253 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG dbcounter [-] [80396] Writing DB stats keystone:SELECT=100 {{(pid=80396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:45:45.626460 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c09ddc25-b369-48d5-8e77-9e5458fa3a38 None admin] Validating token access rules against request {{(pid=80396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:45:45.661831 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f801a8-27e0-46be-b058-20cabaf38429 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:45:45.662842 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f801a8-27e0-46be-b058-20cabaf38429 None admin] REQUEST_METHOD: `GET` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:45:45.663189 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f801a8-27e0-46be-b058-20cabaf38429 None admin] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:45:45.663540 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f801a8-27e0-46be-b058-20cabaf38429 None admin] PATH_INFO: `/v3/users/6afcdf3ec3674ab887fc7347902b583f` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:45:45.664821 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0f801a8-27e0-46be-b058-20cabaf38429 None admin] RBAC: Authorizing `identity:get_user(user_id=6afcdf3ec3674ab887fc7347902b583f)` {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:45:45.667086 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0f801a8-27e0-46be-b058-20cabaf38429 None admin] RBAC: Authorization granted {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:45:45.669110 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 132/262] 10.222.0.59 () {56 vars in 1177 bytes} [Thu Jun 2 15:45:45 2022] GET /identity/v3/users/6afcdf3ec3674ab887fc7347902b583f => generated 283 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 15:45:45.669918 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f801a8-27e0-46be-b058-20cabaf38429 None admin] Authenticating user token {{(pid=80396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:45:45.734975 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-495ec565-247e-4132-8ea9-d7aa65818dd6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:45:45.736392 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-495ec565-247e-4132-8ea9-d7aa65818dd6 None admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:45:45.747087 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writing DB stats keystone:SELECT=100 {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:45:45.778241 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f801a8-27e0-46be-b058-20cabaf38429 None admin] Validating token access rules against request {{(pid=80396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:45:45.815169 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c09d111a-ee46-40e8-b06f-44bfc28baabd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:45:45.816055 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09d111a-ee46-40e8-b06f-44bfc28baabd None admin] REQUEST_METHOD: `PUT` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:45:45.816335 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09d111a-ee46-40e8-b06f-44bfc28baabd None admin] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:45:45.816613 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09d111a-ee46-40e8-b06f-44bfc28baabd None admin] PATH_INFO: `/v3/projects/576f2a66e24a468b921fa6cb1e5ff6db/users/e94cb0088498492aacd150f494c17365/roles/649e0f2b5a264c419ea6a1441f123a03` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:45:45.820351 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c09d111a-ee46-40e8-b06f-44bfc28baabd None admin] RBAC: Authorizing `identity:create_grant(project_id=576f2a66e24a468b921fa6cb1e5ff6db, user_id=e94cb0088498492aacd150f494c17365, role_id=649e0f2b5a264c419ea6a1441f123a03)` {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:45:45.821827 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c09d111a-ee46-40e8-b06f-44bfc28baabd None admin] RBAC: Authorization granted {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:45:45.831901 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG dbcounter [-] [80396] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:45:45.910967 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 133/263] 10.222.0.59 () {58 vars in 1439 bytes} [Thu Jun 2 15:45:45 2022] PUT /identity/v3/projects/576f2a66e24a468b921fa6cb1e5ff6db/users/e94cb0088498492aacd150f494c17365/roles/649e0f2b5a264c419ea6a1441f123a03 => generated 0 bytes in 241 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 15:45:45.911887 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c09d111a-ee46-40e8-b06f-44bfc28baabd None admin] Authenticating user token {{(pid=80396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:45:45.947425 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 131/264] 10.222.0.59 () {58 vars in 1282 bytes} [Thu Jun 2 15:45:45 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 566 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 02 15:45:45.953032 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-495ec565-247e-4132-8ea9-d7aa65818dd6 None admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:45:46.155528 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c09d111a-ee46-40e8-b06f-44bfc28baabd None admin] Validating token access rules against request {{(pid=80396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:45:46.219439 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-495ec565-247e-4132-8ea9-d7aa65818dd6 None admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:45:46.250439 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writing DB stats keystone:SELECT=100 {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:45:46.262565 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e8fec9-5f03-4eb0-a136-26af811025f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:45:46.263690 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e8fec9-5f03-4eb0-a136-26af811025f6 None admin] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:45:46.264063 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e8fec9-5f03-4eb0-a136-26af811025f6 None admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:45:46.264399 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e8fec9-5f03-4eb0-a136-26af811025f6 None admin] PATH_INFO: `/v3/projects/576f2a66e24a468b921fa6cb1e5ff6db` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:45:46.265702 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72e8fec9-5f03-4eb0-a136-26af811025f6 None admin] RBAC: Authorizing `identity:get_project(project_id=576f2a66e24a468b921fa6cb1e5ff6db)` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:45:46.267437 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72e8fec9-5f03-4eb0-a136-26af811025f6 None admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:45:46.269511 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 132/265] 10.222.0.59 () {56 vars in 1186 bytes} [Thu Jun 2 15:45:45 2022] GET /identity/v3/projects/576f2a66e24a468b921fa6cb1e5ff6db => generated 302 bytes in 317 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 15:45:46.274493 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27f86d87-8762-41a9-9c29-a0a7c5ebc3a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:45:46.275737 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f86d87-8762-41a9-9c29-a0a7c5ebc3a0 None admin] REQUEST_METHOD: `GET` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:45:46.276020 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f86d87-8762-41a9-9c29-a0a7c5ebc3a0 None admin] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:45:46.276412 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f86d87-8762-41a9-9c29-a0a7c5ebc3a0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:45:46.279723 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e8fec9-5f03-4eb0-a136-26af811025f6 None admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:45:46.368488 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG dbcounter [-] [80396] Writing DB stats keystone:SELECT=100 {{(pid=80396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:45:46.379713 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27f86d87-8762-41a9-9c29-a0a7c5ebc3a0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:45:46.381179 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27f86d87-8762-41a9-9c29-a0a7c5ebc3a0 None admin] RBAC: Authorization granted {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:45:46.441299 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e8fec9-5f03-4eb0-a136-26af811025f6 None admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:45:46.483584 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ad56d9a-7059-4a17-8f55-45fa884ec08b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:45:46.484701 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad56d9a-7059-4a17-8f55-45fa884ec08b None admin] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:45:46.485210 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad56d9a-7059-4a17-8f55-45fa884ec08b None admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:45:46.485655 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad56d9a-7059-4a17-8f55-45fa884ec08b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:45:46.486684 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ad56d9a-7059-4a17-8f55-45fa884ec08b None admin] RBAC: Adding query filter params (role.id=f1e0c25f6e9049e897cb7350c7e54ab3, scope.project.id=576f2a66e24a468b921fa6cb1e5ff6db, user.id=6afcdf3ec3674ab887fc7347902b583f) {{(pid=80395) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 15:45:46.487181 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ad56d9a-7059-4a17-8f55-45fa884ec08b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:45:46.489033 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ad56d9a-7059-4a17-8f55-45fa884ec08b None admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:45:46.496215 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 133/266] 10.222.0.59 () {56 vars in 1374 bytes} [Thu Jun 2 15:45:46 2022] GET /identity/v3/role_assignments?user.id=6afcdf3ec3674ab887fc7347902b583f&scope.project.id=576f2a66e24a468b921fa6cb1e5ff6db&role.id=f1e0c25f6e9049e897cb7350c7e54ab3 => generated 608 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 15:45:46.497566 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f19e14-3120-423b-9b62-b85370084a93 None None] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:45:46.497858 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f19e14-3120-423b-9b62-b85370084a93 None None] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:45:46.498148 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f19e14-3120-423b-9b62-b85370084a93 None None] PATH_INFO: `/` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:45:46.499647 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 134/267] 10.222.0.59 () {54 vars in 926 bytes} [Thu Jun 2 15:45:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 15:45:46.504695 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c11a6a9e-80b8-4042-a59c-df8cd44836e4 None None] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:45:46.504695 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c11a6a9e-80b8-4042-a59c-df8cd44836e4 None None] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:45:46.504695 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c11a6a9e-80b8-4042-a59c-df8cd44836e4 None None] PATH_INFO: `/` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:45:46.506969 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 135/268] 10.222.0.59 () {54 vars in 926 bytes} [Thu Jun 2 15:45:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 15:45:46.508445 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e50660e-4194-4c07-94cc-a7826b7b10ce None None] REQUEST_METHOD: `POST` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:45:46.508737 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e50660e-4194-4c07-94cc-a7826b7b10ce None None] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:45:46.509116 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e50660e-4194-4c07-94cc-a7826b7b10ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:45:46.528269 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.auth.core [None req-9e50660e-4194-4c07-94cc-a7826b7b10ce None None] MFA Rules not processed for user `400d1f4db9de49638549e5db29a041e1`. Rule list: `[]` (Enabled: `True`). {{(pid=80395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 15:45:46.529464 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.fernet_utils [None req-9e50660e-4194-4c07-94cc-a7826b7b10ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 15:45:46.535921 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 134/269] 10.222.0.59 () {58 vars in 1282 bytes} [Thu Jun 2 15:45:45 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 624 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 02 15:45:46.542021 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc3bdeef-efe5-4609-8f70-8870d5ec223c None None] REQUEST_METHOD: `POST` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:45:46.542021 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc3bdeef-efe5-4609-8f70-8870d5ec223c None None] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:45:46.542021 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc3bdeef-efe5-4609-8f70-8870d5ec223c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:45:46.572392 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writing DB stats keystone:SELECT=100 {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:45:46.594104 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.auth.core [None req-fc3bdeef-efe5-4609-8f70-8870d5ec223c None None] MFA Rules not processed for user `400d1f4db9de49638549e5db29a041e1`. Rule list: `[]` (Enabled: `True`). {{(pid=80396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 15:45:46.595290 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.fernet_utils [None req-fc3bdeef-efe5-4609-8f70-8870d5ec223c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 15:45:46.623818 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 136/270] 10.222.0.59 () {58 vars in 1023 bytes} [Thu Jun 2 15:45:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 02 15:45:46.631277 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e50660e-4194-4c07-94cc-a7826b7b10ce None None] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:45:46.740024 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 135/271] 10.222.0.59 () {58 vars in 1023 bytes} [Thu Jun 2 15:45:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 02 15:45:46.741653 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc3bdeef-efe5-4609-8f70-8870d5ec223c None None] Authenticating user token {{(pid=80396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:45:46.798975 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG dbcounter [-] [80396] Writing DB stats keystone:SELECT=100 {{(pid=80396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:45:46.841853 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e50660e-4194-4c07-94cc-a7826b7b10ce None None] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:45:46.891330 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-651411ca-f6eb-4e4c-a248-29d1bd1dc6d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:45:46.892550 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-651411ca-f6eb-4e4c-a248-29d1bd1dc6d5 None admin] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:45:46.893025 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-651411ca-f6eb-4e4c-a248-29d1bd1dc6d5 None admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:45:46.893532 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-651411ca-f6eb-4e4c-a248-29d1bd1dc6d5 None admin] PATH_INFO: `/v3/projects/576f2a66e24a468b921fa6cb1e5ff6db` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:45:46.894964 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-651411ca-f6eb-4e4c-a248-29d1bd1dc6d5 None admin] RBAC: Authorizing `identity:get_project(project_id=576f2a66e24a468b921fa6cb1e5ff6db)` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:45:46.896624 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-651411ca-f6eb-4e4c-a248-29d1bd1dc6d5 None admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:45:46.898617 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 137/272] 10.222.0.59 () {56 vars in 1186 bytes} [Thu Jun 2 15:45:46 2022] GET /identity/v3/projects/576f2a66e24a468b921fa6cb1e5ff6db => generated 302 bytes in 268 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 15:45:46.904645 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-651411ca-f6eb-4e4c-a248-29d1bd1dc6d5 None admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:45:46.904816 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc3bdeef-efe5-4609-8f70-8870d5ec223c None None] Validating token access rules against request {{(pid=80396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:45:46.944758 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writing DB stats keystone:SELECT=100 {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:45:46.955498 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b1163ea-fa0e-4319-8731-95490ac3ff95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:45:46.956314 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1163ea-fa0e-4319-8731-95490ac3ff95 None admin] REQUEST_METHOD: `GET` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:45:46.956597 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1163ea-fa0e-4319-8731-95490ac3ff95 None admin] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:45:46.958753 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1163ea-fa0e-4319-8731-95490ac3ff95 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:45:46.976612 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b1163ea-fa0e-4319-8731-95490ac3ff95 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 02 15:45:46.987327 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application [None req-6b1163ea-fa0e-4319-8731-95490ac3ff95 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 02 15:45:46.987327 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 15:45:46.987327 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 15:45:46.987327 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 15:45:46.987327 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 15:45:46.987327 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 15:45:46.987327 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 15:45:46.987327 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 15:45:46.987327 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 15:45:46.987327 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 15:45:46.987327 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 15:45:46.987327 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 15:45:46.987327 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 02 15:45:46.987327 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 02 15:45:46.987327 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 02 15:45:46.987327 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 02 15:45:46.988334 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 02 15:45:46.988334 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 02 15:45:46.988334 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 02 15:45:46.988334 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 02 15:45:46.988334 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 15:45:46.988334 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 15:45:46.988334 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 15:45:46.988334 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 15:45:46.988334 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 15:45:46.988334 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 15:45:46.988334 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 15:45:46.988334 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application with Lock( Jun 02 15:45:46.988334 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 15:45:46.988334 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application return self._enter() Jun 02 15:45:46.988334 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 15:45:46.988334 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 15:45:46.989118 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 15:45:46.989118 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application return self.creator() Jun 02 15:45:46.989118 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 15:45:46.989118 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application created_value = creator( Jun 02 15:45:46.989118 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 02 15:45:46.989118 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 02 15:45:46.989118 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 02 15:45:46.989118 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 02 15:45:46.989118 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 02 15:45:46.989118 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 02 15:45:46.989118 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 02 15:45:46.989118 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application Jun 02 15:45:46.989118 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 136/273] 10.222.0.59 () {56 vars in 1099 bytes} [Thu Jun 2 15:45:46 2022] GET /identity/v3/roles/member => generated 84 bytes in 247 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 15:45:46.989755 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b1163ea-fa0e-4319-8731-95490ac3ff95 None admin] Authenticating user token {{(pid=80396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:45:47.045900 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-651411ca-f6eb-4e4c-a248-29d1bd1dc6d5 None admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:45:47.087806 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-197e7376-fb7c-4b06-869d-bb79fe5d5bed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:45:47.089228 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197e7376-fb7c-4b06-869d-bb79fe5d5bed None admin] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:45:47.089737 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197e7376-fb7c-4b06-869d-bb79fe5d5bed None admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:45:47.090319 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197e7376-fb7c-4b06-869d-bb79fe5d5bed None admin] PATH_INFO: `/v3/domains/default` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:45:47.091722 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-197e7376-fb7c-4b06-869d-bb79fe5d5bed None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:45:47.093384 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-197e7376-fb7c-4b06-869d-bb79fe5d5bed None admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:45:47.096108 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 138/274] 10.222.0.59 () {56 vars in 1108 bytes} [Thu Jun 2 15:45:46 2022] GET /identity/v3/domains/default => generated 199 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 15:45:47.097213 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-197e7376-fb7c-4b06-869d-bb79fe5d5bed None admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:45:47.103605 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG dbcounter [-] [80396] Writing DB stats keystone:SELECT=100 {{(pid=80396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:45:47.124257 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b1163ea-fa0e-4319-8731-95490ac3ff95 None admin] Validating token access rules against request {{(pid=80396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:45:47.177808 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4ad1ae2-4767-44bb-93bb-b77efa3e8379 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:45:47.178696 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ad1ae2-4767-44bb-93bb-b77efa3e8379 None admin] REQUEST_METHOD: `GET` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:45:47.179395 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ad1ae2-4767-44bb-93bb-b77efa3e8379 None admin] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:45:47.180339 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ad1ae2-4767-44bb-93bb-b77efa3e8379 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:45:47.182154 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4ad1ae2-4767-44bb-93bb-b77efa3e8379 None admin] RBAC: Adding query filter params (role.id=21f49b1aa1e64120b7ef6fcf4667a641, scope.project.id=576f2a66e24a468b921fa6cb1e5ff6db, user.id=6afcdf3ec3674ab887fc7347902b583f) {{(pid=80396) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 15:45:47.182619 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4ad1ae2-4767-44bb-93bb-b77efa3e8379 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:45:47.187897 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4ad1ae2-4767-44bb-93bb-b77efa3e8379 None admin] RBAC: Authorization granted {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:45:47.224870 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-197e7376-fb7c-4b06-869d-bb79fe5d5bed None admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:45:47.226519 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writing DB stats keystone:SELECT=100 {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:45:47.254263 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 137/275] 10.222.0.59 () {56 vars in 1374 bytes} [Thu Jun 2 15:45:46 2022] GET /identity/v3/role_assignments?user.id=6afcdf3ec3674ab887fc7347902b583f&scope.project.id=576f2a66e24a468b921fa6cb1e5ff6db&role.id=21f49b1aa1e64120b7ef6fcf4667a641 => generated 608 bytes in 258 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 15:45:47.255242 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4ad1ae2-4767-44bb-93bb-b77efa3e8379 None admin] Authenticating user token {{(pid=80396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:45:47.265018 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0e36b09-9af6-462a-9903-5efe0950c8c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:45:47.266137 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e36b09-9af6-462a-9903-5efe0950c8c8 None admin] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:45:47.268764 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e36b09-9af6-462a-9903-5efe0950c8c8 None admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:45:47.269253 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e36b09-9af6-462a-9903-5efe0950c8c8 None admin] PATH_INFO: `/v3/roles` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:45:47.270263 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0e36b09-9af6-462a-9903-5efe0950c8c8 None admin] RBAC: Adding query filter params (name=member) {{(pid=80395) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 15:45:47.270778 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0e36b09-9af6-462a-9903-5efe0950c8c8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:45:47.273776 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0e36b09-9af6-462a-9903-5efe0950c8c8 None admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:45:47.286783 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 139/276] 10.222.0.59 () {56 vars in 1101 bytes} [Thu Jun 2 15:45:47 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 15:45:47.295561 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0e36b09-9af6-462a-9903-5efe0950c8c8 None admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:45:47.408851 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4ad1ae2-4767-44bb-93bb-b77efa3e8379 None admin] Validating token access rules against request {{(pid=80396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:45:47.423113 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0e36b09-9af6-462a-9903-5efe0950c8c8 None admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:45:47.448361 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e66eca76-77de-4256-a220-f1ce08cc28fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:45:47.449040 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e66eca76-77de-4256-a220-f1ce08cc28fe None admin] REQUEST_METHOD: `POST` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:45:47.449322 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e66eca76-77de-4256-a220-f1ce08cc28fe None admin] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:45:47.449703 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e66eca76-77de-4256-a220-f1ce08cc28fe None admin] PATH_INFO: `/v3/users` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:45:47.450557 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e66eca76-77de-4256-a220-f1ce08cc28fe None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:45:47.452042 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e66eca76-77de-4256-a220-f1ce08cc28fe None admin] RBAC: Authorization granted {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:45:47.462165 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2343bacb-0cbb-4bb2-a7ff-ca2531c39bfa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:45:47.463275 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2343bacb-0cbb-4bb2-a7ff-ca2531c39bfa None admin] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:45:47.463551 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2343bacb-0cbb-4bb2-a7ff-ca2531c39bfa None admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:45:47.464081 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2343bacb-0cbb-4bb2-a7ff-ca2531c39bfa None admin] PATH_INFO: `/v3/users/79eef196f58447da804733f76939fa31` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:45:47.481158 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2343bacb-0cbb-4bb2-a7ff-ca2531c39bfa None admin] RBAC: Authorizing `identity:get_user(user_id=79eef196f58447da804733f76939fa31)` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:45:47.482748 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2343bacb-0cbb-4bb2-a7ff-ca2531c39bfa None admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:45:47.484780 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 140/277] 10.222.0.59 () {56 vars in 1177 bytes} [Thu Jun 2 15:45:47 2022] GET /identity/v3/users/79eef196f58447da804733f76939fa31 => generated 293 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 15:45:47.485807 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ecaab0-1ccb-4f1b-897f-ba8c5e55fbf8 None None] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:45:47.486105 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ecaab0-1ccb-4f1b-897f-ba8c5e55fbf8 None None] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:45:47.486389 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ecaab0-1ccb-4f1b-897f-ba8c5e55fbf8 None None] PATH_INFO: `/` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:45:47.487728 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 141/278] 10.222.0.59 () {54 vars in 926 bytes} [Thu Jun 2 15:45:47 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 15:45:47.492272 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38ecaab0-1ccb-4f1b-897f-ba8c5e55fbf8 None None] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:45:47.519225 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writing DB stats keystone:SELECT=100 {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:45:47.559361 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 138/279] 10.222.0.59 () {60 vars in 1132 bytes} [Thu Jun 2 15:45:47 2022] POST /identity/v3/users => generated 293 bytes in 305 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 15:45:47.560634 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ca4e71-e3b8-4bb9-97b6-973dd1b27685 None None] REQUEST_METHOD: `POST` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:45:47.560929 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ca4e71-e3b8-4bb9-97b6-973dd1b27685 None None] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:45:47.561209 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ca4e71-e3b8-4bb9-97b6-973dd1b27685 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:45:47.578418 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG dbcounter [-] [80396] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:45:47.584591 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.auth.core [None req-d1ca4e71-e3b8-4bb9-97b6-973dd1b27685 None None] MFA Rules not processed for user `400d1f4db9de49638549e5db29a041e1`. Rule list: `[]` (Enabled: `True`). {{(pid=80396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 15:45:47.586483 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.fernet_utils [None req-d1ca4e71-e3b8-4bb9-97b6-973dd1b27685 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 15:45:47.632521 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38ecaab0-1ccb-4f1b-897f-ba8c5e55fbf8 None None] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:45:47.680862 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 139/280] 10.222.0.59 () {58 vars in 1023 bytes} [Thu Jun 2 15:45:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 02 15:45:47.687049 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e416908-03c2-4a5b-a152-e84f4e416bcc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:45:47.688024 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e416908-03c2-4a5b-a152-e84f4e416bcc None admin] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:45:47.688481 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e416908-03c2-4a5b-a152-e84f4e416bcc None admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:45:47.688926 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e416908-03c2-4a5b-a152-e84f4e416bcc None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:45:47.691498 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e416908-03c2-4a5b-a152-e84f4e416bcc None admin] RBAC: Adding query filter params (role.id=649e0f2b5a264c419ea6a1441f123a03, user.id=79eef196f58447da804733f76939fa31, scope.system=all) {{(pid=80395) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 15:45:47.691498 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e416908-03c2-4a5b-a152-e84f4e416bcc None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:45:47.692432 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e416908-03c2-4a5b-a152-e84f4e416bcc None admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:45:47.699844 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 142/281] 10.222.0.59 () {56 vars in 1308 bytes} [Thu Jun 2 15:45:47 2022] GET /identity/v3/role_assignments?user.id=79eef196f58447da804733f76939fa31&scope.system=all&role.id=649e0f2b5a264c419ea6a1441f123a03 => generated 226 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 15:45:47.707213 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1ca4e71-e3b8-4bb9-97b6-973dd1b27685 None None] Authenticating user token {{(pid=80396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:45:47.830415 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1ca4e71-e3b8-4bb9-97b6-973dd1b27685 None None] Validating token access rules against request {{(pid=80396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:45:47.875045 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4215a39-ce53-4d1c-aa3b-b41a9547022b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:45:47.876156 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4215a39-ce53-4d1c-aa3b-b41a9547022b None admin] REQUEST_METHOD: `GET` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:45:47.876617 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4215a39-ce53-4d1c-aa3b-b41a9547022b None admin] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:45:47.877161 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4215a39-ce53-4d1c-aa3b-b41a9547022b None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:45:47.881102 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG dbcounter [-] [80396] Writing DB stats keystone:SELECT=100 {{(pid=80396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:45:47.890827 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4215a39-ce53-4d1c-aa3b-b41a9547022b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 02 15:45:47.899261 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application [None req-f4215a39-ce53-4d1c-aa3b-b41a9547022b None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 02 15:45:47.899261 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 15:45:47.899261 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 15:45:47.899261 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 15:45:47.899261 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 15:45:47.899261 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 15:45:47.899261 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 15:45:47.899261 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 15:45:47.899261 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 15:45:47.899261 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 15:45:47.899261 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 15:45:47.899261 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 15:45:47.899261 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 02 15:45:47.899261 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 02 15:45:47.899261 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 02 15:45:47.899261 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 02 15:45:47.900716 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 02 15:45:47.900716 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 02 15:45:47.900716 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 02 15:45:47.900716 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 02 15:45:47.900716 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 15:45:47.900716 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 15:45:47.900716 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 15:45:47.900716 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 15:45:47.900716 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 15:45:47.900716 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 15:45:47.900716 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 15:45:47.900716 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application with Lock( Jun 02 15:45:47.900716 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 15:45:47.900716 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application return self._enter() Jun 02 15:45:47.900716 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 15:45:47.900716 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 15:45:47.901490 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 15:45:47.901490 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application return self.creator() Jun 02 15:45:47.901490 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 15:45:47.901490 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application created_value = creator( Jun 02 15:45:47.901490 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 02 15:45:47.901490 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 02 15:45:47.901490 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 02 15:45:47.901490 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 02 15:45:47.901490 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 02 15:45:47.901490 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 02 15:45:47.901490 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 02 15:45:47.901490 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application Jun 02 15:45:47.903861 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 140/282] 10.222.0.59 () {56 vars in 1099 bytes} [Thu Jun 2 15:45:47 2022] GET /identity/v3/roles/reader => generated 84 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 15:45:47.909707 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e416908-03c2-4a5b-a152-e84f4e416bcc None admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:45:48.010937 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writing DB stats keystone:SELECT=100 {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:45:48.027342 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e416908-03c2-4a5b-a152-e84f4e416bcc None admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:45:48.065338 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a605988c-1c24-4d71-9db0-4354a4f7d838 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:45:48.066157 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a605988c-1c24-4d71-9db0-4354a4f7d838 None admin] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:45:48.066346 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a605988c-1c24-4d71-9db0-4354a4f7d838 None admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:45:48.066588 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a605988c-1c24-4d71-9db0-4354a4f7d838 None admin] PATH_INFO: `/v3/roles` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:45:48.067341 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a605988c-1c24-4d71-9db0-4354a4f7d838 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80395) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 15:45:48.067646 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a605988c-1c24-4d71-9db0-4354a4f7d838 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:45:48.069084 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a605988c-1c24-4d71-9db0-4354a4f7d838 None admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:45:48.078639 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 143/283] 10.222.0.59 () {56 vars in 1101 bytes} [Thu Jun 2 15:45:47 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 15:45:48.083923 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4215a39-ce53-4d1c-aa3b-b41a9547022b None admin] Authenticating user token {{(pid=80396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:45:48.247411 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4215a39-ce53-4d1c-aa3b-b41a9547022b None admin] Validating token access rules against request {{(pid=80396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:45:48.303029 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e08da69-aad9-4bc0-8b1c-cd63e1d95754 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:45:48.303829 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e08da69-aad9-4bc0-8b1c-cd63e1d95754 None admin] REQUEST_METHOD: `GET` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:45:48.304114 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e08da69-aad9-4bc0-8b1c-cd63e1d95754 None admin] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:45:48.304392 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e08da69-aad9-4bc0-8b1c-cd63e1d95754 None admin] PATH_INFO: `/v3/users/3ab71eb10c38404d947b371e2acaee8b` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:45:48.310897 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e08da69-aad9-4bc0-8b1c-cd63e1d95754 None admin] RBAC: Authorizing `identity:get_user(user_id=3ab71eb10c38404d947b371e2acaee8b)` {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:45:48.312392 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e08da69-aad9-4bc0-8b1c-cd63e1d95754 None admin] RBAC: Authorization granted {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:45:48.314439 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 141/284] 10.222.0.59 () {56 vars in 1177 bytes} [Thu Jun 2 15:45:48 2022] GET /identity/v3/users/3ab71eb10c38404d947b371e2acaee8b => generated 297 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 15:45:48.319490 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a605988c-1c24-4d71-9db0-4354a4f7d838 None admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:45:48.450948 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a605988c-1c24-4d71-9db0-4354a4f7d838 None admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:45:48.486585 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba24e026-4fc5-4145-aef6-c134ceb54430 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:45:48.487432 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba24e026-4fc5-4145-aef6-c134ceb54430 None admin] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:45:48.487714 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba24e026-4fc5-4145-aef6-c134ceb54430 None admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:45:48.487988 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba24e026-4fc5-4145-aef6-c134ceb54430 None admin] PATH_INFO: `/v3/projects/576f2a66e24a468b921fa6cb1e5ff6db` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:45:48.489188 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba24e026-4fc5-4145-aef6-c134ceb54430 None admin] RBAC: Authorizing `identity:get_project(project_id=576f2a66e24a468b921fa6cb1e5ff6db)` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:45:48.490706 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba24e026-4fc5-4145-aef6-c134ceb54430 None admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:45:48.492717 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 144/285] 10.222.0.59 () {56 vars in 1186 bytes} [Thu Jun 2 15:45:48 2022] GET /identity/v3/projects/576f2a66e24a468b921fa6cb1e5ff6db => generated 302 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 15:45:48.498685 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e08da69-aad9-4bc0-8b1c-cd63e1d95754 None admin] Authenticating user token {{(pid=80396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:45:48.580526 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG dbcounter [-] [80396] Writing DB stats keystone:SELECT=100 {{(pid=80396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:45:48.625118 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca592dce-fe5c-44d8-9cf4-3d8232f99fea None None] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:45:48.625445 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca592dce-fe5c-44d8-9cf4-3d8232f99fea None None] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:45:48.625681 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca592dce-fe5c-44d8-9cf4-3d8232f99fea None None] PATH_INFO: `/` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:45:48.629047 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 145/286] 10.222.0.59 () {54 vars in 926 bytes} [Thu Jun 2 15:45:48 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 02 15:45:48.635805 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e08da69-aad9-4bc0-8b1c-cd63e1d95754 None admin] Validating token access rules against request {{(pid=80396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:45:48.636101 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d3ade7-a16a-42b9-be1f-a10c3ef9bd9e None None] REQUEST_METHOD: `POST` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:45:48.636418 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d3ade7-a16a-42b9-be1f-a10c3ef9bd9e None None] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:45:48.636693 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d3ade7-a16a-42b9-be1f-a10c3ef9bd9e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:45:48.670064 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.auth.core [None req-98d3ade7-a16a-42b9-be1f-a10c3ef9bd9e None None] MFA Rules not processed for user `400d1f4db9de49638549e5db29a041e1`. Rule list: `[]` (Enabled: `True`). {{(pid=80395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 15:45:48.671395 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.fernet_utils [None req-98d3ade7-a16a-42b9-be1f-a10c3ef9bd9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 15:45:48.672875 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18296399-2132-47ce-be17-eb80c3a7c3d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:45:48.674192 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18296399-2132-47ce-be17-eb80c3a7c3d9 None admin] REQUEST_METHOD: `PUT` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:45:48.674581 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18296399-2132-47ce-be17-eb80c3a7c3d9 None admin] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:45:48.674967 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18296399-2132-47ce-be17-eb80c3a7c3d9 None admin] PATH_INFO: `/v3/projects/576f2a66e24a468b921fa6cb1e5ff6db/users/3ab71eb10c38404d947b371e2acaee8b/roles/67885c18a3dc47718e9197097185f65d` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:45:48.677082 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18296399-2132-47ce-be17-eb80c3a7c3d9 None admin] RBAC: Authorizing `identity:create_grant(project_id=576f2a66e24a468b921fa6cb1e5ff6db, user_id=3ab71eb10c38404d947b371e2acaee8b, role_id=67885c18a3dc47718e9197097185f65d)` {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:45:48.678692 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18296399-2132-47ce-be17-eb80c3a7c3d9 None admin] RBAC: Authorization granted {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:45:48.694041 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writing DB stats keystone:SELECT=100 {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:45:48.760873 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 142/287] 10.222.0.59 () {58 vars in 1439 bytes} [Thu Jun 2 15:45:48 2022] PUT /identity/v3/projects/576f2a66e24a468b921fa6cb1e5ff6db/users/3ab71eb10c38404d947b371e2acaee8b/roles/67885c18a3dc47718e9197097185f65d => generated 0 bytes in 262 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 15:45:48.763130 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 146/288] 10.222.0.59 () {58 vars in 1023 bytes} [Thu Jun 2 15:45:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 02 15:45:48.786766 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18296399-2132-47ce-be17-eb80c3a7c3d9 None admin] Authenticating user token {{(pid=80396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:45:48.923818 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18296399-2132-47ce-be17-eb80c3a7c3d9 None admin] Validating token access rules against request {{(pid=80396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:45:48.966509 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG dbcounter [-] [80396] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:45:48.981073 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c66f602-70cf-4fe7-b1ef-11e8b78b47cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:45:48.987487 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c66f602-70cf-4fe7-b1ef-11e8b78b47cf None admin] REQUEST_METHOD: `GET` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:45:48.987487 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c66f602-70cf-4fe7-b1ef-11e8b78b47cf None admin] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:45:48.987487 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c66f602-70cf-4fe7-b1ef-11e8b78b47cf None admin] PATH_INFO: `/v3/roles/member` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:45:49.001810 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c66f602-70cf-4fe7-b1ef-11e8b78b47cf None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 02 15:45:49.010855 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application [None req-4c66f602-70cf-4fe7-b1ef-11e8b78b47cf None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 02 15:45:49.010855 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 15:45:49.010855 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 15:45:49.010855 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 15:45:49.010855 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 15:45:49.010855 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 15:45:49.010855 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 15:45:49.010855 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 15:45:49.010855 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 15:45:49.010855 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 15:45:49.010855 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 15:45:49.010855 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 15:45:49.010855 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 02 15:45:49.010855 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 02 15:45:49.010855 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 02 15:45:49.010855 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 02 15:45:49.011867 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 02 15:45:49.011867 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 02 15:45:49.011867 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 02 15:45:49.011867 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 02 15:45:49.011867 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 15:45:49.011867 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 15:45:49.011867 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 15:45:49.011867 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 15:45:49.011867 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 15:45:49.011867 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 15:45:49.011867 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 15:45:49.011867 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application with Lock( Jun 02 15:45:49.011867 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 15:45:49.011867 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application return self._enter() Jun 02 15:45:49.011867 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 15:45:49.011867 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 15:45:49.012667 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 15:45:49.012667 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application return self.creator() Jun 02 15:45:49.012667 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 15:45:49.012667 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application created_value = creator( Jun 02 15:45:49.012667 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 02 15:45:49.012667 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 02 15:45:49.012667 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 02 15:45:49.012667 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 02 15:45:49.012667 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 02 15:45:49.012667 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 02 15:45:49.012667 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 02 15:45:49.012667 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application Jun 02 15:45:49.016225 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 143/289] 10.222.0.59 () {56 vars in 1099 bytes} [Thu Jun 2 15:45:48 2022] GET /identity/v3/roles/member => generated 84 bytes in 230 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 15:45:49.022010 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98d3ade7-a16a-42b9-be1f-a10c3ef9bd9e None None] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:45:49.171228 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98d3ade7-a16a-42b9-be1f-a10c3ef9bd9e None None] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:45:49.224168 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef48eb8d-a444-44d7-9a42-1e2360c490db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:45:49.224763 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef48eb8d-a444-44d7-9a42-1e2360c490db None admin] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:45:49.225049 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef48eb8d-a444-44d7-9a42-1e2360c490db None admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:45:49.225330 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef48eb8d-a444-44d7-9a42-1e2360c490db None admin] PATH_INFO: `/v3/roles` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:45:49.226099 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef48eb8d-a444-44d7-9a42-1e2360c490db None admin] RBAC: Adding query filter params (name=member) {{(pid=80395) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 15:45:49.226426 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef48eb8d-a444-44d7-9a42-1e2360c490db None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:45:49.228643 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef48eb8d-a444-44d7-9a42-1e2360c490db None admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:45:49.241744 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 147/290] 10.222.0.59 () {56 vars in 1101 bytes} [Thu Jun 2 15:45:49 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 15:45:49.251159 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c66f602-70cf-4fe7-b1ef-11e8b78b47cf None admin] Authenticating user token {{(pid=80396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:45:49.405959 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c66f602-70cf-4fe7-b1ef-11e8b78b47cf None admin] Validating token access rules against request {{(pid=80396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:45:49.451681 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91338aae-26c8-45c7-a1c8-9b892b7094dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:45:49.452556 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91338aae-26c8-45c7-a1c8-9b892b7094dd None admin] REQUEST_METHOD: `GET` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:45:49.452842 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91338aae-26c8-45c7-a1c8-9b892b7094dd None admin] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:45:49.453124 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91338aae-26c8-45c7-a1c8-9b892b7094dd None admin] PATH_INFO: `/v3/users/e94cb0088498492aacd150f494c17365` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:45:49.458806 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91338aae-26c8-45c7-a1c8-9b892b7094dd None admin] RBAC: Authorizing `identity:get_user(user_id=e94cb0088498492aacd150f494c17365)` {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:45:49.460288 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91338aae-26c8-45c7-a1c8-9b892b7094dd None admin] RBAC: Authorization granted {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:45:49.462795 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 144/291] 10.222.0.59 () {56 vars in 1177 bytes} [Thu Jun 2 15:45:49 2022] GET /identity/v3/users/e94cb0088498492aacd150f494c17365 => generated 297 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 15:45:49.468253 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef48eb8d-a444-44d7-9a42-1e2360c490db None admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:45:49.492347 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writing DB stats keystone:SELECT=100 {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:45:49.633649 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef48eb8d-a444-44d7-9a42-1e2360c490db None admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:45:49.683386 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a972e41b-56d8-48e5-a148-9c2bb1ff081d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:45:49.684036 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a972e41b-56d8-48e5-a148-9c2bb1ff081d None admin] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:45:49.684317 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a972e41b-56d8-48e5-a148-9c2bb1ff081d None admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:45:49.684590 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a972e41b-56d8-48e5-a148-9c2bb1ff081d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:45:49.778433 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a972e41b-56d8-48e5-a148-9c2bb1ff081d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:45:49.779819 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a972e41b-56d8-48e5-a148-9c2bb1ff081d None admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:45:49.794366 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writing DB stats keystone:SELECT=100 {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:45:49.914985 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 148/292] 10.222.0.59 () {58 vars in 1282 bytes} [Thu Jun 2 15:45:49 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 447 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 02 15:45:49.921069 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91338aae-26c8-45c7-a1c8-9b892b7094dd None admin] Authenticating user token {{(pid=80396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:45:50.054742 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG dbcounter [-] [80396] Writing DB stats keystone:SELECT=100 {{(pid=80396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:45:50.172556 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91338aae-26c8-45c7-a1c8-9b892b7094dd None admin] Validating token access rules against request {{(pid=80396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:45:50.236589 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d9e9600-1554-4121-97e6-22283ba46e82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:45:50.237454 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d9e9600-1554-4121-97e6-22283ba46e82 None admin] REQUEST_METHOD: `GET` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:45:50.237740 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d9e9600-1554-4121-97e6-22283ba46e82 None admin] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:45:50.238015 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d9e9600-1554-4121-97e6-22283ba46e82 None admin] PATH_INFO: `/v3/projects/576f2a66e24a468b921fa6cb1e5ff6db` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:45:50.243022 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d9e9600-1554-4121-97e6-22283ba46e82 None admin] RBAC: Authorizing `identity:get_project(project_id=576f2a66e24a468b921fa6cb1e5ff6db)` {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:45:50.245086 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d9e9600-1554-4121-97e6-22283ba46e82 None admin] RBAC: Authorization granted {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:45:50.247345 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 145/293] 10.222.0.59 () {56 vars in 1186 bytes} [Thu Jun 2 15:45:49 2022] GET /identity/v3/projects/576f2a66e24a468b921fa6cb1e5ff6db => generated 302 bytes in 327 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 15:45:50.253210 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a972e41b-56d8-48e5-a148-9c2bb1ff081d None admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:45:50.405099 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a972e41b-56d8-48e5-a148-9c2bb1ff081d None admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:45:50.427361 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writing DB stats keystone:SELECT=100 {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:45:50.453602 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86e81e08-fb53-41f6-be4f-02ee42fdb255 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:45:50.454288 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e81e08-fb53-41f6-be4f-02ee42fdb255 None admin] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:45:50.454577 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e81e08-fb53-41f6-be4f-02ee42fdb255 None admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:45:50.454852 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e81e08-fb53-41f6-be4f-02ee42fdb255 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:45:50.455693 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86e81e08-fb53-41f6-be4f-02ee42fdb255 None admin] RBAC: Adding query filter params (role.id=649e0f2b5a264c419ea6a1441f123a03, scope.project.id=576f2a66e24a468b921fa6cb1e5ff6db, user.id=e94cb0088498492aacd150f494c17365) {{(pid=80395) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 15:45:50.456001 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86e81e08-fb53-41f6-be4f-02ee42fdb255 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:45:50.457462 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86e81e08-fb53-41f6-be4f-02ee42fdb255 None admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:45:50.464957 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 149/294] 10.222.0.59 () {56 vars in 1374 bytes} [Thu Jun 2 15:45:50 2022] GET /identity/v3/role_assignments?user.id=e94cb0088498492aacd150f494c17365&scope.project.id=576f2a66e24a468b921fa6cb1e5ff6db&role.id=649e0f2b5a264c419ea6a1441f123a03 => generated 608 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 15:45:50.488709 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68cb39be-b6f7-4882-8e46-0a2bac40b669 None None] REQUEST_METHOD: `GET` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:45:50.489041 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68cb39be-b6f7-4882-8e46-0a2bac40b669 None None] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:45:50.489276 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68cb39be-b6f7-4882-8e46-0a2bac40b669 None None] PATH_INFO: `/` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:45:50.491087 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 146/295] 10.222.0.59 () {54 vars in 926 bytes} [Thu Jun 2 15:45:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 15:45:50.496980 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0566c620-382f-43cf-9864-76d82938e656 None None] REQUEST_METHOD: `POST` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:45:50.497286 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0566c620-382f-43cf-9864-76d82938e656 None None] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:45:50.497621 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0566c620-382f-43cf-9864-76d82938e656 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:45:50.523466 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.auth.core [None req-0566c620-382f-43cf-9864-76d82938e656 None None] MFA Rules not processed for user `400d1f4db9de49638549e5db29a041e1`. Rule list: `[]` (Enabled: `True`). {{(pid=80395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 15:45:50.524800 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.fernet_utils [None req-0566c620-382f-43cf-9864-76d82938e656 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 15:45:50.629099 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 150/296] 10.222.0.59 () {58 vars in 1023 bytes} [Thu Jun 2 15:45:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 02 15:45:50.644704 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8304ca73-68f6-43ac-b5b6-b262dba97506 None None] REQUEST_METHOD: `GET` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:45:50.645035 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8304ca73-68f6-43ac-b5b6-b262dba97506 None None] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:45:50.645263 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8304ca73-68f6-43ac-b5b6-b262dba97506 None None] PATH_INFO: `/` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:45:50.651203 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 147/297] 10.222.0.59 () {54 vars in 926 bytes} [Thu Jun 2 15:45:50 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 15:45:50.656878 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c21bbda-0b66-41a4-900d-9d9af0cc59f2 None None] REQUEST_METHOD: `POST` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:45:50.657140 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c21bbda-0b66-41a4-900d-9d9af0cc59f2 None None] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:45:50.657365 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c21bbda-0b66-41a4-900d-9d9af0cc59f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:45:50.660630 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8304ca73-68f6-43ac-b5b6-b262dba97506 None None] Authenticating user token {{(pid=80396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:45:50.685938 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.auth.core [None req-8c21bbda-0b66-41a4-900d-9d9af0cc59f2 None None] MFA Rules not processed for user `400d1f4db9de49638549e5db29a041e1`. Rule list: `[]` (Enabled: `True`). {{(pid=80395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 15:45:50.687149 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.fernet_utils [None req-8c21bbda-0b66-41a4-900d-9d9af0cc59f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 15:45:50.768751 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 151/298] 10.222.0.59 () {58 vars in 1023 bytes} [Thu Jun 2 15:45:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 02 15:45:50.782111 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b966f20-66e4-4bc0-b8ff-572ef1af401b None None] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:45:50.782412 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b966f20-66e4-4bc0-b8ff-572ef1af401b None None] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:45:50.782691 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b966f20-66e4-4bc0-b8ff-572ef1af401b None None] PATH_INFO: `/` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:45:50.785313 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 152/299] 10.222.0.59 () {54 vars in 926 bytes} [Thu Jun 2 15:45:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 02 15:45:50.789197 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a813915f-8c6a-456d-82f4-6fc03f32900d None None] REQUEST_METHOD: `POST` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:45:50.789478 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a813915f-8c6a-456d-82f4-6fc03f32900d None None] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:45:50.789952 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a813915f-8c6a-456d-82f4-6fc03f32900d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:45:50.808594 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.auth.core [None req-a813915f-8c6a-456d-82f4-6fc03f32900d None None] MFA Rules not processed for user `400d1f4db9de49638549e5db29a041e1`. Rule list: `[]` (Enabled: `True`). {{(pid=80395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 15:45:50.809777 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.fernet_utils [None req-a813915f-8c6a-456d-82f4-6fc03f32900d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 15:45:50.820472 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8304ca73-68f6-43ac-b5b6-b262dba97506 None None] Validating token access rules against request {{(pid=80396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:45:50.846504 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG dbcounter [-] [80396] Writing DB stats keystone:SELECT=100 {{(pid=80396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:45:50.850906 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writing DB stats keystone:SELECT=100 {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:45:50.867246 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a54d52af-265b-4d3f-9ad6-e03f2d643116 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:45:50.870671 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a54d52af-265b-4d3f-9ad6-e03f2d643116 None admin] REQUEST_METHOD: `GET` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:45:50.870960 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a54d52af-265b-4d3f-9ad6-e03f2d643116 None admin] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:45:50.871267 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a54d52af-265b-4d3f-9ad6-e03f2d643116 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:45:50.882666 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a54d52af-265b-4d3f-9ad6-e03f2d643116 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 02 15:45:50.890994 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application [None req-a54d52af-265b-4d3f-9ad6-e03f2d643116 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 02 15:45:50.890994 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 15:45:50.890994 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 15:45:50.890994 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 15:45:50.890994 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 15:45:50.890994 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 15:45:50.890994 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 15:45:50.890994 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 15:45:50.890994 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 15:45:50.890994 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 15:45:50.890994 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 15:45:50.890994 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 15:45:50.890994 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 02 15:45:50.890994 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 02 15:45:50.890994 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 02 15:45:50.890994 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 02 15:45:50.891870 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 02 15:45:50.891870 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 02 15:45:50.891870 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 02 15:45:50.891870 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 02 15:45:50.891870 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 15:45:50.891870 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 15:45:50.891870 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 15:45:50.891870 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 15:45:50.891870 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 15:45:50.891870 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 15:45:50.891870 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 15:45:50.891870 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application with Lock( Jun 02 15:45:50.891870 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 15:45:50.891870 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application return self._enter() Jun 02 15:45:50.891870 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 15:45:50.891870 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 15:45:50.892629 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 15:45:50.892629 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application return self.creator() Jun 02 15:45:50.892629 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 15:45:50.892629 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application created_value = creator( Jun 02 15:45:50.892629 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 02 15:45:50.892629 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 02 15:45:50.892629 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 02 15:45:50.892629 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 02 15:45:50.892629 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 02 15:45:50.892629 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 02 15:45:50.892629 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 02 15:45:50.892629 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application Jun 02 15:45:50.892629 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 148/300] 10.222.0.59 () {56 vars in 1099 bytes} [Thu Jun 2 15:45:50 2022] GET /identity/v3/roles/member => generated 84 bytes in 232 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 02 15:45:50.893895 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a54d52af-265b-4d3f-9ad6-e03f2d643116 None admin] Authenticating user token {{(pid=80396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:45:50.905166 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 153/301] 10.222.0.59 () {58 vars in 1023 bytes} [Thu Jun 2 15:45:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 02 15:45:50.906751 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a813915f-8c6a-456d-82f4-6fc03f32900d None None] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:45:50.999349 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a54d52af-265b-4d3f-9ad6-e03f2d643116 None admin] Validating token access rules against request {{(pid=80396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:45:51.025889 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a813915f-8c6a-456d-82f4-6fc03f32900d None None] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:45:51.033930 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dfc59de-2038-4759-b424-7cb633f65f9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:45:51.034753 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dfc59de-2038-4759-b424-7cb633f65f9f None admin] REQUEST_METHOD: `GET` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:45:51.035033 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dfc59de-2038-4759-b424-7cb633f65f9f None admin] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:45:51.035303 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dfc59de-2038-4759-b424-7cb633f65f9f None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:45:51.047562 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dfc59de-2038-4759-b424-7cb633f65f9f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 02 15:45:51.055203 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application [None req-4dfc59de-2038-4759-b424-7cb633f65f9f None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 02 15:45:51.055203 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 15:45:51.055203 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 15:45:51.055203 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 15:45:51.055203 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 15:45:51.055203 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 15:45:51.055203 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 15:45:51.055203 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 15:45:51.055203 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 15:45:51.055203 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 15:45:51.055203 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 15:45:51.055203 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 15:45:51.055203 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 02 15:45:51.055203 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 02 15:45:51.055203 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 02 15:45:51.055203 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 02 15:45:51.056528 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 02 15:45:51.056528 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 02 15:45:51.056528 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 02 15:45:51.056528 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 02 15:45:51.056528 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 15:45:51.056528 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 15:45:51.056528 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 15:45:51.056528 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 15:45:51.056528 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 15:45:51.056528 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 15:45:51.056528 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 15:45:51.056528 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application with Lock( Jun 02 15:45:51.056528 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 15:45:51.056528 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application return self._enter() Jun 02 15:45:51.056528 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 15:45:51.056528 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 15:45:51.057947 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 15:45:51.057947 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application return self.creator() Jun 02 15:45:51.057947 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 15:45:51.057947 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application created_value = creator( Jun 02 15:45:51.057947 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 02 15:45:51.057947 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 02 15:45:51.057947 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 02 15:45:51.057947 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 02 15:45:51.057947 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 02 15:45:51.057947 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 02 15:45:51.057947 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 02 15:45:51.057947 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application Jun 02 15:45:51.057947 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 149/302] 10.222.0.59 () {56 vars in 1099 bytes} [Thu Jun 2 15:45:50 2022] GET /identity/v3/roles/reader => generated 84 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 15:45:51.057947 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dfc59de-2038-4759-b424-7cb633f65f9f None admin] Authenticating user token {{(pid=80396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:45:51.074445 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f1820b6-8fa6-4e46-afcc-0b869578d784 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:45:51.075205 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1820b6-8fa6-4e46-afcc-0b869578d784 None admin] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:45:51.075550 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1820b6-8fa6-4e46-afcc-0b869578d784 None admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:45:51.075895 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1820b6-8fa6-4e46-afcc-0b869578d784 None admin] PATH_INFO: `/v3/roles` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:45:51.076712 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f1820b6-8fa6-4e46-afcc-0b869578d784 None admin] RBAC: Adding query filter params (name=member) {{(pid=80395) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 15:45:51.077085 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f1820b6-8fa6-4e46-afcc-0b869578d784 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:45:51.078571 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f1820b6-8fa6-4e46-afcc-0b869578d784 None admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:45:51.088870 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 154/303] 10.222.0.59 () {56 vars in 1101 bytes} [Thu Jun 2 15:45:50 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 15:45:51.089577 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f1820b6-8fa6-4e46-afcc-0b869578d784 None admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:45:51.106910 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG dbcounter [-] [80396] Writing DB stats keystone:SELECT=100 {{(pid=80396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:45:51.115918 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writing DB stats keystone:SELECT=100 {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:45:51.175374 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dfc59de-2038-4759-b424-7cb633f65f9f None admin] Validating token access rules against request {{(pid=80396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:45:51.195329 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f1820b6-8fa6-4e46-afcc-0b869578d784 None admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:45:51.216637 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e26ea6db-4a7d-4993-9b03-14512cd4b514 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:45:51.217467 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e26ea6db-4a7d-4993-9b03-14512cd4b514 None admin] REQUEST_METHOD: `GET` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:45:51.217761 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e26ea6db-4a7d-4993-9b03-14512cd4b514 None admin] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:45:51.218173 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e26ea6db-4a7d-4993-9b03-14512cd4b514 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:45:51.219338 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e26ea6db-4a7d-4993-9b03-14512cd4b514 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:45:51.220778 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e26ea6db-4a7d-4993-9b03-14512cd4b514 None admin] RBAC: Authorization granted {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:45:51.222598 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 150/304] 10.222.0.59 () {56 vars in 1108 bytes} [Thu Jun 2 15:45:51 2022] GET /identity/v3/domains/default => generated 199 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 15:45:51.223281 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e26ea6db-4a7d-4993-9b03-14512cd4b514 None admin] Authenticating user token {{(pid=80396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:45:51.236923 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26b445a6-24e7-4151-84b8-f1a754bde9ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:45:51.237586 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b445a6-24e7-4151-84b8-f1a754bde9ee None admin] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:45:51.237865 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b445a6-24e7-4151-84b8-f1a754bde9ee None admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:45:51.238169 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b445a6-24e7-4151-84b8-f1a754bde9ee None admin] PATH_INFO: `/v3/roles` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:45:51.238917 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26b445a6-24e7-4151-84b8-f1a754bde9ee None admin] RBAC: Adding query filter params (name=reader) {{(pid=80395) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 15:45:51.239220 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26b445a6-24e7-4151-84b8-f1a754bde9ee None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:45:51.240610 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26b445a6-24e7-4151-84b8-f1a754bde9ee None admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:45:51.253412 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 155/305] 10.222.0.59 () {56 vars in 1101 bytes} [Thu Jun 2 15:45:51 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 15:45:51.253412 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26b445a6-24e7-4151-84b8-f1a754bde9ee None admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:45:51.332395 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e26ea6db-4a7d-4993-9b03-14512cd4b514 None admin] Validating token access rules against request {{(pid=80396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:45:51.342523 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG dbcounter [-] [80396] Writing DB stats keystone:SELECT=100 {{(pid=80396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:45:51.343809 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writing DB stats keystone:SELECT=100 {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:45:51.359242 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26b445a6-24e7-4151-84b8-f1a754bde9ee None admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:45:51.367381 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a33314e-70e3-452c-b960-0ffaf9a823da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:45:51.368300 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a33314e-70e3-452c-b960-0ffaf9a823da None admin] REQUEST_METHOD: `GET` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:45:51.368579 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a33314e-70e3-452c-b960-0ffaf9a823da None admin] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:45:51.368850 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a33314e-70e3-452c-b960-0ffaf9a823da None admin] PATH_INFO: `/v3/users/79eef196f58447da804733f76939fa31` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:45:51.370141 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a33314e-70e3-452c-b960-0ffaf9a823da None admin] RBAC: Authorizing `identity:get_user(user_id=79eef196f58447da804733f76939fa31)` {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:45:51.371683 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a33314e-70e3-452c-b960-0ffaf9a823da None admin] RBAC: Authorization granted {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:45:51.374277 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 151/306] 10.222.0.59 () {56 vars in 1177 bytes} [Thu Jun 2 15:45:51 2022] GET /identity/v3/users/79eef196f58447da804733f76939fa31 => generated 293 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 15:45:51.375906 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a33314e-70e3-452c-b960-0ffaf9a823da None admin] Authenticating user token {{(pid=80396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:45:51.399622 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df48a22c-b30b-470c-9c59-6144fe56dbe2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:45:51.401609 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df48a22c-b30b-470c-9c59-6144fe56dbe2 None admin] REQUEST_METHOD: `POST` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:45:51.402173 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df48a22c-b30b-470c-9c59-6144fe56dbe2 None admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:45:51.402930 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df48a22c-b30b-470c-9c59-6144fe56dbe2 None admin] PATH_INFO: `/v3/groups` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:45:51.403895 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df48a22c-b30b-470c-9c59-6144fe56dbe2 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:45:51.405436 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df48a22c-b30b-470c-9c59-6144fe56dbe2 None admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:45:51.474668 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 156/307] 10.222.0.59 () {60 vars in 1134 bytes} [Thu Jun 2 15:45:51 2022] POST /identity/v3/groups => generated 229 bytes in 225 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 15:45:51.475503 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df48a22c-b30b-470c-9c59-6144fe56dbe2 None admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:45:51.491933 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a33314e-70e3-452c-b960-0ffaf9a823da None admin] Validating token access rules against request {{(pid=80396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:45:51.533568 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e41ddafb-f898-4909-a3aa-b80a280a3cd3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:45:51.534551 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41ddafb-f898-4909-a3aa-b80a280a3cd3 None admin] REQUEST_METHOD: `GET` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:45:51.534911 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41ddafb-f898-4909-a3aa-b80a280a3cd3 None admin] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:45:51.535262 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41ddafb-f898-4909-a3aa-b80a280a3cd3 None admin] PATH_INFO: `/v3/users/14066e5730e1422ab0e5eebb4efe292f` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:45:51.552199 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e41ddafb-f898-4909-a3aa-b80a280a3cd3 None admin] RBAC: Authorizing `identity:get_user(user_id=14066e5730e1422ab0e5eebb4efe292f)` {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:45:51.553796 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e41ddafb-f898-4909-a3aa-b80a280a3cd3 None admin] RBAC: Authorization granted {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:45:51.560709 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 152/308] 10.222.0.59 () {56 vars in 1177 bytes} [Thu Jun 2 15:45:51 2022] GET /identity/v3/users/14066e5730e1422ab0e5eebb4efe292f => generated 293 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 15:45:51.562038 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e41ddafb-f898-4909-a3aa-b80a280a3cd3 None admin] Authenticating user token {{(pid=80396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:45:51.608246 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG dbcounter [-] [80396] Writing DB stats keystone:SELECT=100 {{(pid=80396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:45:51.630766 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df48a22c-b30b-470c-9c59-6144fe56dbe2 None admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:45:51.695476 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e41ddafb-f898-4909-a3aa-b80a280a3cd3 None admin] Validating token access rules against request {{(pid=80396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:45:51.698176 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-506030bf-aee1-4159-81ee-6b8018e178c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:45:51.698564 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506030bf-aee1-4159-81ee-6b8018e178c0 None admin] REQUEST_METHOD: `PUT` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:45:51.698890 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506030bf-aee1-4159-81ee-6b8018e178c0 None admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:45:51.699128 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506030bf-aee1-4159-81ee-6b8018e178c0 None admin] PATH_INFO: `/v3/system/users/79eef196f58447da804733f76939fa31/roles/649e0f2b5a264c419ea6a1441f123a03` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:45:51.701596 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-506030bf-aee1-4159-81ee-6b8018e178c0 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=79eef196f58447da804733f76939fa31, role_id=649e0f2b5a264c419ea6a1441f123a03)` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:45:51.703733 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-506030bf-aee1-4159-81ee-6b8018e178c0 None admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:45:51.736538 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-227d437f-4bc0-4a6c-b833-2c7f93207f0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:45:51.737192 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-227d437f-4bc0-4a6c-b833-2c7f93207f0c None admin] REQUEST_METHOD: `GET` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:45:51.737477 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-227d437f-4bc0-4a6c-b833-2c7f93207f0c None admin] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:45:51.737754 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-227d437f-4bc0-4a6c-b833-2c7f93207f0c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:45:51.738660 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-227d437f-4bc0-4a6c-b833-2c7f93207f0c None admin] RBAC: Adding query filter params (role.id=67885c18a3dc47718e9197097185f65d, user.id=14066e5730e1422ab0e5eebb4efe292f, scope.system=all) {{(pid=80396) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 15:45:51.739947 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-227d437f-4bc0-4a6c-b833-2c7f93207f0c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:45:51.740410 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-227d437f-4bc0-4a6c-b833-2c7f93207f0c None admin] RBAC: Authorization granted {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:45:51.747684 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 153/309] 10.222.0.59 () {56 vars in 1308 bytes} [Thu Jun 2 15:45:51 2022] GET /identity/v3/role_assignments?user.id=14066e5730e1422ab0e5eebb4efe292f&scope.system=all&role.id=67885c18a3dc47718e9197097185f65d => generated 226 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 15:45:51.748532 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44744665-a5a2-4d16-9df8-d2f30336f49d None None] REQUEST_METHOD: `GET` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:45:51.749608 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44744665-a5a2-4d16-9df8-d2f30336f49d None None] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:45:51.749608 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44744665-a5a2-4d16-9df8-d2f30336f49d None None] PATH_INFO: `/` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:45:51.751177 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 154/310] 10.222.0.59 () {54 vars in 926 bytes} [Thu Jun 2 15:45:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 15:45:51.757098 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c05b259d-7255-4b0c-9d76-f6519908088d None None] REQUEST_METHOD: `POST` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:45:51.757391 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c05b259d-7255-4b0c-9d76-f6519908088d None None] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:45:51.757674 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c05b259d-7255-4b0c-9d76-f6519908088d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:45:51.785345 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.auth.core [None req-c05b259d-7255-4b0c-9d76-f6519908088d None None] MFA Rules not processed for user `400d1f4db9de49638549e5db29a041e1`. Rule list: `[]` (Enabled: `True`). {{(pid=80396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 15:45:51.788085 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.fernet_utils [None req-c05b259d-7255-4b0c-9d76-f6519908088d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 15:45:51.878215 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 155/311] 10.222.0.59 () {58 vars in 1023 bytes} [Thu Jun 2 15:45:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 02 15:45:51.895699 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c05b259d-7255-4b0c-9d76-f6519908088d None None] Authenticating user token {{(pid=80396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:45:51.927937 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG dbcounter [-] [80396] Writing DB stats keystone:SELECT=100 {{(pid=80396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:45:52.012817 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c05b259d-7255-4b0c-9d76-f6519908088d None None] Validating token access rules against request {{(pid=80396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:45:52.055729 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe2c4c30-849e-4d39-b68e-ae6c5913433b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:45:52.058100 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2c4c30-849e-4d39-b68e-ae6c5913433b None admin] REQUEST_METHOD: `GET` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:45:52.058473 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2c4c30-849e-4d39-b68e-ae6c5913433b None admin] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:45:52.058728 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 157/312] 10.222.0.59 () {58 vars in 1334 bytes} [Thu Jun 2 15:45:51 2022] PUT /identity/v3/system/users/79eef196f58447da804733f76939fa31/roles/649e0f2b5a264c419ea6a1441f123a03 => generated 0 bytes in 583 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 15:45:52.058908 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2c4c30-849e-4d39-b68e-ae6c5913433b None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:45:52.073606 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe2c4c30-849e-4d39-b68e-ae6c5913433b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 02 15:45:52.082209 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application [None req-fe2c4c30-849e-4d39-b68e-ae6c5913433b None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 02 15:45:52.082209 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 15:45:52.082209 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 15:45:52.082209 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 15:45:52.082209 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 15:45:52.082209 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 15:45:52.082209 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 15:45:52.082209 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 15:45:52.082209 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 15:45:52.082209 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 15:45:52.082209 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 15:45:52.082209 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 15:45:52.082209 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 02 15:45:52.082209 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 02 15:45:52.082209 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 02 15:45:52.082209 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 02 15:45:52.083195 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 02 15:45:52.083195 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 02 15:45:52.083195 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 02 15:45:52.083195 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 02 15:45:52.083195 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 15:45:52.083195 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 15:45:52.083195 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 15:45:52.083195 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 15:45:52.083195 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 15:45:52.083195 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 15:45:52.083195 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 15:45:52.083195 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application with Lock( Jun 02 15:45:52.083195 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 15:45:52.083195 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application return self._enter() Jun 02 15:45:52.083195 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 15:45:52.083195 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 15:45:52.084010 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 15:45:52.084010 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application return self.creator() Jun 02 15:45:52.084010 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 15:45:52.084010 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application created_value = creator( Jun 02 15:45:52.084010 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 02 15:45:52.084010 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 02 15:45:52.084010 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 02 15:45:52.084010 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 02 15:45:52.084010 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 02 15:45:52.084010 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 02 15:45:52.084010 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 02 15:45:52.084010 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application Jun 02 15:45:52.089569 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 156/313] 10.222.0.59 () {56 vars in 1099 bytes} [Thu Jun 2 15:45:51 2022] GET /identity/v3/roles/reader => generated 84 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 02 15:45:52.091097 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-506030bf-aee1-4159-81ee-6b8018e178c0 None admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:45:52.112345 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:45:52.252013 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-506030bf-aee1-4159-81ee-6b8018e178c0 None admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:45:52.293250 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f8a8b6-f745-4951-a8b7-a8c8a910cf1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:45:52.293997 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f8a8b6-f745-4951-a8b7-a8c8a910cf1d None admin] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:45:52.294263 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f8a8b6-f745-4951-a8b7-a8c8a910cf1d None admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:45:52.294504 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f8a8b6-f745-4951-a8b7-a8c8a910cf1d None admin] PATH_INFO: `/v3/roles` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:45:52.295252 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3f8a8b6-f745-4951-a8b7-a8c8a910cf1d None admin] RBAC: Adding query filter params (name=reader) {{(pid=80395) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 15:45:52.295557 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3f8a8b6-f745-4951-a8b7-a8c8a910cf1d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:45:52.296928 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3f8a8b6-f745-4951-a8b7-a8c8a910cf1d None admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:45:52.308885 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 158/314] 10.222.0.59 () {56 vars in 1101 bytes} [Thu Jun 2 15:45:52 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 15:45:52.314477 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe2c4c30-849e-4d39-b68e-ae6c5913433b None admin] Authenticating user token {{(pid=80396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:45:52.405888 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG dbcounter [-] [80396] Writing DB stats keystone:SELECT=100 {{(pid=80396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:45:52.418184 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe2c4c30-849e-4d39-b68e-ae6c5913433b None admin] Validating token access rules against request {{(pid=80396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:45:52.452576 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcfef754-4b37-4ad2-90ed-99f99ca3d387 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:45:52.453512 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcfef754-4b37-4ad2-90ed-99f99ca3d387 None admin] REQUEST_METHOD: `GET` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:45:52.453795 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcfef754-4b37-4ad2-90ed-99f99ca3d387 None admin] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:45:52.454095 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcfef754-4b37-4ad2-90ed-99f99ca3d387 None admin] PATH_INFO: `/v3/users/3ab71eb10c38404d947b371e2acaee8b` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:45:52.455336 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcfef754-4b37-4ad2-90ed-99f99ca3d387 None admin] RBAC: Authorizing `identity:get_user(user_id=3ab71eb10c38404d947b371e2acaee8b)` {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:45:52.456786 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcfef754-4b37-4ad2-90ed-99f99ca3d387 None admin] RBAC: Authorization granted {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:45:52.458758 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 157/315] 10.222.0.59 () {56 vars in 1177 bytes} [Thu Jun 2 15:45:52 2022] GET /identity/v3/users/3ab71eb10c38404d947b371e2acaee8b => generated 297 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 15:45:52.464963 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f8a8b6-f745-4951-a8b7-a8c8a910cf1d None admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:45:52.541909 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writing DB stats keystone:SELECT=100 {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:45:52.572434 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f8a8b6-f745-4951-a8b7-a8c8a910cf1d None admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:45:52.608362 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a706ecc4-ceab-459e-91f4-668553488407 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:45:52.609349 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a706ecc4-ceab-459e-91f4-668553488407 None admin] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:45:52.609829 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a706ecc4-ceab-459e-91f4-668553488407 None admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:45:52.610313 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a706ecc4-ceab-459e-91f4-668553488407 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:45:52.689482 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a706ecc4-ceab-459e-91f4-668553488407 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:45:52.691283 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a706ecc4-ceab-459e-91f4-668553488407 None admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:45:52.764023 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writing DB stats keystone:SELECT=100 {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:45:52.796532 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 159/316] 10.222.0.59 () {58 vars in 1282 bytes} [Thu Jun 2 15:45:52 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 332 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jun 02 15:45:52.802377 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcfef754-4b37-4ad2-90ed-99f99ca3d387 None admin] Authenticating user token {{(pid=80396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:45:52.906621 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcfef754-4b37-4ad2-90ed-99f99ca3d387 None admin] Validating token access rules against request {{(pid=80396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:45:52.941295 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b849e043-91f2-4fa7-a7f7-9c2f9eb92ead None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:45:52.942504 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b849e043-91f2-4fa7-a7f7-9c2f9eb92ead None admin] REQUEST_METHOD: `GET` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:45:52.942979 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b849e043-91f2-4fa7-a7f7-9c2f9eb92ead None admin] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:45:52.943434 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b849e043-91f2-4fa7-a7f7-9c2f9eb92ead None admin] PATH_INFO: `/v3/projects/576f2a66e24a468b921fa6cb1e5ff6db` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:45:52.944781 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b849e043-91f2-4fa7-a7f7-9c2f9eb92ead None admin] RBAC: Authorizing `identity:get_project(project_id=576f2a66e24a468b921fa6cb1e5ff6db)` {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:45:52.946990 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b849e043-91f2-4fa7-a7f7-9c2f9eb92ead None admin] RBAC: Authorization granted {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:45:52.949172 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 158/317] 10.222.0.59 () {56 vars in 1186 bytes} [Thu Jun 2 15:45:52 2022] GET /identity/v3/projects/576f2a66e24a468b921fa6cb1e5ff6db => generated 302 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 15:45:52.955081 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a706ecc4-ceab-459e-91f4-668553488407 None admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:45:53.061077 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a706ecc4-ceab-459e-91f4-668553488407 None admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:45:53.096492 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-413f54bf-1a1f-4883-b641-e4d86ca270b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:45:53.097534 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-413f54bf-1a1f-4883-b641-e4d86ca270b8 None admin] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:45:53.098004 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-413f54bf-1a1f-4883-b641-e4d86ca270b8 None admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:45:53.098497 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-413f54bf-1a1f-4883-b641-e4d86ca270b8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:45:53.099510 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-413f54bf-1a1f-4883-b641-e4d86ca270b8 None admin] RBAC: Adding query filter params (role.id=67885c18a3dc47718e9197097185f65d, scope.project.id=576f2a66e24a468b921fa6cb1e5ff6db, user.id=3ab71eb10c38404d947b371e2acaee8b) {{(pid=80395) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 15:45:53.099996 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-413f54bf-1a1f-4883-b641-e4d86ca270b8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:45:53.101636 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-413f54bf-1a1f-4883-b641-e4d86ca270b8 None admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:45:53.109099 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 160/318] 10.222.0.59 () {56 vars in 1374 bytes} [Thu Jun 2 15:45:52 2022] GET /identity/v3/role_assignments?user.id=3ab71eb10c38404d947b371e2acaee8b&scope.project.id=576f2a66e24a468b921fa6cb1e5ff6db&role.id=67885c18a3dc47718e9197097185f65d => generated 608 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 15:45:53.957428 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c834748-21d5-47b9-8e16-6b5a27e4d866 None None] REQUEST_METHOD: `GET` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:45:53.957948 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c834748-21d5-47b9-8e16-6b5a27e4d866 None None] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:45:53.958053 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c834748-21d5-47b9-8e16-6b5a27e4d866 None None] PATH_INFO: `/` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:45:53.959547 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 159/319] 10.222.0.59 () {54 vars in 926 bytes} [Thu Jun 2 15:45:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 15:45:53.966273 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c15910-01a5-421d-9f18-c2e705d503ba None None] REQUEST_METHOD: `POST` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:45:53.966705 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c15910-01a5-421d-9f18-c2e705d503ba None None] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:45:53.966884 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c15910-01a5-421d-9f18-c2e705d503ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:45:53.985562 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.auth.core [None req-e2c15910-01a5-421d-9f18-c2e705d503ba None None] MFA Rules not processed for user `400d1f4db9de49638549e5db29a041e1`. Rule list: `[]` (Enabled: `True`). {{(pid=80395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 15:45:53.988880 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.fernet_utils [None req-e2c15910-01a5-421d-9f18-c2e705d503ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 15:45:54.021556 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writing DB stats keystone:SELECT=100 {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:45:54.062724 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 161/320] 10.222.0.59 () {58 vars in 1023 bytes} [Thu Jun 2 15:45:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 02 15:45:54.085851 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c834748-21d5-47b9-8e16-6b5a27e4d866 None None] Authenticating user token {{(pid=80396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:45:54.111154 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e1982f-a33c-4858-a8fd-b5789e62ed4c None None] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:45:54.111503 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e1982f-a33c-4858-a8fd-b5789e62ed4c None None] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:45:54.111718 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e1982f-a33c-4858-a8fd-b5789e62ed4c None None] PATH_INFO: `/` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:45:54.113140 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 162/321] 10.222.0.59 () {54 vars in 926 bytes} [Thu Jun 2 15:45:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 02 15:45:54.117697 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG dbcounter [-] [80396] Writing DB stats keystone:SELECT=100 {{(pid=80396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:45:54.119454 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef9bebc-6303-4af8-b929-bd440e89aaad None None] REQUEST_METHOD: `POST` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:45:54.119743 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef9bebc-6303-4af8-b929-bd440e89aaad None None] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:45:54.120024 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef9bebc-6303-4af8-b929-bd440e89aaad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:45:54.138009 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.auth.core [None req-1ef9bebc-6303-4af8-b929-bd440e89aaad None None] MFA Rules not processed for user `400d1f4db9de49638549e5db29a041e1`. Rule list: `[]` (Enabled: `True`). {{(pid=80395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 15:45:54.139395 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.fernet_utils [None req-1ef9bebc-6303-4af8-b929-bd440e89aaad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 15:45:54.210061 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c834748-21d5-47b9-8e16-6b5a27e4d866 None None] Validating token access rules against request {{(pid=80396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:45:54.218156 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 163/322] 10.222.0.59 () {58 vars in 1023 bytes} [Thu Jun 2 15:45:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 02 15:45:54.240335 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ef9bebc-6303-4af8-b929-bd440e89aaad None None] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:45:54.251547 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecb133b7-e081-4904-bb34-004300c0135c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:45:54.252623 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb133b7-e081-4904-bb34-004300c0135c None admin] REQUEST_METHOD: `GET` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:45:54.252915 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb133b7-e081-4904-bb34-004300c0135c None admin] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:45:54.253190 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb133b7-e081-4904-bb34-004300c0135c None admin] PATH_INFO: `/v3/domains/default` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:45:54.254366 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecb133b7-e081-4904-bb34-004300c0135c None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:45:54.255808 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecb133b7-e081-4904-bb34-004300c0135c None admin] RBAC: Authorization granted {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:45:54.257405 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 160/323] 10.222.0.59 () {56 vars in 1108 bytes} [Thu Jun 2 15:45:54 2022] GET /identity/v3/domains/default => generated 199 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 15:45:54.264276 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecb133b7-e081-4904-bb34-004300c0135c None admin] Authenticating user token {{(pid=80396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:45:54.343423 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writing DB stats keystone:SELECT=100 {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:45:54.349038 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ef9bebc-6303-4af8-b929-bd440e89aaad None None] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:45:54.362454 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG dbcounter [-] [80396] Writing DB stats keystone:SELECT=100 {{(pid=80396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:45:54.372241 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecb133b7-e081-4904-bb34-004300c0135c None admin] Validating token access rules against request {{(pid=80396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:45:54.386099 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb8248f9-5b66-4c08-9b6d-c69563ab7f96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:45:54.386902 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8248f9-5b66-4c08-9b6d-c69563ab7f96 None admin] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:45:54.387188 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8248f9-5b66-4c08-9b6d-c69563ab7f96 None admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:45:54.387512 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8248f9-5b66-4c08-9b6d-c69563ab7f96 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:45:54.398032 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb8248f9-5b66-4c08-9b6d-c69563ab7f96 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 02 15:45:54.406633 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application [None req-cb8248f9-5b66-4c08-9b6d-c69563ab7f96 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 02 15:45:54.406633 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 15:45:54.406633 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 15:45:54.406633 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 15:45:54.406633 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 15:45:54.406633 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 15:45:54.406633 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 15:45:54.406633 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 15:45:54.406633 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 15:45:54.406633 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 15:45:54.406633 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 15:45:54.406633 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 15:45:54.406633 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 02 15:45:54.406633 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 02 15:45:54.406633 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 02 15:45:54.406633 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 02 15:45:54.407513 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 02 15:45:54.407513 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 02 15:45:54.407513 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 02 15:45:54.407513 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 02 15:45:54.407513 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 15:45:54.407513 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 15:45:54.407513 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 15:45:54.407513 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 15:45:54.407513 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 15:45:54.407513 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 15:45:54.407513 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 15:45:54.407513 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application with Lock( Jun 02 15:45:54.407513 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 15:45:54.407513 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self._enter() Jun 02 15:45:54.407513 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 15:45:54.407513 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 15:45:54.408309 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 15:45:54.408309 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self.creator() Jun 02 15:45:54.408309 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 15:45:54.408309 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application created_value = creator( Jun 02 15:45:54.408309 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 02 15:45:54.408309 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 02 15:45:54.408309 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 02 15:45:54.408309 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 02 15:45:54.408309 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 02 15:45:54.408309 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 02 15:45:54.408309 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 02 15:45:54.408309 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application Jun 02 15:45:54.408309 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 164/324] 10.222.0.59 () {56 vars in 1099 bytes} [Thu Jun 2 15:45:54 2022] GET /identity/v3/roles/reader => generated 84 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 02 15:45:54.410558 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-241668b8-46b2-4aae-8ae4-1ce26a564c06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:45:54.411386 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241668b8-46b2-4aae-8ae4-1ce26a564c06 None admin] REQUEST_METHOD: `POST` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:45:54.411804 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241668b8-46b2-4aae-8ae4-1ce26a564c06 None admin] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:45:54.412230 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241668b8-46b2-4aae-8ae4-1ce26a564c06 None admin] PATH_INFO: `/v3/groups` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:45:54.413074 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-241668b8-46b2-4aae-8ae4-1ce26a564c06 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:45:54.413515 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb8248f9-5b66-4c08-9b6d-c69563ab7f96 None admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:45:54.414822 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-241668b8-46b2-4aae-8ae4-1ce26a564c06 None admin] RBAC: Authorization granted {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:45:54.512822 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb8248f9-5b66-4c08-9b6d-c69563ab7f96 None admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:45:54.515088 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 161/325] 10.222.0.59 () {60 vars in 1134 bytes} [Thu Jun 2 15:45:54 2022] POST /identity/v3/groups => generated 226 bytes in 251 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 02 15:45:54.516371 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7fefba9-86db-462a-9341-8f0aa7da2011 None None] REQUEST_METHOD: `GET` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:45:54.516665 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7fefba9-86db-462a-9341-8f0aa7da2011 None None] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:45:54.517200 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7fefba9-86db-462a-9341-8f0aa7da2011 None None] PATH_INFO: `/` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:45:54.518360 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 162/326] 10.222.0.59 () {54 vars in 926 bytes} [Thu Jun 2 15:45:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 15:45:54.524063 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50491e4-a196-4a88-ae0b-a67eba7d6bf0 None None] REQUEST_METHOD: `POST` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:45:54.524359 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50491e4-a196-4a88-ae0b-a67eba7d6bf0 None None] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:45:54.525203 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50491e4-a196-4a88-ae0b-a67eba7d6bf0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:45:54.544064 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.auth.core [None req-b50491e4-a196-4a88-ae0b-a67eba7d6bf0 None None] MFA Rules not processed for user `400d1f4db9de49638549e5db29a041e1`. Rule list: `[]` (Enabled: `True`). {{(pid=80396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 15:45:54.545315 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.fernet_utils [None req-b50491e4-a196-4a88-ae0b-a67eba7d6bf0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 15:45:54.554227 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f13a93b1-91f6-44ad-92a4-808483d9d89b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:45:54.554915 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f13a93b1-91f6-44ad-92a4-808483d9d89b None admin] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:45:54.555195 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f13a93b1-91f6-44ad-92a4-808483d9d89b None admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:45:54.555463 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f13a93b1-91f6-44ad-92a4-808483d9d89b None admin] PATH_INFO: `/v3/roles` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:45:54.556395 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f13a93b1-91f6-44ad-92a4-808483d9d89b None admin] RBAC: Adding query filter params (name=reader) {{(pid=80395) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 15:45:54.556875 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f13a93b1-91f6-44ad-92a4-808483d9d89b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:45:54.558569 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f13a93b1-91f6-44ad-92a4-808483d9d89b None admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:45:54.568505 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 165/327] 10.222.0.59 () {56 vars in 1101 bytes} [Thu Jun 2 15:45:54 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 15:45:54.574598 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f13a93b1-91f6-44ad-92a4-808483d9d89b None admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:45:54.596811 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writing DB stats keystone:SELECT=100 {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:45:54.630043 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 163/328] 10.222.0.59 () {58 vars in 1023 bytes} [Thu Jun 2 15:45:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 02 15:45:54.653773 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b50491e4-a196-4a88-ae0b-a67eba7d6bf0 None None] Authenticating user token {{(pid=80396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:45:54.687689 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f13a93b1-91f6-44ad-92a4-808483d9d89b None admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:45:54.729234 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-969b6064-878d-4f05-a4c6-54b64b439ac2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:45:54.730138 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969b6064-878d-4f05-a4c6-54b64b439ac2 None admin] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:45:54.730422 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969b6064-878d-4f05-a4c6-54b64b439ac2 None admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:45:54.730694 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969b6064-878d-4f05-a4c6-54b64b439ac2 None admin] PATH_INFO: `/v3/users/14066e5730e1422ab0e5eebb4efe292f` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:45:54.732661 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-969b6064-878d-4f05-a4c6-54b64b439ac2 None admin] RBAC: Authorizing `identity:get_user(user_id=14066e5730e1422ab0e5eebb4efe292f)` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:45:54.733520 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-969b6064-878d-4f05-a4c6-54b64b439ac2 None admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:45:54.735973 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 166/329] 10.222.0.59 () {56 vars in 1177 bytes} [Thu Jun 2 15:45:54 2022] GET /identity/v3/users/14066e5730e1422ab0e5eebb4efe292f => generated 293 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 15:45:54.740962 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-969b6064-878d-4f05-a4c6-54b64b439ac2 None admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:45:54.748456 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG dbcounter [-] [80396] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:45:54.771767 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b50491e4-a196-4a88-ae0b-a67eba7d6bf0 None None] Validating token access rules against request {{(pid=80396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:45:54.819047 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8d6d05a-b640-4b29-bd8a-c6f8b0e9f386 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:45:54.819852 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d6d05a-b640-4b29-bd8a-c6f8b0e9f386 None admin] REQUEST_METHOD: `GET` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:45:54.820128 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d6d05a-b640-4b29-bd8a-c6f8b0e9f386 None admin] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:45:54.820401 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d6d05a-b640-4b29-bd8a-c6f8b0e9f386 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:45:54.831632 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8d6d05a-b640-4b29-bd8a-c6f8b0e9f386 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 02 15:45:54.841538 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application [None req-f8d6d05a-b640-4b29-bd8a-c6f8b0e9f386 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 02 15:45:54.841538 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 15:45:54.841538 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 15:45:54.841538 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 15:45:54.841538 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 15:45:54.841538 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 15:45:54.841538 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 15:45:54.841538 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 15:45:54.841538 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 15:45:54.841538 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 15:45:54.841538 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 15:45:54.841538 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 15:45:54.841538 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 02 15:45:54.841538 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 02 15:45:54.841538 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 02 15:45:54.841538 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 02 15:45:54.842552 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 02 15:45:54.842552 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 02 15:45:54.842552 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 02 15:45:54.842552 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 02 15:45:54.842552 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 15:45:54.842552 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 15:45:54.842552 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 15:45:54.842552 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 15:45:54.842552 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 15:45:54.842552 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 15:45:54.842552 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 15:45:54.842552 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application with Lock( Jun 02 15:45:54.842552 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 15:45:54.842552 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application return self._enter() Jun 02 15:45:54.842552 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 15:45:54.842552 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 15:45:54.843336 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 15:45:54.843336 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application return self.creator() Jun 02 15:45:54.843336 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 15:45:54.843336 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application created_value = creator( Jun 02 15:45:54.843336 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 02 15:45:54.843336 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 02 15:45:54.843336 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 02 15:45:54.843336 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 02 15:45:54.843336 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 02 15:45:54.843336 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 02 15:45:54.843336 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 02 15:45:54.843336 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application Jun 02 15:45:54.843934 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 164/330] 10.222.0.59 () {56 vars in 1099 bytes} [Thu Jun 2 15:45:54 2022] GET /identity/v3/roles/member => generated 84 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 02 15:45:54.849138 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8d6d05a-b640-4b29-bd8a-c6f8b0e9f386 None admin] Authenticating user token {{(pid=80396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:45:54.855296 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writing DB stats keystone:SELECT=100 {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:45:54.871908 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-969b6064-878d-4f05-a4c6-54b64b439ac2 None admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:45:54.913435 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-289edd85-a2dc-4f5e-8e97-d3caf3d77b0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:45:54.914450 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-289edd85-a2dc-4f5e-8e97-d3caf3d77b0b None admin] REQUEST_METHOD: `PUT` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:45:54.914810 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-289edd85-a2dc-4f5e-8e97-d3caf3d77b0b None admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:45:54.915322 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-289edd85-a2dc-4f5e-8e97-d3caf3d77b0b None admin] PATH_INFO: `/v3/system/users/14066e5730e1422ab0e5eebb4efe292f/roles/67885c18a3dc47718e9197097185f65d` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:45:54.917359 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-289edd85-a2dc-4f5e-8e97-d3caf3d77b0b None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=14066e5730e1422ab0e5eebb4efe292f, role_id=67885c18a3dc47718e9197097185f65d)` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:45:54.918803 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-289edd85-a2dc-4f5e-8e97-d3caf3d77b0b None admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:45:54.977305 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8d6d05a-b640-4b29-bd8a-c6f8b0e9f386 None admin] Validating token access rules against request {{(pid=80396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:45:54.993884 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 167/331] 10.222.0.59 () {58 vars in 1334 bytes} [Thu Jun 2 15:45:54 2022] PUT /identity/v3/system/users/14066e5730e1422ab0e5eebb4efe292f/roles/67885c18a3dc47718e9197097185f65d => generated 0 bytes in 253 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 02 15:45:55.023791 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b622eaf4-9597-4aeb-a9a4-37ef04c4fe07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:45:55.025215 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b622eaf4-9597-4aeb-a9a4-37ef04c4fe07 None admin] REQUEST_METHOD: `GET` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:45:55.025709 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b622eaf4-9597-4aeb-a9a4-37ef04c4fe07 None admin] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:45:55.026194 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b622eaf4-9597-4aeb-a9a4-37ef04c4fe07 None admin] PATH_INFO: `/v3/roles` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:45:55.026997 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b622eaf4-9597-4aeb-a9a4-37ef04c4fe07 None admin] RBAC: Adding query filter params (name=member) {{(pid=80396) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 15:45:55.027310 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b622eaf4-9597-4aeb-a9a4-37ef04c4fe07 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:45:55.028829 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b622eaf4-9597-4aeb-a9a4-37ef04c4fe07 None admin] RBAC: Authorization granted {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:45:55.040019 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 165/332] 10.222.0.59 () {56 vars in 1101 bytes} [Thu Jun 2 15:45:54 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 15:45:55.045978 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-289edd85-a2dc-4f5e-8e97-d3caf3d77b0b None admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:45:55.166732 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-289edd85-a2dc-4f5e-8e97-d3caf3d77b0b None admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:45:55.230500 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f0ce9df-2a52-4d0b-abae-cdc0fc1c80bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:45:55.230500 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0ce9df-2a52-4d0b-abae-cdc0fc1c80bb None admin] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:45:55.230500 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0ce9df-2a52-4d0b-abae-cdc0fc1c80bb None admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:45:55.230500 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0ce9df-2a52-4d0b-abae-cdc0fc1c80bb None admin] PATH_INFO: `/v3/users/79eef196f58447da804733f76939fa31` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:45:55.231754 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f0ce9df-2a52-4d0b-abae-cdc0fc1c80bb None admin] RBAC: Authorizing `identity:get_user(user_id=79eef196f58447da804733f76939fa31)` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:45:55.233479 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f0ce9df-2a52-4d0b-abae-cdc0fc1c80bb None admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:45:55.235693 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 168/333] 10.222.0.59 () {56 vars in 1177 bytes} [Thu Jun 2 15:45:55 2022] GET /identity/v3/users/79eef196f58447da804733f76939fa31 => generated 293 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 15:45:55.241776 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b622eaf4-9597-4aeb-a9a4-37ef04c4fe07 None admin] Authenticating user token {{(pid=80396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:45:55.248728 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG dbcounter [-] [80396] Writing DB stats keystone:SELECT=100 {{(pid=80396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:45:55.357588 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b622eaf4-9597-4aeb-a9a4-37ef04c4fe07 None admin] Validating token access rules against request {{(pid=80396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:45:55.396166 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28dab2cd-7a86-4996-992a-632f336e53a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:45:55.397173 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28dab2cd-7a86-4996-992a-632f336e53a9 None admin] REQUEST_METHOD: `GET` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:45:55.397651 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28dab2cd-7a86-4996-992a-632f336e53a9 None admin] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:45:55.398181 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28dab2cd-7a86-4996-992a-632f336e53a9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:45:55.399938 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28dab2cd-7a86-4996-992a-632f336e53a9 None admin] RBAC: Adding query filter params (role.id=649e0f2b5a264c419ea6a1441f123a03, user.id=79eef196f58447da804733f76939fa31, scope.system=all) {{(pid=80396) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 15:45:55.400784 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28dab2cd-7a86-4996-992a-632f336e53a9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:45:55.402508 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28dab2cd-7a86-4996-992a-632f336e53a9 None admin] RBAC: Authorization granted {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:45:55.415966 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 166/334] 10.222.0.59 () {56 vars in 1308 bytes} [Thu Jun 2 15:45:55 2022] GET /identity/v3/role_assignments?user.id=79eef196f58447da804733f76939fa31&scope.system=all&role.id=649e0f2b5a264c419ea6a1441f123a03 => generated 510 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 15:45:57.468807 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f6e76dd-6fa3-4143-a982-2ab01cb47ffa None None] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:45:57.469313 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f6e76dd-6fa3-4143-a982-2ab01cb47ffa None None] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:45:57.469313 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f6e76dd-6fa3-4143-a982-2ab01cb47ffa None None] PATH_INFO: `/` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:45:57.470953 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 169/335] 10.222.0.59 () {54 vars in 926 bytes} [Thu Jun 2 15:45:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 15:45:57.476728 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d76e02e-80ee-47c2-ad8d-57b3e1059b27 None None] REQUEST_METHOD: `POST` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:45:57.477225 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d76e02e-80ee-47c2-ad8d-57b3e1059b27 None None] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:45:57.477839 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d76e02e-80ee-47c2-ad8d-57b3e1059b27 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:45:57.501166 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.auth.core [None req-5d76e02e-80ee-47c2-ad8d-57b3e1059b27 None None] MFA Rules not processed for user `400d1f4db9de49638549e5db29a041e1`. Rule list: `[]` (Enabled: `True`). {{(pid=80396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 15:45:57.502379 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.fernet_utils [None req-5d76e02e-80ee-47c2-ad8d-57b3e1059b27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 15:45:57.569000 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG dbcounter [-] [80396] Writing DB stats keystone:SELECT=100 {{(pid=80396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:45:57.582721 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 167/336] 10.222.0.59 () {58 vars in 1023 bytes} [Thu Jun 2 15:45:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 02 15:45:57.610700 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f6e76dd-6fa3-4143-a982-2ab01cb47ffa None None] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:45:57.637674 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:45:57.735893 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f6e76dd-6fa3-4143-a982-2ab01cb47ffa None None] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:45:57.782945 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b569695f-6cf0-4083-8247-f3c488909b11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:45:57.783750 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b569695f-6cf0-4083-8247-f3c488909b11 None admin] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:45:57.784035 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b569695f-6cf0-4083-8247-f3c488909b11 None admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:45:57.784311 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b569695f-6cf0-4083-8247-f3c488909b11 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:45:57.800338 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b569695f-6cf0-4083-8247-f3c488909b11 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 02 15:45:57.809237 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application [None req-b569695f-6cf0-4083-8247-f3c488909b11 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 02 15:45:57.809237 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 15:45:57.809237 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 15:45:57.809237 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 15:45:57.809237 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 15:45:57.809237 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 15:45:57.809237 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 15:45:57.809237 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 15:45:57.809237 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 15:45:57.809237 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 15:45:57.809237 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 15:45:57.809237 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 15:45:57.809237 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 02 15:45:57.809237 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 02 15:45:57.809237 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 02 15:45:57.809237 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 02 15:45:57.810206 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 02 15:45:57.810206 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 02 15:45:57.810206 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 02 15:45:57.810206 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 02 15:45:57.810206 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 15:45:57.810206 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 15:45:57.810206 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 15:45:57.810206 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 15:45:57.810206 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 15:45:57.810206 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 15:45:57.810206 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 15:45:57.810206 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application with Lock( Jun 02 15:45:57.810206 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 15:45:57.810206 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self._enter() Jun 02 15:45:57.810206 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 15:45:57.810206 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 15:45:57.810994 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 15:45:57.810994 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self.creator() Jun 02 15:45:57.810994 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 15:45:57.810994 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application created_value = creator( Jun 02 15:45:57.810994 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 02 15:45:57.810994 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 02 15:45:57.810994 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 02 15:45:57.810994 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 02 15:45:57.810994 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 02 15:45:57.810994 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 02 15:45:57.810994 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 02 15:45:57.810994 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application Jun 02 15:45:57.814179 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 170/337] 10.222.0.59 () {56 vars in 1099 bytes} [Thu Jun 2 15:45:57 2022] GET /identity/v3/roles/member => generated 84 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 15:45:57.816715 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d76e02e-80ee-47c2-ad8d-57b3e1059b27 None None] Authenticating user token {{(pid=80396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:45:57.933403 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d76e02e-80ee-47c2-ad8d-57b3e1059b27 None None] Validating token access rules against request {{(pid=80396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:45:57.955904 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2661a811-7710-4656-a139-a0ee00c12afe None None] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:45:57.956216 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2661a811-7710-4656-a139-a0ee00c12afe None None] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:45:57.956459 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2661a811-7710-4656-a139-a0ee00c12afe None None] PATH_INFO: `/` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:45:57.958150 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 171/338] 10.222.0.59 () {54 vars in 926 bytes} [Thu Jun 2 15:45:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 15:45:57.963341 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c0b6d9-d8a1-4073-80fd-a7121755d95b None None] REQUEST_METHOD: `POST` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:45:57.963883 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c0b6d9-d8a1-4073-80fd-a7121755d95b None None] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:45:57.964161 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c0b6d9-d8a1-4073-80fd-a7121755d95b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:45:57.991600 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.auth.core [None req-91c0b6d9-d8a1-4073-80fd-a7121755d95b None None] MFA Rules not processed for user `400d1f4db9de49638549e5db29a041e1`. Rule list: `[]` (Enabled: `True`). {{(pid=80395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 15:45:57.993515 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.fernet_utils [None req-91c0b6d9-d8a1-4073-80fd-a7121755d95b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 15:45:57.998757 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-015cdf83-867b-4f13-98d3-a1beb4bc5fa3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:45:57.999438 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-015cdf83-867b-4f13-98d3-a1beb4bc5fa3 None admin] REQUEST_METHOD: `GET` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:45:57.999726 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-015cdf83-867b-4f13-98d3-a1beb4bc5fa3 None admin] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:45:58.000001 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-015cdf83-867b-4f13-98d3-a1beb4bc5fa3 None admin] PATH_INFO: `/v3/roles` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:45:58.000764 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-015cdf83-867b-4f13-98d3-a1beb4bc5fa3 None admin] RBAC: Adding query filter params (name=member) {{(pid=80396) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 15:45:58.005359 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-015cdf83-867b-4f13-98d3-a1beb4bc5fa3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:45:58.005359 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-015cdf83-867b-4f13-98d3-a1beb4bc5fa3 None admin] RBAC: Authorization granted {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:45:58.018188 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 168/339] 10.222.0.59 () {56 vars in 1101 bytes} [Thu Jun 2 15:45:57 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 15:45:58.019592 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc2f501-08cf-4d09-a381-07632aa34a51 None None] REQUEST_METHOD: `GET` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:45:58.019882 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc2f501-08cf-4d09-a381-07632aa34a51 None None] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:45:58.020161 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc2f501-08cf-4d09-a381-07632aa34a51 None None] PATH_INFO: `/` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:45:58.023025 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 169/340] 10.222.0.59 () {54 vars in 926 bytes} [Thu Jun 2 15:45:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 15:45:58.023805 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fc2f501-08cf-4d09-a381-07632aa34a51 None None] Authenticating user token {{(pid=80396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:45:58.082999 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 172/341] 10.222.0.59 () {58 vars in 1023 bytes} [Thu Jun 2 15:45:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 02 15:45:58.084835 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a18ddb0-55bb-4533-ab00-74b432fa088c None None] REQUEST_METHOD: `POST` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:45:58.085383 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a18ddb0-55bb-4533-ab00-74b432fa088c None None] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:45:58.085952 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a18ddb0-55bb-4533-ab00-74b432fa088c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:45:58.093283 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG dbcounter [-] [80396] Writing DB stats keystone:SELECT=100 {{(pid=80396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:45:58.105488 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.auth.core [None req-5a18ddb0-55bb-4533-ab00-74b432fa088c None None] MFA Rules not processed for user `400d1f4db9de49638549e5db29a041e1`. Rule list: `[]` (Enabled: `True`). {{(pid=80395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 15:45:58.115568 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.fernet_utils [None req-5a18ddb0-55bb-4533-ab00-74b432fa088c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 15:45:58.115568 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writing DB stats keystone:SELECT=100 {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:45:58.151231 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fc2f501-08cf-4d09-a381-07632aa34a51 None None] Validating token access rules against request {{(pid=80396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:45:58.185058 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 173/342] 10.222.0.59 () {58 vars in 1023 bytes} [Thu Jun 2 15:45:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 02 15:45:58.187064 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0cff41a-4cf5-437c-bdd6-fb3e0a3985c3 None None] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:45:58.187968 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0cff41a-4cf5-437c-bdd6-fb3e0a3985c3 None None] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:45:58.188441 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0cff41a-4cf5-437c-bdd6-fb3e0a3985c3 None None] PATH_INFO: `/` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:45:58.190062 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 174/343] 10.222.0.59 () {54 vars in 926 bytes} [Thu Jun 2 15:45:58 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 15:45:58.190968 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0cff41a-4cf5-437c-bdd6-fb3e0a3985c3 None None] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:45:58.201625 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7d7b4bd-23ee-428a-82b7-2212de759e97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:45:58.202643 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d7b4bd-23ee-428a-82b7-2212de759e97 None admin] REQUEST_METHOD: `GET` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:45:58.202643 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d7b4bd-23ee-428a-82b7-2212de759e97 None admin] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:45:58.202925 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d7b4bd-23ee-428a-82b7-2212de759e97 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:45:58.282404 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7d7b4bd-23ee-428a-82b7-2212de759e97 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:45:58.283178 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7d7b4bd-23ee-428a-82b7-2212de759e97 None admin] RBAC: Authorization granted {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:45:58.314238 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0cff41a-4cf5-437c-bdd6-fb3e0a3985c3 None None] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:45:58.346778 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG dbcounter [-] [80396] Writing DB stats keystone:SELECT=100 {{(pid=80396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:45:58.354929 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1bf24d2-21dd-4ff9-9fc4-0935222aee56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:45:58.356079 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1bf24d2-21dd-4ff9-9fc4-0935222aee56 None admin] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:45:58.356568 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1bf24d2-21dd-4ff9-9fc4-0935222aee56 None admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:45:58.357145 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1bf24d2-21dd-4ff9-9fc4-0935222aee56 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:45:58.364869 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writing DB stats keystone:SELECT=100 {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:45:58.370307 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1bf24d2-21dd-4ff9-9fc4-0935222aee56 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 02 15:45:58.380981 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application [None req-d1bf24d2-21dd-4ff9-9fc4-0935222aee56 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 02 15:45:58.380981 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 15:45:58.380981 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 15:45:58.380981 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 15:45:58.380981 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 15:45:58.380981 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 15:45:58.380981 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 15:45:58.380981 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 15:45:58.380981 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 15:45:58.380981 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 15:45:58.380981 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 15:45:58.380981 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 15:45:58.380981 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 02 15:45:58.380981 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 02 15:45:58.380981 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 02 15:45:58.380981 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 02 15:45:58.381879 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 02 15:45:58.381879 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 02 15:45:58.381879 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 02 15:45:58.381879 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 02 15:45:58.381879 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 15:45:58.381879 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 15:45:58.381879 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 15:45:58.381879 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 15:45:58.381879 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 15:45:58.381879 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 15:45:58.381879 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 15:45:58.381879 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application with Lock( Jun 02 15:45:58.381879 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 15:45:58.381879 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self._enter() Jun 02 15:45:58.381879 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 15:45:58.381879 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 15:45:58.382682 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 15:45:58.382682 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self.creator() Jun 02 15:45:58.382682 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 15:45:58.382682 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application created_value = creator( Jun 02 15:45:58.382682 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 02 15:45:58.382682 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 02 15:45:58.382682 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 02 15:45:58.382682 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 02 15:45:58.382682 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 02 15:45:58.382682 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 02 15:45:58.382682 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 02 15:45:58.382682 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application Jun 02 15:45:58.385886 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 175/344] 10.222.0.59 () {56 vars in 1114 bytes} [Thu Jun 2 15:45:58 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 15:45:58.387696 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cced1d1-eda4-4132-82cd-e454b6044f71 None None] REQUEST_METHOD: `POST` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:45:58.388211 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cced1d1-eda4-4132-82cd-e454b6044f71 None None] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:45:58.388682 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cced1d1-eda4-4132-82cd-e454b6044f71 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:45:58.404941 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 170/345] 10.222.0.59 () {58 vars in 1282 bytes} [Thu Jun 2 15:45:58 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 381 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 02 15:45:58.405964 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7d7b4bd-23ee-428a-82b7-2212de759e97 None admin] Authenticating user token {{(pid=80396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:45:58.409153 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.auth.core [None req-3cced1d1-eda4-4132-82cd-e454b6044f71 None None] MFA Rules not processed for user `400d1f4db9de49638549e5db29a041e1`. Rule list: `[]` (Enabled: `True`). {{(pid=80395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 15:45:58.410757 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.fernet_utils [None req-3cced1d1-eda4-4132-82cd-e454b6044f71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 15:45:58.489471 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 176/346] 10.222.0.59 () {58 vars in 1023 bytes} [Thu Jun 2 15:45:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 02 15:45:58.491023 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cced1d1-eda4-4132-82cd-e454b6044f71 None None] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:45:58.516928 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7d7b4bd-23ee-428a-82b7-2212de759e97 None admin] Validating token access rules against request {{(pid=80396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:45:58.554871 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb23e8f0-2b02-4409-bb04-9fc2489d54e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:45:58.556132 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb23e8f0-2b02-4409-bb04-9fc2489d54e7 None admin] REQUEST_METHOD: `GET` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:45:58.556624 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb23e8f0-2b02-4409-bb04-9fc2489d54e7 None admin] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:45:58.557373 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb23e8f0-2b02-4409-bb04-9fc2489d54e7 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:45:58.567948 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb23e8f0-2b02-4409-bb04-9fc2489d54e7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 02 15:45:58.577275 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application [None req-cb23e8f0-2b02-4409-bb04-9fc2489d54e7 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 02 15:45:58.577275 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 15:45:58.577275 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 15:45:58.577275 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 15:45:58.577275 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 15:45:58.577275 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 15:45:58.577275 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 15:45:58.577275 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 15:45:58.577275 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 15:45:58.577275 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 15:45:58.577275 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 15:45:58.577275 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 15:45:58.577275 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 02 15:45:58.577275 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 02 15:45:58.577275 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 02 15:45:58.577275 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 02 15:45:58.578498 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 02 15:45:58.578498 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 02 15:45:58.578498 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 02 15:45:58.578498 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 02 15:45:58.578498 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 15:45:58.578498 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 15:45:58.578498 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 15:45:58.578498 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 15:45:58.578498 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 15:45:58.578498 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 15:45:58.578498 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 15:45:58.578498 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application with Lock( Jun 02 15:45:58.578498 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 15:45:58.578498 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application return self._enter() Jun 02 15:45:58.578498 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 15:45:58.578498 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 15:45:58.579414 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 15:45:58.579414 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application return self.creator() Jun 02 15:45:58.579414 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 15:45:58.579414 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application created_value = creator( Jun 02 15:45:58.579414 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 02 15:45:58.579414 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 02 15:45:58.579414 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 02 15:45:58.579414 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 02 15:45:58.579414 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 02 15:45:58.579414 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 02 15:45:58.579414 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 02 15:45:58.579414 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application Jun 02 15:45:58.579414 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 171/347] 10.222.0.59 () {56 vars in 1099 bytes} [Thu Jun 2 15:45:58 2022] GET /identity/v3/roles/reader => generated 84 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 15:45:58.580066 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb23e8f0-2b02-4409-bb04-9fc2489d54e7 None admin] Authenticating user token {{(pid=80396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:45:58.597459 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG dbcounter [-] [80396] Writing DB stats keystone:SELECT=100 {{(pid=80396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:45:58.609770 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cced1d1-eda4-4132-82cd-e454b6044f71 None None] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:45:58.639408 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writing DB stats keystone:SELECT=100 {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:45:58.647763 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7ea7ace-857c-4ddb-8760-518c6a43ceb3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:45:58.648640 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ea7ace-857c-4ddb-8760-518c6a43ceb3 None admin] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:45:58.649619 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ea7ace-857c-4ddb-8760-518c6a43ceb3 None admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:45:58.650043 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ea7ace-857c-4ddb-8760-518c6a43ceb3 None admin] PATH_INFO: `/v3/roles` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:45:58.650949 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7ea7ace-857c-4ddb-8760-518c6a43ceb3 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80395) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 15:45:58.651406 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7ea7ace-857c-4ddb-8760-518c6a43ceb3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:45:58.653015 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7ea7ace-857c-4ddb-8760-518c6a43ceb3 None admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:45:58.663913 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 177/348] 10.222.0.59 () {56 vars in 1111 bytes} [Thu Jun 2 15:45:58 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 15:45:58.665056 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7ea7ace-857c-4ddb-8760-518c6a43ceb3 None admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:45:58.694061 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb23e8f0-2b02-4409-bb04-9fc2489d54e7 None admin] Validating token access rules against request {{(pid=80396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:45:58.732235 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68aeadd8-3168-49d2-b6b1-5a43c6b64a30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:45:58.733098 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68aeadd8-3168-49d2-b6b1-5a43c6b64a30 None admin] REQUEST_METHOD: `GET` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:45:58.733381 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68aeadd8-3168-49d2-b6b1-5a43c6b64a30 None admin] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:45:58.733657 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68aeadd8-3168-49d2-b6b1-5a43c6b64a30 None admin] PATH_INFO: `/v3/projects/06e0633a47e74dcfaeccc8794206da96` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:45:58.734887 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68aeadd8-3168-49d2-b6b1-5a43c6b64a30 None admin] RBAC: Authorizing `identity:get_project(project_id=06e0633a47e74dcfaeccc8794206da96)` {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:45:58.736340 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68aeadd8-3168-49d2-b6b1-5a43c6b64a30 None admin] RBAC: Authorization granted {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:45:58.742179 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 172/349] 10.222.0.59 () {56 vars in 1186 bytes} [Thu Jun 2 15:45:58 2022] GET /identity/v3/projects/06e0633a47e74dcfaeccc8794206da96 => generated 298 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 15:45:58.743648 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68aeadd8-3168-49d2-b6b1-5a43c6b64a30 None admin] Authenticating user token {{(pid=80396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:45:58.781510 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7ea7ace-857c-4ddb-8760-518c6a43ceb3 None admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:45:58.819894 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-267042b6-3995-40a1-8bf2-defa7dee46dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:45:58.821580 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267042b6-3995-40a1-8bf2-defa7dee46dd None admin] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:45:58.822026 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267042b6-3995-40a1-8bf2-defa7dee46dd None admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:45:58.822533 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267042b6-3995-40a1-8bf2-defa7dee46dd None admin] PATH_INFO: `/v3/roles/member` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:45:58.828741 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG dbcounter [-] [80396] Writing DB stats keystone:SELECT=100 {{(pid=80396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:45:58.836432 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-267042b6-3995-40a1-8bf2-defa7dee46dd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 02 15:45:58.845310 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application [None req-267042b6-3995-40a1-8bf2-defa7dee46dd None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 02 15:45:58.845310 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 15:45:58.845310 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 15:45:58.845310 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 15:45:58.845310 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 15:45:58.845310 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 15:45:58.845310 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 15:45:58.845310 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 15:45:58.845310 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 15:45:58.845310 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 15:45:58.845310 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 15:45:58.845310 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 15:45:58.845310 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 02 15:45:58.845310 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 02 15:45:58.845310 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 02 15:45:58.845310 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 02 15:45:58.846438 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 02 15:45:58.846438 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 02 15:45:58.846438 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 02 15:45:58.846438 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 02 15:45:58.846438 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 15:45:58.846438 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 15:45:58.846438 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 15:45:58.846438 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 15:45:58.846438 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 15:45:58.846438 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 15:45:58.846438 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 15:45:58.846438 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application with Lock( Jun 02 15:45:58.846438 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 15:45:58.846438 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self._enter() Jun 02 15:45:58.846438 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 15:45:58.846438 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 15:45:58.847360 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 15:45:58.847360 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self.creator() Jun 02 15:45:58.847360 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 15:45:58.847360 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application created_value = creator( Jun 02 15:45:58.847360 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 02 15:45:58.847360 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 02 15:45:58.847360 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 02 15:45:58.847360 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 02 15:45:58.847360 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 02 15:45:58.847360 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 02 15:45:58.847360 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 02 15:45:58.847360 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application Jun 02 15:45:58.847966 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68aeadd8-3168-49d2-b6b1-5a43c6b64a30 None admin] Validating token access rules against request {{(pid=80396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:45:58.849416 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 178/350] 10.222.0.59 () {56 vars in 1099 bytes} [Thu Jun 2 15:45:58 2022] GET /identity/v3/roles/member => generated 84 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 15:45:58.850440 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-267042b6-3995-40a1-8bf2-defa7dee46dd None admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:45:58.890405 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8f1dbe3-7aea-40a2-9398-8fcacacaae61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:45:58.891078 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f1dbe3-7aea-40a2-9398-8fcacacaae61 None admin] REQUEST_METHOD: `GET` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:45:58.891362 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f1dbe3-7aea-40a2-9398-8fcacacaae61 None admin] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:45:58.891640 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f1dbe3-7aea-40a2-9398-8fcacacaae61 None admin] PATH_INFO: `/v3/roles` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:45:58.893086 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8f1dbe3-7aea-40a2-9398-8fcacacaae61 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80396) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 15:45:58.893086 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8f1dbe3-7aea-40a2-9398-8fcacacaae61 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:45:58.894134 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8f1dbe3-7aea-40a2-9398-8fcacacaae61 None admin] RBAC: Authorization granted {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:45:58.904097 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 173/351] 10.222.0.59 () {56 vars in 1101 bytes} [Thu Jun 2 15:45:58 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 15:45:58.905039 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8f1dbe3-7aea-40a2-9398-8fcacacaae61 None admin] Authenticating user token {{(pid=80396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:45:58.916804 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writing DB stats keystone:SELECT=100 {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:45:58.970542 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-267042b6-3995-40a1-8bf2-defa7dee46dd None admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:45:59.011001 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5d8ca01-a47f-4038-a814-0856e7286a44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:45:59.011780 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d8ca01-a47f-4038-a814-0856e7286a44 None admin] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:45:59.012065 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d8ca01-a47f-4038-a814-0856e7286a44 None admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:45:59.012338 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d8ca01-a47f-4038-a814-0856e7286a44 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:45:59.021957 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8f1dbe3-7aea-40a2-9398-8fcacacaae61 None admin] Validating token access rules against request {{(pid=80396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:45:59.060890 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf2a85e3-759f-40d2-88ac-3b60b608a19d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:45:59.062025 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf2a85e3-759f-40d2-88ac-3b60b608a19d None admin] REQUEST_METHOD: `GET` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:45:59.062479 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf2a85e3-759f-40d2-88ac-3b60b608a19d None admin] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:45:59.062907 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf2a85e3-759f-40d2-88ac-3b60b608a19d None admin] PATH_INFO: `/v3/groups/0d56bf165788496982f9b3bbb67c019e` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:45:59.069966 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf2a85e3-759f-40d2-88ac-3b60b608a19d None admin] RBAC: Authorizing `identity:get_group(group_id=0d56bf165788496982f9b3bbb67c019e)` {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:45:59.072439 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf2a85e3-759f-40d2-88ac-3b60b608a19d None admin] RBAC: Authorization granted {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:45:59.078299 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 174/352] 10.222.0.59 () {56 vars in 1180 bytes} [Thu Jun 2 15:45:58 2022] GET /identity/v3/groups/0d56bf165788496982f9b3bbb67c019e => generated 226 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 15:45:59.079292 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf2a85e3-759f-40d2-88ac-3b60b608a19d None admin] Authenticating user token {{(pid=80396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:45:59.088690 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5d8ca01-a47f-4038-a814-0856e7286a44 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:45:59.090574 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5d8ca01-a47f-4038-a814-0856e7286a44 None admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:45:59.094881 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG dbcounter [-] [80396] Writing DB stats keystone:SELECT=100 {{(pid=80396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:45:59.146750 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writing DB stats keystone:SELECT=100 {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:45:59.193906 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf2a85e3-759f-40d2-88ac-3b60b608a19d None admin] Validating token access rules against request {{(pid=80396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:45:59.204321 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 179/353] 10.222.0.59 () {58 vars in 1282 bytes} [Thu Jun 2 15:45:58 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 354 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 02 15:45:59.205412 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5d8ca01-a47f-4038-a814-0856e7286a44 None admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:45:59.235031 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70870110-8bd7-4f09-8621-3d926834b043 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:45:59.235822 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70870110-8bd7-4f09-8621-3d926834b043 None admin] REQUEST_METHOD: `GET` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:45:59.236114 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70870110-8bd7-4f09-8621-3d926834b043 None admin] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:45:59.236392 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70870110-8bd7-4f09-8621-3d926834b043 None admin] PATH_INFO: `/v3/roles` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:45:59.237268 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70870110-8bd7-4f09-8621-3d926834b043 None admin] RBAC: Adding query filter params (name=member) {{(pid=80396) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 15:45:59.237553 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70870110-8bd7-4f09-8621-3d926834b043 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:45:59.238959 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70870110-8bd7-4f09-8621-3d926834b043 None admin] RBAC: Authorization granted {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:45:59.249202 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 175/354] 10.222.0.59 () {56 vars in 1101 bytes} [Thu Jun 2 15:45:59 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 15:45:59.250144 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70870110-8bd7-4f09-8621-3d926834b043 None admin] Authenticating user token {{(pid=80396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:45:59.321427 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5d8ca01-a47f-4038-a814-0856e7286a44 None admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:45:59.332735 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG dbcounter [-] [80396] Writing DB stats keystone:SELECT=100 {{(pid=80396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:45:59.378845 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84e40257-21f9-4331-a020-f703b9a57e2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:45:59.379146 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70870110-8bd7-4f09-8621-3d926834b043 None admin] Validating token access rules against request {{(pid=80396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:45:59.379729 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e40257-21f9-4331-a020-f703b9a57e2b None admin] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:45:59.380012 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e40257-21f9-4331-a020-f703b9a57e2b None admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:45:59.380287 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e40257-21f9-4331-a020-f703b9a57e2b None admin] PATH_INFO: `/v3/users/14066e5730e1422ab0e5eebb4efe292f` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:45:59.382820 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84e40257-21f9-4331-a020-f703b9a57e2b None admin] RBAC: Authorizing `identity:get_user(user_id=14066e5730e1422ab0e5eebb4efe292f)` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:45:59.384280 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84e40257-21f9-4331-a020-f703b9a57e2b None admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:45:59.386157 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 180/355] 10.222.0.59 () {56 vars in 1177 bytes} [Thu Jun 2 15:45:59 2022] GET /identity/v3/users/14066e5730e1422ab0e5eebb4efe292f => generated 293 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 15:45:59.387906 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84e40257-21f9-4331-a020-f703b9a57e2b None admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:45:59.416506 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writing DB stats keystone:SELECT=100 {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:45:59.419772 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7be219c0-c67b-4769-924f-540a1e32e116 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:45:59.420681 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be219c0-c67b-4769-924f-540a1e32e116 None admin] REQUEST_METHOD: `GET` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:45:59.420844 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be219c0-c67b-4769-924f-540a1e32e116 None admin] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:45:59.421241 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be219c0-c67b-4769-924f-540a1e32e116 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:45:59.422525 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7be219c0-c67b-4769-924f-540a1e32e116 None admin] RBAC: Adding query filter params (group.id=0d56bf165788496982f9b3bbb67c019e, role.id=649e0f2b5a264c419ea6a1441f123a03, scope.project.id=06e0633a47e74dcfaeccc8794206da96) {{(pid=80396) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 15:45:59.422525 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7be219c0-c67b-4769-924f-540a1e32e116 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:45:59.423809 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7be219c0-c67b-4769-924f-540a1e32e116 None admin] RBAC: Authorization granted {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:45:59.435723 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 176/356] 10.222.0.59 () {56 vars in 1376 bytes} [Thu Jun 2 15:45:59 2022] GET /identity/v3/role_assignments?group.id=0d56bf165788496982f9b3bbb67c019e&scope.project.id=06e0633a47e74dcfaeccc8794206da96&role.id=649e0f2b5a264c419ea6a1441f123a03 => generated 260 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 15:45:59.436403 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7be219c0-c67b-4769-924f-540a1e32e116 None admin] Authenticating user token {{(pid=80396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:45:59.545115 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84e40257-21f9-4331-a020-f703b9a57e2b None admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:45:59.585698 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7be219c0-c67b-4769-924f-540a1e32e116 None admin] Validating token access rules against request {{(pid=80396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:45:59.598904 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7905801a-3295-4c6e-80ba-629ce478274f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:45:59.600608 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7905801a-3295-4c6e-80ba-629ce478274f None admin] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:45:59.601539 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7905801a-3295-4c6e-80ba-629ce478274f None admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:45:59.602915 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7905801a-3295-4c6e-80ba-629ce478274f None admin] PATH_INFO: `/v3/projects/06e0633a47e74dcfaeccc8794206da96` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:45:59.604859 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7905801a-3295-4c6e-80ba-629ce478274f None admin] RBAC: Authorizing `identity:get_project(project_id=06e0633a47e74dcfaeccc8794206da96)` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:45:59.607107 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7905801a-3295-4c6e-80ba-629ce478274f None admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:45:59.610645 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 181/357] 10.222.0.59 () {56 vars in 1186 bytes} [Thu Jun 2 15:45:59 2022] GET /identity/v3/projects/06e0633a47e74dcfaeccc8794206da96 => generated 298 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 15:45:59.613329 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb14acf-a316-4a1a-9a7a-7dad6d4b3509 None None] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:45:59.614056 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb14acf-a316-4a1a-9a7a-7dad6d4b3509 None None] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:45:59.614673 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb14acf-a316-4a1a-9a7a-7dad6d4b3509 None None] PATH_INFO: `/` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:45:59.616339 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 182/358] 10.222.0.59 () {54 vars in 926 bytes} [Thu Jun 2 15:45:59 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 15:45:59.618234 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb14acf-a316-4a1a-9a7a-7dad6d4b3509 None None] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:45:59.637949 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeacc4c3-06d1-4af8-92a7-c93b80ecd024 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:45:59.638656 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeacc4c3-06d1-4af8-92a7-c93b80ecd024 None admin] REQUEST_METHOD: `GET` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:45:59.638945 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeacc4c3-06d1-4af8-92a7-c93b80ecd024 None admin] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:45:59.639406 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeacc4c3-06d1-4af8-92a7-c93b80ecd024 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:45:59.643364 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG dbcounter [-] [80396] Writing DB stats keystone:SELECT=100 {{(pid=80396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:45:59.738059 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeacc4c3-06d1-4af8-92a7-c93b80ecd024 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:45:59.738689 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writing DB stats keystone:SELECT=100 {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:45:59.740499 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeacc4c3-06d1-4af8-92a7-c93b80ecd024 None admin] RBAC: Authorization granted {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:45:59.760731 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb14acf-a316-4a1a-9a7a-7dad6d4b3509 None None] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:45:59.808056 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7be8bb52-d192-4e2e-9dcf-4a2542af9552 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:45:59.808834 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be8bb52-d192-4e2e-9dcf-4a2542af9552 None admin] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:45:59.809122 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be8bb52-d192-4e2e-9dcf-4a2542af9552 None admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:45:59.809397 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be8bb52-d192-4e2e-9dcf-4a2542af9552 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:45:59.810912 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7be8bb52-d192-4e2e-9dcf-4a2542af9552 None admin] RBAC: Adding query filter params (role.id=67885c18a3dc47718e9197097185f65d, user.id=14066e5730e1422ab0e5eebb4efe292f, scope.system=all) {{(pid=80395) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 15:45:59.811432 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7be8bb52-d192-4e2e-9dcf-4a2542af9552 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:45:59.813626 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7be8bb52-d192-4e2e-9dcf-4a2542af9552 None admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:45:59.830414 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 183/359] 10.222.0.59 () {56 vars in 1308 bytes} [Thu Jun 2 15:45:59 2022] GET /identity/v3/role_assignments?user.id=14066e5730e1422ab0e5eebb4efe292f&scope.system=all&role.id=67885c18a3dc47718e9197097185f65d => generated 510 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 15:45:59.832188 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7be8bb52-d192-4e2e-9dcf-4a2542af9552 None admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:45:59.865737 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 177/360] 10.222.0.59 () {58 vars in 1282 bytes} [Thu Jun 2 15:45:59 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 430 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 02 15:45:59.867283 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2087100c-fd01-4827-b87f-6ba422cc0c2c None None] REQUEST_METHOD: `POST` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:45:59.867580 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2087100c-fd01-4827-b87f-6ba422cc0c2c None None] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:45:59.867897 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2087100c-fd01-4827-b87f-6ba422cc0c2c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:45:59.886932 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.auth.core [None req-2087100c-fd01-4827-b87f-6ba422cc0c2c None None] MFA Rules not processed for user `400d1f4db9de49638549e5db29a041e1`. Rule list: `[]` (Enabled: `True`). {{(pid=80396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 15:45:59.888176 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.fernet_utils [None req-2087100c-fd01-4827-b87f-6ba422cc0c2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 15:45:59.928391 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG dbcounter [-] [80396] Writing DB stats keystone:SELECT=100 {{(pid=80396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:45:59.981424 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7be8bb52-d192-4e2e-9dcf-4a2542af9552 None admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:45:59.986128 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 178/361] 10.222.0.59 () {58 vars in 1023 bytes} [Thu Jun 2 15:45:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 02 15:45:59.995825 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b621a6aa-fb0f-4e32-929b-0cc1588af75f None None] REQUEST_METHOD: `GET` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:45:59.996191 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b621a6aa-fb0f-4e32-929b-0cc1588af75f None None] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:45:59.996393 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b621a6aa-fb0f-4e32-929b-0cc1588af75f None None] PATH_INFO: `/` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:45:59.998287 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 179/362] 10.222.0.59 () {54 vars in 926 bytes} [Thu Jun 2 15:45:59 2022] GET /identity => generated 270 bytes in 12 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 15:45:59.999244 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b621a6aa-fb0f-4e32-929b-0cc1588af75f None None] Authenticating user token {{(pid=80396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:46:00.026921 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3755460c-3a05-40ca-bfdb-35ece47c3004 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:46:00.028366 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3755460c-3a05-40ca-bfdb-35ece47c3004 None admin] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:46:00.028862 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3755460c-3a05-40ca-bfdb-35ece47c3004 None admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:46:00.029350 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3755460c-3a05-40ca-bfdb-35ece47c3004 None admin] PATH_INFO: `/v3/groups/0d56bf165788496982f9b3bbb67c019e` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:46:00.031071 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3755460c-3a05-40ca-bfdb-35ece47c3004 None admin] RBAC: Authorizing `identity:get_group(group_id=0d56bf165788496982f9b3bbb67c019e)` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:46:00.033549 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3755460c-3a05-40ca-bfdb-35ece47c3004 None admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:46:00.036414 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 184/363] 10.222.0.59 () {56 vars in 1180 bytes} [Thu Jun 2 15:45:59 2022] GET /identity/v3/groups/0d56bf165788496982f9b3bbb67c019e => generated 226 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 15:46:00.037873 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62cef6c2-6d7d-4c4c-ac24-482568d8b484 None None] REQUEST_METHOD: `POST` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:46:00.042554 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62cef6c2-6d7d-4c4c-ac24-482568d8b484 None None] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:46:00.043130 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62cef6c2-6d7d-4c4c-ac24-482568d8b484 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:46:00.066612 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.auth.core [None req-62cef6c2-6d7d-4c4c-ac24-482568d8b484 None None] MFA Rules not processed for user `400d1f4db9de49638549e5db29a041e1`. Rule list: `[]` (Enabled: `True`). {{(pid=80395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 15:46:00.068124 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.fernet_utils [None req-62cef6c2-6d7d-4c4c-ac24-482568d8b484 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 15:46:00.079154 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writing DB stats keystone:SELECT=100 {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:46:00.152827 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b621a6aa-fb0f-4e32-929b-0cc1588af75f None None] Validating token access rules against request {{(pid=80396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:46:00.159611 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 185/364] 10.222.0.59 () {58 vars in 1023 bytes} [Thu Jun 2 15:46:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 02 15:46:00.160897 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62cef6c2-6d7d-4c4c-ac24-482568d8b484 None None] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:46:00.201654 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec3c26db-ac24-4f2f-b511-cd586b634a00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:46:00.203242 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3c26db-ac24-4f2f-b511-cd586b634a00 None admin] REQUEST_METHOD: `GET` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:46:00.203636 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3c26db-ac24-4f2f-b511-cd586b634a00 None admin] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:46:00.204764 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3c26db-ac24-4f2f-b511-cd586b634a00 None admin] PATH_INFO: `/v3/projects/576f2a66e24a468b921fa6cb1e5ff6db` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:46:00.206871 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec3c26db-ac24-4f2f-b511-cd586b634a00 None admin] RBAC: Authorizing `identity:get_project(project_id=576f2a66e24a468b921fa6cb1e5ff6db)` {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:46:00.208336 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec3c26db-ac24-4f2f-b511-cd586b634a00 None admin] RBAC: Authorization granted {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:46:00.210401 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 180/365] 10.222.0.59 () {56 vars in 1186 bytes} [Thu Jun 2 15:45:59 2022] GET /identity/v3/projects/576f2a66e24a468b921fa6cb1e5ff6db => generated 302 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 15:46:00.211112 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec3c26db-ac24-4f2f-b511-cd586b634a00 None admin] Authenticating user token {{(pid=80396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:46:00.260200 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG dbcounter [-] [80396] Writing DB stats keystone:SELECT=100 {{(pid=80396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:46:00.286003 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62cef6c2-6d7d-4c4c-ac24-482568d8b484 None None] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:46:00.329950 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1a1f9be-e3ad-4729-a648-7769640b472b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:46:00.330886 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a1f9be-e3ad-4729-a648-7769640b472b None admin] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:46:00.331198 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a1f9be-e3ad-4729-a648-7769640b472b None admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:46:00.331470 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a1f9be-e3ad-4729-a648-7769640b472b None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:46:00.343722 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1a1f9be-e3ad-4729-a648-7769640b472b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 02 15:46:00.351361 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec3c26db-ac24-4f2f-b511-cd586b634a00 None admin] Validating token access rules against request {{(pid=80396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:46:00.351788 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application [None req-d1a1f9be-e3ad-4729-a648-7769640b472b None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 02 15:46:00.351788 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 15:46:00.351788 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 15:46:00.351788 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 15:46:00.351788 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 15:46:00.351788 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 15:46:00.351788 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 15:46:00.351788 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 15:46:00.351788 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 15:46:00.351788 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 15:46:00.351788 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 15:46:00.351788 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 15:46:00.351788 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 02 15:46:00.351788 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 02 15:46:00.351788 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 02 15:46:00.351788 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 02 15:46:00.353276 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 02 15:46:00.353276 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 02 15:46:00.353276 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 02 15:46:00.353276 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 02 15:46:00.353276 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 15:46:00.353276 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 15:46:00.353276 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 15:46:00.353276 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 15:46:00.353276 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 15:46:00.353276 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 15:46:00.353276 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 15:46:00.353276 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application with Lock( Jun 02 15:46:00.353276 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 15:46:00.353276 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self._enter() Jun 02 15:46:00.353276 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 15:46:00.353276 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 15:46:00.354274 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 15:46:00.354274 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self.creator() Jun 02 15:46:00.354274 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 15:46:00.354274 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application created_value = creator( Jun 02 15:46:00.354274 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 02 15:46:00.354274 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 02 15:46:00.354274 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 02 15:46:00.354274 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 02 15:46:00.354274 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 02 15:46:00.354274 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 02 15:46:00.354274 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 02 15:46:00.354274 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application Jun 02 15:46:00.354274 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 186/366] 10.222.0.59 () {56 vars in 1114 bytes} [Thu Jun 2 15:46:00 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 15:46:00.354943 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1a1f9be-e3ad-4729-a648-7769640b472b None admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:46:00.358789 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writing DB stats keystone:SELECT=100 {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:46:00.399021 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f86ad44-5f30-4c52-a08a-36bb781c33c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:46:00.399652 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f86ad44-5f30-4c52-a08a-36bb781c33c2 None admin] REQUEST_METHOD: `GET` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:46:00.399982 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f86ad44-5f30-4c52-a08a-36bb781c33c2 None admin] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:46:00.400213 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f86ad44-5f30-4c52-a08a-36bb781c33c2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:46:00.401059 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f86ad44-5f30-4c52-a08a-36bb781c33c2 None admin] RBAC: Adding query filter params (group.id=0d56bf165788496982f9b3bbb67c019e, role.id=21f49b1aa1e64120b7ef6fcf4667a641, scope.project.id=06e0633a47e74dcfaeccc8794206da96) {{(pid=80396) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 15:46:00.401373 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f86ad44-5f30-4c52-a08a-36bb781c33c2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:46:00.402958 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f86ad44-5f30-4c52-a08a-36bb781c33c2 None admin] RBAC: Authorization granted {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:46:00.410699 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 181/367] 10.222.0.59 () {56 vars in 1376 bytes} [Thu Jun 2 15:46:00 2022] GET /identity/v3/role_assignments?group.id=0d56bf165788496982f9b3bbb67c019e&scope.project.id=06e0633a47e74dcfaeccc8794206da96&role.id=21f49b1aa1e64120b7ef6fcf4667a641 => generated 260 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 15:46:00.411544 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f86ad44-5f30-4c52-a08a-36bb781c33c2 None admin] Authenticating user token {{(pid=80396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:46:00.483732 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1a1f9be-e3ad-4729-a648-7769640b472b None admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:46:00.527183 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1417c2bf-2560-4cd1-8bda-39bf84feb5f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:46:00.528349 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1417c2bf-2560-4cd1-8bda-39bf84feb5f3 None admin] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:46:00.528897 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1417c2bf-2560-4cd1-8bda-39bf84feb5f3 None admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:46:00.529405 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1417c2bf-2560-4cd1-8bda-39bf84feb5f3 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:46:00.533236 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG dbcounter [-] [80396] Writing DB stats keystone:SELECT=100 {{(pid=80396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:46:00.540486 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f86ad44-5f30-4c52-a08a-36bb781c33c2 None admin] Validating token access rules against request {{(pid=80396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:46:00.544767 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1417c2bf-2560-4cd1-8bda-39bf84feb5f3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 02 15:46:00.553689 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application [None req-1417c2bf-2560-4cd1-8bda-39bf84feb5f3 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 02 15:46:00.553689 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 15:46:00.553689 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 15:46:00.553689 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 15:46:00.553689 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 15:46:00.553689 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 15:46:00.553689 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 15:46:00.553689 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 15:46:00.553689 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 15:46:00.553689 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 15:46:00.553689 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 15:46:00.553689 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 15:46:00.553689 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 02 15:46:00.553689 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 02 15:46:00.553689 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 02 15:46:00.553689 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 02 15:46:00.560712 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 02 15:46:00.560712 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 02 15:46:00.560712 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 02 15:46:00.560712 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 02 15:46:00.560712 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 15:46:00.560712 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 15:46:00.560712 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 15:46:00.560712 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 15:46:00.560712 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 15:46:00.560712 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 15:46:00.560712 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 15:46:00.560712 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application with Lock( Jun 02 15:46:00.560712 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 15:46:00.560712 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self._enter() Jun 02 15:46:00.560712 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 15:46:00.560712 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 15:46:00.561492 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 15:46:00.561492 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self.creator() Jun 02 15:46:00.561492 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 15:46:00.561492 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application created_value = creator( Jun 02 15:46:00.561492 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 02 15:46:00.561492 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 02 15:46:00.561492 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 02 15:46:00.561492 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 02 15:46:00.561492 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 02 15:46:00.561492 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 02 15:46:00.561492 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 02 15:46:00.561492 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application Jun 02 15:46:00.561492 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 187/368] 10.222.0.59 () {56 vars in 1096 bytes} [Thu Jun 2 15:46:00 2022] GET /identity/v3/roles/admin => generated 83 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 15:46:00.561492 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1417c2bf-2560-4cd1-8bda-39bf84feb5f3 None admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:46:00.579056 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-203c5f49-70ce-47e8-8bf2-e3f13852692a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:46:00.579938 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-203c5f49-70ce-47e8-8bf2-e3f13852692a None admin] REQUEST_METHOD: `GET` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:46:00.580223 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-203c5f49-70ce-47e8-8bf2-e3f13852692a None admin] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:46:00.580508 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-203c5f49-70ce-47e8-8bf2-e3f13852692a None admin] PATH_INFO: `/v3/groups/0d56bf165788496982f9b3bbb67c019e` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:46:00.581939 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-203c5f49-70ce-47e8-8bf2-e3f13852692a None admin] RBAC: Authorizing `identity:get_group(group_id=0d56bf165788496982f9b3bbb67c019e)` {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:46:00.583491 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-203c5f49-70ce-47e8-8bf2-e3f13852692a None admin] RBAC: Authorization granted {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:46:00.585246 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 182/369] 10.222.0.59 () {56 vars in 1180 bytes} [Thu Jun 2 15:46:00 2022] GET /identity/v3/groups/0d56bf165788496982f9b3bbb67c019e => generated 226 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 15:46:00.586435 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-203c5f49-70ce-47e8-8bf2-e3f13852692a None admin] Authenticating user token {{(pid=80396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:46:00.632608 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writing DB stats keystone:SELECT=100 {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:46:00.674556 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1417c2bf-2560-4cd1-8bda-39bf84feb5f3 None admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:46:00.718504 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-203c5f49-70ce-47e8-8bf2-e3f13852692a None admin] Validating token access rules against request {{(pid=80396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:46:00.720674 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a685721-653a-47d1-9327-670d94f5d590 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:46:00.721347 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a685721-653a-47d1-9327-670d94f5d590 None admin] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:46:00.721629 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a685721-653a-47d1-9327-670d94f5d590 None admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:46:00.721905 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a685721-653a-47d1-9327-670d94f5d590 None admin] PATH_INFO: `/v3/roles` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:46:00.723400 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a685721-653a-47d1-9327-670d94f5d590 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80395) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 15:46:00.723400 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a685721-653a-47d1-9327-670d94f5d590 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:46:00.725807 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a685721-653a-47d1-9327-670d94f5d590 None admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:46:00.734816 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 188/370] 10.222.0.59 () {56 vars in 1111 bytes} [Thu Jun 2 15:46:00 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 15:46:00.735661 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a685721-653a-47d1-9327-670d94f5d590 None admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:46:00.764970 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65fc9e98-ae99-4dde-b3ea-6a1e32e7006c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:46:00.765874 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65fc9e98-ae99-4dde-b3ea-6a1e32e7006c None admin] REQUEST_METHOD: `GET` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:46:00.766201 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65fc9e98-ae99-4dde-b3ea-6a1e32e7006c None admin] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:46:00.766482 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65fc9e98-ae99-4dde-b3ea-6a1e32e7006c None admin] PATH_INFO: `/v3/roles` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:46:00.767651 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65fc9e98-ae99-4dde-b3ea-6a1e32e7006c None admin] RBAC: Adding query filter params (name=admin) {{(pid=80396) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 15:46:00.768222 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65fc9e98-ae99-4dde-b3ea-6a1e32e7006c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:46:00.770251 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65fc9e98-ae99-4dde-b3ea-6a1e32e7006c None admin] RBAC: Authorization granted {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:46:00.782833 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 183/371] 10.222.0.59 () {56 vars in 1099 bytes} [Thu Jun 2 15:46:00 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 15:46:00.784375 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65fc9e98-ae99-4dde-b3ea-6a1e32e7006c None admin] Authenticating user token {{(pid=80396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:46:00.815286 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG dbcounter [-] [80396] Writing DB stats keystone:SELECT=100 {{(pid=80396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:46:00.870013 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a685721-653a-47d1-9327-670d94f5d590 None admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:46:00.901135 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writing DB stats keystone:SELECT=100 {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:46:00.904566 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65fc9e98-ae99-4dde-b3ea-6a1e32e7006c None admin] Validating token access rules against request {{(pid=80396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:46:00.913541 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55782786-ce7c-4e9d-a563-a56edb204391 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:46:00.914963 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55782786-ce7c-4e9d-a563-a56edb204391 None admin] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:46:00.914963 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55782786-ce7c-4e9d-a563-a56edb204391 None admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:46:00.915622 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55782786-ce7c-4e9d-a563-a56edb204391 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:46:00.916652 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55782786-ce7c-4e9d-a563-a56edb204391 None admin] RBAC: Adding query filter params (group.id=0d56bf165788496982f9b3bbb67c019e, role.id=649e0f2b5a264c419ea6a1441f123a03, scope.project.id=576f2a66e24a468b921fa6cb1e5ff6db) {{(pid=80395) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 15:46:00.917186 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55782786-ce7c-4e9d-a563-a56edb204391 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:46:00.918939 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55782786-ce7c-4e9d-a563-a56edb204391 None admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:46:00.929843 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 189/372] 10.222.0.59 () {56 vars in 1376 bytes} [Thu Jun 2 15:46:00 2022] GET /identity/v3/role_assignments?group.id=0d56bf165788496982f9b3bbb67c019e&scope.project.id=576f2a66e24a468b921fa6cb1e5ff6db&role.id=649e0f2b5a264c419ea6a1441f123a03 => generated 260 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 15:46:00.929843 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55782786-ce7c-4e9d-a563-a56edb204391 None admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:46:00.957177 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30c1a177-9cf9-4c47-afec-7d07a69fd50f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:46:00.958118 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c1a177-9cf9-4c47-afec-7d07a69fd50f None admin] REQUEST_METHOD: `GET` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:46:00.958542 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c1a177-9cf9-4c47-afec-7d07a69fd50f None admin] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:46:00.960748 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c1a177-9cf9-4c47-afec-7d07a69fd50f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:46:01.069708 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30c1a177-9cf9-4c47-afec-7d07a69fd50f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:46:01.072406 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30c1a177-9cf9-4c47-afec-7d07a69fd50f None admin] RBAC: Authorization granted {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:46:01.106828 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG dbcounter [-] [80396] Writing DB stats keystone:SELECT=100 {{(pid=80396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:46:01.155950 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55782786-ce7c-4e9d-a563-a56edb204391 None admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:46:01.228385 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 184/373] 10.222.0.59 () {58 vars in 1282 bytes} [Thu Jun 2 15:46:00 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 444 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 02 15:46:01.231292 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06c998fd-632b-4d93-84c2-99e3b071a14e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:46:01.231963 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c998fd-632b-4d93-84c2-99e3b071a14e None admin] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:46:01.232249 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c998fd-632b-4d93-84c2-99e3b071a14e None admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:46:01.232528 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c998fd-632b-4d93-84c2-99e3b071a14e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:46:01.234101 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30c1a177-9cf9-4c47-afec-7d07a69fd50f None admin] Authenticating user token {{(pid=80396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:46:01.308895 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writing DB stats keystone:SELECT=100 {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:46:01.331895 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06c998fd-632b-4d93-84c2-99e3b071a14e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:46:01.333359 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06c998fd-632b-4d93-84c2-99e3b071a14e None admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:46:01.373625 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30c1a177-9cf9-4c47-afec-7d07a69fd50f None admin] Validating token access rules against request {{(pid=80396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:46:01.417204 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG dbcounter [-] [80396] Writing DB stats keystone:SELECT=100 {{(pid=80396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:46:01.431218 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fb0b0a1-ada7-4868-a904-fbdc28a99a37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:46:01.432088 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb0b0a1-ada7-4868-a904-fbdc28a99a37 None admin] REQUEST_METHOD: `GET` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:46:01.432362 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb0b0a1-ada7-4868-a904-fbdc28a99a37 None admin] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:46:01.434464 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb0b0a1-ada7-4868-a904-fbdc28a99a37 None admin] PATH_INFO: `/v3/projects/576f2a66e24a468b921fa6cb1e5ff6db` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:46:01.436853 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fb0b0a1-ada7-4868-a904-fbdc28a99a37 None admin] RBAC: Authorizing `identity:get_project(project_id=576f2a66e24a468b921fa6cb1e5ff6db)` {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:46:01.438386 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fb0b0a1-ada7-4868-a904-fbdc28a99a37 None admin] RBAC: Authorization granted {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:46:01.440324 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 185/374] 10.222.0.59 () {56 vars in 1186 bytes} [Thu Jun 2 15:46:01 2022] GET /identity/v3/projects/576f2a66e24a468b921fa6cb1e5ff6db => generated 302 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 15:46:01.446063 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fb0b0a1-ada7-4868-a904-fbdc28a99a37 None admin] Authenticating user token {{(pid=80396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:46:01.545205 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 190/375] 10.222.0.59 () {58 vars in 1282 bytes} [Thu Jun 2 15:46:00 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 618 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 02 15:46:01.550413 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06c998fd-632b-4d93-84c2-99e3b071a14e None admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:46:01.638391 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fb0b0a1-ada7-4868-a904-fbdc28a99a37 None admin] Validating token access rules against request {{(pid=80396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:46:01.679981 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b2dd6da-a1da-4b9c-b774-bef408db5f74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:46:01.681747 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2dd6da-a1da-4b9c-b774-bef408db5f74 None admin] REQUEST_METHOD: `GET` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:46:01.682037 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2dd6da-a1da-4b9c-b774-bef408db5f74 None admin] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:46:01.682345 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2dd6da-a1da-4b9c-b774-bef408db5f74 None admin] PATH_INFO: `/v3/groups/0d56bf165788496982f9b3bbb67c019e` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:46:01.683575 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b2dd6da-a1da-4b9c-b774-bef408db5f74 None admin] RBAC: Authorizing `identity:get_group(group_id=0d56bf165788496982f9b3bbb67c019e)` {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:46:01.685039 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b2dd6da-a1da-4b9c-b774-bef408db5f74 None admin] RBAC: Authorization granted {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:46:01.690195 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 186/376] 10.222.0.59 () {56 vars in 1180 bytes} [Thu Jun 2 15:46:01 2022] GET /identity/v3/groups/0d56bf165788496982f9b3bbb67c019e => generated 226 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 15:46:01.692846 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b2dd6da-a1da-4b9c-b774-bef408db5f74 None admin] Authenticating user token {{(pid=80396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:46:01.704711 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writing DB stats keystone:SELECT=100 {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:46:01.719824 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06c998fd-632b-4d93-84c2-99e3b071a14e None admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:46:01.764154 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG dbcounter [-] [80396] Writing DB stats keystone:SELECT=100 {{(pid=80396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:46:01.770546 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d15c1ac4-46a9-4c5c-92b6-831315f40980 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:46:01.772258 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d15c1ac4-46a9-4c5c-92b6-831315f40980 None admin] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:46:01.772878 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d15c1ac4-46a9-4c5c-92b6-831315f40980 None admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:46:01.773338 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d15c1ac4-46a9-4c5c-92b6-831315f40980 None admin] PATH_INFO: `/v3/projects/4f73d5a98be74242b45222df39fb6213` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:46:01.775075 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d15c1ac4-46a9-4c5c-92b6-831315f40980 None admin] RBAC: Authorizing `identity:get_project(project_id=4f73d5a98be74242b45222df39fb6213)` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:46:01.777470 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d15c1ac4-46a9-4c5c-92b6-831315f40980 None admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:46:01.779943 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 191/377] 10.222.0.59 () {56 vars in 1186 bytes} [Thu Jun 2 15:46:01 2022] GET /identity/v3/projects/4f73d5a98be74242b45222df39fb6213 => generated 344 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 15:46:01.785910 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d15c1ac4-46a9-4c5c-92b6-831315f40980 None admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:46:01.826372 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b2dd6da-a1da-4b9c-b774-bef408db5f74 None admin] Validating token access rules against request {{(pid=80396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:46:01.882932 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca8a53d3-a843-4f71-b5bb-02fa557c8a27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:46:01.884427 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca8a53d3-a843-4f71-b5bb-02fa557c8a27 None admin] REQUEST_METHOD: `GET` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:46:01.884887 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca8a53d3-a843-4f71-b5bb-02fa557c8a27 None admin] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:46:01.885175 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca8a53d3-a843-4f71-b5bb-02fa557c8a27 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:46:01.886824 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca8a53d3-a843-4f71-b5bb-02fa557c8a27 None admin] RBAC: Adding query filter params (group.id=0d56bf165788496982f9b3bbb67c019e, role.id=21f49b1aa1e64120b7ef6fcf4667a641, scope.project.id=576f2a66e24a468b921fa6cb1e5ff6db) {{(pid=80396) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 15:46:01.887145 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca8a53d3-a843-4f71-b5bb-02fa557c8a27 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:46:01.890276 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca8a53d3-a843-4f71-b5bb-02fa557c8a27 None admin] RBAC: Authorization granted {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:46:01.907402 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 187/378] 10.222.0.59 () {56 vars in 1376 bytes} [Thu Jun 2 15:46:01 2022] GET /identity/v3/role_assignments?group.id=0d56bf165788496982f9b3bbb67c019e&scope.project.id=576f2a66e24a468b921fa6cb1e5ff6db&role.id=21f49b1aa1e64120b7ef6fcf4667a641 => generated 260 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 15:46:01.927030 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d15c1ac4-46a9-4c5c-92b6-831315f40980 None admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:46:01.987816 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a44548c-bc9b-4e6a-9972-acb3f4b3ae75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:46:01.988686 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a44548c-bc9b-4e6a-9972-acb3f4b3ae75 None admin] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:46:01.988972 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a44548c-bc9b-4e6a-9972-acb3f4b3ae75 None admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:46:01.989241 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a44548c-bc9b-4e6a-9972-acb3f4b3ae75 None admin] PATH_INFO: `/v3/groups/c4ad9096c9d745c18573493d0f5b33ed` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:46:01.998952 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a44548c-bc9b-4e6a-9972-acb3f4b3ae75 None admin] RBAC: Authorizing `identity:get_group(group_id=c4ad9096c9d745c18573493d0f5b33ed)` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:46:02.000438 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a44548c-bc9b-4e6a-9972-acb3f4b3ae75 None admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:46:02.002536 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 192/379] 10.222.0.59 () {56 vars in 1180 bytes} [Thu Jun 2 15:46:01 2022] GET /identity/v3/groups/c4ad9096c9d745c18573493d0f5b33ed => generated 229 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 15:46:02.008944 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca8a53d3-a843-4f71-b5bb-02fa557c8a27 None admin] Authenticating user token {{(pid=80396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:46:02.194218 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca8a53d3-a843-4f71-b5bb-02fa557c8a27 None admin] Validating token access rules against request {{(pid=80396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:46:02.226541 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG dbcounter [-] [80396] Writing DB stats keystone:SELECT=100 {{(pid=80396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:46:02.235985 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ddcf601-6cdc-4ec5-bfd7-e70675a6a988 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:46:02.250485 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ddcf601-6cdc-4ec5-bfd7-e70675a6a988 None admin] REQUEST_METHOD: `GET` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:46:02.250485 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ddcf601-6cdc-4ec5-bfd7-e70675a6a988 None admin] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:46:02.250485 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ddcf601-6cdc-4ec5-bfd7-e70675a6a988 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:46:02.250485 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ddcf601-6cdc-4ec5-bfd7-e70675a6a988 None admin] RBAC: Adding query filter params (group.id=c4ad9096c9d745c18573493d0f5b33ed, role.id=f1e0c25f6e9049e897cb7350c7e54ab3, scope.project.id=4f73d5a98be74242b45222df39fb6213) {{(pid=80396) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 15:46:02.250485 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ddcf601-6cdc-4ec5-bfd7-e70675a6a988 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:46:02.250485 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ddcf601-6cdc-4ec5-bfd7-e70675a6a988 None admin] RBAC: Authorization granted {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:46:02.250885 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 188/380] 10.222.0.59 () {56 vars in 1376 bytes} [Thu Jun 2 15:46:02 2022] GET /identity/v3/role_assignments?group.id=c4ad9096c9d745c18573493d0f5b33ed&scope.project.id=4f73d5a98be74242b45222df39fb6213&role.id=f1e0c25f6e9049e897cb7350c7e54ab3 => generated 260 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 15:46:02.272479 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e605c6-03d4-404d-affd-bc53fc6a7d9e None None] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:46:02.272772 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e605c6-03d4-404d-affd-bc53fc6a7d9e None None] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:46:02.273049 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e605c6-03d4-404d-affd-bc53fc6a7d9e None None] PATH_INFO: `/` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:46:02.275293 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 193/381] 10.222.0.59 () {54 vars in 926 bytes} [Thu Jun 2 15:46:02 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 15:46:02.281790 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4034eb6a-30f0-4a5d-8499-2c75bab3785c None None] REQUEST_METHOD: `POST` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:46:02.282460 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4034eb6a-30f0-4a5d-8499-2c75bab3785c None None] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:46:02.282955 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4034eb6a-30f0-4a5d-8499-2c75bab3785c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:46:02.303153 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.auth.core [None req-4034eb6a-30f0-4a5d-8499-2c75bab3785c None None] MFA Rules not processed for user `400d1f4db9de49638549e5db29a041e1`. Rule list: `[]` (Enabled: `True`). {{(pid=80396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 15:46:02.304747 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.fernet_utils [None req-4034eb6a-30f0-4a5d-8499-2c75bab3785c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 15:46:02.392646 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 189/382] 10.222.0.59 () {58 vars in 1023 bytes} [Thu Jun 2 15:46:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 02 15:46:02.428283 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52e605c6-03d4-404d-affd-bc53fc6a7d9e None None] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:46:02.469165 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writing DB stats keystone:SELECT=100 {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:46:02.583801 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52e605c6-03d4-404d-affd-bc53fc6a7d9e None None] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:46:02.631468 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8059dfc3-b3ff-4e2b-9a6f-bfe9d90b0d39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:46:02.632635 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8059dfc3-b3ff-4e2b-9a6f-bfe9d90b0d39 None admin] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:46:02.633162 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8059dfc3-b3ff-4e2b-9a6f-bfe9d90b0d39 None admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:46:02.633661 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8059dfc3-b3ff-4e2b-9a6f-bfe9d90b0d39 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:46:02.657792 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8059dfc3-b3ff-4e2b-9a6f-bfe9d90b0d39 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 02 15:46:02.666734 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application [None req-8059dfc3-b3ff-4e2b-9a6f-bfe9d90b0d39 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 02 15:46:02.666734 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 15:46:02.666734 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 15:46:02.666734 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 15:46:02.666734 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 15:46:02.666734 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 15:46:02.666734 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 15:46:02.666734 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 15:46:02.666734 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 15:46:02.666734 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 15:46:02.666734 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 15:46:02.666734 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 15:46:02.666734 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 02 15:46:02.666734 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 02 15:46:02.666734 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 02 15:46:02.666734 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 02 15:46:02.667625 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 02 15:46:02.667625 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 02 15:46:02.667625 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 02 15:46:02.667625 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 02 15:46:02.667625 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 15:46:02.667625 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 15:46:02.667625 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 15:46:02.667625 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 15:46:02.667625 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 15:46:02.667625 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 15:46:02.667625 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 15:46:02.667625 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application with Lock( Jun 02 15:46:02.667625 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 15:46:02.667625 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self._enter() Jun 02 15:46:02.667625 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 15:46:02.667625 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 15:46:02.668408 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 15:46:02.668408 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self.creator() Jun 02 15:46:02.668408 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 15:46:02.668408 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application created_value = creator( Jun 02 15:46:02.668408 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 02 15:46:02.668408 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 02 15:46:02.668408 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 02 15:46:02.668408 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 02 15:46:02.668408 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 02 15:46:02.668408 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 02 15:46:02.668408 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 02 15:46:02.668408 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application Jun 02 15:46:02.668408 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 194/383] 10.222.0.59 () {56 vars in 1099 bytes} [Thu Jun 2 15:46:02 2022] GET /identity/v3/roles/member => generated 84 bytes in 241 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 15:46:02.675277 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4034eb6a-30f0-4a5d-8499-2c75bab3785c None None] Authenticating user token {{(pid=80396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:46:02.828847 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4034eb6a-30f0-4a5d-8499-2c75bab3785c None None] Validating token access rules against request {{(pid=80396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:46:02.851569 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG dbcounter [-] [80396] Writing DB stats keystone:SELECT=100 {{(pid=80396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:46:02.869612 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ba386d0-62f7-4bc9-bad1-1f5b7b3c2530 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:46:02.870312 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba386d0-62f7-4bc9-bad1-1f5b7b3c2530 None admin] REQUEST_METHOD: `GET` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:46:02.870599 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba386d0-62f7-4bc9-bad1-1f5b7b3c2530 None admin] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:46:02.870878 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba386d0-62f7-4bc9-bad1-1f5b7b3c2530 None admin] PATH_INFO: `/v3/roles` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:46:02.871628 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ba386d0-62f7-4bc9-bad1-1f5b7b3c2530 None admin] RBAC: Adding query filter params (name=member) {{(pid=80396) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 15:46:02.871935 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ba386d0-62f7-4bc9-bad1-1f5b7b3c2530 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:46:02.873293 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ba386d0-62f7-4bc9-bad1-1f5b7b3c2530 None admin] RBAC: Authorization granted {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:46:02.885975 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 190/384] 10.222.0.59 () {56 vars in 1101 bytes} [Thu Jun 2 15:46:02 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 15:46:02.892267 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8059dfc3-b3ff-4e2b-9a6f-bfe9d90b0d39 None admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:46:02.999289 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writing DB stats keystone:SELECT=100 {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:46:03.021766 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8059dfc3-b3ff-4e2b-9a6f-bfe9d90b0d39 None admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:46:03.063041 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9faf1964-9a3f-4ff7-8175-4f8ca3c53dee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:46:03.063910 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9faf1964-9a3f-4ff7-8175-4f8ca3c53dee None admin] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:46:03.064196 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9faf1964-9a3f-4ff7-8175-4f8ca3c53dee None admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:46:03.064474 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9faf1964-9a3f-4ff7-8175-4f8ca3c53dee None admin] PATH_INFO: `/v3/groups/0d56bf165788496982f9b3bbb67c019e` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:46:03.065654 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9faf1964-9a3f-4ff7-8175-4f8ca3c53dee None admin] RBAC: Authorizing `identity:get_group(group_id=0d56bf165788496982f9b3bbb67c019e)` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:46:03.067292 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9faf1964-9a3f-4ff7-8175-4f8ca3c53dee None admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:46:03.069271 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 195/385] 10.222.0.59 () {56 vars in 1180 bytes} [Thu Jun 2 15:46:02 2022] GET /identity/v3/groups/0d56bf165788496982f9b3bbb67c019e => generated 226 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 15:46:03.075145 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ba386d0-62f7-4bc9-bad1-1f5b7b3c2530 None admin] Authenticating user token {{(pid=80396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:46:03.232617 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ba386d0-62f7-4bc9-bad1-1f5b7b3c2530 None admin] Validating token access rules against request {{(pid=80396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:46:03.280393 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90c97594-f651-4cf0-bb1f-55c39866900b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:46:03.281258 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c97594-f651-4cf0-bb1f-55c39866900b None admin] REQUEST_METHOD: `GET` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:46:03.281539 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c97594-f651-4cf0-bb1f-55c39866900b None admin] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:46:03.281812 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c97594-f651-4cf0-bb1f-55c39866900b None admin] PATH_INFO: `/v3/projects/06e0633a47e74dcfaeccc8794206da96` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:46:03.283052 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90c97594-f651-4cf0-bb1f-55c39866900b None admin] RBAC: Authorizing `identity:get_project(project_id=06e0633a47e74dcfaeccc8794206da96)` {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:46:03.284490 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90c97594-f651-4cf0-bb1f-55c39866900b None admin] RBAC: Authorization granted {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:46:03.286507 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 191/386] 10.222.0.59 () {56 vars in 1186 bytes} [Thu Jun 2 15:46:03 2022] GET /identity/v3/projects/06e0633a47e74dcfaeccc8794206da96 => generated 298 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 15:46:03.292649 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9faf1964-9a3f-4ff7-8175-4f8ca3c53dee None admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:46:03.413085 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e58262-e5e7-4c3e-a3c6-6bb6bb95d88d None None] REQUEST_METHOD: `GET` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:46:03.413369 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e58262-e5e7-4c3e-a3c6-6bb6bb95d88d None None] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:46:03.413645 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e58262-e5e7-4c3e-a3c6-6bb6bb95d88d None None] PATH_INFO: `/` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:46:03.415697 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 192/387] 10.222.0.59 () {54 vars in 926 bytes} [Thu Jun 2 15:46:03 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 02 15:46:03.421220 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91234ec8-9164-4a28-b726-fd110e4a2d2e None None] REQUEST_METHOD: `POST` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:46:03.421432 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91234ec8-9164-4a28-b726-fd110e4a2d2e None None] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:46:03.421844 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91234ec8-9164-4a28-b726-fd110e4a2d2e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:46:03.424540 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9faf1964-9a3f-4ff7-8175-4f8ca3c53dee None admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:46:03.459702 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.auth.core [None req-91234ec8-9164-4a28-b726-fd110e4a2d2e None None] MFA Rules not processed for user `400d1f4db9de49638549e5db29a041e1`. Rule list: `[]` (Enabled: `True`). {{(pid=80396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 15:46:03.460420 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.fernet_utils [None req-91234ec8-9164-4a28-b726-fd110e4a2d2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 15:46:03.465319 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80218581-22d9-4258-9bc6-5fe0a224da5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:46:03.466453 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80218581-22d9-4258-9bc6-5fe0a224da5c None admin] REQUEST_METHOD: `PUT` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:46:03.466900 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80218581-22d9-4258-9bc6-5fe0a224da5c None admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:46:03.467329 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80218581-22d9-4258-9bc6-5fe0a224da5c None admin] PATH_INFO: `/v3/projects/06e0633a47e74dcfaeccc8794206da96/groups/0d56bf165788496982f9b3bbb67c019e/roles/649e0f2b5a264c419ea6a1441f123a03` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:46:03.469473 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80218581-22d9-4258-9bc6-5fe0a224da5c None admin] RBAC: Authorizing `identity:create_grant(project_id=06e0633a47e74dcfaeccc8794206da96, group_id=0d56bf165788496982f9b3bbb67c019e, role_id=649e0f2b5a264c419ea6a1441f123a03)` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:46:03.471123 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80218581-22d9-4258-9bc6-5fe0a224da5c None admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:46:03.524354 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG dbcounter [-] [80396] Writing DB stats keystone:SELECT=100 {{(pid=80396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:46:03.552245 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 193/388] 10.222.0.59 () {58 vars in 1023 bytes} [Thu Jun 2 15:46:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 02 15:46:03.581806 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91234ec8-9164-4a28-b726-fd110e4a2d2e None None] Authenticating user token {{(pid=80396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:46:03.604407 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 196/389] 10.222.0.59 () {58 vars in 1442 bytes} [Thu Jun 2 15:46:03 2022] PUT /identity/v3/projects/06e0633a47e74dcfaeccc8794206da96/groups/0d56bf165788496982f9b3bbb67c019e/roles/649e0f2b5a264c419ea6a1441f123a03 => generated 0 bytes in 312 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 15:46:03.699056 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91234ec8-9164-4a28-b726-fd110e4a2d2e None None] Validating token access rules against request {{(pid=80396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:46:03.736807 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7219304-45ca-46f2-bebc-1a1cbddd642c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:46:03.737697 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7219304-45ca-46f2-bebc-1a1cbddd642c None admin] REQUEST_METHOD: `GET` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:46:03.737982 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7219304-45ca-46f2-bebc-1a1cbddd642c None admin] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:46:03.738358 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7219304-45ca-46f2-bebc-1a1cbddd642c None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:46:03.751415 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7219304-45ca-46f2-bebc-1a1cbddd642c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 02 15:46:03.759868 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application [None req-a7219304-45ca-46f2-bebc-1a1cbddd642c None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 02 15:46:03.759868 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 15:46:03.759868 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 15:46:03.759868 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 15:46:03.759868 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 15:46:03.759868 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 15:46:03.759868 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 15:46:03.759868 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 15:46:03.759868 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 15:46:03.759868 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 15:46:03.759868 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 15:46:03.759868 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 15:46:03.759868 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 02 15:46:03.759868 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 02 15:46:03.759868 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 02 15:46:03.759868 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 02 15:46:03.760773 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 02 15:46:03.760773 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 02 15:46:03.760773 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 02 15:46:03.760773 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 02 15:46:03.760773 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 15:46:03.760773 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 15:46:03.760773 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 15:46:03.760773 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 15:46:03.760773 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 15:46:03.760773 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 15:46:03.760773 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 15:46:03.760773 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application with Lock( Jun 02 15:46:03.760773 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 15:46:03.760773 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application return self._enter() Jun 02 15:46:03.760773 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 15:46:03.760773 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 15:46:03.761551 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 15:46:03.761551 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application return self.creator() Jun 02 15:46:03.761551 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 15:46:03.761551 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application created_value = creator( Jun 02 15:46:03.761551 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 02 15:46:03.761551 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 02 15:46:03.761551 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 02 15:46:03.761551 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 02 15:46:03.761551 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 02 15:46:03.761551 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 02 15:46:03.761551 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 02 15:46:03.761551 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application Jun 02 15:46:03.761551 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 194/390] 10.222.0.59 () {56 vars in 1114 bytes} [Thu Jun 2 15:46:03 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 02 15:46:03.767261 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80218581-22d9-4258-9bc6-5fe0a224da5c None admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:46:03.792622 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:46:03.925052 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80218581-22d9-4258-9bc6-5fe0a224da5c None admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:46:03.973144 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-636d9a5d-0d38-47b2-a78b-8a61f411e037 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:46:03.973754 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-636d9a5d-0d38-47b2-a78b-8a61f411e037 None admin] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:46:03.974045 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-636d9a5d-0d38-47b2-a78b-8a61f411e037 None admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:46:03.974352 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-636d9a5d-0d38-47b2-a78b-8a61f411e037 None admin] PATH_INFO: `/v3/roles` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:46:03.975118 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-636d9a5d-0d38-47b2-a78b-8a61f411e037 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80395) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 15:46:03.975428 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-636d9a5d-0d38-47b2-a78b-8a61f411e037 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:46:03.977426 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-636d9a5d-0d38-47b2-a78b-8a61f411e037 None admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:46:03.995029 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 197/391] 10.222.0.59 () {56 vars in 1111 bytes} [Thu Jun 2 15:46:03 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 15:46:04.000740 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7219304-45ca-46f2-bebc-1a1cbddd642c None admin] Authenticating user token {{(pid=80396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:46:04.005682 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4822cd4-caf1-4470-83a6-661b3c926372 None None] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:46:04.006259 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4822cd4-caf1-4470-83a6-661b3c926372 None None] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:46:04.006769 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4822cd4-caf1-4470-83a6-661b3c926372 None None] PATH_INFO: `/` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:46:04.010200 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 198/392] 10.222.0.59 () {54 vars in 926 bytes} [Thu Jun 2 15:46:04 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 15:46:04.019899 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d786ce-bffb-4f51-8653-519c7ff55675 None None] REQUEST_METHOD: `POST` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:46:04.020188 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d786ce-bffb-4f51-8653-519c7ff55675 None None] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:46:04.020474 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d786ce-bffb-4f51-8653-519c7ff55675 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:46:04.046607 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.auth.core [None req-65d786ce-bffb-4f51-8653-519c7ff55675 None None] MFA Rules not processed for user `400d1f4db9de49638549e5db29a041e1`. Rule list: `[]` (Enabled: `True`). {{(pid=80395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 15:46:04.047811 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.fernet_utils [None req-65d786ce-bffb-4f51-8653-519c7ff55675 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 15:46:04.061198 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG dbcounter [-] [80396] Writing DB stats keystone:SELECT=100 {{(pid=80396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:46:04.139499 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7219304-45ca-46f2-bebc-1a1cbddd642c None admin] Validating token access rules against request {{(pid=80396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:46:04.140385 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writing DB stats keystone:SELECT=100 {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:46:04.146021 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 199/393] 10.222.0.59 () {58 vars in 1023 bytes} [Thu Jun 2 15:46:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 02 15:46:04.177571 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65d786ce-bffb-4f51-8653-519c7ff55675 None None] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:46:04.195160 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9516ba7c-cc69-4b65-8cc7-7800b22d693c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:46:04.196840 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9516ba7c-cc69-4b65-8cc7-7800b22d693c None admin] REQUEST_METHOD: `GET` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:46:04.197745 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9516ba7c-cc69-4b65-8cc7-7800b22d693c None admin] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:46:04.198192 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9516ba7c-cc69-4b65-8cc7-7800b22d693c None admin] PATH_INFO: `/v3/groups/0d56bf165788496982f9b3bbb67c019e` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:46:04.199821 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9516ba7c-cc69-4b65-8cc7-7800b22d693c None admin] RBAC: Authorizing `identity:get_group(group_id=0d56bf165788496982f9b3bbb67c019e)` {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:46:04.201670 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9516ba7c-cc69-4b65-8cc7-7800b22d693c None admin] RBAC: Authorization granted {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:46:04.204513 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 195/394] 10.222.0.59 () {56 vars in 1180 bytes} [Thu Jun 2 15:46:03 2022] GET /identity/v3/groups/0d56bf165788496982f9b3bbb67c019e => generated 226 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 15:46:04.211530 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9516ba7c-cc69-4b65-8cc7-7800b22d693c None admin] Authenticating user token {{(pid=80396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:46:04.331481 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9516ba7c-cc69-4b65-8cc7-7800b22d693c None admin] Validating token access rules against request {{(pid=80396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:46:04.355453 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG dbcounter [-] [80396] Writing DB stats keystone:SELECT=100 {{(pid=80396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:46:04.375692 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9aa21ac-1008-4a78-84a1-a580304f3ac7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:46:04.379695 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9aa21ac-1008-4a78-84a1-a580304f3ac7 None admin] REQUEST_METHOD: `GET` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:46:04.379695 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9aa21ac-1008-4a78-84a1-a580304f3ac7 None admin] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:46:04.379695 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9aa21ac-1008-4a78-84a1-a580304f3ac7 None admin] PATH_INFO: `/v3/projects/06e0633a47e74dcfaeccc8794206da96` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:46:04.379695 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9aa21ac-1008-4a78-84a1-a580304f3ac7 None admin] RBAC: Authorizing `identity:get_project(project_id=06e0633a47e74dcfaeccc8794206da96)` {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:46:04.380793 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9aa21ac-1008-4a78-84a1-a580304f3ac7 None admin] RBAC: Authorization granted {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:46:04.385681 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 196/395] 10.222.0.59 () {56 vars in 1186 bytes} [Thu Jun 2 15:46:04 2022] GET /identity/v3/projects/06e0633a47e74dcfaeccc8794206da96 => generated 298 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 15:46:04.387655 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65d786ce-bffb-4f51-8653-519c7ff55675 None None] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:46:04.395028 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9aa21ac-1008-4a78-84a1-a580304f3ac7 None admin] Authenticating user token {{(pid=80396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:46:04.443276 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ede167-abd3-46a1-bc8c-8f9d9019d673 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:46:04.444268 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ede167-abd3-46a1-bc8c-8f9d9019d673 None admin] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:46:04.444653 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ede167-abd3-46a1-bc8c-8f9d9019d673 None admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:46:04.444999 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ede167-abd3-46a1-bc8c-8f9d9019d673 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:46:04.464126 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53ede167-abd3-46a1-bc8c-8f9d9019d673 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 02 15:46:04.481605 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application [None req-53ede167-abd3-46a1-bc8c-8f9d9019d673 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 02 15:46:04.481605 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 15:46:04.481605 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 15:46:04.481605 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 15:46:04.481605 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 15:46:04.481605 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 15:46:04.481605 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 15:46:04.481605 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 15:46:04.481605 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 15:46:04.481605 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 15:46:04.481605 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 15:46:04.481605 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 15:46:04.481605 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 02 15:46:04.481605 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 02 15:46:04.481605 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 02 15:46:04.481605 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 02 15:46:04.482666 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 02 15:46:04.482666 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 02 15:46:04.482666 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 02 15:46:04.482666 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 02 15:46:04.482666 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 15:46:04.482666 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 15:46:04.482666 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 15:46:04.482666 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 15:46:04.482666 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 15:46:04.482666 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 15:46:04.482666 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 15:46:04.482666 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application with Lock( Jun 02 15:46:04.482666 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 15:46:04.482666 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self._enter() Jun 02 15:46:04.482666 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 15:46:04.482666 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 15:46:04.483446 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 15:46:04.483446 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self.creator() Jun 02 15:46:04.483446 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 15:46:04.483446 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application created_value = creator( Jun 02 15:46:04.483446 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 02 15:46:04.483446 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 02 15:46:04.483446 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 02 15:46:04.483446 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 02 15:46:04.483446 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 02 15:46:04.483446 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 02 15:46:04.483446 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 02 15:46:04.483446 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application Jun 02 15:46:04.483446 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 200/396] 10.222.0.59 () {56 vars in 1099 bytes} [Thu Jun 2 15:46:04 2022] GET /identity/v3/roles/member => generated 84 bytes in 306 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 02 15:46:04.488491 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ede167-abd3-46a1-bc8c-8f9d9019d673 None admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:46:04.512624 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9aa21ac-1008-4a78-84a1-a580304f3ac7 None admin] Validating token access rules against request {{(pid=80396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:46:04.550949 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0e2be67-5b0f-4f40-af87-b1989ce3b98f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:46:04.552217 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e2be67-5b0f-4f40-af87-b1989ce3b98f None admin] REQUEST_METHOD: `PUT` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:46:04.552723 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e2be67-5b0f-4f40-af87-b1989ce3b98f None admin] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:46:04.553188 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e2be67-5b0f-4f40-af87-b1989ce3b98f None admin] PATH_INFO: `/v3/projects/06e0633a47e74dcfaeccc8794206da96/groups/0d56bf165788496982f9b3bbb67c019e/roles/21f49b1aa1e64120b7ef6fcf4667a641` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:46:04.556063 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0e2be67-5b0f-4f40-af87-b1989ce3b98f None admin] RBAC: Authorizing `identity:create_grant(project_id=06e0633a47e74dcfaeccc8794206da96, group_id=0d56bf165788496982f9b3bbb67c019e, role_id=21f49b1aa1e64120b7ef6fcf4667a641)` {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:46:04.557898 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0e2be67-5b0f-4f40-af87-b1989ce3b98f None admin] RBAC: Authorization granted {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:46:04.591408 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writing DB stats keystone:SELECT=100 {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:46:04.639924 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ede167-abd3-46a1-bc8c-8f9d9019d673 None admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:46:04.656354 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 197/397] 10.222.0.59 () {58 vars in 1442 bytes} [Thu Jun 2 15:46:04 2022] PUT /identity/v3/projects/06e0633a47e74dcfaeccc8794206da96/groups/0d56bf165788496982f9b3bbb67c019e/roles/21f49b1aa1e64120b7ef6fcf4667a641 => generated 0 bytes in 259 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 15:46:04.692324 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-614e5c92-d98d-41ad-ae80-58c4dde336c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:46:04.693269 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614e5c92-d98d-41ad-ae80-58c4dde336c7 None admin] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:46:04.693696 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614e5c92-d98d-41ad-ae80-58c4dde336c7 None admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:46:04.694198 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614e5c92-d98d-41ad-ae80-58c4dde336c7 None admin] PATH_INFO: `/v3/roles` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:46:04.695100 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-614e5c92-d98d-41ad-ae80-58c4dde336c7 None admin] RBAC: Adding query filter params (name=member) {{(pid=80395) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 15:46:04.695723 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-614e5c92-d98d-41ad-ae80-58c4dde336c7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:46:04.697358 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-614e5c92-d98d-41ad-ae80-58c4dde336c7 None admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:46:04.707829 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 201/398] 10.222.0.59 () {56 vars in 1101 bytes} [Thu Jun 2 15:46:04 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 15:46:04.715109 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0e2be67-5b0f-4f40-af87-b1989ce3b98f None admin] Authenticating user token {{(pid=80396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:46:04.762487 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG dbcounter [-] [80396] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:46:04.837447 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0e2be67-5b0f-4f40-af87-b1989ce3b98f None admin] Validating token access rules against request {{(pid=80396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:46:04.875503 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a2474b-23c5-4df0-8b02-59dc9fd74666 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:46:04.876285 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a2474b-23c5-4df0-8b02-59dc9fd74666 None admin] REQUEST_METHOD: `GET` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:46:04.876568 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a2474b-23c5-4df0-8b02-59dc9fd74666 None admin] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:46:04.876844 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a2474b-23c5-4df0-8b02-59dc9fd74666 None admin] PATH_INFO: `/v3/groups/0d56bf165788496982f9b3bbb67c019e` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:46:04.880075 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45a2474b-23c5-4df0-8b02-59dc9fd74666 None admin] RBAC: Authorizing `identity:get_group(group_id=0d56bf165788496982f9b3bbb67c019e)` {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:46:04.881571 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45a2474b-23c5-4df0-8b02-59dc9fd74666 None admin] RBAC: Authorization granted {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:46:04.884664 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 198/399] 10.222.0.59 () {56 vars in 1180 bytes} [Thu Jun 2 15:46:04 2022] GET /identity/v3/groups/0d56bf165788496982f9b3bbb67c019e => generated 226 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 15:46:04.889677 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-614e5c92-d98d-41ad-ae80-58c4dde336c7 None admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:46:05.014922 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-614e5c92-d98d-41ad-ae80-58c4dde336c7 None admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:46:05.049215 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writing DB stats keystone:SELECT=100 {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:46:05.063456 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b84467a-2cd9-45aa-9444-ccc64d08c6eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:46:05.064705 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b84467a-2cd9-45aa-9444-ccc64d08c6eb None admin] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:46:05.065220 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b84467a-2cd9-45aa-9444-ccc64d08c6eb None admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:46:05.065698 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b84467a-2cd9-45aa-9444-ccc64d08c6eb None admin] PATH_INFO: `/v3/projects/576f2a66e24a468b921fa6cb1e5ff6db` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:46:05.067246 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b84467a-2cd9-45aa-9444-ccc64d08c6eb None admin] RBAC: Authorizing `identity:get_project(project_id=576f2a66e24a468b921fa6cb1e5ff6db)` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:46:05.068939 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b84467a-2cd9-45aa-9444-ccc64d08c6eb None admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:46:05.071755 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 202/400] 10.222.0.59 () {56 vars in 1186 bytes} [Thu Jun 2 15:46:04 2022] GET /identity/v3/projects/576f2a66e24a468b921fa6cb1e5ff6db => generated 302 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 15:46:05.077923 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a2474b-23c5-4df0-8b02-59dc9fd74666 None admin] Authenticating user token {{(pid=80396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:46:05.110629 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbbc13d0-06b7-490a-8468-3fc3d70b01de None None] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:46:05.111241 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbbc13d0-06b7-490a-8468-3fc3d70b01de None None] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:46:05.111720 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbbc13d0-06b7-490a-8468-3fc3d70b01de None None] PATH_INFO: `/` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:46:05.113487 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 203/401] 10.222.0.59 () {54 vars in 926 bytes} [Thu Jun 2 15:46:05 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 15:46:05.119520 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87d8904-d4b1-4a80-ad92-3d7e4047e232 None None] REQUEST_METHOD: `POST` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:46:05.120175 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87d8904-d4b1-4a80-ad92-3d7e4047e232 None None] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:46:05.120653 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87d8904-d4b1-4a80-ad92-3d7e4047e232 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:46:05.148900 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.auth.core [None req-f87d8904-d4b1-4a80-ad92-3d7e4047e232 None None] MFA Rules not processed for user `400d1f4db9de49638549e5db29a041e1`. Rule list: `[]` (Enabled: `True`). {{(pid=80395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 15:46:05.150670 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.fernet_utils [None req-f87d8904-d4b1-4a80-ad92-3d7e4047e232 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 15:46:05.196885 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a2474b-23c5-4df0-8b02-59dc9fd74666 None admin] Validating token access rules against request {{(pid=80396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:46:05.201603 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG dbcounter [-] [80396] Writing DB stats keystone:SELECT=100 {{(pid=80396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:46:05.240014 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d241572-1703-49c1-8970-83b771c333ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:46:05.240950 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d241572-1703-49c1-8970-83b771c333ef None admin] REQUEST_METHOD: `PUT` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:46:05.241239 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d241572-1703-49c1-8970-83b771c333ef None admin] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:46:05.241514 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d241572-1703-49c1-8970-83b771c333ef None admin] PATH_INFO: `/v3/projects/576f2a66e24a468b921fa6cb1e5ff6db/groups/0d56bf165788496982f9b3bbb67c019e/roles/649e0f2b5a264c419ea6a1441f123a03` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:46:05.244759 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d241572-1703-49c1-8970-83b771c333ef None admin] RBAC: Authorizing `identity:create_grant(project_id=576f2a66e24a468b921fa6cb1e5ff6db, group_id=0d56bf165788496982f9b3bbb67c019e, role_id=649e0f2b5a264c419ea6a1441f123a03)` {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:46:05.246696 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d241572-1703-49c1-8970-83b771c333ef None admin] RBAC: Authorization granted {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:46:05.277244 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 204/402] 10.222.0.59 () {58 vars in 1023 bytes} [Thu Jun 2 15:46:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 02 15:46:05.300495 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f87d8904-d4b1-4a80-ad92-3d7e4047e232 None None] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:46:05.370967 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 199/403] 10.222.0.59 () {58 vars in 1442 bytes} [Thu Jun 2 15:46:05 2022] PUT /identity/v3/projects/576f2a66e24a468b921fa6cb1e5ff6db/groups/0d56bf165788496982f9b3bbb67c019e/roles/649e0f2b5a264c419ea6a1441f123a03 => generated 0 bytes in 293 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 15:46:05.419733 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f87d8904-d4b1-4a80-ad92-3d7e4047e232 None None] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:46:05.443071 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writing DB stats keystone:SELECT=100 {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:46:05.458448 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7e8c254-c8b4-491e-87ae-6d9ca15a1776 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:46:05.459315 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e8c254-c8b4-491e-87ae-6d9ca15a1776 None admin] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:46:05.459599 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e8c254-c8b4-491e-87ae-6d9ca15a1776 None admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:46:05.459872 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e8c254-c8b4-491e-87ae-6d9ca15a1776 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:46:05.471505 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7e8c254-c8b4-491e-87ae-6d9ca15a1776 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 02 15:46:05.482321 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application [None req-a7e8c254-c8b4-491e-87ae-6d9ca15a1776 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 02 15:46:05.482321 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 15:46:05.482321 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 15:46:05.482321 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 15:46:05.482321 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 15:46:05.482321 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 15:46:05.482321 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 15:46:05.482321 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 15:46:05.482321 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 15:46:05.482321 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 15:46:05.482321 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 15:46:05.482321 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 15:46:05.482321 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 02 15:46:05.482321 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 02 15:46:05.482321 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 02 15:46:05.482321 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 02 15:46:05.483296 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 02 15:46:05.483296 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 02 15:46:05.483296 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 02 15:46:05.483296 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 02 15:46:05.483296 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 15:46:05.483296 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 15:46:05.483296 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 15:46:05.483296 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 15:46:05.483296 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 15:46:05.483296 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 15:46:05.483296 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 15:46:05.483296 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application with Lock( Jun 02 15:46:05.483296 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 15:46:05.483296 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self._enter() Jun 02 15:46:05.483296 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 15:46:05.483296 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 15:46:05.484556 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 15:46:05.484556 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self.creator() Jun 02 15:46:05.484556 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 15:46:05.484556 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application created_value = creator( Jun 02 15:46:05.484556 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 02 15:46:05.484556 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 02 15:46:05.484556 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 02 15:46:05.484556 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 02 15:46:05.484556 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 02 15:46:05.484556 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 02 15:46:05.484556 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 02 15:46:05.484556 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application Jun 02 15:46:05.484556 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 205/404] 10.222.0.59 () {56 vars in 1114 bytes} [Thu Jun 2 15:46:05 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 02 15:46:05.491456 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d241572-1703-49c1-8970-83b771c333ef None admin] Authenticating user token {{(pid=80396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:46:05.578798 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3013d965-6f59-4f7b-aaa4-87d9dce815d6 None None] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:46:05.579124 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3013d965-6f59-4f7b-aaa4-87d9dce815d6 None None] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:46:05.579353 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3013d965-6f59-4f7b-aaa4-87d9dce815d6 None None] PATH_INFO: `/` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:46:05.580982 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 206/405] 10.222.0.59 () {54 vars in 926 bytes} [Thu Jun 2 15:46:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 02 15:46:05.612073 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11ca6ce-0873-421a-a321-317ff80120be None None] REQUEST_METHOD: `POST` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:46:05.612381 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11ca6ce-0873-421a-a321-317ff80120be None None] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:46:05.612640 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11ca6ce-0873-421a-a321-317ff80120be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:46:05.630525 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d241572-1703-49c1-8970-83b771c333ef None admin] Validating token access rules against request {{(pid=80396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:46:05.659113 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.auth.core [None req-f11ca6ce-0873-421a-a321-317ff80120be None None] MFA Rules not processed for user `400d1f4db9de49638549e5db29a041e1`. Rule list: `[]` (Enabled: `True`). {{(pid=80395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 15:46:05.660323 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.fernet_utils [None req-f11ca6ce-0873-421a-a321-317ff80120be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 15:46:05.669459 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5a0c821-545d-4f32-8dc9-93eb553f2d88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:46:05.670486 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a0c821-545d-4f32-8dc9-93eb553f2d88 None admin] REQUEST_METHOD: `GET` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:46:05.670972 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a0c821-545d-4f32-8dc9-93eb553f2d88 None admin] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:46:05.671444 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a0c821-545d-4f32-8dc9-93eb553f2d88 None admin] PATH_INFO: `/v3/roles` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:46:05.672404 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5a0c821-545d-4f32-8dc9-93eb553f2d88 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80396) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 15:46:05.672928 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5a0c821-545d-4f32-8dc9-93eb553f2d88 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:46:05.674531 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5a0c821-545d-4f32-8dc9-93eb553f2d88 None admin] RBAC: Authorization granted {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:46:05.687921 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 200/406] 10.222.0.59 () {56 vars in 1111 bytes} [Thu Jun 2 15:46:05 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 15:46:05.689481 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5a0c821-545d-4f32-8dc9-93eb553f2d88 None admin] Authenticating user token {{(pid=80396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:46:05.718514 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG dbcounter [-] [80396] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:46:05.754666 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 207/407] 10.222.0.59 () {58 vars in 1023 bytes} [Thu Jun 2 15:46:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 02 15:46:05.793711 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5a0c821-545d-4f32-8dc9-93eb553f2d88 None admin] Validating token access rules against request {{(pid=80396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:46:05.800345 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f11ca6ce-0873-421a-a321-317ff80120be None None] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:46:05.830727 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a361dedc-2731-4079-a29e-0d5d25076b39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:46:05.831967 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a361dedc-2731-4079-a29e-0d5d25076b39 None admin] REQUEST_METHOD: `GET` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:46:05.832452 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a361dedc-2731-4079-a29e-0d5d25076b39 None admin] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:46:05.832926 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a361dedc-2731-4079-a29e-0d5d25076b39 None admin] PATH_INFO: `/v3/groups/0d56bf165788496982f9b3bbb67c019e` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:46:05.834332 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a361dedc-2731-4079-a29e-0d5d25076b39 None admin] RBAC: Authorizing `identity:get_group(group_id=0d56bf165788496982f9b3bbb67c019e)` {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:46:05.835962 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a361dedc-2731-4079-a29e-0d5d25076b39 None admin] RBAC: Authorization granted {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:46:05.842171 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 201/408] 10.222.0.59 () {56 vars in 1180 bytes} [Thu Jun 2 15:46:05 2022] GET /identity/v3/groups/0d56bf165788496982f9b3bbb67c019e => generated 226 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 15:46:05.844426 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a361dedc-2731-4079-a29e-0d5d25076b39 None admin] Authenticating user token {{(pid=80396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:46:05.909171 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f11ca6ce-0873-421a-a321-317ff80120be None None] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:46:05.933555 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writing DB stats keystone:SELECT=100 {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:46:05.944211 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG dbcounter [-] [80396] Writing DB stats keystone:SELECT=100 {{(pid=80396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:46:05.949120 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a361dedc-2731-4079-a29e-0d5d25076b39 None admin] Validating token access rules against request {{(pid=80396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:46:05.984801 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41d0a1d4-46cc-4bdb-8307-1b94c07c4508 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:46:05.986051 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d0a1d4-46cc-4bdb-8307-1b94c07c4508 None admin] REQUEST_METHOD: `GET` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:46:05.986560 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d0a1d4-46cc-4bdb-8307-1b94c07c4508 None admin] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:46:05.987035 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d0a1d4-46cc-4bdb-8307-1b94c07c4508 None admin] PATH_INFO: `/v3/projects/576f2a66e24a468b921fa6cb1e5ff6db` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:46:05.988506 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41d0a1d4-46cc-4bdb-8307-1b94c07c4508 None admin] RBAC: Authorizing `identity:get_project(project_id=576f2a66e24a468b921fa6cb1e5ff6db)` {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:46:05.990171 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41d0a1d4-46cc-4bdb-8307-1b94c07c4508 None admin] RBAC: Authorization granted {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:46:05.997619 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 202/409] 10.222.0.59 () {56 vars in 1186 bytes} [Thu Jun 2 15:46:05 2022] GET /identity/v3/projects/576f2a66e24a468b921fa6cb1e5ff6db => generated 302 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 15:46:05.999061 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41d0a1d4-46cc-4bdb-8307-1b94c07c4508 None admin] Authenticating user token {{(pid=80396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:46:06.010855 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08b6bef4-175e-412d-b613-4f666e1ed0bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:46:06.011633 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b6bef4-175e-412d-b613-4f666e1ed0bd None admin] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:46:06.011918 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b6bef4-175e-412d-b613-4f666e1ed0bd None admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:46:06.012194 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b6bef4-175e-412d-b613-4f666e1ed0bd None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:46:06.043451 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08b6bef4-175e-412d-b613-4f666e1ed0bd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 02 15:46:06.063475 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application [None req-08b6bef4-175e-412d-b613-4f666e1ed0bd None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 02 15:46:06.063475 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 15:46:06.063475 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 15:46:06.063475 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 15:46:06.063475 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 15:46:06.063475 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 15:46:06.063475 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 15:46:06.063475 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 15:46:06.063475 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 15:46:06.063475 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 15:46:06.063475 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 15:46:06.063475 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 15:46:06.063475 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 02 15:46:06.063475 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 02 15:46:06.063475 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 02 15:46:06.063475 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 02 15:46:06.064494 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 02 15:46:06.064494 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 02 15:46:06.064494 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 02 15:46:06.064494 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 02 15:46:06.064494 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 15:46:06.064494 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 15:46:06.064494 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 15:46:06.064494 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 15:46:06.064494 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 15:46:06.064494 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 15:46:06.064494 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 15:46:06.064494 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application with Lock( Jun 02 15:46:06.064494 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 15:46:06.064494 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self._enter() Jun 02 15:46:06.064494 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 15:46:06.064494 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 15:46:06.065701 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 15:46:06.065701 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self.creator() Jun 02 15:46:06.065701 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 15:46:06.065701 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application created_value = creator( Jun 02 15:46:06.065701 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 02 15:46:06.065701 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 02 15:46:06.065701 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 02 15:46:06.065701 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 02 15:46:06.065701 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 02 15:46:06.065701 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 02 15:46:06.065701 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 02 15:46:06.065701 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application Jun 02 15:46:06.065701 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 208/410] 10.222.0.59 () {56 vars in 1096 bytes} [Thu Jun 2 15:46:05 2022] GET /identity/v3/roles/admin => generated 83 bytes in 265 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 02 15:46:06.071099 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08b6bef4-175e-412d-b613-4f666e1ed0bd None admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:46:06.127336 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41d0a1d4-46cc-4bdb-8307-1b94c07c4508 None admin] Validating token access rules against request {{(pid=80396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:46:06.167181 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca0e0d17-c188-4f07-81ab-61a6f4fc3ca6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:46:06.168523 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0e0d17-c188-4f07-81ab-61a6f4fc3ca6 None admin] REQUEST_METHOD: `PUT` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:46:06.169004 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0e0d17-c188-4f07-81ab-61a6f4fc3ca6 None admin] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:46:06.169475 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0e0d17-c188-4f07-81ab-61a6f4fc3ca6 None admin] PATH_INFO: `/v3/projects/576f2a66e24a468b921fa6cb1e5ff6db/groups/0d56bf165788496982f9b3bbb67c019e/roles/21f49b1aa1e64120b7ef6fcf4667a641` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:46:06.172757 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca0e0d17-c188-4f07-81ab-61a6f4fc3ca6 None admin] RBAC: Authorizing `identity:create_grant(project_id=576f2a66e24a468b921fa6cb1e5ff6db, group_id=0d56bf165788496982f9b3bbb67c019e, role_id=21f49b1aa1e64120b7ef6fcf4667a641)` {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:46:06.174454 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca0e0d17-c188-4f07-81ab-61a6f4fc3ca6 None admin] RBAC: Authorization granted {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:46:06.245853 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08b6bef4-175e-412d-b613-4f666e1ed0bd None admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:46:06.263200 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 203/411] 10.222.0.59 () {58 vars in 1442 bytes} [Thu Jun 2 15:46:05 2022] PUT /identity/v3/projects/576f2a66e24a468b921fa6cb1e5ff6db/groups/0d56bf165788496982f9b3bbb67c019e/roles/21f49b1aa1e64120b7ef6fcf4667a641 => generated 0 bytes in 264 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 02 15:46:06.296013 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-961bed42-6092-44a0-b0ba-7e700faa0e29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:46:06.297047 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961bed42-6092-44a0-b0ba-7e700faa0e29 None admin] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:46:06.297559 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961bed42-6092-44a0-b0ba-7e700faa0e29 None admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:46:06.298064 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961bed42-6092-44a0-b0ba-7e700faa0e29 None admin] PATH_INFO: `/v3/roles` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:46:06.299065 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-961bed42-6092-44a0-b0ba-7e700faa0e29 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80395) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 15:46:06.299579 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-961bed42-6092-44a0-b0ba-7e700faa0e29 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:46:06.302594 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-961bed42-6092-44a0-b0ba-7e700faa0e29 None admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:46:06.317349 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 209/412] 10.222.0.59 () {56 vars in 1099 bytes} [Thu Jun 2 15:46:06 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 15:46:06.318835 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca0e0d17-c188-4f07-81ab-61a6f4fc3ca6 None admin] Authenticating user token {{(pid=80396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:46:06.362500 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG dbcounter [-] [80396] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:46:06.464114 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca0e0d17-c188-4f07-81ab-61a6f4fc3ca6 None admin] Validating token access rules against request {{(pid=80396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:46:06.519555 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df61967d-eafd-4ad7-babc-f7d78b8090ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:46:06.520414 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df61967d-eafd-4ad7-babc-f7d78b8090ff None admin] REQUEST_METHOD: `GET` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:46:06.520701 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df61967d-eafd-4ad7-babc-f7d78b8090ff None admin] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:46:06.520979 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df61967d-eafd-4ad7-babc-f7d78b8090ff None admin] PATH_INFO: `/v3/groups/c4ad9096c9d745c18573493d0f5b33ed` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:46:06.522298 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df61967d-eafd-4ad7-babc-f7d78b8090ff None admin] RBAC: Authorizing `identity:get_group(group_id=c4ad9096c9d745c18573493d0f5b33ed)` {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:46:06.523886 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df61967d-eafd-4ad7-babc-f7d78b8090ff None admin] RBAC: Authorization granted {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:46:06.525583 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 204/413] 10.222.0.59 () {56 vars in 1180 bytes} [Thu Jun 2 15:46:06 2022] GET /identity/v3/groups/c4ad9096c9d745c18573493d0f5b33ed => generated 229 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 15:46:06.531095 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-961bed42-6092-44a0-b0ba-7e700faa0e29 None admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:46:06.577753 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writing DB stats keystone:SELECT=100 {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:46:06.621557 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-243ee3e2-1491-49e7-82b0-48bb2a8924ed None None] REQUEST_METHOD: `GET` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:46:06.621845 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-243ee3e2-1491-49e7-82b0-48bb2a8924ed None None] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:46:06.622149 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-243ee3e2-1491-49e7-82b0-48bb2a8924ed None None] PATH_INFO: `/` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:46:06.623645 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 205/414] 10.222.0.59 () {54 vars in 926 bytes} [Thu Jun 2 15:46:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 02 15:46:06.629819 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a02aff-42dc-43d9-b873-7b9764f65d06 None None] REQUEST_METHOD: `POST` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:46:06.629819 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a02aff-42dc-43d9-b873-7b9764f65d06 None None] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:46:06.630002 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a02aff-42dc-43d9-b873-7b9764f65d06 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:46:06.654726 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.auth.core [None req-42a02aff-42dc-43d9-b873-7b9764f65d06 None None] MFA Rules not processed for user `400d1f4db9de49638549e5db29a041e1`. Rule list: `[]` (Enabled: `True`). {{(pid=80396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 15:46:06.655771 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.fernet_utils [None req-42a02aff-42dc-43d9-b873-7b9764f65d06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 15:46:06.669837 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-961bed42-6092-44a0-b0ba-7e700faa0e29 None admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:46:06.712686 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afbec871-7fd0-4d00-9e58-2062c7d0bf6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:46:06.714165 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afbec871-7fd0-4d00-9e58-2062c7d0bf6d None admin] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:46:06.714700 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afbec871-7fd0-4d00-9e58-2062c7d0bf6d None admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:46:06.715189 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afbec871-7fd0-4d00-9e58-2062c7d0bf6d None admin] PATH_INFO: `/v3/projects/4f73d5a98be74242b45222df39fb6213` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:46:06.717187 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afbec871-7fd0-4d00-9e58-2062c7d0bf6d None admin] RBAC: Authorizing `identity:get_project(project_id=4f73d5a98be74242b45222df39fb6213)` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:46:06.718855 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afbec871-7fd0-4d00-9e58-2062c7d0bf6d None admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:46:06.720898 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 210/415] 10.222.0.59 () {56 vars in 1186 bytes} [Thu Jun 2 15:46:06 2022] GET /identity/v3/projects/4f73d5a98be74242b45222df39fb6213 => generated 344 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 15:46:06.726406 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afbec871-7fd0-4d00-9e58-2062c7d0bf6d None admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:46:06.835333 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afbec871-7fd0-4d00-9e58-2062c7d0bf6d None admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:46:06.839864 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writing DB stats keystone:SELECT=100 {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:46:06.839989 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 206/416] 10.222.0.59 () {58 vars in 1023 bytes} [Thu Jun 2 15:46:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 211 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 02 15:46:06.872756 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5c0ed1e-8961-4e9b-88f0-44d5127bfa09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:46:06.873997 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c0ed1e-8961-4e9b-88f0-44d5127bfa09 None admin] REQUEST_METHOD: `PUT` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:46:06.874543 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c0ed1e-8961-4e9b-88f0-44d5127bfa09 None admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:46:06.875039 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c0ed1e-8961-4e9b-88f0-44d5127bfa09 None admin] PATH_INFO: `/v3/projects/4f73d5a98be74242b45222df39fb6213/groups/c4ad9096c9d745c18573493d0f5b33ed/roles/f1e0c25f6e9049e897cb7350c7e54ab3` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:46:06.875504 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42a02aff-42dc-43d9-b873-7b9764f65d06 None None] Authenticating user token {{(pid=80396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:46:06.877450 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5c0ed1e-8961-4e9b-88f0-44d5127bfa09 None admin] RBAC: Authorizing `identity:create_grant(project_id=4f73d5a98be74242b45222df39fb6213, group_id=c4ad9096c9d745c18573493d0f5b33ed, role_id=f1e0c25f6e9049e897cb7350c7e54ab3)` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:46:06.879278 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5c0ed1e-8961-4e9b-88f0-44d5127bfa09 None admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:46:06.902605 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG dbcounter [-] [80396] Writing DB stats keystone:SELECT=100 {{(pid=80396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:46:06.964452 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 211/417] 10.222.0.59 () {58 vars in 1442 bytes} [Thu Jun 2 15:46:06 2022] PUT /identity/v3/projects/4f73d5a98be74242b45222df39fb6213/groups/c4ad9096c9d745c18573493d0f5b33ed/roles/f1e0c25f6e9049e897cb7350c7e54ab3 => generated 0 bytes in 238 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 15:46:06.996339 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42a02aff-42dc-43d9-b873-7b9764f65d06 None None] Validating token access rules against request {{(pid=80396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:46:07.048872 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7f6e0a7-7518-41dc-8221-0fe12a8d01be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:46:07.050096 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f6e0a7-7518-41dc-8221-0fe12a8d01be None admin] REQUEST_METHOD: `GET` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:46:07.050633 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f6e0a7-7518-41dc-8221-0fe12a8d01be None admin] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:46:07.051112 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f6e0a7-7518-41dc-8221-0fe12a8d01be None admin] PATH_INFO: `/v3/roles/member` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:46:07.075326 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7f6e0a7-7518-41dc-8221-0fe12a8d01be None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 02 15:46:07.083811 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application [None req-b7f6e0a7-7518-41dc-8221-0fe12a8d01be None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 02 15:46:07.083811 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 15:46:07.083811 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 15:46:07.083811 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 15:46:07.083811 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 15:46:07.083811 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 15:46:07.083811 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 15:46:07.083811 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 15:46:07.083811 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 15:46:07.083811 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 15:46:07.083811 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 15:46:07.083811 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 15:46:07.083811 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 02 15:46:07.083811 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 02 15:46:07.083811 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 02 15:46:07.083811 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 02 15:46:07.084789 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 02 15:46:07.084789 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 02 15:46:07.084789 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 02 15:46:07.084789 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 02 15:46:07.084789 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 15:46:07.084789 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 15:46:07.084789 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 15:46:07.084789 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 15:46:07.084789 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 15:46:07.084789 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 15:46:07.084789 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 15:46:07.084789 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application with Lock( Jun 02 15:46:07.084789 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 15:46:07.084789 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application return self._enter() Jun 02 15:46:07.084789 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 15:46:07.084789 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 15:46:07.085609 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 15:46:07.085609 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application return self.creator() Jun 02 15:46:07.085609 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 15:46:07.085609 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application created_value = creator( Jun 02 15:46:07.085609 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 02 15:46:07.085609 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 02 15:46:07.085609 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 02 15:46:07.085609 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 02 15:46:07.085609 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 02 15:46:07.085609 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 02 15:46:07.085609 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 02 15:46:07.085609 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application Jun 02 15:46:07.088759 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 207/418] 10.222.0.59 () {56 vars in 1099 bytes} [Thu Jun 2 15:46:06 2022] GET /identity/v3/roles/member => generated 84 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 15:46:07.094763 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5c0ed1e-8961-4e9b-88f0-44d5127bfa09 None admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:46:07.224195 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5c0ed1e-8961-4e9b-88f0-44d5127bfa09 None admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:46:07.261251 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a603891c-3fc0-4a24-94bf-951e2ecbb697 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:46:07.261921 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a603891c-3fc0-4a24-94bf-951e2ecbb697 None admin] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:46:07.262239 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a603891c-3fc0-4a24-94bf-951e2ecbb697 None admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:46:07.262568 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a603891c-3fc0-4a24-94bf-951e2ecbb697 None admin] PATH_INFO: `/v3/roles` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:46:07.263325 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a603891c-3fc0-4a24-94bf-951e2ecbb697 None admin] RBAC: Adding query filter params (name=member) {{(pid=80395) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 15:46:07.263683 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a603891c-3fc0-4a24-94bf-951e2ecbb697 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:46:07.265065 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a603891c-3fc0-4a24-94bf-951e2ecbb697 None admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:46:07.274832 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 212/419] 10.222.0.59 () {56 vars in 1101 bytes} [Thu Jun 2 15:46:07 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 15:46:07.280114 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7f6e0a7-7518-41dc-8221-0fe12a8d01be None admin] Authenticating user token {{(pid=80396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:46:07.372285 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG dbcounter [-] [80396] Writing DB stats keystone:SELECT=100 {{(pid=80396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:46:07.396860 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7f6e0a7-7518-41dc-8221-0fe12a8d01be None admin] Validating token access rules against request {{(pid=80396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:46:07.443647 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b8081da-82d5-4189-b7ee-b0ac5f6fc887 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:46:07.444622 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b8081da-82d5-4189-b7ee-b0ac5f6fc887 None admin] REQUEST_METHOD: `GET` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:46:07.445083 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b8081da-82d5-4189-b7ee-b0ac5f6fc887 None admin] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:46:07.445615 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b8081da-82d5-4189-b7ee-b0ac5f6fc887 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:46:07.541747 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b8081da-82d5-4189-b7ee-b0ac5f6fc887 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:46:07.543523 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b8081da-82d5-4189-b7ee-b0ac5f6fc887 None admin] RBAC: Authorization granted {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:46:07.639473 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG dbcounter [-] [80396] Writing DB stats keystone:SELECT=100 {{(pid=80396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:46:07.660981 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 208/420] 10.222.0.59 () {58 vars in 1282 bytes} [Thu Jun 2 15:46:07 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 381 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 02 15:46:07.666350 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a603891c-3fc0-4a24-94bf-951e2ecbb697 None admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:46:07.708908 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:46:07.824861 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a603891c-3fc0-4a24-94bf-951e2ecbb697 None admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:46:07.860083 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8c7890c-35ed-4539-bd49-c18c300952a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:46:07.860942 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c7890c-35ed-4539-bd49-c18c300952a3 None admin] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:46:07.861224 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c7890c-35ed-4539-bd49-c18c300952a3 None admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:46:07.861499 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c7890c-35ed-4539-bd49-c18c300952a3 None admin] PATH_INFO: `/v3/projects/06e0633a47e74dcfaeccc8794206da96` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:46:07.862730 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8c7890c-35ed-4539-bd49-c18c300952a3 None admin] RBAC: Authorizing `identity:get_project(project_id=06e0633a47e74dcfaeccc8794206da96)` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:46:07.864239 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8c7890c-35ed-4539-bd49-c18c300952a3 None admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:46:07.866246 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 213/421] 10.222.0.59 () {56 vars in 1186 bytes} [Thu Jun 2 15:46:07 2022] GET /identity/v3/projects/06e0633a47e74dcfaeccc8794206da96 => generated 298 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 15:46:07.871949 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b8081da-82d5-4189-b7ee-b0ac5f6fc887 None admin] Authenticating user token {{(pid=80396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:46:07.925023 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6172ea8-963d-44f7-8068-13d7e9ef9fc7 None None] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:46:07.925669 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6172ea8-963d-44f7-8068-13d7e9ef9fc7 None None] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:46:07.926193 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6172ea8-963d-44f7-8068-13d7e9ef9fc7 None None] PATH_INFO: `/` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:46:07.928152 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 214/422] 10.222.0.59 () {54 vars in 926 bytes} [Thu Jun 2 15:46:07 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 15:46:07.935757 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a456158-9fa6-4b40-9d48-ea8d9cae5e84 None None] REQUEST_METHOD: `POST` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:46:07.936684 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a456158-9fa6-4b40-9d48-ea8d9cae5e84 None None] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:46:07.937188 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a456158-9fa6-4b40-9d48-ea8d9cae5e84 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:46:07.956504 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.auth.core [None req-3a456158-9fa6-4b40-9d48-ea8d9cae5e84 None None] MFA Rules not processed for user `400d1f4db9de49638549e5db29a041e1`. Rule list: `[]` (Enabled: `True`). {{(pid=80395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 15:46:07.958096 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.fernet_utils [None req-3a456158-9fa6-4b40-9d48-ea8d9cae5e84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 15:46:08.059285 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b8081da-82d5-4189-b7ee-b0ac5f6fc887 None admin] Validating token access rules against request {{(pid=80396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:46:08.080781 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 215/423] 10.222.0.59 () {58 vars in 1023 bytes} [Thu Jun 2 15:46:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 02 15:46:08.104771 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a456158-9fa6-4b40-9d48-ea8d9cae5e84 None None] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:46:08.127655 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writing DB stats keystone:SELECT=100 {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:46:08.168323 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66f262f7-e65e-48b0-a9f2-3935f312aebd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:46:08.169315 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f262f7-e65e-48b0-a9f2-3935f312aebd None admin] REQUEST_METHOD: `GET` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:46:08.169615 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f262f7-e65e-48b0-a9f2-3935f312aebd None admin] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:46:08.169896 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f262f7-e65e-48b0-a9f2-3935f312aebd None admin] PATH_INFO: `/v3/groups/0d56bf165788496982f9b3bbb67c019e` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:46:08.178155 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66f262f7-e65e-48b0-a9f2-3935f312aebd None admin] RBAC: Authorizing `identity:get_group(group_id=0d56bf165788496982f9b3bbb67c019e)` {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:46:08.178155 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66f262f7-e65e-48b0-a9f2-3935f312aebd None admin] RBAC: Authorization granted {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:46:08.178155 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 209/424] 10.222.0.59 () {56 vars in 1180 bytes} [Thu Jun 2 15:46:07 2022] GET /identity/v3/groups/0d56bf165788496982f9b3bbb67c019e => generated 226 bytes in 306 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 15:46:08.187433 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66f262f7-e65e-48b0-a9f2-3935f312aebd None admin] Authenticating user token {{(pid=80396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:46:08.221423 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a456158-9fa6-4b40-9d48-ea8d9cae5e84 None None] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:46:08.252260 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG dbcounter [-] [80396] Writing DB stats keystone:SELECT=100 {{(pid=80396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:46:08.267927 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-620437f7-64c5-44fe-9f7a-142331288f47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:46:08.268796 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-620437f7-64c5-44fe-9f7a-142331288f47 None admin] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:46:08.269029 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-620437f7-64c5-44fe-9f7a-142331288f47 None admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:46:08.269307 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-620437f7-64c5-44fe-9f7a-142331288f47 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:46:08.290840 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-620437f7-64c5-44fe-9f7a-142331288f47 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 02 15:46:08.302955 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66f262f7-e65e-48b0-a9f2-3935f312aebd None admin] Validating token access rules against request {{(pid=80396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:46:08.307352 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application [None req-620437f7-64c5-44fe-9f7a-142331288f47 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 02 15:46:08.307352 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 15:46:08.307352 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 15:46:08.307352 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 15:46:08.307352 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 15:46:08.307352 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 15:46:08.307352 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 15:46:08.307352 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 15:46:08.307352 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 15:46:08.307352 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 15:46:08.307352 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 15:46:08.307352 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 15:46:08.307352 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 02 15:46:08.307352 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 02 15:46:08.307352 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 02 15:46:08.307352 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 02 15:46:08.308214 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 02 15:46:08.308214 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 02 15:46:08.308214 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 02 15:46:08.308214 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 02 15:46:08.308214 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 15:46:08.308214 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 15:46:08.308214 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 15:46:08.308214 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 15:46:08.308214 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 15:46:08.308214 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 15:46:08.308214 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 15:46:08.308214 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application with Lock( Jun 02 15:46:08.308214 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 15:46:08.308214 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self._enter() Jun 02 15:46:08.308214 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 15:46:08.308214 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 15:46:08.309026 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 15:46:08.309026 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self.creator() Jun 02 15:46:08.309026 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 15:46:08.309026 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application created_value = creator( Jun 02 15:46:08.309026 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 02 15:46:08.309026 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 02 15:46:08.309026 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 02 15:46:08.309026 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 02 15:46:08.309026 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 02 15:46:08.309026 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 02 15:46:08.309026 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 02 15:46:08.309026 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application Jun 02 15:46:08.309026 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 216/425] 10.222.0.59 () {56 vars in 1114 bytes} [Thu Jun 2 15:46:08 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 02 15:46:08.314911 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-620437f7-64c5-44fe-9f7a-142331288f47 None admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:46:08.342459 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be692829-910e-402b-80fa-f9c554c9b84c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:46:08.343584 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be692829-910e-402b-80fa-f9c554c9b84c None admin] REQUEST_METHOD: `GET` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:46:08.344071 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be692829-910e-402b-80fa-f9c554c9b84c None admin] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:46:08.344544 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be692829-910e-402b-80fa-f9c554c9b84c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:46:08.345611 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be692829-910e-402b-80fa-f9c554c9b84c None admin] RBAC: Adding query filter params (group.id=0d56bf165788496982f9b3bbb67c019e, role.id=649e0f2b5a264c419ea6a1441f123a03, scope.project.id=06e0633a47e74dcfaeccc8794206da96) {{(pid=80396) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 15:46:08.346173 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be692829-910e-402b-80fa-f9c554c9b84c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:46:08.347796 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be692829-910e-402b-80fa-f9c554c9b84c None admin] RBAC: Authorization granted {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:46:08.355510 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 210/426] 10.222.0.59 () {56 vars in 1376 bytes} [Thu Jun 2 15:46:08 2022] GET /identity/v3/role_assignments?group.id=0d56bf165788496982f9b3bbb67c019e&scope.project.id=06e0633a47e74dcfaeccc8794206da96&role.id=649e0f2b5a264c419ea6a1441f123a03 => generated 611 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 15:46:08.382017 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e86523-5fa8-4e55-80fa-03f30f2964ef None None] REQUEST_METHOD: `GET` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:46:08.382675 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e86523-5fa8-4e55-80fa-03f30f2964ef None None] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:46:08.383395 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e86523-5fa8-4e55-80fa-03f30f2964ef None None] PATH_INFO: `/` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:46:08.385088 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 211/427] 10.222.0.59 () {54 vars in 926 bytes} [Thu Jun 2 15:46:08 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 15:46:08.400404 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3968d43-c342-466c-bdcc-ef2f84e77e6a None None] REQUEST_METHOD: `POST` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:46:08.401033 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3968d43-c342-466c-bdcc-ef2f84e77e6a None None] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:46:08.401585 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3968d43-c342-466c-bdcc-ef2f84e77e6a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:46:08.439386 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.auth.core [None req-c3968d43-c342-466c-bdcc-ef2f84e77e6a None None] MFA Rules not processed for user `400d1f4db9de49638549e5db29a041e1`. Rule list: `[]` (Enabled: `True`). {{(pid=80396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 15:46:08.440946 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.fernet_utils [None req-c3968d43-c342-466c-bdcc-ef2f84e77e6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 15:46:08.450333 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writing DB stats keystone:SELECT=100 {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:46:08.481328 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-620437f7-64c5-44fe-9f7a-142331288f47 None admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:46:08.543741 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 212/428] 10.222.0.59 () {58 vars in 1023 bytes} [Thu Jun 2 15:46:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 02 15:46:08.572406 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3968d43-c342-466c-bdcc-ef2f84e77e6a None None] Authenticating user token {{(pid=80396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:46:08.580010 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b8fcc08-2746-4674-bf68-a18dcfeed7b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:46:08.581058 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8fcc08-2746-4674-bf68-a18dcfeed7b4 None admin] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:46:08.581596 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8fcc08-2746-4674-bf68-a18dcfeed7b4 None admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:46:08.582187 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8fcc08-2746-4674-bf68-a18dcfeed7b4 None admin] PATH_INFO: `/v3/roles` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:46:08.583179 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b8fcc08-2746-4674-bf68-a18dcfeed7b4 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80395) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 15:46:08.586559 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b8fcc08-2746-4674-bf68-a18dcfeed7b4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:46:08.588567 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b8fcc08-2746-4674-bf68-a18dcfeed7b4 None admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:46:08.600475 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 217/429] 10.222.0.59 () {56 vars in 1111 bytes} [Thu Jun 2 15:46:08 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 286 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 15:46:08.607280 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b8fcc08-2746-4674-bf68-a18dcfeed7b4 None admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:46:08.645776 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG dbcounter [-] [80396] Writing DB stats keystone:SELECT=100 {{(pid=80396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:46:08.735376 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3968d43-c342-466c-bdcc-ef2f84e77e6a None None] Validating token access rules against request {{(pid=80396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:46:08.761920 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b8fcc08-2746-4674-bf68-a18dcfeed7b4 None admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:46:08.782024 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfd13ca8-fd95-4a0d-95e5-946988a44a13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:46:08.783305 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd13ca8-fd95-4a0d-95e5-946988a44a13 None admin] REQUEST_METHOD: `GET` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:46:08.783794 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd13ca8-fd95-4a0d-95e5-946988a44a13 None admin] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:46:08.785016 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd13ca8-fd95-4a0d-95e5-946988a44a13 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:46:08.800733 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfd13ca8-fd95-4a0d-95e5-946988a44a13 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 02 15:46:08.810721 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application [None req-dfd13ca8-fd95-4a0d-95e5-946988a44a13 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 02 15:46:08.810721 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 15:46:08.810721 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 15:46:08.810721 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 15:46:08.810721 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 15:46:08.810721 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 15:46:08.810721 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 15:46:08.810721 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 15:46:08.810721 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 15:46:08.810721 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 15:46:08.810721 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 15:46:08.810721 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 15:46:08.810721 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 02 15:46:08.810721 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 02 15:46:08.810721 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 02 15:46:08.810721 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 02 15:46:08.811704 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 02 15:46:08.811704 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 02 15:46:08.811704 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 02 15:46:08.811704 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 02 15:46:08.811704 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 15:46:08.811704 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 15:46:08.811704 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 15:46:08.811704 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 15:46:08.811704 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 15:46:08.811704 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 15:46:08.811704 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 15:46:08.811704 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application with Lock( Jun 02 15:46:08.811704 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 15:46:08.811704 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application return self._enter() Jun 02 15:46:08.811704 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 15:46:08.811704 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 15:46:08.812493 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 15:46:08.812493 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application return self.creator() Jun 02 15:46:08.812493 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 15:46:08.812493 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application created_value = creator( Jun 02 15:46:08.812493 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 02 15:46:08.812493 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 02 15:46:08.812493 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 02 15:46:08.812493 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 02 15:46:08.812493 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 02 15:46:08.812493 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 02 15:46:08.812493 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 02 15:46:08.812493 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application Jun 02 15:46:08.815792 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 213/430] 10.222.0.59 () {56 vars in 1099 bytes} [Thu Jun 2 15:46:08 2022] GET /identity/v3/roles/member => generated 84 bytes in 244 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 15:46:08.821541 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-791fc838-fd06-427e-87a2-556991aaf848 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:46:08.822511 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791fc838-fd06-427e-87a2-556991aaf848 None admin] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:46:08.822802 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfd13ca8-fd95-4a0d-95e5-946988a44a13 None admin] Authenticating user token {{(pid=80396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:46:08.822978 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791fc838-fd06-427e-87a2-556991aaf848 None admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:46:08.823355 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791fc838-fd06-427e-87a2-556991aaf848 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:46:08.839195 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writing DB stats keystone:SELECT=100 {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:46:08.914754 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-791fc838-fd06-427e-87a2-556991aaf848 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:46:08.916548 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-791fc838-fd06-427e-87a2-556991aaf848 None admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:46:08.954761 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfd13ca8-fd95-4a0d-95e5-946988a44a13 None admin] Validating token access rules against request {{(pid=80396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:46:08.957697 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG dbcounter [-] [80396] Writing DB stats keystone:SELECT=100 {{(pid=80396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:46:09.004808 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9cf0593-675c-43a2-975a-a48182434e7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:46:09.005572 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9cf0593-675c-43a2-975a-a48182434e7b None admin] REQUEST_METHOD: `GET` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:46:09.005958 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9cf0593-675c-43a2-975a-a48182434e7b None admin] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:46:09.006718 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9cf0593-675c-43a2-975a-a48182434e7b None admin] PATH_INFO: `/v3/roles` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:46:09.007220 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9cf0593-675c-43a2-975a-a48182434e7b None admin] RBAC: Adding query filter params (name=member) {{(pid=80396) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 15:46:09.007657 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9cf0593-675c-43a2-975a-a48182434e7b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:46:09.011079 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9cf0593-675c-43a2-975a-a48182434e7b None admin] RBAC: Authorization granted {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:46:09.022047 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 214/431] 10.222.0.59 () {56 vars in 1101 bytes} [Thu Jun 2 15:46:08 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 15:46:09.028147 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9cf0593-675c-43a2-975a-a48182434e7b None admin] Authenticating user token {{(pid=80396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:46:09.048381 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 218/432] 10.222.0.59 () {58 vars in 1282 bytes} [Thu Jun 2 15:46:08 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 442 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 02 15:46:09.055600 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-791fc838-fd06-427e-87a2-556991aaf848 None admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:46:09.120867 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writing DB stats keystone:SELECT=100 {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:46:09.160709 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9cf0593-675c-43a2-975a-a48182434e7b None admin] Validating token access rules against request {{(pid=80396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:46:09.208737 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-791fc838-fd06-427e-87a2-556991aaf848 None admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:46:09.224741 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9387ceee-7e8f-43ca-9dac-0bcf57d8b74c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:46:09.225399 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9387ceee-7e8f-43ca-9dac-0bcf57d8b74c None admin] REQUEST_METHOD: `GET` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:46:09.225736 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9387ceee-7e8f-43ca-9dac-0bcf57d8b74c None admin] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:46:09.226015 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9387ceee-7e8f-43ca-9dac-0bcf57d8b74c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:46:09.248655 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc5c8b4c-010a-4e09-a681-19fe27cea396 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:46:09.249514 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc5c8b4c-010a-4e09-a681-19fe27cea396 None admin] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:46:09.249793 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc5c8b4c-010a-4e09-a681-19fe27cea396 None admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:46:09.250129 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc5c8b4c-010a-4e09-a681-19fe27cea396 None admin] PATH_INFO: `/v3/projects/06e0633a47e74dcfaeccc8794206da96` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:46:09.251292 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc5c8b4c-010a-4e09-a681-19fe27cea396 None admin] RBAC: Authorizing `identity:get_project(project_id=06e0633a47e74dcfaeccc8794206da96)` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:46:09.252724 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc5c8b4c-010a-4e09-a681-19fe27cea396 None admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:46:09.259098 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 219/433] 10.222.0.59 () {56 vars in 1186 bytes} [Thu Jun 2 15:46:09 2022] GET /identity/v3/projects/06e0633a47e74dcfaeccc8794206da96 => generated 298 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 15:46:09.259098 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148289b5-cc4f-48b3-90a2-f6c5f9eb6138 None None] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:46:09.259098 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148289b5-cc4f-48b3-90a2-f6c5f9eb6138 None None] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:46:09.259098 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148289b5-cc4f-48b3-90a2-f6c5f9eb6138 None None] PATH_INFO: `/` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:46:09.259098 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 220/434] 10.222.0.59 () {54 vars in 926 bytes} [Thu Jun 2 15:46:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 15:46:09.259971 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-148289b5-cc4f-48b3-90a2-f6c5f9eb6138 None None] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:46:09.268933 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG dbcounter [-] [80396] Writing DB stats keystone:SELECT=100 {{(pid=80396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:46:09.310606 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9387ceee-7e8f-43ca-9dac-0bcf57d8b74c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:46:09.312471 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9387ceee-7e8f-43ca-9dac-0bcf57d8b74c None admin] RBAC: Authorization granted {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:46:09.372269 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-148289b5-cc4f-48b3-90a2-f6c5f9eb6138 None None] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:46:09.384688 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writing DB stats keystone:SELECT=100 {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:46:09.409327 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e98a77d9-ad17-4903-8558-d252aa6c0413 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:46:09.410206 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98a77d9-ad17-4903-8558-d252aa6c0413 None admin] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:46:09.410494 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98a77d9-ad17-4903-8558-d252aa6c0413 None admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:46:09.410770 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98a77d9-ad17-4903-8558-d252aa6c0413 None admin] PATH_INFO: `/v3/groups/0d56bf165788496982f9b3bbb67c019e` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:46:09.411947 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e98a77d9-ad17-4903-8558-d252aa6c0413 None admin] RBAC: Authorizing `identity:get_group(group_id=0d56bf165788496982f9b3bbb67c019e)` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:46:09.413407 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e98a77d9-ad17-4903-8558-d252aa6c0413 None admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:46:09.415283 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 221/435] 10.222.0.59 () {56 vars in 1180 bytes} [Thu Jun 2 15:46:09 2022] GET /identity/v3/groups/0d56bf165788496982f9b3bbb67c019e => generated 226 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 15:46:09.416259 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caab1bd5-b6ab-45dc-9649-ebf5441d0cb0 None None] REQUEST_METHOD: `POST` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:46:09.416542 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caab1bd5-b6ab-45dc-9649-ebf5441d0cb0 None None] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:46:09.416816 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caab1bd5-b6ab-45dc-9649-ebf5441d0cb0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:46:09.435185 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 215/436] 10.222.0.59 () {58 vars in 1282 bytes} [Thu Jun 2 15:46:09 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 403 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 02 15:46:09.435185 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9387ceee-7e8f-43ca-9dac-0bcf57d8b74c None admin] Authenticating user token {{(pid=80396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:46:09.436523 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.auth.core [None req-caab1bd5-b6ab-45dc-9649-ebf5441d0cb0 None None] MFA Rules not processed for user `400d1f4db9de49638549e5db29a041e1`. Rule list: `[]` (Enabled: `True`). {{(pid=80395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 15:46:09.437797 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.fernet_utils [None req-caab1bd5-b6ab-45dc-9649-ebf5441d0cb0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 15:46:09.503672 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG dbcounter [-] [80396] Writing DB stats keystone:SELECT=100 {{(pid=80396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:46:09.518173 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 222/437] 10.222.0.59 () {58 vars in 1023 bytes} [Thu Jun 2 15:46:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 02 15:46:09.518173 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caab1bd5-b6ab-45dc-9649-ebf5441d0cb0 None None] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:46:09.558811 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9387ceee-7e8f-43ca-9dac-0bcf57d8b74c None admin] Validating token access rules against request {{(pid=80396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:46:09.593366 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ce3802d-d01a-4a87-891f-d4dc18c470d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:46:09.594014 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce3802d-d01a-4a87-891f-d4dc18c470d3 None admin] REQUEST_METHOD: `GET` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:46:09.594336 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce3802d-d01a-4a87-891f-d4dc18c470d3 None admin] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:46:09.594610 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce3802d-d01a-4a87-891f-d4dc18c470d3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:46:09.595429 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ce3802d-d01a-4a87-891f-d4dc18c470d3 None admin] RBAC: Adding query filter params (group.id=0d56bf165788496982f9b3bbb67c019e, role.id=21f49b1aa1e64120b7ef6fcf4667a641, scope.project.id=06e0633a47e74dcfaeccc8794206da96) {{(pid=80396) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 15:46:09.595739 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ce3802d-d01a-4a87-891f-d4dc18c470d3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:46:09.597168 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ce3802d-d01a-4a87-891f-d4dc18c470d3 None admin] RBAC: Authorization granted {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:46:09.603052 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 216/438] 10.222.0.59 () {56 vars in 1376 bytes} [Thu Jun 2 15:46:09 2022] GET /identity/v3/role_assignments?group.id=0d56bf165788496982f9b3bbb67c019e&scope.project.id=06e0633a47e74dcfaeccc8794206da96&role.id=21f49b1aa1e64120b7ef6fcf4667a641 => generated 611 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 15:46:09.607010 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ce3802d-d01a-4a87-891f-d4dc18c470d3 None admin] Authenticating user token {{(pid=80396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:46:09.622659 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caab1bd5-b6ab-45dc-9649-ebf5441d0cb0 None None] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:46:09.635173 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writing DB stats keystone:SELECT=100 {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:46:09.663573 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-594fa251-6d98-4881-9a26-5780200ed27f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:46:09.665388 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-594fa251-6d98-4881-9a26-5780200ed27f None admin] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:46:09.665820 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-594fa251-6d98-4881-9a26-5780200ed27f None admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:46:09.666298 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-594fa251-6d98-4881-9a26-5780200ed27f None admin] PATH_INFO: `/v3/projects/576f2a66e24a468b921fa6cb1e5ff6db` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:46:09.667843 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-594fa251-6d98-4881-9a26-5780200ed27f None admin] RBAC: Authorizing `identity:get_project(project_id=576f2a66e24a468b921fa6cb1e5ff6db)` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:46:09.669524 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-594fa251-6d98-4881-9a26-5780200ed27f None admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:46:09.671571 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 223/439] 10.222.0.59 () {56 vars in 1186 bytes} [Thu Jun 2 15:46:09 2022] GET /identity/v3/projects/576f2a66e24a468b921fa6cb1e5ff6db => generated 302 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 15:46:09.673069 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b23564fb-5121-4002-b86c-ac9afc2022fc None None] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:46:09.673558 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b23564fb-5121-4002-b86c-ac9afc2022fc None None] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:46:09.673844 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b23564fb-5121-4002-b86c-ac9afc2022fc None None] PATH_INFO: `/` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:46:09.679338 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 224/440] 10.222.0.59 () {54 vars in 926 bytes} [Thu Jun 2 15:46:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 15:46:09.679338 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b23564fb-5121-4002-b86c-ac9afc2022fc None None] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:46:09.738796 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ce3802d-d01a-4a87-891f-d4dc18c470d3 None admin] Validating token access rules against request {{(pid=80396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:46:09.769702 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG dbcounter [-] [80396] Writing DB stats keystone:SELECT=100 {{(pid=80396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:46:09.779321 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b8c193a-598e-4041-9764-a42e7c09a5e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:46:09.781735 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b8c193a-598e-4041-9764-a42e7c09a5e6 None admin] REQUEST_METHOD: `GET` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:46:09.781735 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b8c193a-598e-4041-9764-a42e7c09a5e6 None admin] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:46:09.781735 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b8c193a-598e-4041-9764-a42e7c09a5e6 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:46:09.794522 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b8c193a-598e-4041-9764-a42e7c09a5e6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 02 15:46:09.800664 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b23564fb-5121-4002-b86c-ac9afc2022fc None None] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:46:09.803778 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application [None req-5b8c193a-598e-4041-9764-a42e7c09a5e6 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 02 15:46:09.803778 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 15:46:09.803778 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 15:46:09.803778 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 15:46:09.803778 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 15:46:09.803778 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 15:46:09.803778 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 15:46:09.803778 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 15:46:09.803778 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 15:46:09.803778 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 15:46:09.803778 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 15:46:09.803778 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 15:46:09.803778 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 02 15:46:09.803778 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 02 15:46:09.803778 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 02 15:46:09.803778 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 02 15:46:09.804677 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 02 15:46:09.804677 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 02 15:46:09.804677 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 02 15:46:09.804677 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 02 15:46:09.804677 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 15:46:09.804677 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 15:46:09.804677 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 15:46:09.804677 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 15:46:09.804677 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 15:46:09.804677 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 15:46:09.804677 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 15:46:09.804677 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application with Lock( Jun 02 15:46:09.804677 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 15:46:09.804677 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application return self._enter() Jun 02 15:46:09.804677 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 15:46:09.804677 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 15:46:09.805496 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 15:46:09.805496 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application return self.creator() Jun 02 15:46:09.805496 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 15:46:09.805496 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application created_value = creator( Jun 02 15:46:09.805496 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 02 15:46:09.805496 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 02 15:46:09.805496 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 02 15:46:09.805496 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 02 15:46:09.805496 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 02 15:46:09.805496 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 02 15:46:09.805496 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 02 15:46:09.805496 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application Jun 02 15:46:09.806461 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 217/441] 10.222.0.59 () {56 vars in 1114 bytes} [Thu Jun 2 15:46:09 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 15:46:09.806900 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96819e20-cd70-4b98-8488-21f6bff16c85 None None] REQUEST_METHOD: `POST` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:46:09.807190 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96819e20-cd70-4b98-8488-21f6bff16c85 None None] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:46:09.807468 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96819e20-cd70-4b98-8488-21f6bff16c85 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:46:09.824035 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.auth.core [None req-96819e20-cd70-4b98-8488-21f6bff16c85 None None] MFA Rules not processed for user `400d1f4db9de49638549e5db29a041e1`. Rule list: `[]` (Enabled: `True`). {{(pid=80396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 15:46:09.825212 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.fernet_utils [None req-96819e20-cd70-4b98-8488-21f6bff16c85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 15:46:09.844417 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3cd1502-09fc-4cfe-833a-bb31556a48f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:46:09.844610 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3cd1502-09fc-4cfe-833a-bb31556a48f3 None admin] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:46:09.844908 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3cd1502-09fc-4cfe-833a-bb31556a48f3 None admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:46:09.845277 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3cd1502-09fc-4cfe-833a-bb31556a48f3 None admin] PATH_INFO: `/v3/groups/0d56bf165788496982f9b3bbb67c019e` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:46:09.846881 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3cd1502-09fc-4cfe-833a-bb31556a48f3 None admin] RBAC: Authorizing `identity:get_group(group_id=0d56bf165788496982f9b3bbb67c019e)` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:46:09.848103 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3cd1502-09fc-4cfe-833a-bb31556a48f3 None admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:46:09.850368 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 225/442] 10.222.0.59 () {56 vars in 1180 bytes} [Thu Jun 2 15:46:09 2022] GET /identity/v3/groups/0d56bf165788496982f9b3bbb67c019e => generated 226 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 15:46:09.850491 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3cd1502-09fc-4cfe-833a-bb31556a48f3 None admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:46:09.903375 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 218/443] 10.222.0.59 () {58 vars in 1023 bytes} [Thu Jun 2 15:46:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 02 15:46:09.904421 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96819e20-cd70-4b98-8488-21f6bff16c85 None None] Authenticating user token {{(pid=80396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:46:09.909062 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writing DB stats keystone:SELECT=100 {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:46:09.979698 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3cd1502-09fc-4cfe-833a-bb31556a48f3 None admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:46:10.014581 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96819e20-cd70-4b98-8488-21f6bff16c85 None None] Validating token access rules against request {{(pid=80396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:46:10.020654 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aae843d7-fb30-43fa-a0d9-31ed7d6b3302 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:46:10.021271 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae843d7-fb30-43fa-a0d9-31ed7d6b3302 None admin] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:46:10.021545 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae843d7-fb30-43fa-a0d9-31ed7d6b3302 None admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:46:10.021818 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae843d7-fb30-43fa-a0d9-31ed7d6b3302 None admin] PATH_INFO: `/v3/roles` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:46:10.022600 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aae843d7-fb30-43fa-a0d9-31ed7d6b3302 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80395) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 15:46:10.022901 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aae843d7-fb30-43fa-a0d9-31ed7d6b3302 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:46:10.024339 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aae843d7-fb30-43fa-a0d9-31ed7d6b3302 None admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:46:10.033378 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 226/444] 10.222.0.59 () {56 vars in 1111 bytes} [Thu Jun 2 15:46:09 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 15:46:10.034260 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aae843d7-fb30-43fa-a0d9-31ed7d6b3302 None admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:46:10.035076 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG dbcounter [-] [80396] Writing DB stats keystone:SELECT=100 {{(pid=80396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:46:10.053467 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b5c78cd-c440-490b-bbb4-929c93f5ba11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:46:10.054144 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b5c78cd-c440-490b-bbb4-929c93f5ba11 None admin] REQUEST_METHOD: `GET` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:46:10.054587 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b5c78cd-c440-490b-bbb4-929c93f5ba11 None admin] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:46:10.055448 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b5c78cd-c440-490b-bbb4-929c93f5ba11 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:46:10.056288 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b5c78cd-c440-490b-bbb4-929c93f5ba11 None admin] RBAC: Adding query filter params (group.id=0d56bf165788496982f9b3bbb67c019e, role.id=649e0f2b5a264c419ea6a1441f123a03, scope.project.id=576f2a66e24a468b921fa6cb1e5ff6db) {{(pid=80396) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 15:46:10.056579 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b5c78cd-c440-490b-bbb4-929c93f5ba11 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:46:10.057996 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b5c78cd-c440-490b-bbb4-929c93f5ba11 None admin] RBAC: Authorization granted {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:46:10.063734 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 219/445] 10.222.0.59 () {56 vars in 1376 bytes} [Thu Jun 2 15:46:09 2022] GET /identity/v3/role_assignments?group.id=0d56bf165788496982f9b3bbb67c019e&scope.project.id=576f2a66e24a468b921fa6cb1e5ff6db&role.id=649e0f2b5a264c419ea6a1441f123a03 => generated 611 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 15:46:10.064491 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b5c78cd-c440-490b-bbb4-929c93f5ba11 None admin] Authenticating user token {{(pid=80396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:46:10.144536 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aae843d7-fb30-43fa-a0d9-31ed7d6b3302 None admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:46:10.153753 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writing DB stats keystone:SELECT=100 {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:46:10.187097 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9be0d506-ec03-4a10-87da-15635b599535 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:46:10.188429 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be0d506-ec03-4a10-87da-15635b599535 None admin] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:46:10.188540 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b5c78cd-c440-490b-bbb4-929c93f5ba11 None admin] Validating token access rules against request {{(pid=80396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:46:10.188643 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be0d506-ec03-4a10-87da-15635b599535 None admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:46:10.188643 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be0d506-ec03-4a10-87da-15635b599535 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:46:10.204350 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9be0d506-ec03-4a10-87da-15635b599535 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 02 15:46:10.212560 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application [None req-9be0d506-ec03-4a10-87da-15635b599535 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 02 15:46:10.212560 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 15:46:10.212560 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 15:46:10.212560 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 15:46:10.212560 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 15:46:10.212560 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 15:46:10.212560 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 15:46:10.212560 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 15:46:10.212560 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 15:46:10.212560 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 15:46:10.212560 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 15:46:10.212560 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 15:46:10.212560 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 02 15:46:10.212560 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 02 15:46:10.212560 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 02 15:46:10.212560 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 02 15:46:10.214205 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 02 15:46:10.214205 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 02 15:46:10.214205 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 02 15:46:10.214205 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 02 15:46:10.214205 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 15:46:10.214205 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 15:46:10.214205 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 15:46:10.214205 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 15:46:10.214205 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 15:46:10.214205 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 15:46:10.214205 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 15:46:10.214205 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application with Lock( Jun 02 15:46:10.214205 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 15:46:10.214205 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self._enter() Jun 02 15:46:10.214205 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 15:46:10.214205 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 15:46:10.220256 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 15:46:10.220256 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self.creator() Jun 02 15:46:10.220256 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 15:46:10.220256 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application created_value = creator( Jun 02 15:46:10.220256 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 02 15:46:10.220256 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 02 15:46:10.220256 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 02 15:46:10.220256 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 02 15:46:10.220256 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 02 15:46:10.220256 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 02 15:46:10.220256 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 02 15:46:10.220256 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application Jun 02 15:46:10.220256 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 227/446] 10.222.0.59 () {56 vars in 1096 bytes} [Thu Jun 2 15:46:10 2022] GET /identity/v3/roles/admin => generated 83 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 15:46:10.220256 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9be0d506-ec03-4a10-87da-15635b599535 None admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:46:10.235879 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd86218f-8207-47d4-ad1f-3dd5492a9650 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:46:10.236641 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd86218f-8207-47d4-ad1f-3dd5492a9650 None admin] REQUEST_METHOD: `GET` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:46:10.237016 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd86218f-8207-47d4-ad1f-3dd5492a9650 None admin] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:46:10.237355 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd86218f-8207-47d4-ad1f-3dd5492a9650 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:46:10.305118 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG dbcounter [-] [80396] Writing DB stats keystone:SELECT=100 {{(pid=80396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:46:10.326465 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd86218f-8207-47d4-ad1f-3dd5492a9650 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:46:10.327947 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd86218f-8207-47d4-ad1f-3dd5492a9650 None admin] RBAC: Authorization granted {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:46:10.339144 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9be0d506-ec03-4a10-87da-15635b599535 None admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:46:10.377906 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1e43910-4524-42e5-8a17-5bd3af071072 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:46:10.378628 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e43910-4524-42e5-8a17-5bd3af071072 None admin] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:46:10.378914 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e43910-4524-42e5-8a17-5bd3af071072 None admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:46:10.379193 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e43910-4524-42e5-8a17-5bd3af071072 None admin] PATH_INFO: `/v3/roles` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:46:10.379963 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1e43910-4524-42e5-8a17-5bd3af071072 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80395) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 15:46:10.380272 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1e43910-4524-42e5-8a17-5bd3af071072 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:46:10.381714 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1e43910-4524-42e5-8a17-5bd3af071072 None admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:46:10.392173 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 228/447] 10.222.0.59 () {56 vars in 1099 bytes} [Thu Jun 2 15:46:10 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 15:46:10.397706 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1e43910-4524-42e5-8a17-5bd3af071072 None admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:46:10.433518 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writing DB stats keystone:SELECT=100 {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:46:10.512300 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1e43910-4524-42e5-8a17-5bd3af071072 None admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:46:10.544636 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf2ca17f-350d-402d-a151-93c32c054803 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:46:10.545276 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf2ca17f-350d-402d-a151-93c32c054803 None admin] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:46:10.545556 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf2ca17f-350d-402d-a151-93c32c054803 None admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:46:10.545829 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf2ca17f-350d-402d-a151-93c32c054803 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:46:10.559356 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 220/448] 10.222.0.59 () {58 vars in 1282 bytes} [Thu Jun 2 15:46:10 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 495 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 02 15:46:10.564760 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd86218f-8207-47d4-ad1f-3dd5492a9650 None admin] Authenticating user token {{(pid=80396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:46:10.611359 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf2ca17f-350d-402d-a151-93c32c054803 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:46:10.612835 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf2ca17f-350d-402d-a151-93c32c054803 None admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:46:10.638913 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writing DB stats keystone:SELECT=100 {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:46:10.645953 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG dbcounter [-] [80396] Writing DB stats keystone:SELECT=100 {{(pid=80396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:46:10.663739 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd86218f-8207-47d4-ad1f-3dd5492a9650 None admin] Validating token access rules against request {{(pid=80396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:46:10.697066 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-577cd07a-c722-4163-a886-d8734d7ba53c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:46:10.697918 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-577cd07a-c722-4163-a886-d8734d7ba53c None admin] REQUEST_METHOD: `GET` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:46:10.698235 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-577cd07a-c722-4163-a886-d8734d7ba53c None admin] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:46:10.698508 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-577cd07a-c722-4163-a886-d8734d7ba53c None admin] PATH_INFO: `/v3/projects/576f2a66e24a468b921fa6cb1e5ff6db` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:46:10.699709 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-577cd07a-c722-4163-a886-d8734d7ba53c None admin] RBAC: Authorizing `identity:get_project(project_id=576f2a66e24a468b921fa6cb1e5ff6db)` {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:46:10.701186 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-577cd07a-c722-4163-a886-d8734d7ba53c None admin] RBAC: Authorization granted {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:46:10.707346 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 221/449] 10.222.0.59 () {56 vars in 1186 bytes} [Thu Jun 2 15:46:10 2022] GET /identity/v3/projects/576f2a66e24a468b921fa6cb1e5ff6db => generated 302 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 15:46:10.708269 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-577cd07a-c722-4163-a886-d8734d7ba53c None admin] Authenticating user token {{(pid=80396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:46:10.714128 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 229/450] 10.222.0.59 () {58 vars in 1282 bytes} [Thu Jun 2 15:46:10 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jun 02 15:46:10.715123 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf2ca17f-350d-402d-a151-93c32c054803 None admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:46:10.808565 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-577cd07a-c722-4163-a886-d8734d7ba53c None admin] Validating token access rules against request {{(pid=80396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:46:10.817485 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf2ca17f-350d-402d-a151-93c32c054803 None admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:46:10.841882 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f451781-7e5c-4189-92be-eb10a6eb8de5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:46:10.842754 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f451781-7e5c-4189-92be-eb10a6eb8de5 None admin] REQUEST_METHOD: `GET` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:46:10.843033 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f451781-7e5c-4189-92be-eb10a6eb8de5 None admin] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:46:10.843307 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f451781-7e5c-4189-92be-eb10a6eb8de5 None admin] PATH_INFO: `/v3/groups/0d56bf165788496982f9b3bbb67c019e` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:46:10.844132 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writing DB stats keystone:SELECT=100 {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:46:10.844465 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f451781-7e5c-4189-92be-eb10a6eb8de5 None admin] RBAC: Authorizing `identity:get_group(group_id=0d56bf165788496982f9b3bbb67c019e)` {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:46:10.845881 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f451781-7e5c-4189-92be-eb10a6eb8de5 None admin] RBAC: Authorization granted {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:46:10.847509 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 222/451] 10.222.0.59 () {56 vars in 1180 bytes} [Thu Jun 2 15:46:10 2022] GET /identity/v3/groups/0d56bf165788496982f9b3bbb67c019e => generated 226 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 15:46:10.853294 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f451781-7e5c-4189-92be-eb10a6eb8de5 None admin] Authenticating user token {{(pid=80396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:46:10.856725 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46983efa-175a-45e0-a3cf-52027c232dbc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:46:10.857572 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46983efa-175a-45e0-a3cf-52027c232dbc None admin] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:46:10.857855 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46983efa-175a-45e0-a3cf-52027c232dbc None admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:46:10.858156 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46983efa-175a-45e0-a3cf-52027c232dbc None admin] PATH_INFO: `/v3/projects/4f73d5a98be74242b45222df39fb6213` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:46:10.859332 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46983efa-175a-45e0-a3cf-52027c232dbc None admin] RBAC: Authorizing `identity:get_project(project_id=4f73d5a98be74242b45222df39fb6213)` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:46:10.860763 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46983efa-175a-45e0-a3cf-52027c232dbc None admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:46:10.862462 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 230/452] 10.222.0.59 () {56 vars in 1186 bytes} [Thu Jun 2 15:46:10 2022] GET /identity/v3/projects/4f73d5a98be74242b45222df39fb6213 => generated 344 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 15:46:10.867591 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46983efa-175a-45e0-a3cf-52027c232dbc None admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:46:10.874215 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG dbcounter [-] [80396] Writing DB stats keystone:SELECT=100 {{(pid=80396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:46:10.954439 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f451781-7e5c-4189-92be-eb10a6eb8de5 None admin] Validating token access rules against request {{(pid=80396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:46:10.964584 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46983efa-175a-45e0-a3cf-52027c232dbc None admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:46:10.987387 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-519119a7-9f8e-44ca-ba21-32b48b131f5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:46:10.988025 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519119a7-9f8e-44ca-ba21-32b48b131f5d None admin] REQUEST_METHOD: `GET` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:46:10.988300 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519119a7-9f8e-44ca-ba21-32b48b131f5d None admin] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:46:10.988569 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519119a7-9f8e-44ca-ba21-32b48b131f5d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:46:10.989382 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-519119a7-9f8e-44ca-ba21-32b48b131f5d None admin] RBAC: Adding query filter params (group.id=0d56bf165788496982f9b3bbb67c019e, role.id=21f49b1aa1e64120b7ef6fcf4667a641, scope.project.id=576f2a66e24a468b921fa6cb1e5ff6db) {{(pid=80396) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 15:46:10.989685 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-519119a7-9f8e-44ca-ba21-32b48b131f5d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:46:10.991136 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-519119a7-9f8e-44ca-ba21-32b48b131f5d None admin] RBAC: Authorization granted {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:46:10.997554 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 223/453] 10.222.0.59 () {56 vars in 1376 bytes} [Thu Jun 2 15:46:10 2022] GET /identity/v3/role_assignments?group.id=0d56bf165788496982f9b3bbb67c019e&scope.project.id=576f2a66e24a468b921fa6cb1e5ff6db&role.id=21f49b1aa1e64120b7ef6fcf4667a641 => generated 611 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 15:46:10.999391 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d26172b-2669-44ba-9d3a-bf661c86717c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:46:11.000236 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d26172b-2669-44ba-9d3a-bf661c86717c None admin] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:46:11.000515 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d26172b-2669-44ba-9d3a-bf661c86717c None admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:46:11.000787 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d26172b-2669-44ba-9d3a-bf661c86717c None admin] PATH_INFO: `/v3/groups/c4ad9096c9d745c18573493d0f5b33ed` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:46:11.001985 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d26172b-2669-44ba-9d3a-bf661c86717c None admin] RBAC: Authorizing `identity:get_group(group_id=c4ad9096c9d745c18573493d0f5b33ed)` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:46:11.003482 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d26172b-2669-44ba-9d3a-bf661c86717c None admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:46:11.005142 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 231/454] 10.222.0.59 () {56 vars in 1180 bytes} [Thu Jun 2 15:46:10 2022] GET /identity/v3/groups/c4ad9096c9d745c18573493d0f5b33ed => generated 229 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 15:46:11.011273 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-519119a7-9f8e-44ca-ba21-32b48b131f5d None admin] Authenticating user token {{(pid=80396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:46:11.097231 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG dbcounter [-] [80396] Writing DB stats keystone:SELECT=100 {{(pid=80396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:46:11.117042 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-519119a7-9f8e-44ca-ba21-32b48b131f5d None admin] Validating token access rules against request {{(pid=80396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:46:11.153718 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54696029-dcff-465c-b111-8658df36804b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:46:11.154419 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54696029-dcff-465c-b111-8658df36804b None admin] REQUEST_METHOD: `GET` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:46:11.154704 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54696029-dcff-465c-b111-8658df36804b None admin] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:46:11.155011 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54696029-dcff-465c-b111-8658df36804b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:46:11.155849 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54696029-dcff-465c-b111-8658df36804b None admin] RBAC: Adding query filter params (group.id=c4ad9096c9d745c18573493d0f5b33ed, role.id=f1e0c25f6e9049e897cb7350c7e54ab3, scope.project.id=4f73d5a98be74242b45222df39fb6213) {{(pid=80396) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 15:46:11.156161 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54696029-dcff-465c-b111-8658df36804b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:46:11.157604 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54696029-dcff-465c-b111-8658df36804b None admin] RBAC: Authorization granted {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:46:11.164858 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 224/455] 10.222.0.59 () {56 vars in 1376 bytes} [Thu Jun 2 15:46:11 2022] GET /identity/v3/role_assignments?group.id=c4ad9096c9d745c18573493d0f5b33ed&scope.project.id=4f73d5a98be74242b45222df39fb6213&role.id=f1e0c25f6e9049e897cb7350c7e54ab3 => generated 611 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 15:46:13.926906 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34df423f-8a2f-48fc-8a33-bb1a114765f2 None None] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:46:13.927439 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34df423f-8a2f-48fc-8a33-bb1a114765f2 None None] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:46:13.927439 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34df423f-8a2f-48fc-8a33-bb1a114765f2 None None] PATH_INFO: `/` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:46:13.929043 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 232/456] 10.222.0.59 () {54 vars in 926 bytes} [Thu Jun 2 15:46:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 15:46:13.948846 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205a5a0f-2cd6-4105-a227-29990d25a727 None None] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:46:13.949503 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205a5a0f-2cd6-4105-a227-29990d25a727 None None] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:46:13.949987 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205a5a0f-2cd6-4105-a227-29990d25a727 None None] PATH_INFO: `/` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:46:13.952002 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 233/457] 10.222.0.59 () {54 vars in 926 bytes} [Thu Jun 2 15:46:13 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 15:46:13.953685 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7471b203-a808-42c5-9c80-9f06b4c36439 None None] REQUEST_METHOD: `POST` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:46:13.954544 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7471b203-a808-42c5-9c80-9f06b4c36439 None None] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:46:13.955039 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7471b203-a808-42c5-9c80-9f06b4c36439 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:46:13.956967 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f31238-25bf-4486-b637-89d3b932da25 None None] REQUEST_METHOD: `POST` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:46:13.957474 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f31238-25bf-4486-b637-89d3b932da25 None None] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:46:13.957979 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f31238-25bf-4486-b637-89d3b932da25 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:46:13.989772 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.auth.core [None req-a1f31238-25bf-4486-b637-89d3b932da25 None None] MFA Rules not processed for user `400d1f4db9de49638549e5db29a041e1`. Rule list: `[]` (Enabled: `True`). {{(pid=80395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 15:46:13.991318 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.fernet_utils [None req-a1f31238-25bf-4486-b637-89d3b932da25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 15:46:13.992506 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.auth.core [None req-7471b203-a808-42c5-9c80-9f06b4c36439 None None] MFA Rules not processed for user `400d1f4db9de49638549e5db29a041e1`. Rule list: `[]` (Enabled: `True`). {{(pid=80396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 15:46:13.997986 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.fernet_utils [None req-7471b203-a808-42c5-9c80-9f06b4c36439 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 15:46:14.111819 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writing DB stats keystone:SELECT=100 {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:46:14.123933 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 225/458] 10.222.0.59 () {58 vars in 1023 bytes} [Thu Jun 2 15:46:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 02 15:46:14.127790 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 234/459] 10.222.0.59 () {58 vars in 1023 bytes} [Thu Jun 2 15:46:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 02 15:46:14.149294 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7471b203-a808-42c5-9c80-9f06b4c36439 None None] Authenticating user token {{(pid=80396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:46:14.157490 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f31238-25bf-4486-b637-89d3b932da25 None None] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:46:14.234616 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG dbcounter [-] [80396] Writing DB stats keystone:SELECT=100 {{(pid=80396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:46:14.261295 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7471b203-a808-42c5-9c80-9f06b4c36439 None None] Validating token access rules against request {{(pid=80396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:46:14.300495 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48f5d4ad-d725-4ebb-94aa-42692ad95a85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:46:14.301356 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f5d4ad-d725-4ebb-94aa-42692ad95a85 None admin] REQUEST_METHOD: `GET` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:46:14.301642 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f5d4ad-d725-4ebb-94aa-42692ad95a85 None admin] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:46:14.301979 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f5d4ad-d725-4ebb-94aa-42692ad95a85 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:46:14.307218 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f31238-25bf-4486-b637-89d3b932da25 None None] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:46:14.313363 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48f5d4ad-d725-4ebb-94aa-42692ad95a85 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:46:14.315355 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48f5d4ad-d725-4ebb-94aa-42692ad95a85 None admin] RBAC: Authorization granted {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:46:14.336436 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application [None req-48f5d4ad-d725-4ebb-94aa-42692ad95a85 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 15:46:14.336436 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 15:46:14.336436 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 15:46:14.336436 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 15:46:14.336436 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 15:46:14.336436 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 15:46:14.336436 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 15:46:14.336436 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 15:46:14.336436 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 15:46:14.336436 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 15:46:14.336436 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 15:46:14.336436 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 15:46:14.336436 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 02 15:46:14.336436 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 02 15:46:14.336436 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 02 15:46:14.337515 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 02 15:46:14.337515 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 15:46:14.337515 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 15:46:14.337515 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 15:46:14.337515 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 15:46:14.337515 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 15:46:14.337515 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 15:46:14.337515 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 15:46:14.337515 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application with Lock( Jun 02 15:46:14.337515 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 15:46:14.337515 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application return self._enter() Jun 02 15:46:14.337515 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 15:46:14.337515 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 15:46:14.337515 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 15:46:14.337515 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application return self.creator() Jun 02 15:46:14.337515 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 15:46:14.337515 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application created_value = creator( Jun 02 15:46:14.338853 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 02 15:46:14.338853 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 02 15:46:14.338853 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 15:46:14.338853 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application Jun 02 15:46:14.345344 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 226/460] 10.222.0.59 () {56 vars in 1108 bytes} [Thu Jun 2 15:46:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 15:46:14.351519 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2887c1f-108c-4d40-9556-48f3a8b1b698 None None] REQUEST_METHOD: `GET` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:46:14.351519 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2887c1f-108c-4d40-9556-48f3a8b1b698 None None] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:46:14.351519 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2887c1f-108c-4d40-9556-48f3a8b1b698 None None] PATH_INFO: `/` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:46:14.351742 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36e100d0-2e56-4aa8-9175-d6d0418615cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:46:14.351854 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 227/461] 10.222.0.59 () {54 vars in 926 bytes} [Thu Jun 2 15:46:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 15:46:14.351854 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2887c1f-108c-4d40-9556-48f3a8b1b698 None None] Authenticating user token {{(pid=80396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:46:14.352061 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e100d0-2e56-4aa8-9175-d6d0418615cb None admin] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:46:14.352061 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e100d0-2e56-4aa8-9175-d6d0418615cb None admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:46:14.352061 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e100d0-2e56-4aa8-9175-d6d0418615cb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:46:14.363312 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36e100d0-2e56-4aa8-9175-d6d0418615cb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:46:14.365416 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36e100d0-2e56-4aa8-9175-d6d0418615cb None admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:46:14.388902 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application [None req-36e100d0-2e56-4aa8-9175-d6d0418615cb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 15:46:14.388902 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 15:46:14.388902 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 15:46:14.388902 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 15:46:14.388902 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 15:46:14.388902 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 15:46:14.388902 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 15:46:14.388902 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 15:46:14.388902 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 15:46:14.388902 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 15:46:14.388902 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 15:46:14.388902 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 15:46:14.388902 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 02 15:46:14.388902 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 02 15:46:14.388902 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 02 15:46:14.389823 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 02 15:46:14.389823 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 15:46:14.389823 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 15:46:14.389823 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 15:46:14.389823 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 15:46:14.389823 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 15:46:14.389823 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 15:46:14.389823 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 15:46:14.389823 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application with Lock( Jun 02 15:46:14.389823 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 15:46:14.389823 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self._enter() Jun 02 15:46:14.389823 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 15:46:14.389823 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 15:46:14.389823 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 15:46:14.389823 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self.creator() Jun 02 15:46:14.389823 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 15:46:14.389823 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application created_value = creator( Jun 02 15:46:14.391129 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 02 15:46:14.391129 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 02 15:46:14.391129 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 15:46:14.391129 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application Jun 02 15:46:14.394147 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 235/462] 10.222.0.59 () {56 vars in 1108 bytes} [Thu Jun 2 15:46:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 233 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 02 15:46:14.395641 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff0ced9-5e02-4e38-84bf-2d332486aa06 None None] REQUEST_METHOD: `POST` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:46:14.395933 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff0ced9-5e02-4e38-84bf-2d332486aa06 None None] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:46:14.396215 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff0ced9-5e02-4e38-84bf-2d332486aa06 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:46:14.417260 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.auth.core [None req-4ff0ced9-5e02-4e38-84bf-2d332486aa06 None None] MFA Rules not processed for user `400d1f4db9de49638549e5db29a041e1`. Rule list: `[]` (Enabled: `True`). {{(pid=80395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 15:46:14.419234 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.fernet_utils [None req-4ff0ced9-5e02-4e38-84bf-2d332486aa06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 15:46:14.471786 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2887c1f-108c-4d40-9556-48f3a8b1b698 None None] Validating token access rules against request {{(pid=80396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:46:14.479625 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writing DB stats keystone:SELECT=100 {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:46:14.502416 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG dbcounter [-] [80396] Writing DB stats keystone:SELECT=100 {{(pid=80396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:46:14.511996 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 236/463] 10.222.0.59 () {58 vars in 1023 bytes} [Thu Jun 2 15:46:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 02 15:46:14.512407 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbc16376-dfc9-4d55-a03e-f7191a3e562a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:46:14.513172 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc16376-dfc9-4d55-a03e-f7191a3e562a None admin] REQUEST_METHOD: `GET` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:46:14.513530 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc16376-dfc9-4d55-a03e-f7191a3e562a None admin] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:46:14.513773 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ff0ced9-5e02-4e38-84bf-2d332486aa06 None None] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:46:14.513873 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc16376-dfc9-4d55-a03e-f7191a3e562a None admin] PATH_INFO: `/v3/domains` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:46:14.514777 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbc16376-dfc9-4d55-a03e-f7191a3e562a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80396) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 15:46:14.515216 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbc16376-dfc9-4d55-a03e-f7191a3e562a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:46:14.516869 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbc16376-dfc9-4d55-a03e-f7191a3e562a None admin] RBAC: Authorization granted {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:46:14.531371 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 228/464] 10.222.0.59 () {56 vars in 1109 bytes} [Thu Jun 2 15:46:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 15:46:14.536757 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbc16376-dfc9-4d55-a03e-f7191a3e562a None admin] Authenticating user token {{(pid=80396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:46:14.642933 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ff0ced9-5e02-4e38-84bf-2d332486aa06 None None] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:46:14.661975 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbc16376-dfc9-4d55-a03e-f7191a3e562a None admin] Validating token access rules against request {{(pid=80396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:46:14.681336 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f773db0-65f7-43aa-ab73-dbfed8065506 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:46:14.682285 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f773db0-65f7-43aa-ab73-dbfed8065506 None admin] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:46:14.682674 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f773db0-65f7-43aa-ab73-dbfed8065506 None admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:46:14.683051 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f773db0-65f7-43aa-ab73-dbfed8065506 None admin] PATH_INFO: `/v3/domains` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:46:14.683883 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f773db0-65f7-43aa-ab73-dbfed8065506 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80395) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 15:46:14.684290 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f773db0-65f7-43aa-ab73-dbfed8065506 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:46:14.685869 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f773db0-65f7-43aa-ab73-dbfed8065506 None admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:46:14.703508 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 237/465] 10.222.0.59 () {56 vars in 1109 bytes} [Thu Jun 2 15:46:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 15:46:14.703508 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f773db0-65f7-43aa-ab73-dbfed8065506 None admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:46:14.706314 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad03796c-fdbb-42f1-9da6-4935565cafae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:46:14.707211 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad03796c-fdbb-42f1-9da6-4935565cafae None admin] REQUEST_METHOD: `POST` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:46:14.707502 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad03796c-fdbb-42f1-9da6-4935565cafae None admin] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:46:14.707785 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad03796c-fdbb-42f1-9da6-4935565cafae None admin] PATH_INFO: `/v3/users` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:46:14.708506 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad03796c-fdbb-42f1-9da6-4935565cafae None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:46:14.711110 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad03796c-fdbb-42f1-9da6-4935565cafae None admin] RBAC: Authorization granted {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:46:14.744847 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writing DB stats keystone:SELECT=100 {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:46:14.810449 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f773db0-65f7-43aa-ab73-dbfed8065506 None admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:46:14.822770 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 229/466] 10.222.0.59 () {60 vars in 1132 bytes} [Thu Jun 2 15:46:14 2022] POST /identity/v3/users => generated 246 bytes in 280 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 02 15:46:14.822770 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad03796c-fdbb-42f1-9da6-4935565cafae None admin] Authenticating user token {{(pid=80396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:46:14.888012 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-584818e6-38e2-445f-9732-f2475967ad02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:46:14.888822 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584818e6-38e2-445f-9732-f2475967ad02 None admin] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:46:14.889106 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584818e6-38e2-445f-9732-f2475967ad02 None admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:46:14.889382 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584818e6-38e2-445f-9732-f2475967ad02 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:46:14.911203 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-584818e6-38e2-445f-9732-f2475967ad02 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:46:14.918209 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-584818e6-38e2-445f-9732-f2475967ad02 None admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:46:14.934267 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG dbcounter [-] [80396] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:46:14.952817 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application [None req-584818e6-38e2-445f-9732-f2475967ad02 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 15:46:14.952817 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 15:46:14.952817 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 15:46:14.952817 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 15:46:14.952817 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 15:46:14.952817 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 15:46:14.952817 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 15:46:14.952817 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 15:46:14.952817 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 15:46:14.952817 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 15:46:14.952817 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 15:46:14.952817 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 15:46:14.952817 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 02 15:46:14.952817 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 02 15:46:14.952817 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 02 15:46:14.954090 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 02 15:46:14.954090 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 15:46:14.954090 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 15:46:14.954090 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 15:46:14.954090 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 15:46:14.954090 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 15:46:14.954090 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 15:46:14.954090 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 15:46:14.954090 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application with Lock( Jun 02 15:46:14.954090 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 15:46:14.954090 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self._enter() Jun 02 15:46:14.954090 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 15:46:14.954090 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 15:46:14.954090 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 15:46:14.954090 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self.creator() Jun 02 15:46:14.954090 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 15:46:14.954090 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application created_value = creator( Jun 02 15:46:14.954940 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 02 15:46:14.954940 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 02 15:46:14.954940 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 15:46:14.954940 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application Jun 02 15:46:14.956294 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 238/467] 10.222.0.59 () {56 vars in 1108 bytes} [Thu Jun 2 15:46:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 256 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 15:46:14.957415 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1f3971-2880-465e-a852-dc22c3b9c9ae None None] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:46:14.957705 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1f3971-2880-465e-a852-dc22c3b9c9ae None None] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:46:14.957980 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1f3971-2880-465e-a852-dc22c3b9c9ae None None] PATH_INFO: `/` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:46:14.959570 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 239/468] 10.222.0.59 () {54 vars in 926 bytes} [Thu Jun 2 15:46:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 15:46:14.963499 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b1f3971-2880-465e-a852-dc22c3b9c9ae None None] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:46:15.022400 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad03796c-fdbb-42f1-9da6-4935565cafae None admin] Validating token access rules against request {{(pid=80396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:46:15.061652 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67935caa-87ef-41dd-8817-f9b44c984b9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:46:15.062677 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67935caa-87ef-41dd-8817-f9b44c984b9a None admin] REQUEST_METHOD: `POST` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:46:15.063189 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67935caa-87ef-41dd-8817-f9b44c984b9a None admin] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:46:15.063664 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67935caa-87ef-41dd-8817-f9b44c984b9a None admin] PATH_INFO: `/v3/users` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:46:15.064568 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67935caa-87ef-41dd-8817-f9b44c984b9a None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:46:15.066360 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67935caa-87ef-41dd-8817-f9b44c984b9a None admin] RBAC: Authorization granted {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:46:15.086331 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writing DB stats keystone:SELECT=100 {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:46:15.102645 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b1f3971-2880-465e-a852-dc22c3b9c9ae None None] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:46:15.139261 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-922f0063-7b8f-4464-aef9-c115062b7b8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:46:15.140232 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922f0063-7b8f-4464-aef9-c115062b7b8a None admin] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:46:15.140518 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922f0063-7b8f-4464-aef9-c115062b7b8a None admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:46:15.140797 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922f0063-7b8f-4464-aef9-c115062b7b8a None admin] PATH_INFO: `/v3/domains` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:46:15.141526 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-922f0063-7b8f-4464-aef9-c115062b7b8a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80395) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 15:46:15.141836 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-922f0063-7b8f-4464-aef9-c115062b7b8a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:46:15.143336 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-922f0063-7b8f-4464-aef9-c115062b7b8a None admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:46:15.151438 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 230/469] 10.222.0.59 () {60 vars in 1132 bytes} [Thu Jun 2 15:46:14 2022] POST /identity/v3/users => generated 248 bytes in 328 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 15:46:15.153137 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f0589d2-4e8a-413d-90cc-92b32e82d41a None None] REQUEST_METHOD: `POST` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:46:15.153428 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f0589d2-4e8a-413d-90cc-92b32e82d41a None None] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:46:15.153705 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f0589d2-4e8a-413d-90cc-92b32e82d41a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:46:15.166281 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 240/470] 10.222.0.59 () {56 vars in 1109 bytes} [Thu Jun 2 15:46:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 15:46:15.178106 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-922f0063-7b8f-4464-aef9-c115062b7b8a None admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:46:15.189353 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.auth.core [None req-4f0589d2-4e8a-413d-90cc-92b32e82d41a None None] MFA Rules not processed for user `400d1f4db9de49638549e5db29a041e1`. Rule list: `[]` (Enabled: `True`). {{(pid=80396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 15:46:15.190383 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.fernet_utils [None req-4f0589d2-4e8a-413d-90cc-92b32e82d41a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 15:46:15.268159 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 231/471] 10.222.0.59 () {58 vars in 1023 bytes} [Thu Jun 2 15:46:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 02 15:46:15.269541 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be63c8c-ce98-49bd-b4d8-af625fb7b949 None None] REQUEST_METHOD: `GET` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:46:15.269829 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be63c8c-ce98-49bd-b4d8-af625fb7b949 None None] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:46:15.278184 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be63c8c-ce98-49bd-b4d8-af625fb7b949 None None] PATH_INFO: `/` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:46:15.280100 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 232/472] 10.222.0.59 () {54 vars in 926 bytes} [Thu Jun 2 15:46:15 2022] GET /identity => generated 270 bytes in 11 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 15:46:15.287575 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c27c6e25-f93e-49a1-93d6-f2268ca7c4af None None] REQUEST_METHOD: `POST` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:46:15.287903 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c27c6e25-f93e-49a1-93d6-f2268ca7c4af None None] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:46:15.288144 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c27c6e25-f93e-49a1-93d6-f2268ca7c4af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:46:15.307821 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-922f0063-7b8f-4464-aef9-c115062b7b8a None admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:46:15.317471 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.auth.core [None req-c27c6e25-f93e-49a1-93d6-f2268ca7c4af None None] MFA Rules not processed for user `400d1f4db9de49638549e5db29a041e1`. Rule list: `[]` (Enabled: `True`). {{(pid=80396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 15:46:15.318624 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.fernet_utils [None req-c27c6e25-f93e-49a1-93d6-f2268ca7c4af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 15:46:15.349399 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94310257-e0f9-4bdf-bf0b-14d1509fcdd7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:46:15.350486 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94310257-e0f9-4bdf-bf0b-14d1509fcdd7 None admin] REQUEST_METHOD: `POST` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:46:15.351105 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94310257-e0f9-4bdf-bf0b-14d1509fcdd7 None admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:46:15.351387 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94310257-e0f9-4bdf-bf0b-14d1509fcdd7 None admin] PATH_INFO: `/v3/users` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:46:15.352216 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94310257-e0f9-4bdf-bf0b-14d1509fcdd7 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:46:15.352923 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG dbcounter [-] [80396] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:46:15.354636 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94310257-e0f9-4bdf-bf0b-14d1509fcdd7 None admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:46:15.401079 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 233/473] 10.222.0.59 () {58 vars in 1023 bytes} [Thu Jun 2 15:46:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 02 15:46:15.401999 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c27c6e25-f93e-49a1-93d6-f2268ca7c4af None None] Authenticating user token {{(pid=80396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:46:15.445696 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 241/474] 10.222.0.59 () {60 vars in 1132 bytes} [Thu Jun 2 15:46:15 2022] POST /identity/v3/users => generated 248 bytes in 273 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 15:46:15.447057 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94310257-e0f9-4bdf-bf0b-14d1509fcdd7 None admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:46:15.451278 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:46:15.518588 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c27c6e25-f93e-49a1-93d6-f2268ca7c4af None None] Validating token access rules against request {{(pid=80396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:46:15.555809 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ed7350c-703d-46ab-9e2a-b95d47dc9d3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:46:15.556686 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed7350c-703d-46ab-9e2a-b95d47dc9d3d None admin] REQUEST_METHOD: `GET` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:46:15.556969 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed7350c-703d-46ab-9e2a-b95d47dc9d3d None admin] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:46:15.557294 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed7350c-703d-46ab-9e2a-b95d47dc9d3d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:46:15.565025 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94310257-e0f9-4bdf-bf0b-14d1509fcdd7 None admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:46:15.569600 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ed7350c-703d-46ab-9e2a-b95d47dc9d3d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:46:15.570730 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ed7350c-703d-46ab-9e2a-b95d47dc9d3d None admin] RBAC: Authorization granted {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:46:15.590317 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application [None req-7ed7350c-703d-46ab-9e2a-b95d47dc9d3d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 15:46:15.590317 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 15:46:15.590317 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 15:46:15.590317 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 15:46:15.590317 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 15:46:15.590317 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 15:46:15.590317 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 15:46:15.590317 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 15:46:15.590317 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 15:46:15.590317 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 15:46:15.590317 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 15:46:15.590317 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 15:46:15.590317 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 02 15:46:15.590317 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 02 15:46:15.590317 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 02 15:46:15.591229 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 02 15:46:15.591229 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 15:46:15.591229 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 15:46:15.591229 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 15:46:15.591229 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 15:46:15.591229 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 15:46:15.591229 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 15:46:15.591229 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 15:46:15.591229 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application with Lock( Jun 02 15:46:15.591229 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 15:46:15.591229 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application return self._enter() Jun 02 15:46:15.591229 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 15:46:15.591229 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 15:46:15.591229 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 15:46:15.591229 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application return self.creator() Jun 02 15:46:15.591229 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 15:46:15.591229 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application created_value = creator( Jun 02 15:46:15.592065 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 02 15:46:15.592065 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 02 15:46:15.592065 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 15:46:15.592065 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application Jun 02 15:46:15.592065 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 234/475] 10.222.0.59 () {56 vars in 1108 bytes} [Thu Jun 2 15:46:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 15:46:15.598491 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ed7350c-703d-46ab-9e2a-b95d47dc9d3d None admin] Authenticating user token {{(pid=80396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:46:15.620705 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c4df1c7-4e1f-4290-b334-febfb8d026e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:46:15.625974 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c4df1c7-4e1f-4290-b334-febfb8d026e7 None admin] REQUEST_METHOD: `POST` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:46:15.626397 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c4df1c7-4e1f-4290-b334-febfb8d026e7 None admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:46:15.626686 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c4df1c7-4e1f-4290-b334-febfb8d026e7 None admin] PATH_INFO: `/v3/roles` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:46:15.627505 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c4df1c7-4e1f-4290-b334-febfb8d026e7 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:46:15.628968 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c4df1c7-4e1f-4290-b334-febfb8d026e7 None admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:46:15.639809 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG dbcounter [-] [80396] Writing DB stats keystone:SELECT=100 {{(pid=80396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:46:15.673367 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.sql.core [None req-9c4df1c7-4e1f-4290-b334-febfb8d026e7 None admin] Conflict role: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Jun 02 15:46:15.673367 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Jun 02 15:46:15.673367 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [parameters: {'id': '251301b0950f405a929fce53879a744e', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Jun 02 15:46:15.673367 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=80395) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Jun 02 15:46:15.700871 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application [None req-9c4df1c7-4e1f-4290-b334-febfb8d026e7 None admin] Conflict occurred attempting to store role - Duplicate entry found with name anotherrole.: keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Jun 02 15:46:15.700871 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 15:46:15.700871 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jun 02 15:46:15.700871 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application self.dialect.do_execute( Jun 02 15:46:15.700871 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jun 02 15:46:15.700871 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jun 02 15:46:15.700871 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jun 02 15:46:15.700871 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application result = self._query(query) Jun 02 15:46:15.700871 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jun 02 15:46:15.700871 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application conn.query(q) Jun 02 15:46:15.700871 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jun 02 15:46:15.700871 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jun 02 15:46:15.700871 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jun 02 15:46:15.700871 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application result.read() Jun 02 15:46:15.700871 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jun 02 15:46:15.702739 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jun 02 15:46:15.702739 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jun 02 15:46:15.702739 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application packet.raise_for_error() Jun 02 15:46:15.702739 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jun 02 15:46:15.702739 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jun 02 15:46:15.702739 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jun 02 15:46:15.702739 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jun 02 15:46:15.702739 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Jun 02 15:46:15.702739 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application Jun 02 15:46:15.702739 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Jun 02 15:46:15.702739 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application Jun 02 15:46:15.702739 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 15:46:15.702739 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Jun 02 15:46:15.702739 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return method(*args, **kwargs) Jun 02 15:46:15.702739 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 33, in create_role Jun 02 15:46:15.702739 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return ref.to_dict() Jun 02 15:46:15.702739 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jun 02 15:46:15.702739 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application next(self.gen) Jun 02 15:46:15.704911 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Jun 02 15:46:15.704911 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application yield resource Jun 02 15:46:15.704911 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jun 02 15:46:15.704911 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application next(self.gen) Jun 02 15:46:15.704911 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Jun 02 15:46:15.704911 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application self.session.rollback() Jun 02 15:46:15.704911 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jun 02 15:46:15.704911 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application self.force_reraise() Jun 02 15:46:15.704911 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jun 02 15:46:15.704911 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application raise self.value Jun 02 15:46:15.704911 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Jun 02 15:46:15.704911 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Jun 02 15:46:15.704911 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Jun 02 15:46:15.704911 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application session.commit() Jun 02 15:46:15.704911 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1435, in commit Jun 02 15:46:15.704911 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Jun 02 15:46:15.704911 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Jun 02 15:46:15.706997 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application self._prepare_impl() Jun 02 15:46:15.706997 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Jun 02 15:46:15.706997 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application self.session.flush() Jun 02 15:46:15.706997 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3367, in flush Jun 02 15:46:15.706997 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application self._flush(objects) Jun 02 15:46:15.706997 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3507, in _flush Jun 02 15:46:15.706997 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Jun 02 15:46:15.706997 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Jun 02 15:46:15.706997 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application compat.raise_( Jun 02 15:46:15.706997 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ Jun 02 15:46:15.706997 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application raise exception Jun 02 15:46:15.706997 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3467, in _flush Jun 02 15:46:15.706997 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application flush_context.execute() Jun 02 15:46:15.706997 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Jun 02 15:46:15.706997 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application rec.execute(self) Jun 02 15:46:15.706997 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Jun 02 15:46:15.706997 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Jun 02 15:46:15.709119 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Jun 02 15:46:15.709119 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application _emit_insert_statements( Jun 02 15:46:15.709119 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Jun 02 15:46:15.709119 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application c = connection._execute_20( Jun 02 15:46:15.709119 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Jun 02 15:46:15.709119 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Jun 02 15:46:15.709119 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 325, in _execute_on_connection Jun 02 15:46:15.709119 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Jun 02 15:46:15.709119 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Jun 02 15:46:15.709119 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application ret = self._execute_context( Jun 02 15:46:15.709119 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Jun 02 15:46:15.709119 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Jun 02 15:46:15.709119 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Jun 02 15:46:15.709119 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Jun 02 15:46:15.709119 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ Jun 02 15:46:15.709119 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application raise exception Jun 02 15:46:15.717072 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jun 02 15:46:15.717072 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application self.dialect.do_execute( Jun 02 15:46:15.717072 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jun 02 15:46:15.717072 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jun 02 15:46:15.717072 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jun 02 15:46:15.717072 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application result = self._query(query) Jun 02 15:46:15.717072 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jun 02 15:46:15.717072 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application conn.query(q) Jun 02 15:46:15.717072 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jun 02 15:46:15.717072 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jun 02 15:46:15.717072 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jun 02 15:46:15.717072 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application result.read() Jun 02 15:46:15.717072 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jun 02 15:46:15.717072 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jun 02 15:46:15.717072 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jun 02 15:46:15.717072 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application packet.raise_for_error() Jun 02 15:46:15.719978 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jun 02 15:46:15.719978 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jun 02 15:46:15.719978 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jun 02 15:46:15.719978 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jun 02 15:46:15.719978 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Jun 02 15:46:15.719978 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Jun 02 15:46:15.719978 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application [parameters: {'id': '251301b0950f405a929fce53879a744e', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Jun 02 15:46:15.719978 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Jun 02 15:46:15.719978 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application Jun 02 15:46:15.719978 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 02 15:46:15.719978 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application Jun 02 15:46:15.719978 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 15:46:15.719978 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 15:46:15.719978 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 15:46:15.719978 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 15:46:15.719978 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 15:46:15.721600 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 15:46:15.721600 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 15:46:15.721600 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 15:46:15.721600 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 15:46:15.721600 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 15:46:15.721600 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 15:46:15.721600 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 115, in post Jun 02 15:46:15.721600 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application ref = PROVIDERS.role_api.create_role( Jun 02 15:46:15.721600 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 15:46:15.721600 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 15:46:15.721600 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1298, in create_role Jun 02 15:46:15.721600 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application ret = self.driver.create_role(role_id, role) Jun 02 15:46:15.721600 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Jun 02 15:46:15.721600 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Jun 02 15:46:15.721600 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Jun 02 15:46:15.721600 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application Jun 02 15:46:15.722605 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 242/476] 10.222.0.59 () {60 vars in 1131 bytes} [Thu Jun 2 15:46:15 2022] POST /identity/v3/roles => generated 144 bytes in 256 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Jun 02 15:46:15.722605 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c4df1c7-4e1f-4290-b334-febfb8d026e7 None admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:46:15.768601 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ed7350c-703d-46ab-9e2a-b95d47dc9d3d None admin] Validating token access rules against request {{(pid=80396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:46:15.816030 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:46:15.823320 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82a7645d-0c38-4b3f-af41-e949f860cdc9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:46:15.824065 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a7645d-0c38-4b3f-af41-e949f860cdc9 None admin] REQUEST_METHOD: `GET` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:46:15.824446 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a7645d-0c38-4b3f-af41-e949f860cdc9 None admin] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:46:15.824783 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a7645d-0c38-4b3f-af41-e949f860cdc9 None admin] PATH_INFO: `/v3/domains` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:46:15.825581 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82a7645d-0c38-4b3f-af41-e949f860cdc9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80396) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 15:46:15.825952 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82a7645d-0c38-4b3f-af41-e949f860cdc9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:46:15.827463 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82a7645d-0c38-4b3f-af41-e949f860cdc9 None admin] RBAC: Authorization granted {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:46:15.847600 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 235/477] 10.222.0.59 () {56 vars in 1109 bytes} [Thu Jun 2 15:46:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 249 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 15:46:15.854049 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82a7645d-0c38-4b3f-af41-e949f860cdc9 None admin] Authenticating user token {{(pid=80396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:46:15.858721 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c4df1c7-4e1f-4290-b334-febfb8d026e7 None admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:46:15.900475 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c431736-84ab-4ec6-a869-3c5e35155f80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:46:15.901764 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c431736-84ab-4ec6-a869-3c5e35155f80 None admin] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:46:15.902221 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c431736-84ab-4ec6-a869-3c5e35155f80 None admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:46:15.903120 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c431736-84ab-4ec6-a869-3c5e35155f80 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:46:15.916006 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c431736-84ab-4ec6-a869-3c5e35155f80 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 02 15:46:15.925376 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application [None req-9c431736-84ab-4ec6-a869-3c5e35155f80 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 02 15:46:15.925376 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 15:46:15.925376 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 15:46:15.925376 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 15:46:15.925376 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 15:46:15.925376 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 15:46:15.925376 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 15:46:15.925376 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 15:46:15.925376 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 15:46:15.925376 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 15:46:15.925376 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 15:46:15.925376 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 15:46:15.925376 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 02 15:46:15.925376 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 02 15:46:15.925376 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 02 15:46:15.925376 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 02 15:46:15.926497 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 02 15:46:15.926497 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 02 15:46:15.926497 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 02 15:46:15.926497 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 02 15:46:15.926497 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 15:46:15.926497 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 15:46:15.926497 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 15:46:15.926497 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 15:46:15.926497 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 15:46:15.926497 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 15:46:15.926497 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 15:46:15.926497 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application with Lock( Jun 02 15:46:15.926497 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 15:46:15.926497 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self._enter() Jun 02 15:46:15.926497 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 15:46:15.926497 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 15:46:15.927459 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 15:46:15.927459 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self.creator() Jun 02 15:46:15.927459 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 15:46:15.927459 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application created_value = creator( Jun 02 15:46:15.927459 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 02 15:46:15.927459 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 02 15:46:15.927459 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 02 15:46:15.927459 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 02 15:46:15.927459 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 02 15:46:15.927459 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 02 15:46:15.927459 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 02 15:46:15.927459 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application Jun 02 15:46:15.930838 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 243/478] 10.222.0.59 () {56 vars in 1114 bytes} [Thu Jun 2 15:46:15 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 15:46:15.942519 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c431736-84ab-4ec6-a869-3c5e35155f80 None admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:46:15.999843 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG dbcounter [-] [80396] Writing DB stats keystone:SELECT=100 {{(pid=80396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:46:16.036173 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82a7645d-0c38-4b3f-af41-e949f860cdc9 None admin] Validating token access rules against request {{(pid=80396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:46:16.102698 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4d74039-cb0f-4552-b932-bbc935089d14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:46:16.103286 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d74039-cb0f-4552-b932-bbc935089d14 None admin] REQUEST_METHOD: `POST` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:46:16.103565 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d74039-cb0f-4552-b932-bbc935089d14 None admin] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:46:16.103844 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d74039-cb0f-4552-b932-bbc935089d14 None admin] PATH_INFO: `/v3/users` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:46:16.104560 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4d74039-cb0f-4552-b932-bbc935089d14 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:46:16.105997 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4d74039-cb0f-4552-b932-bbc935089d14 None admin] RBAC: Authorization granted {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:46:16.133776 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c431736-84ab-4ec6-a869-3c5e35155f80 None admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:46:16.162483 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writing DB stats keystone:SELECT=100 {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:46:16.174146 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a0d9190-eb0b-46d2-8cab-f3e3529b024d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:46:16.174869 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0d9190-eb0b-46d2-8cab-f3e3529b024d None admin] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:46:16.175152 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0d9190-eb0b-46d2-8cab-f3e3529b024d None admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:46:16.175424 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0d9190-eb0b-46d2-8cab-f3e3529b024d None admin] PATH_INFO: `/v3/roles` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:46:16.176177 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a0d9190-eb0b-46d2-8cab-f3e3529b024d None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80395) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 15:46:16.176481 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a0d9190-eb0b-46d2-8cab-f3e3529b024d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:46:16.177916 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a0d9190-eb0b-46d2-8cab-f3e3529b024d None admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:46:16.194036 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 244/479] 10.222.0.59 () {56 vars in 1111 bytes} [Thu Jun 2 15:46:15 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 247 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 15:46:16.206559 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 236/480] 10.222.0.59 () {60 vars in 1132 bytes} [Thu Jun 2 15:46:15 2022] POST /identity/v3/users => generated 249 bytes in 353 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 02 15:46:17.744206 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e25c7718-882a-410a-95fa-14a71d6de352 None None] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:46:17.744746 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e25c7718-882a-410a-95fa-14a71d6de352 None None] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:46:17.744746 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e25c7718-882a-410a-95fa-14a71d6de352 None None] PATH_INFO: `/` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:46:17.746463 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 245/481] 10.222.0.59 () {54 vars in 926 bytes} [Thu Jun 2 15:46:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 15:46:17.751550 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6cfd262-6ead-40fc-9e45-e78a58869bb9 None None] REQUEST_METHOD: `POST` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:46:17.752017 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6cfd262-6ead-40fc-9e45-e78a58869bb9 None None] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:46:17.752092 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6cfd262-6ead-40fc-9e45-e78a58869bb9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:46:17.775091 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.auth.core [None req-e6cfd262-6ead-40fc-9e45-e78a58869bb9 None None] MFA Rules not processed for user `400d1f4db9de49638549e5db29a041e1`. Rule list: `[]` (Enabled: `True`). {{(pid=80396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 15:46:17.776285 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.fernet_utils [None req-e6cfd262-6ead-40fc-9e45-e78a58869bb9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 15:46:17.868776 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 237/482] 10.222.0.59 () {58 vars in 1023 bytes} [Thu Jun 2 15:46:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 02 15:46:17.894718 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ec2328-f2fb-4987-abb3-93ae9f89c18c None None] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:46:17.895008 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ec2328-f2fb-4987-abb3-93ae9f89c18c None None] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:46:17.895275 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ec2328-f2fb-4987-abb3-93ae9f89c18c None None] PATH_INFO: `/` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:46:17.896775 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 246/483] 10.222.0.59 () {54 vars in 926 bytes} [Thu Jun 2 15:46:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 15:46:17.902658 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d7d1845-9b44-4be1-8a73-628327703fa7 None None] REQUEST_METHOD: `POST` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:46:17.903021 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d7d1845-9b44-4be1-8a73-628327703fa7 None None] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:46:17.903307 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d7d1845-9b44-4be1-8a73-628327703fa7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:46:17.904106 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09ec2328-f2fb-4987-abb3-93ae9f89c18c None None] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:46:17.921845 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.auth.core [None req-8d7d1845-9b44-4be1-8a73-628327703fa7 None None] MFA Rules not processed for user `400d1f4db9de49638549e5db29a041e1`. Rule list: `[]` (Enabled: `True`). {{(pid=80396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 15:46:17.923536 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.fernet_utils [None req-8d7d1845-9b44-4be1-8a73-628327703fa7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 15:46:18.022128 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG dbcounter [-] [80396] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:46:18.053100 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 238/484] 10.222.0.59 () {58 vars in 1023 bytes} [Thu Jun 2 15:46:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 02 15:46:18.083549 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d7d1845-9b44-4be1-8a73-628327703fa7 None None] Authenticating user token {{(pid=80396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:46:18.087567 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09ec2328-f2fb-4987-abb3-93ae9f89c18c None None] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:46:18.167978 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82767550-8645-444b-9cd8-44e47e4386e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:46:18.168788 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82767550-8645-444b-9cd8-44e47e4386e0 None admin] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:46:18.169083 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82767550-8645-444b-9cd8-44e47e4386e0 None admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:46:18.169358 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82767550-8645-444b-9cd8-44e47e4386e0 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:46:18.192647 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82767550-8645-444b-9cd8-44e47e4386e0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 02 15:46:18.201475 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application [None req-82767550-8645-444b-9cd8-44e47e4386e0 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 02 15:46:18.201475 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 15:46:18.201475 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 15:46:18.201475 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 15:46:18.201475 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 15:46:18.201475 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 15:46:18.201475 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 15:46:18.201475 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 15:46:18.201475 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 15:46:18.201475 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 15:46:18.201475 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 15:46:18.201475 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 15:46:18.201475 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 02 15:46:18.201475 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 02 15:46:18.201475 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 02 15:46:18.201475 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 02 15:46:18.202495 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 02 15:46:18.202495 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 02 15:46:18.202495 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 02 15:46:18.202495 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 02 15:46:18.202495 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 15:46:18.202495 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 15:46:18.202495 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 15:46:18.202495 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 15:46:18.202495 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 15:46:18.202495 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 15:46:18.202495 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 15:46:18.202495 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application with Lock( Jun 02 15:46:18.202495 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 15:46:18.202495 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self._enter() Jun 02 15:46:18.202495 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 15:46:18.202495 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 15:46:18.203281 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 15:46:18.203281 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self.creator() Jun 02 15:46:18.203281 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 15:46:18.203281 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application created_value = creator( Jun 02 15:46:18.203281 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 02 15:46:18.203281 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 02 15:46:18.203281 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 02 15:46:18.203281 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 02 15:46:18.203281 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 02 15:46:18.203281 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 02 15:46:18.203281 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 02 15:46:18.203281 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application Jun 02 15:46:18.203281 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 247/485] 10.222.0.59 () {56 vars in 1102 bytes} [Thu Jun 2 15:46:17 2022] GET /identity/v3/roles/service => generated 85 bytes in 299 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 15:46:18.208227 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82767550-8645-444b-9cd8-44e47e4386e0 None admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:46:18.282799 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writing DB stats keystone:SELECT=100 {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:46:18.309047 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d7d1845-9b44-4be1-8a73-628327703fa7 None None] Validating token access rules against request {{(pid=80396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:46:18.332843 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82767550-8645-444b-9cd8-44e47e4386e0 None admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:46:18.369867 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d1ee0bc-5798-4401-8132-cba9d730aeac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:46:18.370843 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d1ee0bc-5798-4401-8132-cba9d730aeac None admin] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:46:18.371229 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d1ee0bc-5798-4401-8132-cba9d730aeac None admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:46:18.371603 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d1ee0bc-5798-4401-8132-cba9d730aeac None admin] PATH_INFO: `/v3/roles` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:46:18.372461 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d1ee0bc-5798-4401-8132-cba9d730aeac None admin] RBAC: Adding query filter params (name=service) {{(pid=80395) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 15:46:18.372864 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d1ee0bc-5798-4401-8132-cba9d730aeac None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:46:18.374501 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d1ee0bc-5798-4401-8132-cba9d730aeac None admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:46:18.383660 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be580f5e-85f6-4e1c-9a6a-92beafef4459 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:46:18.384863 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be580f5e-85f6-4e1c-9a6a-92beafef4459 None admin] REQUEST_METHOD: `GET` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:46:18.385928 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be580f5e-85f6-4e1c-9a6a-92beafef4459 None admin] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:46:18.386866 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be580f5e-85f6-4e1c-9a6a-92beafef4459 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:46:18.387955 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 248/486] 10.222.0.59 () {56 vars in 1103 bytes} [Thu Jun 2 15:46:18 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 15:46:18.389474 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d1ee0bc-5798-4401-8132-cba9d730aeac None admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:46:18.401605 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be580f5e-85f6-4e1c-9a6a-92beafef4459 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 02 15:46:18.410109 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application [None req-be580f5e-85f6-4e1c-9a6a-92beafef4459 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 02 15:46:18.410109 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 15:46:18.410109 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 15:46:18.410109 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 15:46:18.410109 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 15:46:18.410109 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 15:46:18.410109 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 15:46:18.410109 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 15:46:18.410109 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 15:46:18.410109 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 15:46:18.410109 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 15:46:18.410109 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 15:46:18.410109 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 02 15:46:18.410109 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 02 15:46:18.410109 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 02 15:46:18.410109 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 02 15:46:18.411042 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 02 15:46:18.411042 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 02 15:46:18.411042 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 02 15:46:18.411042 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 02 15:46:18.411042 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 15:46:18.411042 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 15:46:18.411042 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 15:46:18.411042 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 15:46:18.411042 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 15:46:18.411042 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 15:46:18.411042 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 15:46:18.411042 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application with Lock( Jun 02 15:46:18.411042 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 15:46:18.411042 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application return self._enter() Jun 02 15:46:18.411042 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 15:46:18.411042 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 15:46:18.411814 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 15:46:18.411814 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application return self.creator() Jun 02 15:46:18.411814 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 15:46:18.411814 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application created_value = creator( Jun 02 15:46:18.411814 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 02 15:46:18.411814 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 02 15:46:18.411814 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 02 15:46:18.411814 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 02 15:46:18.411814 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 02 15:46:18.411814 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 02 15:46:18.411814 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 02 15:46:18.411814 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application Jun 02 15:46:18.415278 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 239/487] 10.222.0.59 () {56 vars in 1102 bytes} [Thu Jun 2 15:46:18 2022] GET /identity/v3/roles/service => generated 85 bytes in 332 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 02 15:46:18.431782 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be580f5e-85f6-4e1c-9a6a-92beafef4459 None admin] Authenticating user token {{(pid=80396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:46:18.551995 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG dbcounter [-] [80396] Writing DB stats keystone:SELECT=100 {{(pid=80396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:46:18.615309 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be580f5e-85f6-4e1c-9a6a-92beafef4459 None admin] Validating token access rules against request {{(pid=80396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:46:18.633053 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d1ee0bc-5798-4401-8132-cba9d730aeac None admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:46:18.648371 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writing DB stats keystone:SELECT=100 {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:46:18.661885 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b74bf77c-5f94-4c56-9ab8-36b209088798 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:46:18.663042 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74bf77c-5f94-4c56-9ab8-36b209088798 None admin] REQUEST_METHOD: `GET` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:46:18.664672 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74bf77c-5f94-4c56-9ab8-36b209088798 None admin] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:46:18.665061 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74bf77c-5f94-4c56-9ab8-36b209088798 None admin] PATH_INFO: `/v3/roles` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:46:18.666122 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b74bf77c-5f94-4c56-9ab8-36b209088798 None admin] RBAC: Adding query filter params (name=service) {{(pid=80396) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 15:46:18.666535 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b74bf77c-5f94-4c56-9ab8-36b209088798 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:46:18.668613 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b74bf77c-5f94-4c56-9ab8-36b209088798 None admin] RBAC: Authorization granted {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:46:18.671981 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2260ef8-31a3-48d0-9754-9db6bc091b05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:46:18.672974 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2260ef8-31a3-48d0-9754-9db6bc091b05 None admin] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:46:18.673514 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2260ef8-31a3-48d0-9754-9db6bc091b05 None admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:46:18.673938 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2260ef8-31a3-48d0-9754-9db6bc091b05 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:46:18.678660 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 240/488] 10.222.0.59 () {56 vars in 1103 bytes} [Thu Jun 2 15:46:18 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 247 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 15:46:18.680936 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa40f2e-5710-492a-b445-e21642c59b63 None None] REQUEST_METHOD: `GET` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:46:18.681366 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa40f2e-5710-492a-b445-e21642c59b63 None None] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:46:18.681739 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa40f2e-5710-492a-b445-e21642c59b63 None None] PATH_INFO: `/` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:46:18.686153 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 241/489] 10.222.0.59 () {54 vars in 926 bytes} [Thu Jun 2 15:46:18 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 15:46:18.687076 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfa40f2e-5710-492a-b445-e21642c59b63 None None] Authenticating user token {{(pid=80396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:46:18.690374 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2260ef8-31a3-48d0-9754-9db6bc091b05 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:46:18.692264 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2260ef8-31a3-48d0-9754-9db6bc091b05 None admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:46:18.711839 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application [None req-d2260ef8-31a3-48d0-9754-9db6bc091b05 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 15:46:18.711839 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 15:46:18.711839 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 15:46:18.711839 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 15:46:18.711839 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 15:46:18.711839 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 15:46:18.711839 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 15:46:18.711839 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 15:46:18.711839 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 15:46:18.711839 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 15:46:18.711839 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 15:46:18.711839 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 15:46:18.711839 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 02 15:46:18.711839 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 02 15:46:18.711839 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 02 15:46:18.712731 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 02 15:46:18.712731 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 15:46:18.712731 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 15:46:18.712731 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 15:46:18.712731 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 15:46:18.712731 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 15:46:18.712731 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 15:46:18.712731 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 15:46:18.712731 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application with Lock( Jun 02 15:46:18.712731 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 15:46:18.712731 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self._enter() Jun 02 15:46:18.712731 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 15:46:18.712731 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 15:46:18.712731 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 15:46:18.712731 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self.creator() Jun 02 15:46:18.712731 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 15:46:18.712731 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application created_value = creator( Jun 02 15:46:18.713872 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 02 15:46:18.713872 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 02 15:46:18.713872 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 15:46:18.713872 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application Jun 02 15:46:18.720579 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 249/490] 10.222.0.59 () {56 vars in 1108 bytes} [Thu Jun 2 15:46:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 327 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 02 15:46:18.722337 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c782959d-c540-4fcc-9893-6ca55a6bb668 None None] REQUEST_METHOD: `POST` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:46:18.722927 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c782959d-c540-4fcc-9893-6ca55a6bb668 None None] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:46:18.723403 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c782959d-c540-4fcc-9893-6ca55a6bb668 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:46:18.742326 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.auth.core [None req-c782959d-c540-4fcc-9893-6ca55a6bb668 None None] MFA Rules not processed for user `400d1f4db9de49638549e5db29a041e1`. Rule list: `[]` (Enabled: `True`). {{(pid=80395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 15:46:18.743959 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.fernet_utils [None req-c782959d-c540-4fcc-9893-6ca55a6bb668 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 15:46:18.811303 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfa40f2e-5710-492a-b445-e21642c59b63 None None] Validating token access rules against request {{(pid=80396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:46:18.824493 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG dbcounter [-] [80396] Writing DB stats keystone:SELECT=100 {{(pid=80396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:46:18.832899 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 250/491] 10.222.0.59 () {58 vars in 1023 bytes} [Thu Jun 2 15:46:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 02 15:46:18.833750 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c782959d-c540-4fcc-9893-6ca55a6bb668 None None] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:46:18.850542 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-452e226b-70bb-497a-96f3-b71c57e78ee0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:46:18.851759 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-452e226b-70bb-497a-96f3-b71c57e78ee0 None admin] REQUEST_METHOD: `GET` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:46:18.852275 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-452e226b-70bb-497a-96f3-b71c57e78ee0 None admin] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:46:18.852840 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-452e226b-70bb-497a-96f3-b71c57e78ee0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:46:18.864378 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-452e226b-70bb-497a-96f3-b71c57e78ee0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:46:18.866914 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-452e226b-70bb-497a-96f3-b71c57e78ee0 None admin] RBAC: Authorization granted {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:46:18.884916 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application [None req-452e226b-70bb-497a-96f3-b71c57e78ee0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 15:46:18.884916 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 15:46:18.884916 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 15:46:18.884916 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 15:46:18.884916 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 15:46:18.884916 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 15:46:18.884916 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 15:46:18.884916 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 15:46:18.884916 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 15:46:18.884916 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 15:46:18.884916 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 15:46:18.884916 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 15:46:18.884916 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 02 15:46:18.884916 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 02 15:46:18.884916 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 02 15:46:18.885813 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 02 15:46:18.885813 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 15:46:18.885813 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 15:46:18.885813 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 15:46:18.885813 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 15:46:18.885813 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 15:46:18.885813 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 15:46:18.885813 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 15:46:18.885813 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application with Lock( Jun 02 15:46:18.885813 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 15:46:18.885813 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application return self._enter() Jun 02 15:46:18.885813 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 15:46:18.885813 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 15:46:18.885813 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 15:46:18.885813 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application return self.creator() Jun 02 15:46:18.885813 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 15:46:18.885813 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application created_value = creator( Jun 02 15:46:18.886683 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 02 15:46:18.886683 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 02 15:46:18.886683 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 15:46:18.886683 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application Jun 02 15:46:18.886683 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 242/492] 10.222.0.59 () {56 vars in 1108 bytes} [Thu Jun 2 15:46:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 15:46:18.888938 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2899a2d1-48f7-4427-8601-1caff2032b8f None None] REQUEST_METHOD: `GET` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:46:18.889366 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2899a2d1-48f7-4427-8601-1caff2032b8f None None] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:46:18.890134 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2899a2d1-48f7-4427-8601-1caff2032b8f None None] PATH_INFO: `/` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:46:18.891964 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 243/493] 10.222.0.59 () {54 vars in 926 bytes} [Thu Jun 2 15:46:18 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 15:46:18.893066 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2899a2d1-48f7-4427-8601-1caff2032b8f None None] Authenticating user token {{(pid=80396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:46:18.943137 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writing DB stats keystone:SELECT=100 {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:46:18.951265 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c782959d-c540-4fcc-9893-6ca55a6bb668 None None] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:46:18.988894 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cfc99da-dffb-4867-b2d0-cb319abd33e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:46:18.989971 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cfc99da-dffb-4867-b2d0-cb319abd33e9 None admin] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:46:18.990271 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cfc99da-dffb-4867-b2d0-cb319abd33e9 None admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:46:18.990459 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cfc99da-dffb-4867-b2d0-cb319abd33e9 None admin] PATH_INFO: `/v3/domains` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:46:18.991174 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cfc99da-dffb-4867-b2d0-cb319abd33e9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80395) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 15:46:18.991626 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cfc99da-dffb-4867-b2d0-cb319abd33e9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:46:18.993067 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cfc99da-dffb-4867-b2d0-cb319abd33e9 None admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:46:18.999272 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2899a2d1-48f7-4427-8601-1caff2032b8f None None] Validating token access rules against request {{(pid=80396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:46:19.010141 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 251/494] 10.222.0.59 () {56 vars in 1109 bytes} [Thu Jun 2 15:46:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 15:46:19.010141 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cfc99da-dffb-4867-b2d0-cb319abd33e9 None admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:46:19.040278 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68a74511-f094-4f37-a9b5-ab52d3912576 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:46:19.041070 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a74511-f094-4f37-a9b5-ab52d3912576 None admin] REQUEST_METHOD: `GET` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:46:19.041352 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a74511-f094-4f37-a9b5-ab52d3912576 None admin] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:46:19.041626 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a74511-f094-4f37-a9b5-ab52d3912576 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:46:19.051988 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68a74511-f094-4f37-a9b5-ab52d3912576 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 02 15:46:19.060033 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application [None req-68a74511-f094-4f37-a9b5-ab52d3912576 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 02 15:46:19.060033 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 15:46:19.060033 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 15:46:19.060033 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 15:46:19.060033 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 15:46:19.060033 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 15:46:19.060033 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 15:46:19.060033 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 15:46:19.060033 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 15:46:19.060033 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 15:46:19.060033 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 15:46:19.060033 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 15:46:19.060033 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 02 15:46:19.060033 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 02 15:46:19.060033 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 02 15:46:19.060033 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 02 15:46:19.060887 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 02 15:46:19.060887 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 02 15:46:19.060887 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 02 15:46:19.060887 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 02 15:46:19.060887 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 15:46:19.060887 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 15:46:19.060887 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 15:46:19.060887 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 15:46:19.060887 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 15:46:19.060887 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 15:46:19.060887 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 15:46:19.060887 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application with Lock( Jun 02 15:46:19.060887 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 15:46:19.060887 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application return self._enter() Jun 02 15:46:19.060887 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 15:46:19.060887 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 15:46:19.061714 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 15:46:19.061714 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application return self.creator() Jun 02 15:46:19.061714 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 15:46:19.061714 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application created_value = creator( Jun 02 15:46:19.061714 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 02 15:46:19.061714 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 02 15:46:19.061714 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 02 15:46:19.061714 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 02 15:46:19.061714 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 02 15:46:19.061714 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 02 15:46:19.061714 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 02 15:46:19.061714 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application Jun 02 15:46:19.061714 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 244/495] 10.222.0.59 () {56 vars in 1102 bytes} [Thu Jun 2 15:46:18 2022] GET /identity/v3/roles/service => generated 85 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 15:46:19.062746 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab88f040-2e1d-404f-869d-c56f1a7b18ea None None] REQUEST_METHOD: `POST` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:46:19.062840 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab88f040-2e1d-404f-869d-c56f1a7b18ea None None] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:46:19.063075 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab88f040-2e1d-404f-869d-c56f1a7b18ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:46:19.080568 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.auth.core [None req-ab88f040-2e1d-404f-869d-c56f1a7b18ea None None] MFA Rules not processed for user `400d1f4db9de49638549e5db29a041e1`. Rule list: `[]` (Enabled: `True`). {{(pid=80396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 15:46:19.081737 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.fernet_utils [None req-ab88f040-2e1d-404f-869d-c56f1a7b18ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 15:46:19.099362 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG dbcounter [-] [80396] Writing DB stats keystone:SELECT=100 {{(pid=80396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:46:19.123646 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cfc99da-dffb-4867-b2d0-cb319abd33e9 None admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:46:19.154431 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 245/496] 10.222.0.59 () {58 vars in 1023 bytes} [Thu Jun 2 15:46:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 02 15:46:19.155274 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab88f040-2e1d-404f-869d-c56f1a7b18ea None None] Authenticating user token {{(pid=80396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:46:19.161065 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b1179cc-450e-4f64-bd6c-2c502424b073 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:46:19.161734 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1179cc-450e-4f64-bd6c-2c502424b073 None admin] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:46:19.162048 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1179cc-450e-4f64-bd6c-2c502424b073 None admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:46:19.162356 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1179cc-450e-4f64-bd6c-2c502424b073 None admin] PATH_INFO: `/v3/domains` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:46:19.163084 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b1179cc-450e-4f64-bd6c-2c502424b073 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80395) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 15:46:19.163963 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b1179cc-450e-4f64-bd6c-2c502424b073 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:46:19.165720 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b1179cc-450e-4f64-bd6c-2c502424b073 None admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:46:19.184211 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 252/497] 10.222.0.59 () {56 vars in 1109 bytes} [Thu Jun 2 15:46:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 15:46:19.184211 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b1179cc-450e-4f64-bd6c-2c502424b073 None admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:46:19.199027 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writing DB stats keystone:SELECT=100 {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:46:19.257498 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab88f040-2e1d-404f-869d-c56f1a7b18ea None None] Validating token access rules against request {{(pid=80396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:46:19.280847 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b1179cc-450e-4f64-bd6c-2c502424b073 None admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:46:19.291597 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d44de36-a616-4197-a148-9b5f3f396863 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:46:19.292383 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d44de36-a616-4197-a148-9b5f3f396863 None admin] REQUEST_METHOD: `GET` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:46:19.292669 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d44de36-a616-4197-a148-9b5f3f396863 None admin] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:46:19.292974 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d44de36-a616-4197-a148-9b5f3f396863 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:46:19.300154 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d44de36-a616-4197-a148-9b5f3f396863 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:46:19.301584 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d44de36-a616-4197-a148-9b5f3f396863 None admin] RBAC: Authorization granted {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:46:19.315550 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72489997-24e4-45e2-9b8b-583985fb797a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:46:19.316151 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72489997-24e4-45e2-9b8b-583985fb797a None admin] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:46:19.316435 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72489997-24e4-45e2-9b8b-583985fb797a None admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:46:19.316711 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72489997-24e4-45e2-9b8b-583985fb797a None admin] PATH_INFO: `/v3/roles` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:46:19.317457 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72489997-24e4-45e2-9b8b-583985fb797a None admin] RBAC: Adding query filter params (name=service) {{(pid=80395) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 15:46:19.317592 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application [None req-6d44de36-a616-4197-a148-9b5f3f396863 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 02 15:46:19.317592 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 15:46:19.317592 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 15:46:19.317592 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 15:46:19.317592 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 15:46:19.317592 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 15:46:19.317592 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 15:46:19.317592 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 15:46:19.317592 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 15:46:19.317592 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 15:46:19.317592 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 15:46:19.317592 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 15:46:19.317592 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 02 15:46:19.317592 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 02 15:46:19.317592 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 02 15:46:19.317592 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 02 15:46:19.318706 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 15:46:19.318706 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 15:46:19.318706 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 02 15:46:19.318706 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 02 15:46:19.318706 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 02 15:46:19.318706 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 02 15:46:19.318706 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 15:46:19.318706 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 15:46:19.318706 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 15:46:19.318706 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 15:46:19.318706 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 15:46:19.318706 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application with Lock( Jun 02 15:46:19.318706 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 15:46:19.318706 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application return self._enter() Jun 02 15:46:19.318706 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 15:46:19.318706 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 15:46:19.318706 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 15:46:19.318706 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application return self.creator() Jun 02 15:46:19.320238 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 15:46:19.320238 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application created_value = creator( Jun 02 15:46:19.320238 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 02 15:46:19.320238 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 02 15:46:19.320238 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 02 15:46:19.320238 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 02 15:46:19.320238 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 02 15:46:19.320238 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 02 15:46:19.320238 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 02 15:46:19.320238 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application Jun 02 15:46:19.320946 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72489997-24e4-45e2-9b8b-583985fb797a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:46:19.321017 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 246/498] 10.222.0.59 () {56 vars in 1093 bytes} [Thu Jun 2 15:46:19 2022] GET /identity/v3/users/nova => generated 82 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 15:46:19.321081 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72489997-24e4-45e2-9b8b-583985fb797a None admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:46:19.321158 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e70a35-902a-4d66-aa38-072cae677a32 None None] REQUEST_METHOD: `GET` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:46:19.321158 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e70a35-902a-4d66-aa38-072cae677a32 None None] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:46:19.321158 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e70a35-902a-4d66-aa38-072cae677a32 None None] PATH_INFO: `/` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:46:19.322552 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 247/499] 10.222.0.59 () {54 vars in 926 bytes} [Thu Jun 2 15:46:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 15:46:19.323250 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4e70a35-902a-4d66-aa38-072cae677a32 None None] Authenticating user token {{(pid=80396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:46:19.332994 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 253/500] 10.222.0.59 () {56 vars in 1103 bytes} [Thu Jun 2 15:46:19 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 15:46:19.332994 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72489997-24e4-45e2-9b8b-583985fb797a None admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:46:19.340874 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG dbcounter [-] [80396] Writing DB stats keystone:SELECT=100 {{(pid=80396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:46:19.405916 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writing DB stats keystone:SELECT=100 {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:46:19.427161 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72489997-24e4-45e2-9b8b-583985fb797a None admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:46:19.427813 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4e70a35-902a-4d66-aa38-072cae677a32 None None] Validating token access rules against request {{(pid=80396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:46:19.461557 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f10315d-9dbb-4ddc-97b6-791aa3e85e16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:46:19.462047 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e203468-2a78-4cb5-9503-7c5d7d3dab83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:46:19.462370 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f10315d-9dbb-4ddc-97b6-791aa3e85e16 None admin] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:46:19.462655 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f10315d-9dbb-4ddc-97b6-791aa3e85e16 None admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:46:19.462837 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e203468-2a78-4cb5-9503-7c5d7d3dab83 None admin] REQUEST_METHOD: `GET` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:46:19.463213 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f10315d-9dbb-4ddc-97b6-791aa3e85e16 None admin] PATH_INFO: `/v3/users/glance` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:46:19.463384 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e203468-2a78-4cb5-9503-7c5d7d3dab83 None admin] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:46:19.463744 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e203468-2a78-4cb5-9503-7c5d7d3dab83 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:46:19.470538 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f10315d-9dbb-4ddc-97b6-791aa3e85e16 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:46:19.471975 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f10315d-9dbb-4ddc-97b6-791aa3e85e16 None admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:46:19.473452 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e203468-2a78-4cb5-9503-7c5d7d3dab83 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:46:19.474900 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e203468-2a78-4cb5-9503-7c5d7d3dab83 None admin] RBAC: Authorization granted {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:46:19.487386 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application [None req-8f10315d-9dbb-4ddc-97b6-791aa3e85e16 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Jun 02 15:46:19.487386 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 15:46:19.487386 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 15:46:19.487386 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 15:46:19.487386 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 15:46:19.487386 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 15:46:19.487386 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 15:46:19.487386 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 15:46:19.487386 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 15:46:19.487386 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 15:46:19.487386 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 15:46:19.487386 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 15:46:19.487386 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 02 15:46:19.487386 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 02 15:46:19.487386 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 02 15:46:19.487386 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 02 15:46:19.488296 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 15:46:19.488296 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 15:46:19.488296 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 02 15:46:19.488296 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 02 15:46:19.488296 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 02 15:46:19.488296 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 02 15:46:19.488296 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 15:46:19.488296 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 15:46:19.488296 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 15:46:19.488296 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 15:46:19.488296 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 15:46:19.488296 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application with Lock( Jun 02 15:46:19.488296 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 15:46:19.488296 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self._enter() Jun 02 15:46:19.488296 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 15:46:19.488296 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 15:46:19.488296 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 15:46:19.488296 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self.creator() Jun 02 15:46:19.494559 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 15:46:19.494559 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application created_value = creator( Jun 02 15:46:19.494559 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 02 15:46:19.494559 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 02 15:46:19.494559 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 02 15:46:19.494559 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 02 15:46:19.494559 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 02 15:46:19.494559 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 02 15:46:19.494559 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Jun 02 15:46:19.494559 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application Jun 02 15:46:19.494559 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 254/501] 10.222.0.59 () {56 vars in 1099 bytes} [Thu Jun 2 15:46:19 2022] GET /identity/v3/users/glance => generated 84 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 15:46:19.494559 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff16562b-2566-40b2-b62b-66ed80720d3d None None] REQUEST_METHOD: `POST` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:46:19.494559 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff16562b-2566-40b2-b62b-66ed80720d3d None None] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:46:19.495212 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff16562b-2566-40b2-b62b-66ed80720d3d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:46:19.495277 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application [None req-6e203468-2a78-4cb5-9503-7c5d7d3dab83 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 15:46:19.495277 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 15:46:19.495277 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 15:46:19.495277 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 15:46:19.495277 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 15:46:19.495277 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 15:46:19.495277 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 15:46:19.495277 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 15:46:19.495277 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 15:46:19.495277 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 15:46:19.495277 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 15:46:19.495277 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 15:46:19.495277 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 02 15:46:19.495277 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 02 15:46:19.495277 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 02 15:46:19.496094 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 02 15:46:19.496094 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 15:46:19.496094 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 15:46:19.496094 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 15:46:19.496094 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 15:46:19.496094 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 15:46:19.496094 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 15:46:19.496094 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 15:46:19.496094 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application with Lock( Jun 02 15:46:19.496094 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 15:46:19.496094 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application return self._enter() Jun 02 15:46:19.496094 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 15:46:19.496094 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 15:46:19.496094 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 15:46:19.496094 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application return self.creator() Jun 02 15:46:19.496094 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 15:46:19.496094 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application created_value = creator( Jun 02 15:46:19.496920 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 02 15:46:19.496920 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 02 15:46:19.496920 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 15:46:19.496920 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application Jun 02 15:46:19.496920 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 248/502] 10.222.0.59 () {56 vars in 1108 bytes} [Thu Jun 2 15:46:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 15:46:19.496920 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e203468-2a78-4cb5-9503-7c5d7d3dab83 None admin] Authenticating user token {{(pid=80396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:46:19.511478 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.auth.core [None req-ff16562b-2566-40b2-b62b-66ed80720d3d None None] MFA Rules not processed for user `400d1f4db9de49638549e5db29a041e1`. Rule list: `[]` (Enabled: `True`). {{(pid=80395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 15:46:19.512646 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.fernet_utils [None req-ff16562b-2566-40b2-b62b-66ed80720d3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 15:46:19.559056 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG dbcounter [-] [80396] Writing DB stats keystone:SELECT=100 {{(pid=80396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:46:19.577835 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 255/503] 10.222.0.59 () {58 vars in 1023 bytes} [Thu Jun 2 15:46:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 02 15:46:19.578633 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff16562b-2566-40b2-b62b-66ed80720d3d None None] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:46:19.606018 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e203468-2a78-4cb5-9503-7c5d7d3dab83 None admin] Validating token access rules against request {{(pid=80396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:46:19.639122 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65955dc2-4131-40ef-a388-8e20aed4f9ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:46:19.639778 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65955dc2-4131-40ef-a388-8e20aed4f9ab None admin] REQUEST_METHOD: `GET` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:46:19.640055 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65955dc2-4131-40ef-a388-8e20aed4f9ab None admin] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:46:19.640329 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65955dc2-4131-40ef-a388-8e20aed4f9ab None admin] PATH_INFO: `/v3/users` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:46:19.641153 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65955dc2-4131-40ef-a388-8e20aed4f9ab None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80396) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 15:46:19.641458 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65955dc2-4131-40ef-a388-8e20aed4f9ab None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:46:19.642901 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65955dc2-4131-40ef-a388-8e20aed4f9ab None admin] RBAC: Authorization granted {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:46:19.642997 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writing DB stats keystone:SELECT=100 {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:46:19.677354 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff16562b-2566-40b2-b62b-66ed80720d3d None None] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:46:19.680300 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 249/504] 10.222.0.59 () {56 vars in 1133 bytes} [Thu Jun 2 15:46:19 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 15:46:19.681119 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65955dc2-4131-40ef-a388-8e20aed4f9ab None admin] Authenticating user token {{(pid=80396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:46:19.711967 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34cf2a4b-5b05-42be-b8e0-3d320f027385 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:46:19.712755 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34cf2a4b-5b05-42be-b8e0-3d320f027385 None admin] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:46:19.713289 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34cf2a4b-5b05-42be-b8e0-3d320f027385 None admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:46:19.713563 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34cf2a4b-5b05-42be-b8e0-3d320f027385 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:46:19.723394 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34cf2a4b-5b05-42be-b8e0-3d320f027385 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:46:19.724842 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34cf2a4b-5b05-42be-b8e0-3d320f027385 None admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:46:19.741886 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application [None req-34cf2a4b-5b05-42be-b8e0-3d320f027385 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 15:46:19.741886 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 15:46:19.741886 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 15:46:19.741886 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 15:46:19.741886 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 15:46:19.741886 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 15:46:19.741886 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 15:46:19.741886 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 15:46:19.741886 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 15:46:19.741886 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 15:46:19.741886 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 15:46:19.741886 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 15:46:19.741886 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 02 15:46:19.741886 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 02 15:46:19.741886 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 02 15:46:19.742773 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 02 15:46:19.742773 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 15:46:19.742773 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 15:46:19.742773 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 15:46:19.742773 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 15:46:19.742773 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 15:46:19.742773 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 15:46:19.742773 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 15:46:19.742773 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application with Lock( Jun 02 15:46:19.742773 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 15:46:19.742773 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self._enter() Jun 02 15:46:19.742773 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 15:46:19.742773 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 15:46:19.742773 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 15:46:19.742773 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self.creator() Jun 02 15:46:19.742773 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 15:46:19.742773 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application created_value = creator( Jun 02 15:46:19.743855 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 02 15:46:19.743855 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 02 15:46:19.743855 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 15:46:19.743855 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application Jun 02 15:46:19.743855 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 256/505] 10.222.0.59 () {56 vars in 1108 bytes} [Thu Jun 2 15:46:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 15:46:19.743855 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34cf2a4b-5b05-42be-b8e0-3d320f027385 None admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:46:19.783441 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65955dc2-4131-40ef-a388-8e20aed4f9ab None admin] Validating token access rules against request {{(pid=80396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:46:19.805264 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG dbcounter [-] [80396] Writing DB stats keystone:SELECT=100 {{(pid=80396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:46:19.815947 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc23b009-a85b-46ec-8ce0-d966dce68a0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:46:19.816616 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc23b009-a85b-46ec-8ce0-d966dce68a0e None admin] REQUEST_METHOD: `GET` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:46:19.819246 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc23b009-a85b-46ec-8ce0-d966dce68a0e None admin] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:46:19.819246 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc23b009-a85b-46ec-8ce0-d966dce68a0e None admin] PATH_INFO: `/v3/users` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:46:19.819246 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc23b009-a85b-46ec-8ce0-d966dce68a0e None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=80396) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 15:46:19.819246 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc23b009-a85b-46ec-8ce0-d966dce68a0e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:46:19.820375 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc23b009-a85b-46ec-8ce0-d966dce68a0e None admin] RBAC: Authorization granted {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:46:19.839099 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 250/506] 10.222.0.59 () {56 vars in 1137 bytes} [Thu Jun 2 15:46:19 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 15:46:19.839831 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc23b009-a85b-46ec-8ce0-d966dce68a0e None admin] Authenticating user token {{(pid=80396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:46:19.842709 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34cf2a4b-5b05-42be-b8e0-3d320f027385 None admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:46:19.860438 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writing DB stats keystone:SELECT=100 {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:46:19.877263 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-530a9361-fa8e-493c-9ea6-0a6d494d0814 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:46:19.877920 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-530a9361-fa8e-493c-9ea6-0a6d494d0814 None admin] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:46:19.878252 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-530a9361-fa8e-493c-9ea6-0a6d494d0814 None admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:46:19.878533 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-530a9361-fa8e-493c-9ea6-0a6d494d0814 None admin] PATH_INFO: `/v3/domains` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:46:19.879255 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-530a9361-fa8e-493c-9ea6-0a6d494d0814 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80395) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 15:46:19.879564 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-530a9361-fa8e-493c-9ea6-0a6d494d0814 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:46:19.880932 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-530a9361-fa8e-493c-9ea6-0a6d494d0814 None admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:46:19.892932 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 257/507] 10.222.0.59 () {56 vars in 1109 bytes} [Thu Jun 2 15:46:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 15:46:19.893751 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-530a9361-fa8e-493c-9ea6-0a6d494d0814 None admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:46:19.945854 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc23b009-a85b-46ec-8ce0-d966dce68a0e None admin] Validating token access rules against request {{(pid=80396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:46:19.979302 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afebf1d6-9753-45b6-824a-a53fccf3d1c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:46:19.980075 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afebf1d6-9753-45b6-824a-a53fccf3d1c4 None admin] REQUEST_METHOD: `GET` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:46:19.980354 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afebf1d6-9753-45b6-824a-a53fccf3d1c4 None admin] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:46:19.980631 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afebf1d6-9753-45b6-824a-a53fccf3d1c4 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:46:19.990811 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afebf1d6-9753-45b6-824a-a53fccf3d1c4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 02 15:46:19.992708 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-530a9361-fa8e-493c-9ea6-0a6d494d0814 None admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:46:19.998685 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application [None req-afebf1d6-9753-45b6-824a-a53fccf3d1c4 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 02 15:46:19.998685 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 15:46:19.998685 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 15:46:19.998685 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 15:46:19.998685 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 15:46:19.998685 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 15:46:19.998685 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 15:46:19.998685 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 15:46:19.998685 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 15:46:19.998685 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 15:46:19.998685 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 15:46:19.998685 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 15:46:19.998685 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 02 15:46:19.998685 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 02 15:46:19.998685 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 02 15:46:19.998685 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 02 15:46:19.999613 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 02 15:46:19.999613 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 02 15:46:19.999613 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 02 15:46:19.999613 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 02 15:46:19.999613 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 15:46:19.999613 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 15:46:19.999613 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 15:46:19.999613 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 15:46:19.999613 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 15:46:19.999613 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 15:46:19.999613 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 15:46:19.999613 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application with Lock( Jun 02 15:46:19.999613 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 15:46:19.999613 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application return self._enter() Jun 02 15:46:19.999613 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 15:46:19.999613 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 15:46:20.000392 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 15:46:20.000392 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application return self.creator() Jun 02 15:46:20.000392 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 15:46:20.000392 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application created_value = creator( Jun 02 15:46:20.000392 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 02 15:46:20.000392 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 02 15:46:20.000392 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 02 15:46:20.000392 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 02 15:46:20.000392 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 02 15:46:20.000392 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 02 15:46:20.000392 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 02 15:46:20.000392 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application Jun 02 15:46:20.000392 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 251/508] 10.222.0.59 () {56 vars in 1102 bytes} [Thu Jun 2 15:46:19 2022] GET /identity/v3/roles/service => generated 85 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 15:46:20.001052 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afebf1d6-9753-45b6-824a-a53fccf3d1c4 None admin] Authenticating user token {{(pid=80396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:46:20.027303 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a67bbeb-52d4-4f16-b16b-b870bb91f84f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:46:20.027948 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a67bbeb-52d4-4f16-b16b-b870bb91f84f None admin] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:46:20.028231 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a67bbeb-52d4-4f16-b16b-b870bb91f84f None admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:46:20.028505 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a67bbeb-52d4-4f16-b16b-b870bb91f84f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:46:20.042647 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG dbcounter [-] [80396] Writing DB stats keystone:SELECT=100 {{(pid=80396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:46:20.074023 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writing DB stats keystone:SELECT=100 {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:46:20.099556 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a67bbeb-52d4-4f16-b16b-b870bb91f84f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:46:20.100128 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afebf1d6-9753-45b6-824a-a53fccf3d1c4 None admin] Validating token access rules against request {{(pid=80396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:46:20.100967 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a67bbeb-52d4-4f16-b16b-b870bb91f84f None admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:46:20.134976 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ec4da9c-46ee-4cb6-8021-cfa00e60120e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:46:20.135841 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec4da9c-46ee-4cb6-8021-cfa00e60120e None admin] REQUEST_METHOD: `GET` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:46:20.136127 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec4da9c-46ee-4cb6-8021-cfa00e60120e None admin] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:46:20.136405 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec4da9c-46ee-4cb6-8021-cfa00e60120e None admin] PATH_INFO: `/v3/domains` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:46:20.137126 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ec4da9c-46ee-4cb6-8021-cfa00e60120e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80396) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 15:46:20.137434 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ec4da9c-46ee-4cb6-8021-cfa00e60120e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:46:20.138827 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ec4da9c-46ee-4cb6-8021-cfa00e60120e None admin] RBAC: Authorization granted {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:46:20.150511 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 252/509] 10.222.0.59 () {56 vars in 1109 bytes} [Thu Jun 2 15:46:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 15:46:20.151339 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ec4da9c-46ee-4cb6-8021-cfa00e60120e None admin] Authenticating user token {{(pid=80396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:46:20.206001 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 258/510] 10.222.0.59 () {58 vars in 1282 bytes} [Thu Jun 2 15:46:19 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 02 15:46:20.206933 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a67bbeb-52d4-4f16-b16b-b870bb91f84f None admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:46:20.312217 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG dbcounter [-] [80396] Writing DB stats keystone:SELECT=100 {{(pid=80396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:46:20.315318 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ec4da9c-46ee-4cb6-8021-cfa00e60120e None admin] Validating token access rules against request {{(pid=80396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:46:20.322552 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writing DB stats keystone:SELECT=100 {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:46:20.343092 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a67bbeb-52d4-4f16-b16b-b870bb91f84f None admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:46:20.349129 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26e51b10-b158-48a3-99ca-a48b83e23ada None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:46:20.349820 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e51b10-b158-48a3-99ca-a48b83e23ada None admin] REQUEST_METHOD: `GET` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:46:20.350056 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e51b10-b158-48a3-99ca-a48b83e23ada None admin] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:46:20.350362 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e51b10-b158-48a3-99ca-a48b83e23ada None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:46:20.376018 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6666b3a4-01fa-4e9c-8b8f-da3b8ca11230 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:46:20.376685 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6666b3a4-01fa-4e9c-8b8f-da3b8ca11230 None admin] REQUEST_METHOD: `POST` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:46:20.376964 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6666b3a4-01fa-4e9c-8b8f-da3b8ca11230 None admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:46:20.377234 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6666b3a4-01fa-4e9c-8b8f-da3b8ca11230 None admin] PATH_INFO: `/v3/users` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:46:20.377933 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6666b3a4-01fa-4e9c-8b8f-da3b8ca11230 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:46:20.379390 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6666b3a4-01fa-4e9c-8b8f-da3b8ca11230 None admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:46:20.418371 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26e51b10-b158-48a3-99ca-a48b83e23ada None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:46:20.419807 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26e51b10-b158-48a3-99ca-a48b83e23ada None admin] RBAC: Authorization granted {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:46:20.471037 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 259/511] 10.222.0.59 () {60 vars in 1132 bytes} [Thu Jun 2 15:46:20 2022] POST /identity/v3/users => generated 247 bytes in 264 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 15:46:20.471885 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6666b3a4-01fa-4e9c-8b8f-da3b8ca11230 None admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:46:20.525121 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG dbcounter [-] [80396] Writing DB stats keystone:SELECT=100 {{(pid=80396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:46:20.529591 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 253/512] 10.222.0.59 () {58 vars in 1282 bytes} [Thu Jun 2 15:46:20 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 378 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 02 15:46:20.530506 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26e51b10-b158-48a3-99ca-a48b83e23ada None admin] Authenticating user token {{(pid=80396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:46:20.595359 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6666b3a4-01fa-4e9c-8b8f-da3b8ca11230 None admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:46:20.634377 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65c694ae-b90a-4c0b-9c6c-dab7b8d79f16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:46:20.634983 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c694ae-b90a-4c0b-9c6c-dab7b8d79f16 None admin] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:46:20.635272 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c694ae-b90a-4c0b-9c6c-dab7b8d79f16 None admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:46:20.635554 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c694ae-b90a-4c0b-9c6c-dab7b8d79f16 None admin] PATH_INFO: `/v3/roles` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:46:20.636385 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65c694ae-b90a-4c0b-9c6c-dab7b8d79f16 None admin] RBAC: Adding query filter params (name=service) {{(pid=80395) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 15:46:20.636720 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65c694ae-b90a-4c0b-9c6c-dab7b8d79f16 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:46:20.638113 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65c694ae-b90a-4c0b-9c6c-dab7b8d79f16 None admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:46:20.639761 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:46:20.644655 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26e51b10-b158-48a3-99ca-a48b83e23ada None admin] Validating token access rules against request {{(pid=80396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:46:20.648928 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 260/513] 10.222.0.59 () {56 vars in 1103 bytes} [Thu Jun 2 15:46:20 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 15:46:20.650041 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65c694ae-b90a-4c0b-9c6c-dab7b8d79f16 None admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:46:20.685884 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cca8c413-0582-43d5-a363-2a01482cc896 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:46:20.686704 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca8c413-0582-43d5-a363-2a01482cc896 None admin] REQUEST_METHOD: `GET` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:46:20.686982 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca8c413-0582-43d5-a363-2a01482cc896 None admin] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:46:20.687277 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca8c413-0582-43d5-a363-2a01482cc896 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:46:20.696504 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cca8c413-0582-43d5-a363-2a01482cc896 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:46:20.697959 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cca8c413-0582-43d5-a363-2a01482cc896 None admin] RBAC: Authorization granted {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:46:20.714570 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application [None req-cca8c413-0582-43d5-a363-2a01482cc896 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jun 02 15:46:20.714570 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 15:46:20.714570 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 15:46:20.714570 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 15:46:20.714570 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 15:46:20.714570 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 15:46:20.714570 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 15:46:20.714570 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 15:46:20.714570 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 15:46:20.714570 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 15:46:20.714570 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 15:46:20.714570 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 15:46:20.714570 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 02 15:46:20.714570 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 02 15:46:20.714570 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 02 15:46:20.714570 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 02 15:46:20.715485 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 15:46:20.715485 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 15:46:20.715485 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 02 15:46:20.715485 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 02 15:46:20.715485 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 02 15:46:20.715485 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 02 15:46:20.715485 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 15:46:20.715485 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 15:46:20.715485 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 15:46:20.715485 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 15:46:20.715485 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 15:46:20.715485 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application with Lock( Jun 02 15:46:20.715485 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 15:46:20.715485 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application return self._enter() Jun 02 15:46:20.715485 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 15:46:20.715485 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 15:46:20.715485 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 15:46:20.715485 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application return self.creator() Jun 02 15:46:20.716350 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 15:46:20.716350 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application created_value = creator( Jun 02 15:46:20.716350 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 02 15:46:20.716350 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 02 15:46:20.716350 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 02 15:46:20.716350 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 02 15:46:20.716350 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 02 15:46:20.716350 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 02 15:46:20.716350 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jun 02 15:46:20.716350 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application Jun 02 15:46:20.716350 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 254/514] 10.222.0.59 () {56 vars in 1099 bytes} [Thu Jun 2 15:46:20 2022] GET /identity/v3/users/cinder => generated 84 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 15:46:20.716900 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cca8c413-0582-43d5-a363-2a01482cc896 None admin] Authenticating user token {{(pid=80396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:46:20.767823 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65c694ae-b90a-4c0b-9c6c-dab7b8d79f16 None admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:46:20.778859 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG dbcounter [-] [80396] Writing DB stats keystone:SELECT=100 {{(pid=80396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:46:20.810551 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05922611-6343-4bbc-81bd-398e68b558b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:46:20.811630 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05922611-6343-4bbc-81bd-398e68b558b6 None admin] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:46:20.811913 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05922611-6343-4bbc-81bd-398e68b558b6 None admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:46:20.812177 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05922611-6343-4bbc-81bd-398e68b558b6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:46:20.820592 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cca8c413-0582-43d5-a363-2a01482cc896 None admin] Validating token access rules against request {{(pid=80396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:46:20.823890 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05922611-6343-4bbc-81bd-398e68b558b6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:46:20.825344 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05922611-6343-4bbc-81bd-398e68b558b6 None admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:46:20.843169 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application [None req-05922611-6343-4bbc-81bd-398e68b558b6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 15:46:20.843169 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 15:46:20.843169 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 15:46:20.843169 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 15:46:20.843169 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 15:46:20.843169 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 15:46:20.843169 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 15:46:20.843169 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 15:46:20.843169 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 15:46:20.843169 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 15:46:20.843169 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 15:46:20.843169 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 15:46:20.843169 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 02 15:46:20.843169 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 02 15:46:20.843169 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 02 15:46:20.844643 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 02 15:46:20.844643 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 15:46:20.844643 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 15:46:20.844643 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 15:46:20.844643 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 15:46:20.844643 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 15:46:20.844643 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 15:46:20.844643 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 15:46:20.844643 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application with Lock( Jun 02 15:46:20.844643 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 15:46:20.844643 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self._enter() Jun 02 15:46:20.844643 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 15:46:20.844643 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 15:46:20.844643 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 15:46:20.844643 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self.creator() Jun 02 15:46:20.844643 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 15:46:20.844643 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application created_value = creator( Jun 02 15:46:20.845477 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 02 15:46:20.845477 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 02 15:46:20.845477 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 15:46:20.845477 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application Jun 02 15:46:20.845477 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 261/515] 10.222.0.59 () {56 vars in 1108 bytes} [Thu Jun 2 15:46:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 15:46:20.845477 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05922611-6343-4bbc-81bd-398e68b558b6 None admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:46:20.864041 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf388030-02ea-42d8-b5fc-e74bd73908ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:46:20.864835 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf388030-02ea-42d8-b5fc-e74bd73908ee None admin] REQUEST_METHOD: `GET` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:46:20.865122 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf388030-02ea-42d8-b5fc-e74bd73908ee None admin] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:46:20.865399 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf388030-02ea-42d8-b5fc-e74bd73908ee None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:46:20.877451 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf388030-02ea-42d8-b5fc-e74bd73908ee None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:46:20.879054 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf388030-02ea-42d8-b5fc-e74bd73908ee None admin] RBAC: Authorization granted {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:46:20.898242 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application [None req-cf388030-02ea-42d8-b5fc-e74bd73908ee None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 15:46:20.898242 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 15:46:20.898242 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 15:46:20.898242 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 15:46:20.898242 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 15:46:20.898242 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 15:46:20.898242 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 15:46:20.898242 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 15:46:20.898242 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 15:46:20.898242 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 15:46:20.898242 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 15:46:20.898242 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 15:46:20.898242 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 02 15:46:20.898242 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 02 15:46:20.898242 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 02 15:46:20.899293 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 02 15:46:20.899293 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 15:46:20.899293 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 15:46:20.899293 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 15:46:20.899293 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 15:46:20.899293 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 15:46:20.899293 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 15:46:20.899293 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 15:46:20.899293 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application with Lock( Jun 02 15:46:20.899293 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 15:46:20.899293 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application return self._enter() Jun 02 15:46:20.899293 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 15:46:20.899293 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 15:46:20.899293 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 15:46:20.899293 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application return self.creator() Jun 02 15:46:20.899293 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 15:46:20.899293 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application created_value = creator( Jun 02 15:46:20.900134 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 02 15:46:20.900134 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 02 15:46:20.900134 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 15:46:20.900134 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application Jun 02 15:46:20.900134 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 255/516] 10.222.0.59 () {56 vars in 1108 bytes} [Thu Jun 2 15:46:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 15:46:20.900391 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf388030-02ea-42d8-b5fc-e74bd73908ee None admin] Authenticating user token {{(pid=80396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:46:20.901320 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writing DB stats keystone:SELECT=100 {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:46:20.961152 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05922611-6343-4bbc-81bd-398e68b558b6 None admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:46:20.999583 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c059a28-be1a-4f68-abe5-8d3453b5ce4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:46:21.000369 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c059a28-be1a-4f68-abe5-8d3453b5ce4f None admin] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:46:21.000653 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c059a28-be1a-4f68-abe5-8d3453b5ce4f None admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:46:21.000923 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c059a28-be1a-4f68-abe5-8d3453b5ce4f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:46:21.003984 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf388030-02ea-42d8-b5fc-e74bd73908ee None admin] Validating token access rules against request {{(pid=80396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:46:21.011290 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c059a28-be1a-4f68-abe5-8d3453b5ce4f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:46:21.012752 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c059a28-be1a-4f68-abe5-8d3453b5ce4f None admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:46:21.017729 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG dbcounter [-] [80396] Writing DB stats keystone:SELECT=100 {{(pid=80396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:46:21.031431 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application [None req-9c059a28-be1a-4f68-abe5-8d3453b5ce4f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 15:46:21.031431 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 15:46:21.031431 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 15:46:21.031431 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 15:46:21.031431 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 15:46:21.031431 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 15:46:21.031431 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 15:46:21.031431 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 15:46:21.031431 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 15:46:21.031431 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 15:46:21.031431 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 15:46:21.031431 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 15:46:21.031431 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 02 15:46:21.031431 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 02 15:46:21.031431 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 02 15:46:21.038443 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 02 15:46:21.038443 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 15:46:21.038443 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 15:46:21.038443 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 15:46:21.038443 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 15:46:21.038443 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 15:46:21.038443 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 15:46:21.038443 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 15:46:21.038443 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application with Lock( Jun 02 15:46:21.038443 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 15:46:21.038443 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self._enter() Jun 02 15:46:21.038443 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 15:46:21.038443 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 15:46:21.038443 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 15:46:21.038443 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self.creator() Jun 02 15:46:21.038443 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 15:46:21.038443 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application created_value = creator( Jun 02 15:46:21.039572 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 02 15:46:21.039572 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 02 15:46:21.039572 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 15:46:21.039572 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application Jun 02 15:46:21.039572 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 262/517] 10.222.0.59 () {56 vars in 1108 bytes} [Thu Jun 2 15:46:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 15:46:21.039572 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c059a28-be1a-4f68-abe5-8d3453b5ce4f None admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:46:21.048262 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b201a769-3810-4543-84a5-bdeb918f0e8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:46:21.048928 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b201a769-3810-4543-84a5-bdeb918f0e8e None admin] REQUEST_METHOD: `GET` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:46:21.049205 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b201a769-3810-4543-84a5-bdeb918f0e8e None admin] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:46:21.049475 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b201a769-3810-4543-84a5-bdeb918f0e8e None admin] PATH_INFO: `/v3/users` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:46:21.050339 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b201a769-3810-4543-84a5-bdeb918f0e8e None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=80396) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 15:46:21.050642 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b201a769-3810-4543-84a5-bdeb918f0e8e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:46:21.052067 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b201a769-3810-4543-84a5-bdeb918f0e8e None admin] RBAC: Authorization granted {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:46:21.071577 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 256/518] 10.222.0.59 () {56 vars in 1137 bytes} [Thu Jun 2 15:46:20 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 15:46:21.072239 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b201a769-3810-4543-84a5-bdeb918f0e8e None admin] Authenticating user token {{(pid=80396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:46:21.147089 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writing DB stats keystone:SELECT=100 {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:46:21.151347 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c059a28-be1a-4f68-abe5-8d3453b5ce4f None admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:46:21.182249 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b201a769-3810-4543-84a5-bdeb918f0e8e None admin] Validating token access rules against request {{(pid=80396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:46:21.189198 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aa1424d-b464-4ba9-bbde-0c9ae69fd319 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:46:21.189903 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa1424d-b464-4ba9-bbde-0c9ae69fd319 None admin] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:46:21.190265 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa1424d-b464-4ba9-bbde-0c9ae69fd319 None admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:46:21.195105 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa1424d-b464-4ba9-bbde-0c9ae69fd319 None admin] PATH_INFO: `/v3/domains` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:46:21.195951 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aa1424d-b464-4ba9-bbde-0c9ae69fd319 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80395) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 15:46:21.196272 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aa1424d-b464-4ba9-bbde-0c9ae69fd319 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:46:21.197671 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aa1424d-b464-4ba9-bbde-0c9ae69fd319 None admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:46:21.210301 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 263/519] 10.222.0.59 () {56 vars in 1109 bytes} [Thu Jun 2 15:46:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 15:46:21.211321 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aa1424d-b464-4ba9-bbde-0c9ae69fd319 None admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:46:21.231441 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9307f79b-e9db-48df-8e79-3c62bc29e9c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:46:21.232110 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9307f79b-e9db-48df-8e79-3c62bc29e9c5 None admin] REQUEST_METHOD: `GET` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:46:21.232459 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9307f79b-e9db-48df-8e79-3c62bc29e9c5 None admin] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:46:21.232743 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9307f79b-e9db-48df-8e79-3c62bc29e9c5 None admin] PATH_INFO: `/v3/domains` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:46:21.233471 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9307f79b-e9db-48df-8e79-3c62bc29e9c5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80396) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 15:46:21.233779 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9307f79b-e9db-48df-8e79-3c62bc29e9c5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:46:21.235346 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9307f79b-e9db-48df-8e79-3c62bc29e9c5 None admin] RBAC: Authorization granted {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:46:21.253369 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 257/520] 10.222.0.59 () {56 vars in 1109 bytes} [Thu Jun 2 15:46:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 15:46:21.253369 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9307f79b-e9db-48df-8e79-3c62bc29e9c5 None admin] Authenticating user token {{(pid=80396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:46:21.286349 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG dbcounter [-] [80396] Writing DB stats keystone:SELECT=100 {{(pid=80396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:46:21.314379 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aa1424d-b464-4ba9-bbde-0c9ae69fd319 None admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:46:21.351901 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac25f1dc-180f-46dc-b617-7246c62a803a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:46:21.352872 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac25f1dc-180f-46dc-b617-7246c62a803a None admin] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:46:21.353338 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac25f1dc-180f-46dc-b617-7246c62a803a None admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:46:21.353793 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac25f1dc-180f-46dc-b617-7246c62a803a None admin] PATH_INFO: `/v3/domains` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:46:21.354868 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac25f1dc-180f-46dc-b617-7246c62a803a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80395) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 15:46:21.355355 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac25f1dc-180f-46dc-b617-7246c62a803a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:46:21.356917 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac25f1dc-180f-46dc-b617-7246c62a803a None admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:46:21.363249 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9307f79b-e9db-48df-8e79-3c62bc29e9c5 None admin] Validating token access rules against request {{(pid=80396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:46:21.369444 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 264/521] 10.222.0.59 () {56 vars in 1109 bytes} [Thu Jun 2 15:46:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 15:46:21.370314 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac25f1dc-180f-46dc-b617-7246c62a803a None admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:46:21.395024 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writing DB stats keystone:SELECT=100 {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:46:21.409117 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83fbb796-c0e0-4d63-9909-c19760235ec2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:46:21.409117 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83fbb796-c0e0-4d63-9909-c19760235ec2 None admin] REQUEST_METHOD: `GET` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:46:21.409117 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83fbb796-c0e0-4d63-9909-c19760235ec2 None admin] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:46:21.409117 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83fbb796-c0e0-4d63-9909-c19760235ec2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:46:21.476486 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac25f1dc-180f-46dc-b617-7246c62a803a None admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:46:21.477109 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83fbb796-c0e0-4d63-9909-c19760235ec2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:46:21.478608 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83fbb796-c0e0-4d63-9909-c19760235ec2 None admin] RBAC: Authorization granted {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:46:21.508981 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG dbcounter [-] [80396] Writing DB stats keystone:SELECT=100 {{(pid=80396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:46:21.514765 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d03a6484-fed4-4fc4-80f0-ac52c26a3513 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:46:21.515553 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d03a6484-fed4-4fc4-80f0-ac52c26a3513 None admin] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:46:21.515837 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d03a6484-fed4-4fc4-80f0-ac52c26a3513 None admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:46:21.516113 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d03a6484-fed4-4fc4-80f0-ac52c26a3513 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:46:21.523027 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d03a6484-fed4-4fc4-80f0-ac52c26a3513 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:46:21.524551 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d03a6484-fed4-4fc4-80f0-ac52c26a3513 None admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:46:21.539515 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application [None req-d03a6484-fed4-4fc4-80f0-ac52c26a3513 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 02 15:46:21.539515 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 15:46:21.539515 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 15:46:21.539515 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 15:46:21.539515 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 15:46:21.539515 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 15:46:21.539515 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 15:46:21.539515 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 15:46:21.539515 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 15:46:21.539515 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 15:46:21.539515 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 15:46:21.539515 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 15:46:21.539515 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 02 15:46:21.539515 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 02 15:46:21.539515 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 02 15:46:21.540355 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 02 15:46:21.540355 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 15:46:21.540355 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 15:46:21.540355 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 15:46:21.540355 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 15:46:21.540355 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 15:46:21.540355 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 15:46:21.540355 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 15:46:21.540355 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application with Lock( Jun 02 15:46:21.540355 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 15:46:21.540355 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self._enter() Jun 02 15:46:21.540355 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 15:46:21.540355 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 15:46:21.540355 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 15:46:21.540355 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self.creator() Jun 02 15:46:21.540355 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 15:46:21.540355 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application created_value = creator( Jun 02 15:46:21.546453 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 02 15:46:21.546453 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 02 15:46:21.546453 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 02 15:46:21.546453 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 02 15:46:21.546453 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 02 15:46:21.546453 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 02 15:46:21.546453 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 02 15:46:21.546453 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application Jun 02 15:46:21.546453 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 265/522] 10.222.0.59 () {56 vars in 1111 bytes} [Thu Jun 2 15:46:21 2022] GET /identity/v3/projects/service => generated 88 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 15:46:21.546453 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d03a6484-fed4-4fc4-80f0-ac52c26a3513 None admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:46:21.585008 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 258/523] 10.222.0.59 () {58 vars in 1282 bytes} [Thu Jun 2 15:46:21 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 335 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 02 15:46:21.586032 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83fbb796-c0e0-4d63-9909-c19760235ec2 None admin] Authenticating user token {{(pid=80396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:46:21.638520 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writing DB stats keystone:SELECT=100 {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:46:21.659670 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d03a6484-fed4-4fc4-80f0-ac52c26a3513 None admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:46:21.695636 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83fbb796-c0e0-4d63-9909-c19760235ec2 None admin] Validating token access rules against request {{(pid=80396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:46:21.696192 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfaaf5cb-a0f7-47c1-ad72-bbe29b8951e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:46:21.697115 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfaaf5cb-a0f7-47c1-ad72-bbe29b8951e4 None admin] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:46:21.697456 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfaaf5cb-a0f7-47c1-ad72-bbe29b8951e4 None admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:46:21.697737 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfaaf5cb-a0f7-47c1-ad72-bbe29b8951e4 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:46:21.704862 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfaaf5cb-a0f7-47c1-ad72-bbe29b8951e4 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:46:21.706332 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfaaf5cb-a0f7-47c1-ad72-bbe29b8951e4 None admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:46:21.722509 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application [None req-dfaaf5cb-a0f7-47c1-ad72-bbe29b8951e4 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 02 15:46:21.722509 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 15:46:21.722509 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 15:46:21.722509 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 15:46:21.722509 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 15:46:21.722509 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 15:46:21.722509 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 15:46:21.722509 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 15:46:21.722509 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 15:46:21.722509 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 15:46:21.722509 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 15:46:21.722509 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 15:46:21.722509 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 02 15:46:21.722509 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 02 15:46:21.722509 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 02 15:46:21.723529 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 02 15:46:21.723529 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 15:46:21.723529 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 15:46:21.723529 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 15:46:21.723529 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 15:46:21.723529 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 15:46:21.723529 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 15:46:21.723529 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 15:46:21.723529 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application with Lock( Jun 02 15:46:21.723529 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 15:46:21.723529 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self._enter() Jun 02 15:46:21.723529 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 15:46:21.723529 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 15:46:21.723529 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 15:46:21.723529 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self.creator() Jun 02 15:46:21.723529 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 15:46:21.723529 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application created_value = creator( Jun 02 15:46:21.724578 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 02 15:46:21.724578 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 02 15:46:21.724578 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 02 15:46:21.724578 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 02 15:46:21.724578 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 02 15:46:21.724578 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 02 15:46:21.724578 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 02 15:46:21.724578 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application Jun 02 15:46:21.726477 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 266/524] 10.222.0.59 () {56 vars in 1111 bytes} [Thu Jun 2 15:46:21 2022] GET /identity/v3/projects/service => generated 88 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 15:46:21.727140 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG dbcounter [-] [80396] Writing DB stats keystone:SELECT=100 {{(pid=80396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:46:21.727957 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfaaf5cb-a0f7-47c1-ad72-bbe29b8951e4 None admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:46:21.737918 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3e05885-a053-40f0-8295-023c65f13482 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:46:21.738742 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e05885-a053-40f0-8295-023c65f13482 None admin] REQUEST_METHOD: `GET` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:46:21.741720 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e05885-a053-40f0-8295-023c65f13482 None admin] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:46:21.741720 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e05885-a053-40f0-8295-023c65f13482 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:46:21.747996 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3e05885-a053-40f0-8295-023c65f13482 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:46:21.749444 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3e05885-a053-40f0-8295-023c65f13482 None admin] RBAC: Authorization granted {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:46:21.764440 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application [None req-d3e05885-a053-40f0-8295-023c65f13482 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Jun 02 15:46:21.764440 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 15:46:21.764440 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 15:46:21.764440 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 15:46:21.764440 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 15:46:21.764440 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 15:46:21.764440 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 15:46:21.764440 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 15:46:21.764440 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 15:46:21.764440 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 15:46:21.764440 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 15:46:21.764440 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 15:46:21.764440 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 02 15:46:21.764440 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 02 15:46:21.764440 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 02 15:46:21.764440 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 02 15:46:21.765349 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 15:46:21.765349 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 15:46:21.765349 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 02 15:46:21.765349 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 02 15:46:21.765349 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 02 15:46:21.765349 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 02 15:46:21.765349 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 15:46:21.765349 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 15:46:21.765349 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 15:46:21.765349 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 15:46:21.765349 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 15:46:21.765349 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application with Lock( Jun 02 15:46:21.765349 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 15:46:21.765349 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application return self._enter() Jun 02 15:46:21.765349 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 15:46:21.765349 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 15:46:21.765349 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 15:46:21.765349 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application return self.creator() Jun 02 15:46:21.766248 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 15:46:21.766248 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application created_value = creator( Jun 02 15:46:21.766248 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 02 15:46:21.766248 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 02 15:46:21.766248 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 02 15:46:21.766248 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 02 15:46:21.766248 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 02 15:46:21.766248 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 02 15:46:21.766248 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Jun 02 15:46:21.766248 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application Jun 02 15:46:21.766248 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 259/525] 10.222.0.59 () {56 vars in 1102 bytes} [Thu Jun 2 15:46:21 2022] GET /identity/v3/users/neutron => generated 85 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 15:46:21.766805 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3e05885-a053-40f0-8295-023c65f13482 None admin] Authenticating user token {{(pid=80396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:46:21.844037 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfaaf5cb-a0f7-47c1-ad72-bbe29b8951e4 None admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:46:21.875887 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3e05885-a053-40f0-8295-023c65f13482 None admin] Validating token access rules against request {{(pid=80396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:46:21.878895 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43d57f9f-a6ac-499d-875c-85532f6c567b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:46:21.879546 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d57f9f-a6ac-499d-875c-85532f6c567b None admin] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:46:21.879821 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d57f9f-a6ac-499d-875c-85532f6c567b None admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:46:21.880090 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d57f9f-a6ac-499d-875c-85532f6c567b None admin] PATH_INFO: `/v3/projects` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:46:21.880896 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43d57f9f-a6ac-499d-875c-85532f6c567b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80395) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 15:46:21.881198 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43d57f9f-a6ac-499d-875c-85532f6c567b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:46:21.882745 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43d57f9f-a6ac-499d-875c-85532f6c567b None admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:46:21.898642 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writing DB stats keystone:SELECT=100 {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:46:21.902318 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 267/526] 10.222.0.59 () {56 vars in 1148 bytes} [Thu Jun 2 15:46:21 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 15:46:21.903307 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43d57f9f-a6ac-499d-875c-85532f6c567b None admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:46:21.915749 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-269d90ae-5043-4d9c-bbdd-c980c3d926cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:46:21.916461 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269d90ae-5043-4d9c-bbdd-c980c3d926cc None admin] REQUEST_METHOD: `GET` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:46:21.916743 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269d90ae-5043-4d9c-bbdd-c980c3d926cc None admin] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:46:21.917014 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269d90ae-5043-4d9c-bbdd-c980c3d926cc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:46:21.927874 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-269d90ae-5043-4d9c-bbdd-c980c3d926cc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:46:21.930391 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-269d90ae-5043-4d9c-bbdd-c980c3d926cc None admin] RBAC: Authorization granted {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:46:21.949012 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application [None req-269d90ae-5043-4d9c-bbdd-c980c3d926cc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 15:46:21.949012 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 15:46:21.949012 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 15:46:21.949012 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 15:46:21.949012 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 15:46:21.949012 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 15:46:21.949012 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 15:46:21.949012 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 15:46:21.949012 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 15:46:21.949012 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 15:46:21.949012 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 15:46:21.949012 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 15:46:21.949012 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 02 15:46:21.949012 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 02 15:46:21.949012 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 02 15:46:21.949868 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 02 15:46:21.949868 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 15:46:21.949868 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 15:46:21.949868 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 15:46:21.949868 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 15:46:21.949868 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 15:46:21.949868 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 15:46:21.949868 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 15:46:21.949868 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application with Lock( Jun 02 15:46:21.949868 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 15:46:21.949868 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application return self._enter() Jun 02 15:46:21.949868 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 15:46:21.949868 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 15:46:21.949868 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 15:46:21.949868 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application return self.creator() Jun 02 15:46:21.949868 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 15:46:21.949868 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application created_value = creator( Jun 02 15:46:21.951299 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 02 15:46:21.951299 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 02 15:46:21.951299 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 15:46:21.951299 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application Jun 02 15:46:21.951299 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 260/527] 10.222.0.59 () {56 vars in 1108 bytes} [Thu Jun 2 15:46:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 15:46:21.951299 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-269d90ae-5043-4d9c-bbdd-c980c3d926cc None admin] Authenticating user token {{(pid=80396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:46:22.003259 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG dbcounter [-] [80396] Writing DB stats keystone:SELECT=100 {{(pid=80396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:46:22.016038 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43d57f9f-a6ac-499d-875c-85532f6c567b None admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:46:22.053905 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0955aea9-e38b-4394-92f6-36c1ee08c746 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:46:22.054895 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0955aea9-e38b-4394-92f6-36c1ee08c746 None admin] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:46:22.055178 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0955aea9-e38b-4394-92f6-36c1ee08c746 None admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:46:22.055719 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0955aea9-e38b-4394-92f6-36c1ee08c746 None admin] PATH_INFO: `/v3/projects` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:46:22.056510 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0955aea9-e38b-4394-92f6-36c1ee08c746 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80395) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 15:46:22.056947 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0955aea9-e38b-4394-92f6-36c1ee08c746 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:46:22.058996 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0955aea9-e38b-4394-92f6-36c1ee08c746 None admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:46:22.060228 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-269d90ae-5043-4d9c-bbdd-c980c3d926cc None admin] Validating token access rules against request {{(pid=80396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:46:22.072635 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 268/528] 10.222.0.59 () {56 vars in 1148 bytes} [Thu Jun 2 15:46:21 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 15:46:22.072635 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0955aea9-e38b-4394-92f6-36c1ee08c746 None admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:46:22.100235 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c78da923-95c1-4398-b524-5f0821e8fd39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:46:22.101661 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c78da923-95c1-4398-b524-5f0821e8fd39 None admin] REQUEST_METHOD: `GET` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:46:22.102096 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c78da923-95c1-4398-b524-5f0821e8fd39 None admin] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:46:22.102385 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c78da923-95c1-4398-b524-5f0821e8fd39 None admin] PATH_INFO: `/v3/users` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:46:22.103230 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c78da923-95c1-4398-b524-5f0821e8fd39 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=80396) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 15:46:22.103543 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c78da923-95c1-4398-b524-5f0821e8fd39 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:46:22.104979 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c78da923-95c1-4398-b524-5f0821e8fd39 None admin] RBAC: Authorization granted {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:46:22.123888 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 261/529] 10.222.0.59 () {56 vars in 1139 bytes} [Thu Jun 2 15:46:21 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 15:46:22.124708 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c78da923-95c1-4398-b524-5f0821e8fd39 None admin] Authenticating user token {{(pid=80396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:46:22.144885 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writing DB stats keystone:SELECT=100 {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:46:22.197749 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0955aea9-e38b-4394-92f6-36c1ee08c746 None admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:46:22.234213 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20edcba6-401d-47f3-a061-02fdd37bcf40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:46:22.234867 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20edcba6-401d-47f3-a061-02fdd37bcf40 None admin] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:46:22.235144 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20edcba6-401d-47f3-a061-02fdd37bcf40 None admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:46:22.235415 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20edcba6-401d-47f3-a061-02fdd37bcf40 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:46:22.236241 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20edcba6-401d-47f3-a061-02fdd37bcf40 None admin] RBAC: Adding query filter params (role.id=36214aa6067e4493a555da410f965c5e, scope.project.id=9c87c981909d4b8db02783421818c79b, user.id=52f9fe4b13574516bb0a8e2aa11a61e8) {{(pid=80395) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 15:46:22.236547 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20edcba6-401d-47f3-a061-02fdd37bcf40 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:46:22.238057 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG dbcounter [-] [80396] Writing DB stats keystone:SELECT=100 {{(pid=80396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:46:22.238207 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20edcba6-401d-47f3-a061-02fdd37bcf40 None admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:46:22.242803 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c78da923-95c1-4398-b524-5f0821e8fd39 None admin] Validating token access rules against request {{(pid=80396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:46:22.251050 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 269/530] 10.222.0.59 () {56 vars in 1374 bytes} [Thu Jun 2 15:46:22 2022] GET /identity/v3/role_assignments?user.id=52f9fe4b13574516bb0a8e2aa11a61e8&scope.project.id=9c87c981909d4b8db02783421818c79b&role.id=36214aa6067e4493a555da410f965c5e => generated 259 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 15:46:22.252323 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20edcba6-401d-47f3-a061-02fdd37bcf40 None admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:46:22.282588 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae912047-3b8b-460b-88cb-ecfd0d7799b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:46:22.283264 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae912047-3b8b-460b-88cb-ecfd0d7799b0 None admin] REQUEST_METHOD: `GET` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:46:22.283549 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae912047-3b8b-460b-88cb-ecfd0d7799b0 None admin] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:46:22.283825 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae912047-3b8b-460b-88cb-ecfd0d7799b0 None admin] PATH_INFO: `/v3/domains` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:46:22.284582 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae912047-3b8b-460b-88cb-ecfd0d7799b0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80396) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 15:46:22.284873 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae912047-3b8b-460b-88cb-ecfd0d7799b0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:46:22.286364 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae912047-3b8b-460b-88cb-ecfd0d7799b0 None admin] RBAC: Authorization granted {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:46:22.308465 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 262/531] 10.222.0.59 () {56 vars in 1109 bytes} [Thu Jun 2 15:46:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 15:46:22.308465 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae912047-3b8b-460b-88cb-ecfd0d7799b0 None admin] Authenticating user token {{(pid=80396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:46:22.409140 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20edcba6-401d-47f3-a061-02fdd37bcf40 None admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:46:22.443532 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writing DB stats keystone:SELECT=100 {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:46:22.446346 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae912047-3b8b-460b-88cb-ecfd0d7799b0 None admin] Validating token access rules against request {{(pid=80396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:46:22.455775 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac359bf7-1b86-48a3-8c1d-71c005914e3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:46:22.456518 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac359bf7-1b86-48a3-8c1d-71c005914e3e None admin] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:46:22.456751 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac359bf7-1b86-48a3-8c1d-71c005914e3e None admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:46:22.457041 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac359bf7-1b86-48a3-8c1d-71c005914e3e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:46:22.457897 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac359bf7-1b86-48a3-8c1d-71c005914e3e None admin] RBAC: Adding query filter params (role.id=36214aa6067e4493a555da410f965c5e, scope.project.id=9c87c981909d4b8db02783421818c79b, user.id=e673e7e0a4bf4c77bdb3e5325d0d3275) {{(pid=80395) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 15:46:22.458249 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac359bf7-1b86-48a3-8c1d-71c005914e3e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:46:22.459765 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac359bf7-1b86-48a3-8c1d-71c005914e3e None admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:46:22.468063 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 270/532] 10.222.0.59 () {56 vars in 1374 bytes} [Thu Jun 2 15:46:22 2022] GET /identity/v3/role_assignments?user.id=e673e7e0a4bf4c77bdb3e5325d0d3275&scope.project.id=9c87c981909d4b8db02783421818c79b&role.id=36214aa6067e4493a555da410f965c5e => generated 259 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 15:46:22.468950 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac359bf7-1b86-48a3-8c1d-71c005914e3e None admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:46:22.493021 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96bbb45e-9fd2-4beb-ac37-57b69a2c70d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:46:22.494038 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96bbb45e-9fd2-4beb-ac37-57b69a2c70d8 None admin] REQUEST_METHOD: `GET` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:46:22.494390 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96bbb45e-9fd2-4beb-ac37-57b69a2c70d8 None admin] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:46:22.494681 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96bbb45e-9fd2-4beb-ac37-57b69a2c70d8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:46:22.538612 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG dbcounter [-] [80396] Writing DB stats keystone:SELECT=100 {{(pid=80396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:46:22.587044 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96bbb45e-9fd2-4beb-ac37-57b69a2c70d8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:46:22.588810 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96bbb45e-9fd2-4beb-ac37-57b69a2c70d8 None admin] RBAC: Authorization granted {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:46:22.701733 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac359bf7-1b86-48a3-8c1d-71c005914e3e None admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:46:22.712262 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 263/533] 10.222.0.59 () {58 vars in 1282 bytes} [Thu Jun 2 15:46:22 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 405 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 02 15:46:22.720844 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96bbb45e-9fd2-4beb-ac37-57b69a2c70d8 None admin] Authenticating user token {{(pid=80396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:46:22.754179 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d65edbd5-34ce-4a52-9aa7-8c08a36fbde9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:46:22.755443 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d65edbd5-34ce-4a52-9aa7-8c08a36fbde9 None admin] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:46:22.755941 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d65edbd5-34ce-4a52-9aa7-8c08a36fbde9 None admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:46:22.756440 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d65edbd5-34ce-4a52-9aa7-8c08a36fbde9 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:46:22.775356 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d65edbd5-34ce-4a52-9aa7-8c08a36fbde9 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:46:22.777284 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d65edbd5-34ce-4a52-9aa7-8c08a36fbde9 None admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:46:22.794780 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG dbcounter [-] [80396] Writing DB stats keystone:SELECT=100 {{(pid=80396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:46:22.810950 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application [None req-d65edbd5-34ce-4a52-9aa7-8c08a36fbde9 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 02 15:46:22.810950 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 15:46:22.810950 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 15:46:22.810950 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 15:46:22.810950 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 15:46:22.810950 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 15:46:22.810950 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 15:46:22.810950 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 15:46:22.810950 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 15:46:22.810950 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 15:46:22.810950 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 15:46:22.810950 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 15:46:22.810950 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 02 15:46:22.810950 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 02 15:46:22.810950 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 02 15:46:22.816433 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 02 15:46:22.816433 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 15:46:22.816433 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 15:46:22.816433 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 15:46:22.816433 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 15:46:22.816433 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 15:46:22.816433 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 15:46:22.816433 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 15:46:22.816433 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application with Lock( Jun 02 15:46:22.816433 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 15:46:22.816433 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self._enter() Jun 02 15:46:22.816433 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 15:46:22.816433 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 15:46:22.816433 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 15:46:22.816433 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self.creator() Jun 02 15:46:22.816433 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 15:46:22.816433 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application created_value = creator( Jun 02 15:46:22.817308 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 02 15:46:22.817308 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 02 15:46:22.817308 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 02 15:46:22.817308 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 02 15:46:22.817308 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 02 15:46:22.817308 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 02 15:46:22.817308 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 02 15:46:22.817308 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application Jun 02 15:46:22.817308 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 271/534] 10.222.0.59 () {56 vars in 1111 bytes} [Thu Jun 2 15:46:22 2022] GET /identity/v3/projects/service => generated 88 bytes in 344 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 15:46:22.817308 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2342bd4e-1238-4421-94b1-3f72bfe0b93c None None] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:46:22.817308 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2342bd4e-1238-4421-94b1-3f72bfe0b93c None None] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:46:22.817983 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2342bd4e-1238-4421-94b1-3f72bfe0b93c None None] PATH_INFO: `/` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:46:22.820357 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 272/535] 10.222.0.59 () {54 vars in 926 bytes} [Thu Jun 2 15:46:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 15:46:22.821181 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2342bd4e-1238-4421-94b1-3f72bfe0b93c None None] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:46:22.846294 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96bbb45e-9fd2-4beb-ac37-57b69a2c70d8 None admin] Validating token access rules against request {{(pid=80396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:46:22.878607 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writing DB stats keystone:SELECT=100 {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:46:22.900607 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8438c384-ba0a-4403-b678-a066fa2a0110 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:46:22.901445 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8438c384-ba0a-4403-b678-a066fa2a0110 None admin] REQUEST_METHOD: `GET` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:46:22.902019 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8438c384-ba0a-4403-b678-a066fa2a0110 None admin] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:46:22.902331 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8438c384-ba0a-4403-b678-a066fa2a0110 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:46:22.919361 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8438c384-ba0a-4403-b678-a066fa2a0110 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:46:22.921121 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8438c384-ba0a-4403-b678-a066fa2a0110 None admin] RBAC: Authorization granted {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:46:22.943221 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2342bd4e-1238-4421-94b1-3f72bfe0b93c None None] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:46:22.947861 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application [None req-8438c384-ba0a-4403-b678-a066fa2a0110 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 15:46:22.947861 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 15:46:22.947861 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 15:46:22.947861 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 15:46:22.947861 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 15:46:22.947861 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 15:46:22.947861 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 15:46:22.947861 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 15:46:22.947861 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 15:46:22.947861 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 15:46:22.947861 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 15:46:22.947861 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 15:46:22.947861 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 02 15:46:22.947861 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 02 15:46:22.947861 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 02 15:46:22.949860 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 02 15:46:22.949860 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 15:46:22.949860 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 15:46:22.949860 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 15:46:22.949860 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 15:46:22.949860 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 15:46:22.949860 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 15:46:22.949860 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 15:46:22.949860 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application with Lock( Jun 02 15:46:22.949860 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 15:46:22.949860 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application return self._enter() Jun 02 15:46:22.949860 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 15:46:22.949860 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 15:46:22.949860 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 15:46:22.949860 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application return self.creator() Jun 02 15:46:22.949860 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 15:46:22.949860 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application created_value = creator( Jun 02 15:46:22.952012 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 02 15:46:22.952012 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 02 15:46:22.952012 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 15:46:22.952012 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application Jun 02 15:46:22.952012 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 264/536] 10.222.0.59 () {56 vars in 1108 bytes} [Thu Jun 2 15:46:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 229 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 15:46:22.952012 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be9caf1f-b595-4e44-8b22-a295050baa64 None None] REQUEST_METHOD: `POST` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:46:22.952012 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be9caf1f-b595-4e44-8b22-a295050baa64 None None] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:46:22.952012 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be9caf1f-b595-4e44-8b22-a295050baa64 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:46:22.973999 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.auth.core [None req-be9caf1f-b595-4e44-8b22-a295050baa64 None None] MFA Rules not processed for user `400d1f4db9de49638549e5db29a041e1`. Rule list: `[]` (Enabled: `True`). {{(pid=80396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 15:46:22.976725 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.fernet_utils [None req-be9caf1f-b595-4e44-8b22-a295050baa64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 15:46:22.984907 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1161b83c-20ee-4566-9b28-146aa0cf1436 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:46:22.985690 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1161b83c-20ee-4566-9b28-146aa0cf1436 None admin] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:46:22.986131 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1161b83c-20ee-4566-9b28-146aa0cf1436 None admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:46:22.986545 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1161b83c-20ee-4566-9b28-146aa0cf1436 None admin] PATH_INFO: `/v3/projects` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:46:22.987890 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1161b83c-20ee-4566-9b28-146aa0cf1436 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80395) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 15:46:22.988312 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1161b83c-20ee-4566-9b28-146aa0cf1436 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:46:22.990602 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1161b83c-20ee-4566-9b28-146aa0cf1436 None admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:46:23.006695 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 273/537] 10.222.0.59 () {56 vars in 1148 bytes} [Thu Jun 2 15:46:22 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 15:46:23.008269 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1161b83c-20ee-4566-9b28-146aa0cf1436 None admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:46:23.073342 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 265/538] 10.222.0.59 () {58 vars in 1023 bytes} [Thu Jun 2 15:46:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 02 15:46:23.074464 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be9caf1f-b595-4e44-8b22-a295050baa64 None None] Authenticating user token {{(pid=80396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:46:23.123475 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1161b83c-20ee-4566-9b28-146aa0cf1436 None admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:46:23.137312 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG dbcounter [-] [80396] Writing DB stats keystone:SELECT=100 {{(pid=80396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:46:23.138447 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writing DB stats keystone:SELECT=100 {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:46:23.161061 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bf8a030-e2b7-4357-99c4-c2ef8cabd9bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:46:23.161982 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf8a030-e2b7-4357-99c4-c2ef8cabd9bb None admin] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:46:23.162518 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf8a030-e2b7-4357-99c4-c2ef8cabd9bb None admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:46:23.163076 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf8a030-e2b7-4357-99c4-c2ef8cabd9bb None admin] PATH_INFO: `/v3/domains` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:46:23.164010 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bf8a030-e2b7-4357-99c4-c2ef8cabd9bb None admin] RBAC: Adding query filter params (name=Default) {{(pid=80395) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 15:46:23.164537 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bf8a030-e2b7-4357-99c4-c2ef8cabd9bb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:46:23.166245 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bf8a030-e2b7-4357-99c4-c2ef8cabd9bb None admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:46:23.180199 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 274/539] 10.222.0.59 () {56 vars in 1109 bytes} [Thu Jun 2 15:46:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 15:46:23.181485 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bf8a030-e2b7-4357-99c4-c2ef8cabd9bb None admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:46:23.199234 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be9caf1f-b595-4e44-8b22-a295050baa64 None None] Validating token access rules against request {{(pid=80396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:46:23.236234 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6095636b-21e0-44c0-88bc-d82023b86964 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:46:23.236735 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6095636b-21e0-44c0-88bc-d82023b86964 None admin] REQUEST_METHOD: `GET` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:46:23.237019 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6095636b-21e0-44c0-88bc-d82023b86964 None admin] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:46:23.237293 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6095636b-21e0-44c0-88bc-d82023b86964 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:46:23.238166 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6095636b-21e0-44c0-88bc-d82023b86964 None admin] RBAC: Adding query filter params (role.id=36214aa6067e4493a555da410f965c5e, scope.project.id=9c87c981909d4b8db02783421818c79b, user.id=6534961c369940a5b88f310c6450250b) {{(pid=80396) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 15:46:23.238478 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6095636b-21e0-44c0-88bc-d82023b86964 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:46:23.239991 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6095636b-21e0-44c0-88bc-d82023b86964 None admin] RBAC: Authorization granted {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:46:23.246865 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 266/540] 10.222.0.59 () {56 vars in 1374 bytes} [Thu Jun 2 15:46:23 2022] GET /identity/v3/role_assignments?user.id=6534961c369940a5b88f310c6450250b&scope.project.id=9c87c981909d4b8db02783421818c79b&role.id=36214aa6067e4493a555da410f965c5e => generated 259 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 15:46:23.247805 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6095636b-21e0-44c0-88bc-d82023b86964 None admin] Authenticating user token {{(pid=80396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:46:23.298443 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bf8a030-e2b7-4357-99c4-c2ef8cabd9bb None admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:46:23.339058 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-561877db-d04f-4e47-ae6e-7d42d7ac9b10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:46:23.340381 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561877db-d04f-4e47-ae6e-7d42d7ac9b10 None admin] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:46:23.340917 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561877db-d04f-4e47-ae6e-7d42d7ac9b10 None admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:46:23.341455 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561877db-d04f-4e47-ae6e-7d42d7ac9b10 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:46:23.355879 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-561877db-d04f-4e47-ae6e-7d42d7ac9b10 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 02 15:46:23.364352 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application [None req-561877db-d04f-4e47-ae6e-7d42d7ac9b10 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 02 15:46:23.364352 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 15:46:23.364352 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 15:46:23.364352 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 15:46:23.364352 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 15:46:23.364352 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 15:46:23.364352 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 15:46:23.364352 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 15:46:23.364352 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 15:46:23.364352 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 15:46:23.364352 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 15:46:23.364352 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 15:46:23.364352 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 02 15:46:23.364352 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 02 15:46:23.364352 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 02 15:46:23.364352 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 02 15:46:23.365331 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 02 15:46:23.365331 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 02 15:46:23.365331 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 02 15:46:23.365331 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 02 15:46:23.365331 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 15:46:23.365331 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 15:46:23.365331 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 15:46:23.365331 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 15:46:23.365331 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 15:46:23.365331 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 15:46:23.365331 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 15:46:23.365331 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application with Lock( Jun 02 15:46:23.365331 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 15:46:23.365331 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self._enter() Jun 02 15:46:23.365331 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 15:46:23.365331 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 15:46:23.366842 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 15:46:23.366842 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self.creator() Jun 02 15:46:23.366842 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 15:46:23.366842 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application created_value = creator( Jun 02 15:46:23.366842 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 02 15:46:23.366842 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 02 15:46:23.366842 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 02 15:46:23.366842 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 02 15:46:23.366842 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 02 15:46:23.366842 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 02 15:46:23.366842 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 02 15:46:23.366842 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application Jun 02 15:46:23.369429 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 275/541] 10.222.0.59 () {56 vars in 1102 bytes} [Thu Jun 2 15:46:23 2022] GET /identity/v3/roles/service => generated 85 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 15:46:23.376106 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-561877db-d04f-4e47-ae6e-7d42d7ac9b10 None admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:46:23.438472 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writing DB stats keystone:SELECT=100 {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:46:23.439440 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6095636b-21e0-44c0-88bc-d82023b86964 None admin] Validating token access rules against request {{(pid=80396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:46:23.454363 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG dbcounter [-] [80396] Writing DB stats keystone:SELECT=100 {{(pid=80396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:46:23.513992 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8257af3b-c55d-478b-8f51-00e58f78cef6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:46:23.514858 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8257af3b-c55d-478b-8f51-00e58f78cef6 None admin] REQUEST_METHOD: `GET` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:46:23.515147 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8257af3b-c55d-478b-8f51-00e58f78cef6 None admin] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:46:23.517811 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8257af3b-c55d-478b-8f51-00e58f78cef6 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:46:23.534933 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8257af3b-c55d-478b-8f51-00e58f78cef6 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:46:23.536403 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8257af3b-c55d-478b-8f51-00e58f78cef6 None admin] RBAC: Authorization granted {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:46:23.565104 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-561877db-d04f-4e47-ae6e-7d42d7ac9b10 None admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:46:23.566997 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application [None req-8257af3b-c55d-478b-8f51-00e58f78cef6 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 02 15:46:23.566997 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 15:46:23.566997 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 15:46:23.566997 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 15:46:23.566997 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 15:46:23.566997 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 15:46:23.566997 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 15:46:23.566997 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 15:46:23.566997 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 15:46:23.566997 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 15:46:23.566997 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 15:46:23.566997 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 15:46:23.566997 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 02 15:46:23.566997 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 02 15:46:23.566997 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 02 15:46:23.567805 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 02 15:46:23.567805 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 15:46:23.567805 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 15:46:23.567805 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 15:46:23.567805 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 15:46:23.567805 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 15:46:23.567805 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 15:46:23.567805 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 15:46:23.567805 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application with Lock( Jun 02 15:46:23.567805 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 15:46:23.567805 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application return self._enter() Jun 02 15:46:23.567805 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 15:46:23.567805 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 15:46:23.567805 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 15:46:23.567805 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application return self.creator() Jun 02 15:46:23.567805 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 15:46:23.567805 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application created_value = creator( Jun 02 15:46:23.568639 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 02 15:46:23.568639 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 02 15:46:23.568639 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 02 15:46:23.568639 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 02 15:46:23.568639 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 02 15:46:23.568639 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 02 15:46:23.568639 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 02 15:46:23.568639 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application Jun 02 15:46:23.574517 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 267/542] 10.222.0.59 () {56 vars in 1111 bytes} [Thu Jun 2 15:46:23 2022] GET /identity/v3/projects/service => generated 88 bytes in 327 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 15:46:23.583597 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8257af3b-c55d-478b-8f51-00e58f78cef6 None admin] Authenticating user token {{(pid=80396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:46:23.601617 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56b44df7-212c-4f32-9eb7-715733545f3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:46:23.602326 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b44df7-212c-4f32-9eb7-715733545f3f None admin] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:46:23.602616 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b44df7-212c-4f32-9eb7-715733545f3f None admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:46:23.602912 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b44df7-212c-4f32-9eb7-715733545f3f None admin] PATH_INFO: `/v3/roles` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:46:23.603679 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56b44df7-212c-4f32-9eb7-715733545f3f None admin] RBAC: Adding query filter params (name=service) {{(pid=80395) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 15:46:23.603996 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56b44df7-212c-4f32-9eb7-715733545f3f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:46:23.605380 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56b44df7-212c-4f32-9eb7-715733545f3f None admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:46:23.614364 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 276/543] 10.222.0.59 () {56 vars in 1103 bytes} [Thu Jun 2 15:46:23 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 15:46:23.620075 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56b44df7-212c-4f32-9eb7-715733545f3f None admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:46:23.733033 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writing DB stats keystone:SELECT=100 {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:46:23.738653 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56b44df7-212c-4f32-9eb7-715733545f3f None admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:46:23.779357 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-374efe74-6da8-48b9-afed-b676f30b31af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:46:23.780098 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-374efe74-6da8-48b9-afed-b676f30b31af None admin] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:46:23.780384 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-374efe74-6da8-48b9-afed-b676f30b31af None admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:46:23.780663 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-374efe74-6da8-48b9-afed-b676f30b31af None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:46:23.800987 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-374efe74-6da8-48b9-afed-b676f30b31af None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:46:23.802908 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-374efe74-6da8-48b9-afed-b676f30b31af None admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:46:23.843943 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application [None req-374efe74-6da8-48b9-afed-b676f30b31af None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 15:46:23.843943 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 15:46:23.843943 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 15:46:23.843943 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 15:46:23.843943 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 15:46:23.843943 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 15:46:23.843943 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 15:46:23.843943 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 15:46:23.843943 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 15:46:23.843943 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 15:46:23.843943 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 15:46:23.843943 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 15:46:23.843943 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 02 15:46:23.843943 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 02 15:46:23.843943 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 02 15:46:23.844857 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 02 15:46:23.844857 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 15:46:23.844857 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 15:46:23.844857 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 15:46:23.844857 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 15:46:23.844857 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 15:46:23.844857 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 15:46:23.844857 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 15:46:23.844857 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application with Lock( Jun 02 15:46:23.844857 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 15:46:23.844857 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self._enter() Jun 02 15:46:23.844857 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 15:46:23.844857 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 15:46:23.844857 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 15:46:23.844857 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self.creator() Jun 02 15:46:23.844857 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 15:46:23.844857 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application created_value = creator( Jun 02 15:46:23.845762 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 02 15:46:23.845762 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 02 15:46:23.845762 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 15:46:23.845762 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application Jun 02 15:46:23.847807 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 277/544] 10.222.0.59 () {56 vars in 1108 bytes} [Thu Jun 2 15:46:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 15:46:23.848464 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8257af3b-c55d-478b-8f51-00e58f78cef6 None admin] Validating token access rules against request {{(pid=80396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:46:23.853524 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-374efe74-6da8-48b9-afed-b676f30b31af None admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:46:23.891131 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84dd8510-c2a2-4c3a-a91f-0b712c121fe2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:46:23.892069 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84dd8510-c2a2-4c3a-a91f-0b712c121fe2 None admin] REQUEST_METHOD: `GET` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:46:23.892366 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84dd8510-c2a2-4c3a-a91f-0b712c121fe2 None admin] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:46:23.892649 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84dd8510-c2a2-4c3a-a91f-0b712c121fe2 None admin] PATH_INFO: `/v3/projects` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:46:23.893954 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84dd8510-c2a2-4c3a-a91f-0b712c121fe2 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80396) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 15:46:23.894307 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84dd8510-c2a2-4c3a-a91f-0b712c121fe2 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:46:23.895920 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84dd8510-c2a2-4c3a-a91f-0b712c121fe2 None admin] RBAC: Authorization granted {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:46:23.916866 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 268/545] 10.222.0.59 () {56 vars in 1148 bytes} [Thu Jun 2 15:46:23 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 334 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 15:46:23.922251 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84dd8510-c2a2-4c3a-a91f-0b712c121fe2 None admin] Authenticating user token {{(pid=80396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:46:23.982442 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG dbcounter [-] [80396] Writing DB stats keystone:SELECT=100 {{(pid=80396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:46:24.084239 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-374efe74-6da8-48b9-afed-b676f30b31af None admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:46:24.090010 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84dd8510-c2a2-4c3a-a91f-0b712c121fe2 None admin] Validating token access rules against request {{(pid=80396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:46:24.159931 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee4cbf05-a36e-4910-bb00-a3fb532abc64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:46:24.161442 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee4cbf05-a36e-4910-bb00-a3fb532abc64 None admin] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:46:24.169605 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee4cbf05-a36e-4910-bb00-a3fb532abc64 None admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:46:24.169605 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee4cbf05-a36e-4910-bb00-a3fb532abc64 None admin] PATH_INFO: `/v3/domains` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:46:24.169605 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee4cbf05-a36e-4910-bb00-a3fb532abc64 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80395) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 15:46:24.169605 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee4cbf05-a36e-4910-bb00-a3fb532abc64 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:46:24.169605 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee4cbf05-a36e-4910-bb00-a3fb532abc64 None admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:46:24.176160 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed097aaa-a722-45e8-a85c-e53a818b10e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:46:24.176831 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed097aaa-a722-45e8-a85c-e53a818b10e3 None admin] REQUEST_METHOD: `GET` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:46:24.177114 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed097aaa-a722-45e8-a85c-e53a818b10e3 None admin] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:46:24.177392 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed097aaa-a722-45e8-a85c-e53a818b10e3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:46:24.178256 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed097aaa-a722-45e8-a85c-e53a818b10e3 None admin] RBAC: Adding query filter params (role.id=36214aa6067e4493a555da410f965c5e, scope.project.id=9c87c981909d4b8db02783421818c79b, user.id=9af40ddfe9ff4be3887b068f13a28dc0) {{(pid=80396) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 15:46:24.178696 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed097aaa-a722-45e8-a85c-e53a818b10e3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:46:24.180579 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed097aaa-a722-45e8-a85c-e53a818b10e3 None admin] RBAC: Authorization granted {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:46:24.196887 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 269/546] 10.222.0.59 () {56 vars in 1374 bytes} [Thu Jun 2 15:46:23 2022] GET /identity/v3/role_assignments?user.id=9af40ddfe9ff4be3887b068f13a28dc0&scope.project.id=9c87c981909d4b8db02783421818c79b&role.id=36214aa6067e4493a555da410f965c5e => generated 259 bytes in 275 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 15:46:24.206704 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 278/547] 10.222.0.59 () {56 vars in 1109 bytes} [Thu Jun 2 15:46:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 354 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 15:46:24.213498 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed097aaa-a722-45e8-a85c-e53a818b10e3 None admin] Authenticating user token {{(pid=80396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:46:24.387375 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG dbcounter [-] [80396] Writing DB stats keystone:SELECT=100 {{(pid=80396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:46:24.408066 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed097aaa-a722-45e8-a85c-e53a818b10e3 None admin] Validating token access rules against request {{(pid=80396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:46:24.452676 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72ecc01c-3d73-4eb8-a890-868b2fa513eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:46:24.453469 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ecc01c-3d73-4eb8-a890-868b2fa513eb None admin] REQUEST_METHOD: `GET` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:46:24.453750 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ecc01c-3d73-4eb8-a890-868b2fa513eb None admin] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:46:24.454019 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ecc01c-3d73-4eb8-a890-868b2fa513eb None admin] PATH_INFO: `/v3/users/swift` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:46:24.463362 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72ecc01c-3d73-4eb8-a890-868b2fa513eb None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:46:24.464870 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72ecc01c-3d73-4eb8-a890-868b2fa513eb None admin] RBAC: Authorization granted {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:46:24.480283 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application [None req-72ecc01c-3d73-4eb8-a890-868b2fa513eb None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jun 02 15:46:24.480283 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 15:46:24.480283 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 15:46:24.480283 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 15:46:24.480283 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 15:46:24.480283 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 15:46:24.480283 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 15:46:24.480283 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 15:46:24.480283 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 15:46:24.480283 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 15:46:24.480283 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 15:46:24.480283 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 15:46:24.480283 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 02 15:46:24.480283 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 02 15:46:24.480283 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 02 15:46:24.480283 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 02 15:46:24.481286 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 15:46:24.481286 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 15:46:24.481286 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 02 15:46:24.481286 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 02 15:46:24.481286 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 02 15:46:24.481286 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 02 15:46:24.481286 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 15:46:24.481286 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 15:46:24.481286 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 15:46:24.481286 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 15:46:24.481286 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 15:46:24.481286 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application with Lock( Jun 02 15:46:24.481286 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 15:46:24.481286 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application return self._enter() Jun 02 15:46:24.481286 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 15:46:24.481286 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 15:46:24.481286 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 15:46:24.481286 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application return self.creator() Jun 02 15:46:24.482244 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 15:46:24.482244 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application created_value = creator( Jun 02 15:46:24.482244 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 02 15:46:24.482244 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 02 15:46:24.482244 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 02 15:46:24.482244 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 02 15:46:24.482244 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 02 15:46:24.482244 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 02 15:46:24.482244 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jun 02 15:46:24.482244 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application Jun 02 15:46:24.482244 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 270/548] 10.222.0.59 () {56 vars in 1096 bytes} [Thu Jun 2 15:46:24 2022] GET /identity/v3/users/swift => generated 83 bytes in 269 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 15:46:24.488139 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee4cbf05-a36e-4910-bb00-a3fb532abc64 None admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:46:24.491826 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writing DB stats keystone:SELECT=100 {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:46:24.604556 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee4cbf05-a36e-4910-bb00-a3fb532abc64 None admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:46:24.645682 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a874e74b-4f30-40d3-9f98-c686e414eff3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:46:24.646300 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a874e74b-4f30-40d3-9f98-c686e414eff3 None admin] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:46:24.646582 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a874e74b-4f30-40d3-9f98-c686e414eff3 None admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:46:24.646857 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a874e74b-4f30-40d3-9f98-c686e414eff3 None admin] PATH_INFO: `/v3/users` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:46:24.648241 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a874e74b-4f30-40d3-9f98-c686e414eff3 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80395) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 15:46:24.648645 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a874e74b-4f30-40d3-9f98-c686e414eff3 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:46:24.650101 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a874e74b-4f30-40d3-9f98-c686e414eff3 None admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:46:24.696286 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 279/549] 10.222.0.59 () {56 vars in 1135 bytes} [Thu Jun 2 15:46:24 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 15:46:24.698634 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72ecc01c-3d73-4eb8-a890-868b2fa513eb None admin] Authenticating user token {{(pid=80396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:46:24.864263 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72ecc01c-3d73-4eb8-a890-868b2fa513eb None admin] Validating token access rules against request {{(pid=80396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:46:24.934956 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1eea722-e773-44a9-8aaa-1a82abafa6e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:46:24.935702 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1eea722-e773-44a9-8aaa-1a82abafa6e9 None admin] REQUEST_METHOD: `GET` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:46:24.935936 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1eea722-e773-44a9-8aaa-1a82abafa6e9 None admin] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:46:24.936131 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1eea722-e773-44a9-8aaa-1a82abafa6e9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:46:24.967198 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG dbcounter [-] [80396] Writing DB stats keystone:SELECT=100 {{(pid=80396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:46:25.041649 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1eea722-e773-44a9-8aaa-1a82abafa6e9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:46:25.043127 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1eea722-e773-44a9-8aaa-1a82abafa6e9 None admin] RBAC: Authorization granted {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:46:25.092731 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed84984-bc58-41ef-9c83-5f86c2a9d030 None None] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:46:25.093259 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed84984-bc58-41ef-9c83-5f86c2a9d030 None None] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:46:25.093350 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed84984-bc58-41ef-9c83-5f86c2a9d030 None None] PATH_INFO: `/` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:46:25.094999 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 280/550] 10.222.0.59 () {54 vars in 926 bytes} [Thu Jun 2 15:46:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 15:46:25.100179 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50065a2f-69fb-4995-9d88-b3ac8aa1b83e None None] REQUEST_METHOD: `POST` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:46:25.101044 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50065a2f-69fb-4995-9d88-b3ac8aa1b83e None None] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:46:25.101388 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50065a2f-69fb-4995-9d88-b3ac8aa1b83e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:46:25.130142 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.auth.core [None req-50065a2f-69fb-4995-9d88-b3ac8aa1b83e None None] MFA Rules not processed for user `400d1f4db9de49638549e5db29a041e1`. Rule list: `[]` (Enabled: `True`). {{(pid=80395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 15:46:25.132248 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.fernet_utils [None req-50065a2f-69fb-4995-9d88-b3ac8aa1b83e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 15:46:25.157494 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 271/551] 10.222.0.59 () {58 vars in 1282 bytes} [Thu Jun 2 15:46:24 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 459 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 02 15:46:25.159895 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d990803-628f-48bf-973f-e5901fff88e1 None None] REQUEST_METHOD: `GET` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:46:25.159895 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d990803-628f-48bf-973f-e5901fff88e1 None None] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:46:25.159895 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d990803-628f-48bf-973f-e5901fff88e1 None None] PATH_INFO: `/` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:46:25.161008 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 272/552] 10.222.0.59 () {54 vars in 926 bytes} [Thu Jun 2 15:46:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 15:46:25.164487 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d990803-628f-48bf-973f-e5901fff88e1 None None] Authenticating user token {{(pid=80396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:46:25.214507 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writing DB stats keystone:SELECT=100 {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:46:25.226489 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG dbcounter [-] [80396] Writing DB stats keystone:SELECT=100 {{(pid=80396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:46:25.227231 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 281/553] 10.222.0.59 () {58 vars in 1023 bytes} [Thu Jun 2 15:46:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 02 15:46:25.228574 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b92709-378b-4ab8-b66a-5ad028a1739c None None] REQUEST_METHOD: `POST` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:46:25.229025 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b92709-378b-4ab8-b66a-5ad028a1739c None None] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:46:25.229402 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b92709-378b-4ab8-b66a-5ad028a1739c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:46:25.250788 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.auth.core [None req-a1b92709-378b-4ab8-b66a-5ad028a1739c None None] MFA Rules not processed for user `400d1f4db9de49638549e5db29a041e1`. Rule list: `[]` (Enabled: `True`). {{(pid=80395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 15:46:25.252111 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.fernet_utils [None req-a1b92709-378b-4ab8-b66a-5ad028a1739c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 15:46:25.287144 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d990803-628f-48bf-973f-e5901fff88e1 None None] Validating token access rules against request {{(pid=80396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:46:25.326141 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b67c623-e970-437e-b5e9-b2b63e15953a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:46:25.327205 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b67c623-e970-437e-b5e9-b2b63e15953a None admin] REQUEST_METHOD: `GET` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:46:25.327701 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b67c623-e970-437e-b5e9-b2b63e15953a None admin] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:46:25.328123 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b67c623-e970-437e-b5e9-b2b63e15953a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:46:25.346095 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 282/554] 10.222.0.59 () {58 vars in 1023 bytes} [Thu Jun 2 15:46:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 02 15:46:25.346095 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1b92709-378b-4ab8-b66a-5ad028a1739c None None] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:46:25.347448 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b67c623-e970-437e-b5e9-b2b63e15953a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:46:25.349146 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b67c623-e970-437e-b5e9-b2b63e15953a None admin] RBAC: Authorization granted {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:46:25.383587 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application [None req-5b67c623-e970-437e-b5e9-b2b63e15953a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 15:46:25.383587 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 15:46:25.383587 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 15:46:25.383587 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 15:46:25.383587 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 15:46:25.383587 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 15:46:25.383587 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 15:46:25.383587 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 15:46:25.383587 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 15:46:25.383587 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 15:46:25.383587 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 15:46:25.383587 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 15:46:25.383587 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 02 15:46:25.383587 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 02 15:46:25.383587 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 02 15:46:25.384738 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 02 15:46:25.384738 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 15:46:25.384738 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 15:46:25.384738 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 15:46:25.384738 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 15:46:25.384738 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 15:46:25.384738 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 15:46:25.384738 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 15:46:25.384738 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application with Lock( Jun 02 15:46:25.384738 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 15:46:25.384738 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application return self._enter() Jun 02 15:46:25.384738 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 15:46:25.384738 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 15:46:25.384738 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 15:46:25.384738 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application return self.creator() Jun 02 15:46:25.384738 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 15:46:25.384738 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application created_value = creator( Jun 02 15:46:25.385655 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 02 15:46:25.385655 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 02 15:46:25.385655 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 15:46:25.385655 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application Jun 02 15:46:25.387731 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 273/555] 10.222.0.59 () {56 vars in 1108 bytes} [Thu Jun 2 15:46:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 02 15:46:25.388827 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b67c623-e970-437e-b5e9-b2b63e15953a None admin] Authenticating user token {{(pid=80396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:46:25.455586 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1b92709-378b-4ab8-b66a-5ad028a1739c None None] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:46:25.480795 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writing DB stats keystone:SELECT=100 {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:46:25.496048 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b316a58-289d-4378-9a2f-aee0ad28624b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:46:25.497005 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b316a58-289d-4378-9a2f-aee0ad28624b None admin] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:46:25.497350 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b316a58-289d-4378-9a2f-aee0ad28624b None admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:46:25.497700 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b316a58-289d-4378-9a2f-aee0ad28624b None admin] PATH_INFO: `/v3/roles/service` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:46:25.509587 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b316a58-289d-4378-9a2f-aee0ad28624b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 02 15:46:25.519432 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application [None req-4b316a58-289d-4378-9a2f-aee0ad28624b None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 02 15:46:25.519432 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 15:46:25.519432 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 15:46:25.519432 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 15:46:25.519432 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 15:46:25.519432 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 15:46:25.519432 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 15:46:25.519432 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 15:46:25.519432 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 15:46:25.519432 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 15:46:25.519432 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 15:46:25.519432 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 15:46:25.519432 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 02 15:46:25.519432 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 02 15:46:25.519432 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 02 15:46:25.519432 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 02 15:46:25.521883 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 02 15:46:25.521883 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 02 15:46:25.521883 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 02 15:46:25.521883 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 02 15:46:25.521883 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 15:46:25.521883 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 15:46:25.521883 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 15:46:25.521883 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 15:46:25.521883 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 15:46:25.521883 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 15:46:25.521883 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 15:46:25.521883 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application with Lock( Jun 02 15:46:25.521883 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 15:46:25.521883 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self._enter() Jun 02 15:46:25.521883 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 15:46:25.521883 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 15:46:25.523686 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 15:46:25.523686 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self.creator() Jun 02 15:46:25.523686 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 15:46:25.523686 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application created_value = creator( Jun 02 15:46:25.523686 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 02 15:46:25.523686 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 02 15:46:25.523686 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 02 15:46:25.523686 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 02 15:46:25.523686 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 02 15:46:25.523686 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 02 15:46:25.523686 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 02 15:46:25.523686 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application Jun 02 15:46:25.523686 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 283/556] 10.222.0.59 () {56 vars in 1102 bytes} [Thu Jun 2 15:46:25 2022] GET /identity/v3/roles/service => generated 85 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 15:46:25.523686 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b316a58-289d-4378-9a2f-aee0ad28624b None admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:46:25.531849 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b67c623-e970-437e-b5e9-b2b63e15953a None admin] Validating token access rules against request {{(pid=80396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:46:25.547635 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG dbcounter [-] [80396] Writing DB stats keystone:SELECT=100 {{(pid=80396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:46:25.580988 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6ed65f6-001e-42ae-9eb4-bc891e5a32a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:46:25.581661 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ed65f6-001e-42ae-9eb4-bc891e5a32a3 None admin] REQUEST_METHOD: `GET` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:46:25.582044 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ed65f6-001e-42ae-9eb4-bc891e5a32a3 None admin] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:46:25.582454 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ed65f6-001e-42ae-9eb4-bc891e5a32a3 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:46:25.595042 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6ed65f6-001e-42ae-9eb4-bc891e5a32a3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 02 15:46:25.603237 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application [None req-b6ed65f6-001e-42ae-9eb4-bc891e5a32a3 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 02 15:46:25.603237 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 15:46:25.603237 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 15:46:25.603237 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 15:46:25.603237 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 15:46:25.603237 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 15:46:25.603237 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 15:46:25.603237 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 15:46:25.603237 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 15:46:25.603237 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 15:46:25.603237 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 15:46:25.603237 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 15:46:25.603237 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 02 15:46:25.603237 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 02 15:46:25.603237 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 02 15:46:25.603237 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 02 15:46:25.604375 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 02 15:46:25.604375 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 02 15:46:25.604375 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 02 15:46:25.604375 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 02 15:46:25.604375 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 15:46:25.604375 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 15:46:25.604375 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 15:46:25.604375 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 15:46:25.604375 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 15:46:25.604375 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 15:46:25.604375 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 15:46:25.604375 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application with Lock( Jun 02 15:46:25.604375 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 15:46:25.604375 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application return self._enter() Jun 02 15:46:25.604375 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 15:46:25.604375 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 15:46:25.605877 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 15:46:25.605877 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application return self.creator() Jun 02 15:46:25.605877 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 15:46:25.605877 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application created_value = creator( Jun 02 15:46:25.605877 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 02 15:46:25.605877 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 02 15:46:25.605877 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 02 15:46:25.605877 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 02 15:46:25.605877 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 02 15:46:25.605877 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 02 15:46:25.605877 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 02 15:46:25.605877 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application Jun 02 15:46:25.611847 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 274/557] 10.222.0.59 () {56 vars in 1102 bytes} [Thu Jun 2 15:46:25 2022] GET /identity/v3/roles/service => generated 85 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 15:46:25.611847 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6ed65f6-001e-42ae-9eb4-bc891e5a32a3 None admin] Authenticating user token {{(pid=80396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:46:25.677718 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b316a58-289d-4378-9a2f-aee0ad28624b None admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:46:25.719569 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3737403d-8e18-4e2f-9a31-b2ee502305f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:46:25.720632 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3737403d-8e18-4e2f-9a31-b2ee502305f8 None admin] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:46:25.721247 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3737403d-8e18-4e2f-9a31-b2ee502305f8 None admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:46:25.721839 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3737403d-8e18-4e2f-9a31-b2ee502305f8 None admin] PATH_INFO: `/v3/domains` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:46:25.722847 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3737403d-8e18-4e2f-9a31-b2ee502305f8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80395) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 15:46:25.723387 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3737403d-8e18-4e2f-9a31-b2ee502305f8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:46:25.725187 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3737403d-8e18-4e2f-9a31-b2ee502305f8 None admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:46:25.728511 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6ed65f6-001e-42ae-9eb4-bc891e5a32a3 None admin] Validating token access rules against request {{(pid=80396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:46:25.740481 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 284/558] 10.222.0.59 () {56 vars in 1109 bytes} [Thu Jun 2 15:46:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 15:46:25.742530 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3737403d-8e18-4e2f-9a31-b2ee502305f8 None admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:46:25.764615 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be4a42aa-76ea-4974-894d-8682bf983c9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:46:25.765371 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be4a42aa-76ea-4974-894d-8682bf983c9a None admin] REQUEST_METHOD: `GET` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:46:25.765610 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be4a42aa-76ea-4974-894d-8682bf983c9a None admin] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:46:25.765932 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be4a42aa-76ea-4974-894d-8682bf983c9a None admin] PATH_INFO: `/v3/roles` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:46:25.766762 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be4a42aa-76ea-4974-894d-8682bf983c9a None admin] RBAC: Adding query filter params (name=service) {{(pid=80396) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 15:46:25.767118 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be4a42aa-76ea-4974-894d-8682bf983c9a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:46:25.768500 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be4a42aa-76ea-4974-894d-8682bf983c9a None admin] RBAC: Authorization granted {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:46:25.777854 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 275/559] 10.222.0.59 () {56 vars in 1103 bytes} [Thu Jun 2 15:46:25 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 15:46:25.778822 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be4a42aa-76ea-4974-894d-8682bf983c9a None admin] Authenticating user token {{(pid=80396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:46:25.794501 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writing DB stats keystone:SELECT=100 {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:46:25.805778 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG dbcounter [-] [80396] Writing DB stats keystone:SELECT=100 {{(pid=80396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:46:25.862701 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3737403d-8e18-4e2f-9a31-b2ee502305f8 None admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:46:25.884521 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be4a42aa-76ea-4974-894d-8682bf983c9a None admin] Validating token access rules against request {{(pid=80396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:46:25.903078 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-564f617a-20c4-420f-9c7a-a494ca27e2cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:46:25.904029 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564f617a-20c4-420f-9c7a-a494ca27e2cc None admin] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:46:25.904500 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564f617a-20c4-420f-9c7a-a494ca27e2cc None admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:46:25.905059 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564f617a-20c4-420f-9c7a-a494ca27e2cc None admin] PATH_INFO: `/v3/roles` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:46:25.906027 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-564f617a-20c4-420f-9c7a-a494ca27e2cc None admin] RBAC: Adding query filter params (name=service) {{(pid=80395) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 15:46:25.906618 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-564f617a-20c4-420f-9c7a-a494ca27e2cc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:46:25.908178 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-564f617a-20c4-420f-9c7a-a494ca27e2cc None admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:46:25.919002 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 285/560] 10.222.0.59 () {56 vars in 1103 bytes} [Thu Jun 2 15:46:25 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 15:46:25.920070 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-564f617a-20c4-420f-9c7a-a494ca27e2cc None admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:46:25.928611 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-253a55ca-3edd-4212-9cef-6fb47ddf5fc3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:46:25.928611 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-253a55ca-3edd-4212-9cef-6fb47ddf5fc3 None admin] REQUEST_METHOD: `GET` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:46:25.928611 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-253a55ca-3edd-4212-9cef-6fb47ddf5fc3 None admin] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:46:25.928611 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-253a55ca-3edd-4212-9cef-6fb47ddf5fc3 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:46:25.940840 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-253a55ca-3edd-4212-9cef-6fb47ddf5fc3 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:46:25.942329 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-253a55ca-3edd-4212-9cef-6fb47ddf5fc3 None admin] RBAC: Authorization granted {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:46:25.956701 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application [None req-253a55ca-3edd-4212-9cef-6fb47ddf5fc3 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 02 15:46:25.956701 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 15:46:25.956701 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 15:46:25.956701 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 15:46:25.956701 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 15:46:25.956701 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 15:46:25.956701 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 15:46:25.956701 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 15:46:25.956701 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 15:46:25.956701 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 15:46:25.956701 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 15:46:25.956701 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 15:46:25.956701 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 02 15:46:25.956701 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 02 15:46:25.956701 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 02 15:46:25.957617 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 02 15:46:25.957617 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 15:46:25.957617 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 15:46:25.957617 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 15:46:25.957617 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 15:46:25.957617 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 15:46:25.957617 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 15:46:25.957617 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 15:46:25.957617 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application with Lock( Jun 02 15:46:25.957617 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 15:46:25.957617 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application return self._enter() Jun 02 15:46:25.957617 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 15:46:25.957617 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 15:46:25.957617 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 15:46:25.957617 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application return self.creator() Jun 02 15:46:25.957617 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 15:46:25.957617 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application created_value = creator( Jun 02 15:46:25.958653 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 02 15:46:25.958653 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 02 15:46:25.958653 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 02 15:46:25.958653 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 02 15:46:25.958653 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 02 15:46:25.958653 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 02 15:46:25.958653 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 02 15:46:25.958653 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application Jun 02 15:46:25.958653 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 276/561] 10.222.0.59 () {56 vars in 1111 bytes} [Thu Jun 2 15:46:25 2022] GET /identity/v3/projects/service => generated 88 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 15:46:25.960219 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-253a55ca-3edd-4212-9cef-6fb47ddf5fc3 None admin] Authenticating user token {{(pid=80396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:46:26.048402 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG dbcounter [-] [80396] Writing DB stats keystone:SELECT=100 {{(pid=80396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:46:26.048894 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-564f617a-20c4-420f-9c7a-a494ca27e2cc None admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:46:26.050870 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writing DB stats keystone:SELECT=100 {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:46:26.064331 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-253a55ca-3edd-4212-9cef-6fb47ddf5fc3 None admin] Validating token access rules against request {{(pid=80396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:46:26.088645 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-832f46fe-625c-4922-a957-f76e815a9b81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:46:26.089397 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832f46fe-625c-4922-a957-f76e815a9b81 None admin] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:46:26.089678 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832f46fe-625c-4922-a957-f76e815a9b81 None admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:46:26.090249 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832f46fe-625c-4922-a957-f76e815a9b81 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:46:26.101260 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-832f46fe-625c-4922-a957-f76e815a9b81 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:46:26.102900 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-832f46fe-625c-4922-a957-f76e815a9b81 None admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:46:26.103103 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-442fd8d7-68de-40ab-a311-e04ce0db9c78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:46:26.103948 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-442fd8d7-68de-40ab-a311-e04ce0db9c78 None admin] REQUEST_METHOD: `GET` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:46:26.104208 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-442fd8d7-68de-40ab-a311-e04ce0db9c78 None admin] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:46:26.104475 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-442fd8d7-68de-40ab-a311-e04ce0db9c78 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:46:26.114839 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-442fd8d7-68de-40ab-a311-e04ce0db9c78 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:46:26.116831 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-442fd8d7-68de-40ab-a311-e04ce0db9c78 None admin] RBAC: Authorization granted {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:46:26.122919 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application [None req-832f46fe-625c-4922-a957-f76e815a9b81 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 15:46:26.122919 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 15:46:26.122919 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 15:46:26.122919 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 15:46:26.122919 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 15:46:26.122919 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 15:46:26.122919 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 15:46:26.122919 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 15:46:26.122919 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 15:46:26.122919 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 15:46:26.122919 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 15:46:26.122919 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 15:46:26.122919 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 02 15:46:26.122919 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 02 15:46:26.122919 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 02 15:46:26.123771 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 02 15:46:26.123771 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 15:46:26.123771 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 15:46:26.123771 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 15:46:26.123771 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 15:46:26.123771 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 15:46:26.123771 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 15:46:26.123771 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 15:46:26.123771 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application with Lock( Jun 02 15:46:26.123771 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 15:46:26.123771 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self._enter() Jun 02 15:46:26.123771 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 15:46:26.123771 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 15:46:26.123771 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 15:46:26.123771 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self.creator() Jun 02 15:46:26.123771 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 15:46:26.123771 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application created_value = creator( Jun 02 15:46:26.124658 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 02 15:46:26.124658 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 02 15:46:26.124658 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 15:46:26.124658 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application Jun 02 15:46:26.126382 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 286/562] 10.222.0.59 () {56 vars in 1108 bytes} [Thu Jun 2 15:46:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 15:46:26.127910 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-832f46fe-625c-4922-a957-f76e815a9b81 None admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:46:26.137498 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application [None req-442fd8d7-68de-40ab-a311-e04ce0db9c78 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 15:46:26.137498 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 15:46:26.137498 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 15:46:26.137498 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 15:46:26.137498 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 15:46:26.137498 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 15:46:26.137498 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 15:46:26.137498 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 15:46:26.137498 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 15:46:26.137498 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 15:46:26.137498 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 15:46:26.137498 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 15:46:26.137498 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 02 15:46:26.137498 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 02 15:46:26.137498 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 02 15:46:26.138468 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 02 15:46:26.138468 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 15:46:26.138468 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 15:46:26.138468 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 15:46:26.138468 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 15:46:26.138468 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 15:46:26.138468 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 15:46:26.138468 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 15:46:26.138468 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application with Lock( Jun 02 15:46:26.138468 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 15:46:26.138468 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application return self._enter() Jun 02 15:46:26.138468 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 15:46:26.138468 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 15:46:26.138468 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 15:46:26.138468 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application return self.creator() Jun 02 15:46:26.138468 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 15:46:26.138468 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application created_value = creator( Jun 02 15:46:26.144666 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 02 15:46:26.144666 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 02 15:46:26.144666 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 15:46:26.144666 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application Jun 02 15:46:26.144666 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 277/563] 10.222.0.59 () {56 vars in 1108 bytes} [Thu Jun 2 15:46:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 15:46:26.144666 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9f44c2-0b54-4b31-b879-9681e5ee69ad None None] REQUEST_METHOD: `GET` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:46:26.144666 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9f44c2-0b54-4b31-b879-9681e5ee69ad None None] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:46:26.144666 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9f44c2-0b54-4b31-b879-9681e5ee69ad None None] PATH_INFO: `/` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:46:26.144666 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 278/564] 10.222.0.59 () {54 vars in 926 bytes} [Thu Jun 2 15:46:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 15:46:26.145184 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee9f44c2-0b54-4b31-b879-9681e5ee69ad None None] Authenticating user token {{(pid=80396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:46:26.260799 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-832f46fe-625c-4922-a957-f76e815a9b81 None admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:46:26.261110 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee9f44c2-0b54-4b31-b879-9681e5ee69ad None None] Validating token access rules against request {{(pid=80396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:46:26.297515 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a6af044-76ad-4ee4-80f5-980a4765a3da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:46:26.298488 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a6af044-76ad-4ee4-80f5-980a4765a3da None admin] REQUEST_METHOD: `GET` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:46:26.299098 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a6af044-76ad-4ee4-80f5-980a4765a3da None admin] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:46:26.299380 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a6af044-76ad-4ee4-80f5-980a4765a3da None admin] PATH_INFO: `/v3/domains` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:46:26.300358 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a6af044-76ad-4ee4-80f5-980a4765a3da None admin] RBAC: Adding query filter params (name=Default) {{(pid=80396) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 15:46:26.300655 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a6af044-76ad-4ee4-80f5-980a4765a3da None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:46:26.302053 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a6af044-76ad-4ee4-80f5-980a4765a3da None admin] RBAC: Authorization granted {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:46:26.303520 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ce7f59b-d8f3-4256-a2e4-a16c40f1b20a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:46:26.304402 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce7f59b-d8f3-4256-a2e4-a16c40f1b20a None admin] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:46:26.304686 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce7f59b-d8f3-4256-a2e4-a16c40f1b20a None admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:46:26.304958 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce7f59b-d8f3-4256-a2e4-a16c40f1b20a None admin] PATH_INFO: `/v3/projects` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:46:26.305053 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG dbcounter [-] [80396] Writing DB stats keystone:SELECT=100 {{(pid=80396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:46:26.305756 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ce7f59b-d8f3-4256-a2e4-a16c40f1b20a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80395) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 15:46:26.306066 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ce7f59b-d8f3-4256-a2e4-a16c40f1b20a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:46:26.307523 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ce7f59b-d8f3-4256-a2e4-a16c40f1b20a None admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:46:26.316429 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 279/565] 10.222.0.59 () {56 vars in 1109 bytes} [Thu Jun 2 15:46:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 15:46:26.317526 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a6af044-76ad-4ee4-80f5-980a4765a3da None admin] Authenticating user token {{(pid=80396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:46:26.322228 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 287/566] 10.222.0.59 () {56 vars in 1148 bytes} [Thu Jun 2 15:46:26 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 15:46:26.323579 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-496c6a01-61f4-4890-b232-7c3ef91c5b61 None None] REQUEST_METHOD: `POST` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:46:26.323869 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-496c6a01-61f4-4890-b232-7c3ef91c5b61 None None] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:46:26.324145 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-496c6a01-61f4-4890-b232-7c3ef91c5b61 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:46:26.340849 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.auth.core [None req-496c6a01-61f4-4890-b232-7c3ef91c5b61 None None] MFA Rules not processed for user `400d1f4db9de49638549e5db29a041e1`. Rule list: `[]` (Enabled: `True`). {{(pid=80395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 15:46:26.342365 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.fernet_utils [None req-496c6a01-61f4-4890-b232-7c3ef91c5b61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 15:46:26.353350 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writing DB stats keystone:SELECT=100 {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:46:26.414655 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 288/567] 10.222.0.59 () {58 vars in 1023 bytes} [Thu Jun 2 15:46:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 02 15:46:26.415623 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-496c6a01-61f4-4890-b232-7c3ef91c5b61 None None] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:46:26.440929 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a6af044-76ad-4ee4-80f5-980a4765a3da None admin] Validating token access rules against request {{(pid=80396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:46:26.476969 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-772c3d1b-f5d6-448f-a97a-29f653cbd8ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:46:26.477646 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-772c3d1b-f5d6-448f-a97a-29f653cbd8ac None admin] REQUEST_METHOD: `GET` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:46:26.477925 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-772c3d1b-f5d6-448f-a97a-29f653cbd8ac None admin] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:46:26.478241 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-772c3d1b-f5d6-448f-a97a-29f653cbd8ac None admin] PATH_INFO: `/v3/domains` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:46:26.478973 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-772c3d1b-f5d6-448f-a97a-29f653cbd8ac None admin] RBAC: Adding query filter params (name=Default) {{(pid=80396) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 15:46:26.479278 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-772c3d1b-f5d6-448f-a97a-29f653cbd8ac None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:46:26.480693 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-772c3d1b-f5d6-448f-a97a-29f653cbd8ac None admin] RBAC: Authorization granted {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:46:26.498973 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 280/568] 10.222.0.59 () {56 vars in 1109 bytes} [Thu Jun 2 15:46:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 15:46:26.498973 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-772c3d1b-f5d6-448f-a97a-29f653cbd8ac None admin] Authenticating user token {{(pid=80396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:46:26.544868 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-496c6a01-61f4-4890-b232-7c3ef91c5b61 None None] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:46:26.555985 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG dbcounter [-] [80396] Writing DB stats keystone:SELECT=100 {{(pid=80396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:46:26.579447 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d8748ed-9524-4e0b-8177-8fc9a2c8baae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:46:26.580234 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8748ed-9524-4e0b-8177-8fc9a2c8baae None admin] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:46:26.580522 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8748ed-9524-4e0b-8177-8fc9a2c8baae None admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:46:26.588177 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8748ed-9524-4e0b-8177-8fc9a2c8baae None admin] PATH_INFO: `/v3/users/glance` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:46:26.589453 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d8748ed-9524-4e0b-8177-8fc9a2c8baae None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:46:26.590953 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d8748ed-9524-4e0b-8177-8fc9a2c8baae None admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:46:26.602133 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-772c3d1b-f5d6-448f-a97a-29f653cbd8ac None admin] Validating token access rules against request {{(pid=80396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:46:26.607070 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application [None req-7d8748ed-9524-4e0b-8177-8fc9a2c8baae None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Jun 02 15:46:26.607070 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 15:46:26.607070 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 15:46:26.607070 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 15:46:26.607070 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 15:46:26.607070 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 15:46:26.607070 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 15:46:26.607070 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 15:46:26.607070 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 15:46:26.607070 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 15:46:26.607070 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 15:46:26.607070 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 15:46:26.607070 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 02 15:46:26.607070 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 02 15:46:26.607070 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 02 15:46:26.607070 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 02 15:46:26.608001 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 15:46:26.608001 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 15:46:26.608001 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 02 15:46:26.608001 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 02 15:46:26.608001 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 02 15:46:26.608001 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 02 15:46:26.608001 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 15:46:26.608001 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 15:46:26.608001 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 15:46:26.608001 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 15:46:26.608001 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 15:46:26.608001 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application with Lock( Jun 02 15:46:26.608001 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 15:46:26.608001 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self._enter() Jun 02 15:46:26.608001 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 15:46:26.608001 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 15:46:26.608001 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 15:46:26.608001 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self.creator() Jun 02 15:46:26.608964 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 15:46:26.608964 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application created_value = creator( Jun 02 15:46:26.608964 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 02 15:46:26.608964 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 02 15:46:26.608964 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 02 15:46:26.608964 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 02 15:46:26.608964 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 02 15:46:26.608964 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 02 15:46:26.608964 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Jun 02 15:46:26.608964 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application Jun 02 15:46:26.608964 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 289/569] 10.222.0.59 () {56 vars in 1099 bytes} [Thu Jun 2 15:46:26 2022] GET /identity/v3/users/glance => generated 84 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 15:46:26.609552 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d8748ed-9524-4e0b-8177-8fc9a2c8baae None admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:46:26.614494 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writing DB stats keystone:SELECT=100 {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:46:26.642728 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36027d35-4a5d-4031-a959-16d63cb44777 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:46:26.643436 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36027d35-4a5d-4031-a959-16d63cb44777 None admin] REQUEST_METHOD: `GET` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:46:26.643723 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36027d35-4a5d-4031-a959-16d63cb44777 None admin] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:46:26.644001 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36027d35-4a5d-4031-a959-16d63cb44777 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:46:26.644838 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36027d35-4a5d-4031-a959-16d63cb44777 None admin] RBAC: Adding query filter params (role.id=36214aa6067e4493a555da410f965c5e, scope.project.id=9c87c981909d4b8db02783421818c79b, user.id=31bd858bf7674f43a99b77d11bc3c1a3) {{(pid=80396) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 15:46:26.645163 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36027d35-4a5d-4031-a959-16d63cb44777 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:46:26.647220 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36027d35-4a5d-4031-a959-16d63cb44777 None admin] RBAC: Authorization granted {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:46:26.653017 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 281/570] 10.222.0.59 () {56 vars in 1374 bytes} [Thu Jun 2 15:46:26 2022] GET /identity/v3/role_assignments?user.id=31bd858bf7674f43a99b77d11bc3c1a3&scope.project.id=9c87c981909d4b8db02783421818c79b&role.id=36214aa6067e4493a555da410f965c5e => generated 259 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 15:46:26.653830 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36027d35-4a5d-4031-a959-16d63cb44777 None admin] Authenticating user token {{(pid=80396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:46:26.750678 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d8748ed-9524-4e0b-8177-8fc9a2c8baae None admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:46:26.789021 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36027d35-4a5d-4031-a959-16d63cb44777 None admin] Validating token access rules against request {{(pid=80396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:46:26.790351 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57675263-f340-4219-ac5a-66e5bd341d01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:46:26.791223 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57675263-f340-4219-ac5a-66e5bd341d01 None admin] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:46:26.791656 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57675263-f340-4219-ac5a-66e5bd341d01 None admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:46:26.791792 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57675263-f340-4219-ac5a-66e5bd341d01 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:46:26.804360 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57675263-f340-4219-ac5a-66e5bd341d01 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 02 15:46:26.812312 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application [None req-57675263-f340-4219-ac5a-66e5bd341d01 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 02 15:46:26.812312 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 15:46:26.812312 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 15:46:26.812312 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 15:46:26.812312 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 15:46:26.812312 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 15:46:26.812312 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 15:46:26.812312 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 15:46:26.812312 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 15:46:26.812312 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 15:46:26.812312 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 15:46:26.812312 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 15:46:26.812312 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 02 15:46:26.812312 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 02 15:46:26.812312 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 02 15:46:26.812312 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 02 15:46:26.813309 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 02 15:46:26.813309 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 02 15:46:26.813309 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 02 15:46:26.813309 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 02 15:46:26.813309 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 15:46:26.813309 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 15:46:26.813309 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 15:46:26.813309 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 15:46:26.813309 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 15:46:26.813309 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 15:46:26.813309 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 15:46:26.813309 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application with Lock( Jun 02 15:46:26.813309 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 15:46:26.813309 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self._enter() Jun 02 15:46:26.813309 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 15:46:26.813309 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 15:46:26.814182 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 15:46:26.814182 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self.creator() Jun 02 15:46:26.814182 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 15:46:26.814182 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application created_value = creator( Jun 02 15:46:26.814182 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 02 15:46:26.814182 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 02 15:46:26.814182 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 02 15:46:26.814182 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 02 15:46:26.814182 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 02 15:46:26.814182 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 02 15:46:26.814182 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 02 15:46:26.814182 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application Jun 02 15:46:26.818166 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 290/571] 10.222.0.59 () {56 vars in 1102 bytes} [Thu Jun 2 15:46:26 2022] GET /identity/v3/roles/service => generated 85 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 15:46:26.818748 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG dbcounter [-] [80396] Writing DB stats keystone:SELECT=100 {{(pid=80396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:46:26.819724 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57675263-f340-4219-ac5a-66e5bd341d01 None admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:46:26.837188 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5490889-c630-46fb-ba46-e8af2434ae40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:46:26.838276 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5490889-c630-46fb-ba46-e8af2434ae40 None admin] REQUEST_METHOD: `GET` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:46:26.838560 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5490889-c630-46fb-ba46-e8af2434ae40 None admin] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:46:26.838831 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5490889-c630-46fb-ba46-e8af2434ae40 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:46:26.847930 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5490889-c630-46fb-ba46-e8af2434ae40 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:46:26.849424 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5490889-c630-46fb-ba46-e8af2434ae40 None admin] RBAC: Authorization granted {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:46:26.865312 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application [None req-f5490889-c630-46fb-ba46-e8af2434ae40 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 02 15:46:26.865312 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 15:46:26.865312 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 15:46:26.865312 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 15:46:26.865312 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 15:46:26.865312 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 15:46:26.865312 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 15:46:26.865312 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 15:46:26.865312 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 15:46:26.865312 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 15:46:26.865312 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 15:46:26.865312 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 15:46:26.865312 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 02 15:46:26.865312 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 02 15:46:26.865312 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 02 15:46:26.865312 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 02 15:46:26.867066 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 15:46:26.867066 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 15:46:26.867066 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 02 15:46:26.867066 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 02 15:46:26.867066 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 02 15:46:26.867066 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 02 15:46:26.867066 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 15:46:26.867066 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 15:46:26.867066 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 15:46:26.867066 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 15:46:26.867066 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 15:46:26.867066 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application with Lock( Jun 02 15:46:26.867066 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 15:46:26.867066 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application return self._enter() Jun 02 15:46:26.867066 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 15:46:26.867066 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 15:46:26.867066 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 15:46:26.867066 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application return self.creator() Jun 02 15:46:26.868053 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 15:46:26.868053 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application created_value = creator( Jun 02 15:46:26.868053 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 02 15:46:26.868053 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 02 15:46:26.868053 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 02 15:46:26.868053 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 02 15:46:26.868053 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 02 15:46:26.868053 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 02 15:46:26.868053 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 02 15:46:26.868053 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application Jun 02 15:46:26.868053 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 282/572] 10.222.0.59 () {56 vars in 1093 bytes} [Thu Jun 2 15:46:26 2022] GET /identity/v3/users/nova => generated 82 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 15:46:26.869019 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a837a14-129d-4c34-b284-52a9ad73ac41 None None] REQUEST_METHOD: `GET` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:46:26.869309 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a837a14-129d-4c34-b284-52a9ad73ac41 None None] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:46:26.869586 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a837a14-129d-4c34-b284-52a9ad73ac41 None None] PATH_INFO: `/` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:46:26.875527 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 283/573] 10.222.0.59 () {54 vars in 926 bytes} [Thu Jun 2 15:46:26 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 15:46:26.876289 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a837a14-129d-4c34-b284-52a9ad73ac41 None None] Authenticating user token {{(pid=80396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:46:26.899063 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writing DB stats keystone:SELECT=100 {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:46:26.941424 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57675263-f340-4219-ac5a-66e5bd341d01 None admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:46:26.979237 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cd8679b-4402-441a-9195-b4eaa9e91a23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:46:26.980064 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd8679b-4402-441a-9195-b4eaa9e91a23 None admin] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:46:26.980353 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd8679b-4402-441a-9195-b4eaa9e91a23 None admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:46:26.980627 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd8679b-4402-441a-9195-b4eaa9e91a23 None admin] PATH_INFO: `/v3/users` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:46:26.981469 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cd8679b-4402-441a-9195-b4eaa9e91a23 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=80395) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 15:46:26.981784 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cd8679b-4402-441a-9195-b4eaa9e91a23 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:46:26.983258 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cd8679b-4402-441a-9195-b4eaa9e91a23 None admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:46:26.991990 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a837a14-129d-4c34-b284-52a9ad73ac41 None None] Validating token access rules against request {{(pid=80396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:46:27.001613 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 291/574] 10.222.0.59 () {56 vars in 1137 bytes} [Thu Jun 2 15:46:26 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 15:46:27.002506 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cd8679b-4402-441a-9195-b4eaa9e91a23 None admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:46:27.034977 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1353f67a-409d-4b23-8aab-125c33a11534 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:46:27.035954 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1353f67a-409d-4b23-8aab-125c33a11534 None admin] REQUEST_METHOD: `GET` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:46:27.036520 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1353f67a-409d-4b23-8aab-125c33a11534 None admin] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:46:27.036990 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1353f67a-409d-4b23-8aab-125c33a11534 None admin] PATH_INFO: `/v3/roles` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:46:27.038572 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1353f67a-409d-4b23-8aab-125c33a11534 None admin] RBAC: Adding query filter params (name=service) {{(pid=80396) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 15:46:27.038949 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1353f67a-409d-4b23-8aab-125c33a11534 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:46:27.040393 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1353f67a-409d-4b23-8aab-125c33a11534 None admin] RBAC: Authorization granted {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:46:27.054227 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 284/575] 10.222.0.59 () {56 vars in 1103 bytes} [Thu Jun 2 15:46:26 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 15:46:27.054227 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-193f02d3-78fc-43c7-8468-f62b37392a24 None None] REQUEST_METHOD: `POST` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:46:27.054227 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-193f02d3-78fc-43c7-8468-f62b37392a24 None None] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:46:27.054227 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-193f02d3-78fc-43c7-8468-f62b37392a24 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:46:27.068344 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.auth.core [None req-193f02d3-78fc-43c7-8468-f62b37392a24 None None] MFA Rules not processed for user `400d1f4db9de49638549e5db29a041e1`. Rule list: `[]` (Enabled: `True`). {{(pid=80396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 15:46:27.069759 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.fernet_utils [None req-193f02d3-78fc-43c7-8468-f62b37392a24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 15:46:27.110405 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG dbcounter [-] [80396] Writing DB stats keystone:SELECT=100 {{(pid=80396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:46:27.116439 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cd8679b-4402-441a-9195-b4eaa9e91a23 None admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:46:27.140437 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writing DB stats keystone:SELECT=100 {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:46:27.152993 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8814c40-7ab8-4125-a719-dd508fd5e889 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:46:27.153621 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 285/576] 10.222.0.59 () {58 vars in 1023 bytes} [Thu Jun 2 15:46:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 02 15:46:27.153731 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8814c40-7ab8-4125-a719-dd508fd5e889 None admin] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:46:27.153939 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8814c40-7ab8-4125-a719-dd508fd5e889 None admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:46:27.154254 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8814c40-7ab8-4125-a719-dd508fd5e889 None admin] PATH_INFO: `/v3/users` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:46:27.155097 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8814c40-7ab8-4125-a719-dd508fd5e889 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80395) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 15:46:27.155377 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-193f02d3-78fc-43c7-8468-f62b37392a24 None None] Authenticating user token {{(pid=80396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:46:27.155478 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8814c40-7ab8-4125-a719-dd508fd5e889 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:46:27.156828 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8814c40-7ab8-4125-a719-dd508fd5e889 None admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:46:27.179827 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 292/577] 10.222.0.59 () {56 vars in 1133 bytes} [Thu Jun 2 15:46:27 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 15:46:27.180878 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8814c40-7ab8-4125-a719-dd508fd5e889 None admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:46:27.271782 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-193f02d3-78fc-43c7-8468-f62b37392a24 None None] Validating token access rules against request {{(pid=80396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:46:27.286288 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8814c40-7ab8-4125-a719-dd508fd5e889 None admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:46:27.312316 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22c1c083-595c-4a83-8d28-3b790ca04c64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:46:27.313040 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c1c083-595c-4a83-8d28-3b790ca04c64 None admin] REQUEST_METHOD: `GET` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:46:27.313573 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c1c083-595c-4a83-8d28-3b790ca04c64 None admin] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:46:27.313573 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c1c083-595c-4a83-8d28-3b790ca04c64 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:46:27.321851 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5212585-4398-42a0-b6de-de771a674748 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:46:27.322597 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5212585-4398-42a0-b6de-de771a674748 None admin] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:46:27.322876 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5212585-4398-42a0-b6de-de771a674748 None admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:46:27.323149 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5212585-4398-42a0-b6de-de771a674748 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:46:27.324832 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22c1c083-595c-4a83-8d28-3b790ca04c64 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:46:27.326358 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22c1c083-595c-4a83-8d28-3b790ca04c64 None admin] RBAC: Authorization granted {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:46:27.333738 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5212585-4398-42a0-b6de-de771a674748 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:46:27.335817 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5212585-4398-42a0-b6de-de771a674748 None admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:46:27.344977 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application [None req-22c1c083-595c-4a83-8d28-3b790ca04c64 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 15:46:27.344977 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 15:46:27.344977 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 15:46:27.344977 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 15:46:27.344977 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 15:46:27.344977 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 15:46:27.344977 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 15:46:27.344977 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 15:46:27.344977 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 15:46:27.344977 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 15:46:27.344977 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 15:46:27.344977 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 15:46:27.344977 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 02 15:46:27.344977 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 02 15:46:27.344977 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 02 15:46:27.345868 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 02 15:46:27.345868 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 15:46:27.345868 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 15:46:27.345868 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 15:46:27.345868 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 15:46:27.345868 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 15:46:27.345868 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 15:46:27.345868 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 15:46:27.345868 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application with Lock( Jun 02 15:46:27.345868 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 15:46:27.345868 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application return self._enter() Jun 02 15:46:27.345868 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 15:46:27.345868 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 15:46:27.345868 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 15:46:27.345868 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application return self.creator() Jun 02 15:46:27.345868 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 15:46:27.345868 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application created_value = creator( Jun 02 15:46:27.346793 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 02 15:46:27.346793 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 02 15:46:27.346793 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 15:46:27.346793 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application Jun 02 15:46:27.346793 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 286/578] 10.222.0.59 () {56 vars in 1108 bytes} [Thu Jun 2 15:46:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 15:46:27.348616 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22c1c083-595c-4a83-8d28-3b790ca04c64 None admin] Authenticating user token {{(pid=80396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:46:27.356299 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application [None req-f5212585-4398-42a0-b6de-de771a674748 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 15:46:27.356299 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 15:46:27.356299 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 15:46:27.356299 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 15:46:27.356299 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 15:46:27.356299 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 15:46:27.356299 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 15:46:27.356299 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 15:46:27.356299 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 15:46:27.356299 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 15:46:27.356299 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 15:46:27.356299 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 15:46:27.356299 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 02 15:46:27.356299 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 02 15:46:27.356299 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 02 15:46:27.357193 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 02 15:46:27.357193 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 15:46:27.357193 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 15:46:27.357193 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 15:46:27.357193 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 15:46:27.357193 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 15:46:27.357193 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 15:46:27.357193 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 15:46:27.357193 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application with Lock( Jun 02 15:46:27.357193 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 15:46:27.357193 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self._enter() Jun 02 15:46:27.357193 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 15:46:27.357193 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 15:46:27.357193 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 15:46:27.357193 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self.creator() Jun 02 15:46:27.357193 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 15:46:27.357193 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application created_value = creator( Jun 02 15:46:27.358060 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 02 15:46:27.358060 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 02 15:46:27.358060 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 15:46:27.358060 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application Jun 02 15:46:27.358060 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 293/579] 10.222.0.59 () {56 vars in 1108 bytes} [Thu Jun 2 15:46:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 15:46:27.358791 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5212585-4398-42a0-b6de-de771a674748 None admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:46:27.379503 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG dbcounter [-] [80396] Writing DB stats keystone:SELECT=100 {{(pid=80396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:46:27.393051 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writing DB stats keystone:SELECT=100 {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:46:27.460768 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22c1c083-595c-4a83-8d28-3b790ca04c64 None admin] Validating token access rules against request {{(pid=80396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:46:27.468379 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5212585-4398-42a0-b6de-de771a674748 None admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:46:27.502903 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e268123e-4bbb-4099-8fa3-7f9c28655f5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:46:27.503944 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e268123e-4bbb-4099-8fa3-7f9c28655f5c None admin] REQUEST_METHOD: `GET` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:46:27.504330 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e268123e-4bbb-4099-8fa3-7f9c28655f5c None admin] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:46:27.504599 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e268123e-4bbb-4099-8fa3-7f9c28655f5c None admin] PATH_INFO: `/v3/roles/service` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:46:27.505536 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05e06b53-48cf-4799-b16a-9561cf7f60e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:46:27.507556 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e06b53-48cf-4799-b16a-9561cf7f60e4 None admin] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:46:27.507556 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e06b53-48cf-4799-b16a-9561cf7f60e4 None admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:46:27.507556 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e06b53-48cf-4799-b16a-9561cf7f60e4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:46:27.517336 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e268123e-4bbb-4099-8fa3-7f9c28655f5c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 02 15:46:27.517902 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05e06b53-48cf-4799-b16a-9561cf7f60e4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:46:27.519363 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05e06b53-48cf-4799-b16a-9561cf7f60e4 None admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:46:27.525382 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application [None req-e268123e-4bbb-4099-8fa3-7f9c28655f5c None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 02 15:46:27.525382 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 15:46:27.525382 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 15:46:27.525382 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 15:46:27.525382 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 15:46:27.525382 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 15:46:27.525382 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 15:46:27.525382 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 15:46:27.525382 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 15:46:27.525382 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 15:46:27.525382 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 15:46:27.525382 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 15:46:27.525382 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 02 15:46:27.525382 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 02 15:46:27.525382 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 02 15:46:27.525382 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 02 15:46:27.526555 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 02 15:46:27.526555 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 02 15:46:27.526555 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 02 15:46:27.526555 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 02 15:46:27.526555 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 15:46:27.526555 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 15:46:27.526555 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 15:46:27.526555 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 15:46:27.526555 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 15:46:27.526555 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 15:46:27.526555 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 15:46:27.526555 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application with Lock( Jun 02 15:46:27.526555 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 15:46:27.526555 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application return self._enter() Jun 02 15:46:27.526555 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 15:46:27.526555 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 15:46:27.527459 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 15:46:27.527459 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application return self.creator() Jun 02 15:46:27.527459 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 15:46:27.527459 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application created_value = creator( Jun 02 15:46:27.527459 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 02 15:46:27.527459 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 02 15:46:27.527459 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 02 15:46:27.527459 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 02 15:46:27.527459 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 02 15:46:27.527459 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 02 15:46:27.527459 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 02 15:46:27.527459 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application Jun 02 15:46:27.527459 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 287/580] 10.222.0.59 () {56 vars in 1102 bytes} [Thu Jun 2 15:46:27 2022] GET /identity/v3/roles/service => generated 85 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 15:46:27.527459 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e268123e-4bbb-4099-8fa3-7f9c28655f5c None admin] Authenticating user token {{(pid=80396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:46:27.542403 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application [None req-05e06b53-48cf-4799-b16a-9561cf7f60e4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 15:46:27.542403 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 15:46:27.542403 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 15:46:27.542403 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 15:46:27.542403 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 15:46:27.542403 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 15:46:27.542403 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 15:46:27.542403 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 15:46:27.542403 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 15:46:27.542403 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 15:46:27.542403 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 15:46:27.542403 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 15:46:27.542403 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 02 15:46:27.542403 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 02 15:46:27.542403 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 02 15:46:27.543316 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 02 15:46:27.543316 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 15:46:27.543316 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 15:46:27.543316 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 15:46:27.543316 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 15:46:27.543316 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 15:46:27.543316 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 15:46:27.543316 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 15:46:27.543316 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application with Lock( Jun 02 15:46:27.543316 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 15:46:27.543316 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self._enter() Jun 02 15:46:27.543316 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 15:46:27.543316 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 15:46:27.543316 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 15:46:27.543316 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self.creator() Jun 02 15:46:27.543316 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 15:46:27.543316 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application created_value = creator( Jun 02 15:46:27.544218 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 02 15:46:27.544218 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 02 15:46:27.544218 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 15:46:27.544218 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application Jun 02 15:46:27.544218 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 294/581] 10.222.0.59 () {56 vars in 1108 bytes} [Thu Jun 2 15:46:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 15:46:27.545124 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05e06b53-48cf-4799-b16a-9561cf7f60e4 None admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:46:27.620916 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG dbcounter [-] [80396] Writing DB stats keystone:SELECT=100 {{(pid=80396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:46:27.632739 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writing DB stats keystone:SELECT=100 {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:46:27.636057 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e268123e-4bbb-4099-8fa3-7f9c28655f5c None admin] Validating token access rules against request {{(pid=80396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:46:27.648289 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05e06b53-48cf-4799-b16a-9561cf7f60e4 None admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:46:27.670353 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8459f689-5340-419e-87c6-d5bd6cf7f702 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:46:27.671053 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8459f689-5340-419e-87c6-d5bd6cf7f702 None admin] REQUEST_METHOD: `GET` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:46:27.671335 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8459f689-5340-419e-87c6-d5bd6cf7f702 None admin] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:46:27.671606 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8459f689-5340-419e-87c6-d5bd6cf7f702 None admin] PATH_INFO: `/v3/domains` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:46:27.672315 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8459f689-5340-419e-87c6-d5bd6cf7f702 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80396) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 15:46:27.672615 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8459f689-5340-419e-87c6-d5bd6cf7f702 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:46:27.673975 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8459f689-5340-419e-87c6-d5bd6cf7f702 None admin] RBAC: Authorization granted {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:46:27.683087 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0296deb8-855a-453e-8349-5dfa6b273b51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:46:27.683745 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0296deb8-855a-453e-8349-5dfa6b273b51 None admin] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:46:27.684026 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0296deb8-855a-453e-8349-5dfa6b273b51 None admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:46:27.684305 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0296deb8-855a-453e-8349-5dfa6b273b51 None admin] PATH_INFO: `/v3/domains` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:46:27.685020 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0296deb8-855a-453e-8349-5dfa6b273b51 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80395) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 15:46:27.685323 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0296deb8-855a-453e-8349-5dfa6b273b51 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:46:27.686705 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0296deb8-855a-453e-8349-5dfa6b273b51 None admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:46:27.687250 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 288/582] 10.222.0.59 () {56 vars in 1109 bytes} [Thu Jun 2 15:46:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 15:46:27.688214 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8459f689-5340-419e-87c6-d5bd6cf7f702 None admin] Authenticating user token {{(pid=80396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:46:27.703351 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 295/583] 10.222.0.59 () {56 vars in 1109 bytes} [Thu Jun 2 15:46:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 15:46:27.703351 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0296deb8-855a-453e-8349-5dfa6b273b51 None admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:46:27.800855 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8459f689-5340-419e-87c6-d5bd6cf7f702 None admin] Validating token access rules against request {{(pid=80396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:46:27.807895 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0296deb8-855a-453e-8349-5dfa6b273b51 None admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:46:27.838567 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d61d95c0-6e0e-40c2-986e-beda6e45a299 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:46:27.839227 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d61d95c0-6e0e-40c2-986e-beda6e45a299 None admin] REQUEST_METHOD: `GET` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:46:27.839508 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d61d95c0-6e0e-40c2-986e-beda6e45a299 None admin] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:46:27.839778 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d61d95c0-6e0e-40c2-986e-beda6e45a299 None admin] PATH_INFO: `/v3/roles` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:46:27.840518 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d61d95c0-6e0e-40c2-986e-beda6e45a299 None admin] RBAC: Adding query filter params (name=service) {{(pid=80396) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 15:46:27.840825 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d61d95c0-6e0e-40c2-986e-beda6e45a299 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:46:27.841414 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc271f9f-5616-4493-a206-747da6d1a790 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:46:27.842062 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc271f9f-5616-4493-a206-747da6d1a790 None admin] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:46:27.842245 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d61d95c0-6e0e-40c2-986e-beda6e45a299 None admin] RBAC: Authorization granted {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:46:27.842348 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc271f9f-5616-4493-a206-747da6d1a790 None admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:46:27.842622 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc271f9f-5616-4493-a206-747da6d1a790 None admin] PATH_INFO: `/v3/domains` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:46:27.843325 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc271f9f-5616-4493-a206-747da6d1a790 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80395) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 15:46:27.843631 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc271f9f-5616-4493-a206-747da6d1a790 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:46:27.844975 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc271f9f-5616-4493-a206-747da6d1a790 None admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:46:27.852611 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 289/584] 10.222.0.59 () {56 vars in 1103 bytes} [Thu Jun 2 15:46:27 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 15:46:27.853735 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d61d95c0-6e0e-40c2-986e-beda6e45a299 None admin] Authenticating user token {{(pid=80396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:46:27.860098 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 296/585] 10.222.0.59 () {56 vars in 1109 bytes} [Thu Jun 2 15:46:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 15:46:27.861081 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc271f9f-5616-4493-a206-747da6d1a790 None admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:46:27.864625 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writing DB stats keystone:SELECT=100 {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:46:27.871653 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG dbcounter [-] [80396] Writing DB stats keystone:SELECT=100 {{(pid=80396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:46:27.963145 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d61d95c0-6e0e-40c2-986e-beda6e45a299 None admin] Validating token access rules against request {{(pid=80396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:46:27.964721 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc271f9f-5616-4493-a206-747da6d1a790 None admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:46:27.996265 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fb78ba2-1191-4ec7-ac8e-7a6a894e53f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:46:27.997051 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb78ba2-1191-4ec7-ac8e-7a6a894e53f8 None admin] REQUEST_METHOD: `GET` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:46:27.997332 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb78ba2-1191-4ec7-ac8e-7a6a894e53f8 None admin] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:46:27.997605 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb78ba2-1191-4ec7-ac8e-7a6a894e53f8 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:46:28.002246 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3734c34-435d-4aec-ad05-bc1fbbc98081 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:46:28.003260 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3734c34-435d-4aec-ad05-bc1fbbc98081 None admin] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:46:28.003722 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3734c34-435d-4aec-ad05-bc1fbbc98081 None admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:46:28.004152 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fb78ba2-1191-4ec7-ac8e-7a6a894e53f8 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:46:28.004351 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3734c34-435d-4aec-ad05-bc1fbbc98081 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:46:28.005574 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fb78ba2-1191-4ec7-ac8e-7a6a894e53f8 None admin] RBAC: Authorization granted {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:46:28.012694 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3734c34-435d-4aec-ad05-bc1fbbc98081 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:46:28.014392 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3734c34-435d-4aec-ad05-bc1fbbc98081 None admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:46:28.019961 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application [None req-6fb78ba2-1191-4ec7-ac8e-7a6a894e53f8 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 02 15:46:28.019961 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 15:46:28.019961 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 15:46:28.019961 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 15:46:28.019961 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 15:46:28.019961 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 15:46:28.019961 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 15:46:28.019961 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 15:46:28.019961 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 15:46:28.019961 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 15:46:28.019961 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 15:46:28.019961 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 15:46:28.019961 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 02 15:46:28.019961 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 02 15:46:28.019961 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 02 15:46:28.020827 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 02 15:46:28.020827 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 15:46:28.020827 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 15:46:28.020827 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 15:46:28.020827 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 15:46:28.020827 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 15:46:28.020827 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 15:46:28.020827 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 15:46:28.020827 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application with Lock( Jun 02 15:46:28.020827 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 15:46:28.020827 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application return self._enter() Jun 02 15:46:28.020827 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 15:46:28.020827 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 15:46:28.020827 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 15:46:28.020827 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application return self.creator() Jun 02 15:46:28.020827 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 15:46:28.020827 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application created_value = creator( Jun 02 15:46:28.021701 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 02 15:46:28.021701 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 02 15:46:28.021701 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 02 15:46:28.021701 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 02 15:46:28.021701 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 02 15:46:28.021701 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 02 15:46:28.021701 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 02 15:46:28.021701 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application Jun 02 15:46:28.021701 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 290/586] 10.222.0.59 () {56 vars in 1111 bytes} [Thu Jun 2 15:46:27 2022] GET /identity/v3/projects/service => generated 88 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 15:46:28.022998 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fb78ba2-1191-4ec7-ac8e-7a6a894e53f8 None admin] Authenticating user token {{(pid=80396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:46:28.034860 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application [None req-c3734c34-435d-4aec-ad05-bc1fbbc98081 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jun 02 15:46:28.034860 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 15:46:28.034860 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 15:46:28.034860 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 15:46:28.034860 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 15:46:28.034860 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 15:46:28.034860 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 15:46:28.034860 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 15:46:28.034860 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 15:46:28.034860 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 15:46:28.034860 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 15:46:28.034860 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 15:46:28.034860 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 02 15:46:28.034860 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 02 15:46:28.034860 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 02 15:46:28.034860 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 02 15:46:28.035864 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 15:46:28.035864 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 15:46:28.035864 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 02 15:46:28.035864 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 02 15:46:28.035864 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 02 15:46:28.035864 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 02 15:46:28.035864 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 15:46:28.035864 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 15:46:28.035864 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 15:46:28.035864 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 15:46:28.035864 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 15:46:28.035864 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application with Lock( Jun 02 15:46:28.035864 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 15:46:28.035864 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self._enter() Jun 02 15:46:28.035864 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 15:46:28.035864 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 15:46:28.035864 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 15:46:28.035864 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self.creator() Jun 02 15:46:28.036997 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 15:46:28.036997 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application created_value = creator( Jun 02 15:46:28.036997 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 02 15:46:28.036997 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 02 15:46:28.036997 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 02 15:46:28.036997 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 02 15:46:28.036997 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 02 15:46:28.036997 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 02 15:46:28.036997 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jun 02 15:46:28.036997 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application Jun 02 15:46:28.039031 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 297/587] 10.222.0.59 () {56 vars in 1099 bytes} [Thu Jun 2 15:46:27 2022] GET /identity/v3/users/cinder => generated 84 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 15:46:28.039948 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3734c34-435d-4aec-ad05-bc1fbbc98081 None admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:46:28.095771 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG dbcounter [-] [80396] Writing DB stats keystone:SELECT=100 {{(pid=80396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:46:28.108647 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writing DB stats keystone:SELECT=100 {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:46:28.133397 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fb78ba2-1191-4ec7-ac8e-7a6a894e53f8 None admin] Validating token access rules against request {{(pid=80396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:46:28.145375 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3734c34-435d-4aec-ad05-bc1fbbc98081 None admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:46:28.171129 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67be28f2-3214-4fc7-98e3-f476ea517626 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:46:28.172131 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67be28f2-3214-4fc7-98e3-f476ea517626 None admin] REQUEST_METHOD: `GET` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:46:28.172255 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67be28f2-3214-4fc7-98e3-f476ea517626 None admin] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:46:28.172441 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67be28f2-3214-4fc7-98e3-f476ea517626 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:46:28.187593 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b36e8d65-0906-4b15-8642-68b13490768b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:46:28.188917 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36e8d65-0906-4b15-8642-68b13490768b None admin] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:46:28.189047 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67be28f2-3214-4fc7-98e3-f476ea517626 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:46:28.189501 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36e8d65-0906-4b15-8642-68b13490768b None admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:46:28.189778 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36e8d65-0906-4b15-8642-68b13490768b None admin] PATH_INFO: `/v3/projects/service` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:46:28.190554 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67be28f2-3214-4fc7-98e3-f476ea517626 None admin] RBAC: Authorization granted {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:46:28.198461 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b36e8d65-0906-4b15-8642-68b13490768b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:46:28.200641 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b36e8d65-0906-4b15-8642-68b13490768b None admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:46:28.208251 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application [None req-67be28f2-3214-4fc7-98e3-f476ea517626 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 15:46:28.208251 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 15:46:28.208251 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 15:46:28.208251 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 15:46:28.208251 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 15:46:28.208251 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 15:46:28.208251 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 15:46:28.208251 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 15:46:28.208251 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 15:46:28.208251 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 15:46:28.208251 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 15:46:28.208251 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 15:46:28.208251 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 02 15:46:28.208251 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 02 15:46:28.208251 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 02 15:46:28.209101 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 02 15:46:28.209101 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 15:46:28.209101 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 15:46:28.209101 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 15:46:28.209101 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 15:46:28.209101 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 15:46:28.209101 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 15:46:28.209101 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 15:46:28.209101 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application with Lock( Jun 02 15:46:28.209101 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 15:46:28.209101 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application return self._enter() Jun 02 15:46:28.209101 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 15:46:28.209101 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 15:46:28.209101 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 15:46:28.209101 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application return self.creator() Jun 02 15:46:28.209101 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 15:46:28.209101 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application created_value = creator( Jun 02 15:46:28.210583 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 02 15:46:28.210583 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 02 15:46:28.210583 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 15:46:28.210583 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application Jun 02 15:46:28.214479 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 291/588] 10.222.0.59 () {56 vars in 1108 bytes} [Thu Jun 2 15:46:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 15:46:28.214698 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application [None req-b36e8d65-0906-4b15-8642-68b13490768b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 02 15:46:28.214698 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 15:46:28.214698 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 15:46:28.214698 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 15:46:28.214698 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 15:46:28.214698 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 15:46:28.214698 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 15:46:28.214698 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 15:46:28.214698 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 15:46:28.214698 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 15:46:28.214698 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 15:46:28.214698 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 15:46:28.214698 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 02 15:46:28.214698 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 02 15:46:28.214698 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 02 15:46:28.215803 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 02 15:46:28.215803 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 15:46:28.215803 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 15:46:28.215803 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 15:46:28.215803 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 15:46:28.215803 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 15:46:28.215803 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 15:46:28.215803 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 15:46:28.215803 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application with Lock( Jun 02 15:46:28.215803 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 15:46:28.215803 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self._enter() Jun 02 15:46:28.215803 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 15:46:28.215803 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 15:46:28.215803 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 15:46:28.215803 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self.creator() Jun 02 15:46:28.215803 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 15:46:28.215803 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application created_value = creator( Jun 02 15:46:28.216697 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 02 15:46:28.216697 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 02 15:46:28.216697 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 02 15:46:28.216697 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 02 15:46:28.216697 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 02 15:46:28.216697 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 02 15:46:28.216697 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 02 15:46:28.216697 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application Jun 02 15:46:28.217121 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67be28f2-3214-4fc7-98e3-f476ea517626 None admin] Authenticating user token {{(pid=80396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:46:28.217590 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 298/589] 10.222.0.59 () {56 vars in 1111 bytes} [Thu Jun 2 15:46:28 2022] GET /identity/v3/projects/service => generated 88 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 15:46:28.217590 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b36e8d65-0906-4b15-8642-68b13490768b None admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:46:28.317980 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67be28f2-3214-4fc7-98e3-f476ea517626 None admin] Validating token access rules against request {{(pid=80396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:46:28.328995 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b36e8d65-0906-4b15-8642-68b13490768b None admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:46:28.338116 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG dbcounter [-] [80396] Writing DB stats keystone:SELECT=100 {{(pid=80396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:46:28.353099 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writing DB stats keystone:SELECT=100 {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:46:28.357656 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd0f91d6-9bab-496a-b212-3934039548b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:46:28.358496 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0f91d6-9bab-496a-b212-3934039548b3 None admin] REQUEST_METHOD: `GET` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:46:28.358786 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0f91d6-9bab-496a-b212-3934039548b3 None admin] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:46:28.359362 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0f91d6-9bab-496a-b212-3934039548b3 None admin] PATH_INFO: `/v3/projects` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:46:28.360467 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd0f91d6-9bab-496a-b212-3934039548b3 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80396) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 15:46:28.360735 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd0f91d6-9bab-496a-b212-3934039548b3 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:46:28.362198 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd0f91d6-9bab-496a-b212-3934039548b3 None admin] RBAC: Authorization granted {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:46:28.363828 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d4931a3-6cb9-4b3f-b0a2-4588c4b8c063 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:46:28.364489 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4931a3-6cb9-4b3f-b0a2-4588c4b8c063 None admin] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:46:28.364775 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4931a3-6cb9-4b3f-b0a2-4588c4b8c063 None admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:46:28.365046 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4931a3-6cb9-4b3f-b0a2-4588c4b8c063 None admin] PATH_INFO: `/v3/users` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:46:28.366584 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d4931a3-6cb9-4b3f-b0a2-4588c4b8c063 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=80395) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 15:46:28.366892 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d4931a3-6cb9-4b3f-b0a2-4588c4b8c063 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:46:28.368311 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d4931a3-6cb9-4b3f-b0a2-4588c4b8c063 None admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:46:28.375449 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 292/590] 10.222.0.59 () {56 vars in 1148 bytes} [Thu Jun 2 15:46:28 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 15:46:28.376329 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd0f91d6-9bab-496a-b212-3934039548b3 None admin] Authenticating user token {{(pid=80396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:46:28.391451 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 299/591] 10.222.0.59 () {56 vars in 1137 bytes} [Thu Jun 2 15:46:28 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 15:46:28.392591 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d4931a3-6cb9-4b3f-b0a2-4588c4b8c063 None admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:46:28.486196 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd0f91d6-9bab-496a-b212-3934039548b3 None admin] Validating token access rules against request {{(pid=80396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:46:28.500738 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d4931a3-6cb9-4b3f-b0a2-4588c4b8c063 None admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:46:28.524657 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e57d6333-bef5-435a-b2ce-3edb32a590e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:46:28.525477 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57d6333-bef5-435a-b2ce-3edb32a590e4 None admin] REQUEST_METHOD: `GET` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:46:28.526095 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57d6333-bef5-435a-b2ce-3edb32a590e4 None admin] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:46:28.526376 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57d6333-bef5-435a-b2ce-3edb32a590e4 None admin] PATH_INFO: `/v3/domains` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:46:28.527360 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e57d6333-bef5-435a-b2ce-3edb32a590e4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80396) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 15:46:28.527661 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e57d6333-bef5-435a-b2ce-3edb32a590e4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:46:28.529733 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e57d6333-bef5-435a-b2ce-3edb32a590e4 None admin] RBAC: Authorization granted {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:46:28.536102 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74fe3d01-3a30-4ac8-a5fb-283650858964 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:46:28.536763 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74fe3d01-3a30-4ac8-a5fb-283650858964 None admin] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:46:28.537056 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74fe3d01-3a30-4ac8-a5fb-283650858964 None admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:46:28.537331 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74fe3d01-3a30-4ac8-a5fb-283650858964 None admin] PATH_INFO: `/v3/projects` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:46:28.538247 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74fe3d01-3a30-4ac8-a5fb-283650858964 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80395) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 15:46:28.538563 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74fe3d01-3a30-4ac8-a5fb-283650858964 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:46:28.539987 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74fe3d01-3a30-4ac8-a5fb-283650858964 None admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:46:28.543682 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 293/592] 10.222.0.59 () {56 vars in 1109 bytes} [Thu Jun 2 15:46:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 15:46:28.544678 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e57d6333-bef5-435a-b2ce-3edb32a590e4 None admin] Authenticating user token {{(pid=80396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:46:28.557146 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 300/593] 10.222.0.59 () {56 vars in 1148 bytes} [Thu Jun 2 15:46:28 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 15:46:28.558034 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74fe3d01-3a30-4ac8-a5fb-283650858964 None admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:46:28.592798 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG dbcounter [-] [80396] Writing DB stats keystone:SELECT=100 {{(pid=80396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:46:28.607968 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writing DB stats keystone:SELECT=100 {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:46:28.663725 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e57d6333-bef5-435a-b2ce-3edb32a590e4 None admin] Validating token access rules against request {{(pid=80396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:46:28.672342 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74fe3d01-3a30-4ac8-a5fb-283650858964 None admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:46:28.697602 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56a62d1a-fe52-431a-a040-5f5c3294e8cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:46:28.698697 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a62d1a-fe52-431a-a040-5f5c3294e8cb None admin] REQUEST_METHOD: `PUT` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:46:28.698988 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a62d1a-fe52-431a-a040-5f5c3294e8cb None admin] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:46:28.699263 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a62d1a-fe52-431a-a040-5f5c3294e8cb None admin] PATH_INFO: `/v3/projects/9c87c981909d4b8db02783421818c79b/users/e673e7e0a4bf4c77bdb3e5325d0d3275/roles/36214aa6067e4493a555da410f965c5e` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:46:28.711501 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85af37c4-431d-43de-8c46-d72eae91ccc6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:46:28.712413 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85af37c4-431d-43de-8c46-d72eae91ccc6 None admin] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:46:28.713052 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85af37c4-431d-43de-8c46-d72eae91ccc6 None admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:46:28.713327 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85af37c4-431d-43de-8c46-d72eae91ccc6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:46:28.714858 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56a62d1a-fe52-431a-a040-5f5c3294e8cb None admin] RBAC: Authorizing `identity:create_grant(project_id=9c87c981909d4b8db02783421818c79b, user_id=e673e7e0a4bf4c77bdb3e5325d0d3275, role_id=36214aa6067e4493a555da410f965c5e)` {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:46:28.716302 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56a62d1a-fe52-431a-a040-5f5c3294e8cb None admin] RBAC: Authorization granted {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:46:28.725152 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85af37c4-431d-43de-8c46-d72eae91ccc6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:46:28.726658 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85af37c4-431d-43de-8c46-d72eae91ccc6 None admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:46:28.743487 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application [None req-85af37c4-431d-43de-8c46-d72eae91ccc6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 15:46:28.743487 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 15:46:28.743487 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 15:46:28.743487 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 15:46:28.743487 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 15:46:28.743487 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 15:46:28.743487 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 15:46:28.743487 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 15:46:28.743487 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 15:46:28.743487 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 15:46:28.743487 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 15:46:28.743487 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 15:46:28.743487 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 02 15:46:28.743487 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 02 15:46:28.743487 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 02 15:46:28.744599 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 02 15:46:28.744599 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 15:46:28.744599 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 15:46:28.744599 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 15:46:28.744599 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 15:46:28.744599 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 15:46:28.744599 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 15:46:28.744599 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 15:46:28.744599 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application with Lock( Jun 02 15:46:28.744599 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 15:46:28.744599 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self._enter() Jun 02 15:46:28.744599 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 15:46:28.744599 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 15:46:28.744599 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 15:46:28.744599 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self.creator() Jun 02 15:46:28.744599 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 15:46:28.744599 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application created_value = creator( Jun 02 15:46:28.745492 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 02 15:46:28.745492 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 02 15:46:28.745492 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 15:46:28.745492 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application Jun 02 15:46:28.745492 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 301/594] 10.222.0.59 () {56 vars in 1108 bytes} [Thu Jun 2 15:46:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 15:46:28.745492 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85af37c4-431d-43de-8c46-d72eae91ccc6 None admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:46:28.791540 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 294/595] 10.222.0.59 () {58 vars in 1439 bytes} [Thu Jun 2 15:46:28 2022] PUT /identity/v3/projects/9c87c981909d4b8db02783421818c79b/users/e673e7e0a4bf4c77bdb3e5325d0d3275/roles/36214aa6067e4493a555da410f965c5e => generated 0 bytes in 247 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 15:46:28.802484 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56a62d1a-fe52-431a-a040-5f5c3294e8cb None admin] Authenticating user token {{(pid=80396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:46:28.849993 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writing DB stats keystone:SELECT=100 {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:46:28.857760 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85af37c4-431d-43de-8c46-d72eae91ccc6 None admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:46:28.896455 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89545a2e-1b34-4f5e-a94b-676f93696c83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:46:28.898110 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89545a2e-1b34-4f5e-a94b-676f93696c83 None admin] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:46:28.898429 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89545a2e-1b34-4f5e-a94b-676f93696c83 None admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:46:28.898782 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89545a2e-1b34-4f5e-a94b-676f93696c83 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:46:28.907780 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89545a2e-1b34-4f5e-a94b-676f93696c83 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:46:28.909354 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89545a2e-1b34-4f5e-a94b-676f93696c83 None admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:46:28.925624 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application [None req-89545a2e-1b34-4f5e-a94b-676f93696c83 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Jun 02 15:46:28.925624 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 15:46:28.925624 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 15:46:28.925624 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 15:46:28.925624 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 15:46:28.925624 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 15:46:28.925624 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 15:46:28.925624 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 15:46:28.925624 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 15:46:28.925624 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 15:46:28.925624 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 15:46:28.925624 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 15:46:28.925624 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 02 15:46:28.925624 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 02 15:46:28.925624 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 02 15:46:28.925624 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 02 15:46:28.926697 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 15:46:28.926697 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 15:46:28.926697 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 02 15:46:28.926697 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 02 15:46:28.926697 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 02 15:46:28.926697 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 02 15:46:28.926697 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 15:46:28.926697 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 15:46:28.926697 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 15:46:28.926697 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 15:46:28.926697 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 15:46:28.926697 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application with Lock( Jun 02 15:46:28.926697 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 15:46:28.926697 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self._enter() Jun 02 15:46:28.926697 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 15:46:28.926697 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 15:46:28.926697 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 15:46:28.926697 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self.creator() Jun 02 15:46:28.927633 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 15:46:28.927633 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application created_value = creator( Jun 02 15:46:28.927633 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 02 15:46:28.927633 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 02 15:46:28.927633 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 02 15:46:28.927633 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 02 15:46:28.927633 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 02 15:46:28.927633 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 02 15:46:28.927633 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Jun 02 15:46:28.927633 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application Jun 02 15:46:28.930396 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG dbcounter [-] [80396] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:46:28.932155 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 302/596] 10.222.0.59 () {56 vars in 1102 bytes} [Thu Jun 2 15:46:28 2022] GET /identity/v3/users/neutron => generated 85 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 15:46:28.933228 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89545a2e-1b34-4f5e-a94b-676f93696c83 None admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:46:28.949580 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56a62d1a-fe52-431a-a040-5f5c3294e8cb None admin] Validating token access rules against request {{(pid=80396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:46:29.002257 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2f18827-f23f-4574-80ad-5aa04adf4377 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:46:29.004008 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f18827-f23f-4574-80ad-5aa04adf4377 None admin] REQUEST_METHOD: `PUT` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:46:29.004471 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f18827-f23f-4574-80ad-5aa04adf4377 None admin] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:46:29.004901 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f18827-f23f-4574-80ad-5aa04adf4377 None admin] PATH_INFO: `/v3/projects/9c87c981909d4b8db02783421818c79b/users/52f9fe4b13574516bb0a8e2aa11a61e8/roles/36214aa6067e4493a555da410f965c5e` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:46:29.020551 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2f18827-f23f-4574-80ad-5aa04adf4377 None admin] RBAC: Authorizing `identity:create_grant(project_id=9c87c981909d4b8db02783421818c79b, user_id=52f9fe4b13574516bb0a8e2aa11a61e8, role_id=36214aa6067e4493a555da410f965c5e)` {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:46:29.022130 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2f18827-f23f-4574-80ad-5aa04adf4377 None admin] RBAC: Authorization granted {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:46:29.047445 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89545a2e-1b34-4f5e-a94b-676f93696c83 None admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:46:29.081359 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e995d11-9818-4c59-8d4a-d09f83b298f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:46:29.082016 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e995d11-9818-4c59-8d4a-d09f83b298f8 None admin] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:46:29.082327 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e995d11-9818-4c59-8d4a-d09f83b298f8 None admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:46:29.082604 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e995d11-9818-4c59-8d4a-d09f83b298f8 None admin] PATH_INFO: `/v3/domains` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:46:29.083324 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e995d11-9818-4c59-8d4a-d09f83b298f8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80395) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 15:46:29.083632 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e995d11-9818-4c59-8d4a-d09f83b298f8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:46:29.085890 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e995d11-9818-4c59-8d4a-d09f83b298f8 None admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:46:29.098099 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 295/597] 10.222.0.59 () {58 vars in 1439 bytes} [Thu Jun 2 15:46:28 2022] PUT /identity/v3/projects/9c87c981909d4b8db02783421818c79b/users/52f9fe4b13574516bb0a8e2aa11a61e8/roles/36214aa6067e4493a555da410f965c5e => generated 0 bytes in 300 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 15:46:29.098099 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2f18827-f23f-4574-80ad-5aa04adf4377 None admin] Authenticating user token {{(pid=80396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:46:29.098502 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 303/598] 10.222.0.59 () {56 vars in 1109 bytes} [Thu Jun 2 15:46:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 15:46:29.100708 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7994c484-7aa9-49b5-bc1e-9daacc7e46c2 None None] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:46:29.101408 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7994c484-7aa9-49b5-bc1e-9daacc7e46c2 None None] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:46:29.101822 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7994c484-7aa9-49b5-bc1e-9daacc7e46c2 None None] PATH_INFO: `/` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:46:29.107931 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 304/599] 10.222.0.59 () {54 vars in 926 bytes} [Thu Jun 2 15:46:29 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 15:46:29.109863 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7994c484-7aa9-49b5-bc1e-9daacc7e46c2 None None] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:46:29.133400 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writing DB stats keystone:SELECT=100 {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:46:29.253648 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2f18827-f23f-4574-80ad-5aa04adf4377 None admin] Validating token access rules against request {{(pid=80396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:46:29.267443 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7994c484-7aa9-49b5-bc1e-9daacc7e46c2 None None] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:46:29.296202 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6847c8a8-c6e0-4832-9e50-42e2b101c021 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:46:29.297665 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6847c8a8-c6e0-4832-9e50-42e2b101c021 None admin] REQUEST_METHOD: `GET` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:46:29.298137 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6847c8a8-c6e0-4832-9e50-42e2b101c021 None admin] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:46:29.299289 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6847c8a8-c6e0-4832-9e50-42e2b101c021 None admin] PATH_INFO: `/v3/users` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:46:29.300293 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6847c8a8-c6e0-4832-9e50-42e2b101c021 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=80396) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 15:46:29.300775 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6847c8a8-c6e0-4832-9e50-42e2b101c021 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:46:29.303663 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6847c8a8-c6e0-4832-9e50-42e2b101c021 None admin] RBAC: Authorization granted {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:46:29.314974 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaa6b469-fd6a-457e-9de1-8f0c1e3a425e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:46:29.315171 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG dbcounter [-] [80396] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:46:29.315271 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa6b469-fd6a-457e-9de1-8f0c1e3a425e None admin] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:46:29.315408 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa6b469-fd6a-457e-9de1-8f0c1e3a425e None admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:46:29.315684 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa6b469-fd6a-457e-9de1-8f0c1e3a425e None admin] PATH_INFO: `/v3/projects/service` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:46:29.324773 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaa6b469-fd6a-457e-9de1-8f0c1e3a425e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:46:29.326412 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaa6b469-fd6a-457e-9de1-8f0c1e3a425e None admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:46:29.329048 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 296/600] 10.222.0.59 () {56 vars in 1139 bytes} [Thu Jun 2 15:46:29 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 15:46:29.333541 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39cd22ea-4c36-4efb-9d05-16e39ae96cb3 None None] REQUEST_METHOD: `POST` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:46:29.333541 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39cd22ea-4c36-4efb-9d05-16e39ae96cb3 None None] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:46:29.333541 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39cd22ea-4c36-4efb-9d05-16e39ae96cb3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:46:29.351170 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application [None req-aaa6b469-fd6a-457e-9de1-8f0c1e3a425e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 02 15:46:29.351170 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 15:46:29.351170 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 15:46:29.351170 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 15:46:29.351170 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 15:46:29.351170 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 15:46:29.351170 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 15:46:29.351170 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 15:46:29.351170 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 15:46:29.351170 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 15:46:29.351170 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 15:46:29.351170 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 15:46:29.351170 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 02 15:46:29.351170 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 02 15:46:29.351170 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 02 15:46:29.352291 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 02 15:46:29.352291 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 15:46:29.352291 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 15:46:29.352291 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 15:46:29.352291 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 15:46:29.352291 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 15:46:29.352291 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 15:46:29.352291 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 15:46:29.352291 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application with Lock( Jun 02 15:46:29.352291 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 15:46:29.352291 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self._enter() Jun 02 15:46:29.352291 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 15:46:29.352291 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 15:46:29.352291 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 15:46:29.352291 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self.creator() Jun 02 15:46:29.352291 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 15:46:29.352291 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application created_value = creator( Jun 02 15:46:29.353365 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 02 15:46:29.353365 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 02 15:46:29.353365 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 02 15:46:29.353365 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 02 15:46:29.353365 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 02 15:46:29.353365 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 02 15:46:29.353365 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 02 15:46:29.353365 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application Jun 02 15:46:29.354501 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.auth.core [None req-39cd22ea-4c36-4efb-9d05-16e39ae96cb3 None None] MFA Rules not processed for user `400d1f4db9de49638549e5db29a041e1`. Rule list: `[]` (Enabled: `True`). {{(pid=80396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 15:46:29.355685 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 305/601] 10.222.0.59 () {56 vars in 1111 bytes} [Thu Jun 2 15:46:29 2022] GET /identity/v3/projects/service => generated 88 bytes in 247 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 15:46:29.355914 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.fernet_utils [None req-39cd22ea-4c36-4efb-9d05-16e39ae96cb3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 15:46:29.356801 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaa6b469-fd6a-457e-9de1-8f0c1e3a425e None admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:46:29.441156 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writing DB stats keystone:SELECT=100 {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:46:29.457398 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 297/602] 10.222.0.59 () {58 vars in 1023 bytes} [Thu Jun 2 15:46:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 02 15:46:29.458564 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39cd22ea-4c36-4efb-9d05-16e39ae96cb3 None None] Authenticating user token {{(pid=80396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:46:29.472151 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaa6b469-fd6a-457e-9de1-8f0c1e3a425e None admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:46:29.519566 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-060f96ef-f24c-4a36-b3d7-01b458008ace None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:46:29.520986 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-060f96ef-f24c-4a36-b3d7-01b458008ace None admin] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:46:29.521364 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-060f96ef-f24c-4a36-b3d7-01b458008ace None admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:46:29.522628 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-060f96ef-f24c-4a36-b3d7-01b458008ace None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:46:29.538032 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-060f96ef-f24c-4a36-b3d7-01b458008ace None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:46:29.540845 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-060f96ef-f24c-4a36-b3d7-01b458008ace None admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:46:29.563547 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application [None req-060f96ef-f24c-4a36-b3d7-01b458008ace None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 15:46:29.563547 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 15:46:29.563547 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 15:46:29.563547 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 15:46:29.563547 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 15:46:29.563547 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 15:46:29.563547 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 15:46:29.563547 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 15:46:29.563547 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 15:46:29.563547 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 15:46:29.563547 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 15:46:29.563547 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 15:46:29.563547 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 02 15:46:29.563547 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 02 15:46:29.563547 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 02 15:46:29.564618 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 02 15:46:29.564618 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 15:46:29.564618 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 15:46:29.564618 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 15:46:29.564618 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 15:46:29.564618 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 15:46:29.564618 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 15:46:29.564618 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 15:46:29.564618 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application with Lock( Jun 02 15:46:29.564618 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 15:46:29.564618 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self._enter() Jun 02 15:46:29.564618 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 15:46:29.564618 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 15:46:29.564618 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 15:46:29.564618 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self.creator() Jun 02 15:46:29.564618 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 15:46:29.564618 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application created_value = creator( Jun 02 15:46:29.565512 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 02 15:46:29.565512 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 02 15:46:29.565512 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 15:46:29.565512 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application Jun 02 15:46:29.570149 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 306/603] 10.222.0.59 () {56 vars in 1108 bytes} [Thu Jun 2 15:46:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 15:46:29.571246 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-060f96ef-f24c-4a36-b3d7-01b458008ace None admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:46:29.580309 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39cd22ea-4c36-4efb-9d05-16e39ae96cb3 None None] Validating token access rules against request {{(pid=80396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:46:29.611953 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG dbcounter [-] [80396] Writing DB stats keystone:SELECT=100 {{(pid=80396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:46:29.623155 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3912f39b-b2a2-4b37-bd20-2c67f7182b60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:46:29.623878 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3912f39b-b2a2-4b37-bd20-2c67f7182b60 None admin] REQUEST_METHOD: `GET` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:46:29.627908 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3912f39b-b2a2-4b37-bd20-2c67f7182b60 None admin] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:46:29.627908 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3912f39b-b2a2-4b37-bd20-2c67f7182b60 None admin] PATH_INFO: `/v3/projects` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:46:29.627908 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3912f39b-b2a2-4b37-bd20-2c67f7182b60 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80396) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 15:46:29.627908 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3912f39b-b2a2-4b37-bd20-2c67f7182b60 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:46:29.627908 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3912f39b-b2a2-4b37-bd20-2c67f7182b60 None admin] RBAC: Authorization granted {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:46:29.645392 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 298/604] 10.222.0.59 () {56 vars in 1148 bytes} [Thu Jun 2 15:46:29 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 15:46:29.645392 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3912f39b-b2a2-4b37-bd20-2c67f7182b60 None admin] Authenticating user token {{(pid=80396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:46:29.716166 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-060f96ef-f24c-4a36-b3d7-01b458008ace None admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:46:29.749166 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writing DB stats keystone:SELECT=100 {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:46:29.757636 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3912f39b-b2a2-4b37-bd20-2c67f7182b60 None admin] Validating token access rules against request {{(pid=80396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:46:29.761472 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd32f1a2-cc54-4cf3-99dc-cf149e913da4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:46:29.768570 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd32f1a2-cc54-4cf3-99dc-cf149e913da4 None admin] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:46:29.768570 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd32f1a2-cc54-4cf3-99dc-cf149e913da4 None admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:46:29.768570 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd32f1a2-cc54-4cf3-99dc-cf149e913da4 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:46:29.778384 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd32f1a2-cc54-4cf3-99dc-cf149e913da4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 02 15:46:29.789197 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application [None req-cd32f1a2-cc54-4cf3-99dc-cf149e913da4 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 02 15:46:29.789197 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 15:46:29.789197 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 15:46:29.789197 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 15:46:29.789197 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 15:46:29.789197 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 15:46:29.789197 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 15:46:29.789197 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 15:46:29.789197 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 15:46:29.789197 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 15:46:29.789197 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 15:46:29.789197 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 15:46:29.789197 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 02 15:46:29.789197 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 02 15:46:29.789197 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 02 15:46:29.789197 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 02 15:46:29.790139 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 02 15:46:29.790139 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 02 15:46:29.790139 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 02 15:46:29.790139 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 02 15:46:29.790139 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 15:46:29.790139 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 15:46:29.790139 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 15:46:29.790139 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 15:46:29.790139 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 15:46:29.790139 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 15:46:29.790139 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 15:46:29.790139 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application with Lock( Jun 02 15:46:29.790139 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 15:46:29.790139 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self._enter() Jun 02 15:46:29.790139 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 15:46:29.790139 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 15:46:29.790983 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 15:46:29.790983 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self.creator() Jun 02 15:46:29.790983 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 15:46:29.790983 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application created_value = creator( Jun 02 15:46:29.790983 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 02 15:46:29.790983 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 02 15:46:29.790983 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 02 15:46:29.790983 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 02 15:46:29.790983 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 02 15:46:29.790983 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 02 15:46:29.790983 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 02 15:46:29.790983 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application Jun 02 15:46:29.790983 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 307/605] 10.222.0.59 () {56 vars in 1102 bytes} [Thu Jun 2 15:46:29 2022] GET /identity/v3/roles/service => generated 85 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 15:46:29.794498 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd32f1a2-cc54-4cf3-99dc-cf149e913da4 None admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:46:29.801606 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45c0c8d0-1f42-4a23-a52e-f1ed4ac4ddfb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:46:29.802309 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c0c8d0-1f42-4a23-a52e-f1ed4ac4ddfb None admin] REQUEST_METHOD: `GET` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:46:29.802591 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c0c8d0-1f42-4a23-a52e-f1ed4ac4ddfb None admin] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:46:29.802868 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c0c8d0-1f42-4a23-a52e-f1ed4ac4ddfb None admin] PATH_INFO: `/v3/domains` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:46:29.803836 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45c0c8d0-1f42-4a23-a52e-f1ed4ac4ddfb None admin] RBAC: Adding query filter params (name=Default) {{(pid=80396) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 15:46:29.804155 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45c0c8d0-1f42-4a23-a52e-f1ed4ac4ddfb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:46:29.805888 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45c0c8d0-1f42-4a23-a52e-f1ed4ac4ddfb None admin] RBAC: Authorization granted {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:46:29.819799 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 299/606] 10.222.0.59 () {56 vars in 1109 bytes} [Thu Jun 2 15:46:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 15:46:29.820714 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45c0c8d0-1f42-4a23-a52e-f1ed4ac4ddfb None admin] Authenticating user token {{(pid=80396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:46:29.875444 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG dbcounter [-] [80396] Writing DB stats keystone:SELECT=100 {{(pid=80396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:46:29.933771 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45c0c8d0-1f42-4a23-a52e-f1ed4ac4ddfb None admin] Validating token access rules against request {{(pid=80396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:46:29.934044 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd32f1a2-cc54-4cf3-99dc-cf149e913da4 None admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:46:29.973804 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed646493-1717-46f1-b87b-e781857d2326 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:46:29.974722 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed646493-1717-46f1-b87b-e781857d2326 None admin] REQUEST_METHOD: `GET` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:46:29.975255 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed646493-1717-46f1-b87b-e781857d2326 None admin] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:46:29.975609 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed646493-1717-46f1-b87b-e781857d2326 None admin] PATH_INFO: `/v3/roles` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:46:29.976450 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed646493-1717-46f1-b87b-e781857d2326 None admin] RBAC: Adding query filter params (name=service) {{(pid=80396) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 15:46:29.976824 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed646493-1717-46f1-b87b-e781857d2326 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:46:29.978794 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed646493-1717-46f1-b87b-e781857d2326 None admin] RBAC: Authorization granted {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:46:29.980202 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f593eba-9cd8-4fc9-a80c-f15f3149b899 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:46:29.981422 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f593eba-9cd8-4fc9-a80c-f15f3149b899 None admin] REQUEST_METHOD: `PUT` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:46:29.982242 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f593eba-9cd8-4fc9-a80c-f15f3149b899 None admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:46:29.982524 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f593eba-9cd8-4fc9-a80c-f15f3149b899 None admin] PATH_INFO: `/v3/projects/9c87c981909d4b8db02783421818c79b/users/6534961c369940a5b88f310c6450250b/roles/36214aa6067e4493a555da410f965c5e` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:46:29.989693 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 300/607] 10.222.0.59 () {56 vars in 1103 bytes} [Thu Jun 2 15:46:29 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 15:46:29.991266 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed646493-1717-46f1-b87b-e781857d2326 None admin] Authenticating user token {{(pid=80396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:46:30.007128 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f593eba-9cd8-4fc9-a80c-f15f3149b899 None admin] RBAC: Authorizing `identity:create_grant(project_id=9c87c981909d4b8db02783421818c79b, user_id=6534961c369940a5b88f310c6450250b, role_id=36214aa6067e4493a555da410f965c5e)` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:46:30.009328 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f593eba-9cd8-4fc9-a80c-f15f3149b899 None admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:46:30.098481 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed646493-1717-46f1-b87b-e781857d2326 None admin] Validating token access rules against request {{(pid=80396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:46:30.108246 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG dbcounter [-] [80396] Writing DB stats keystone:SELECT=100 {{(pid=80396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:46:30.130538 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 308/608] 10.222.0.59 () {58 vars in 1439 bytes} [Thu Jun 2 15:46:29 2022] PUT /identity/v3/projects/9c87c981909d4b8db02783421818c79b/users/6534961c369940a5b88f310c6450250b/roles/36214aa6067e4493a555da410f965c5e => generated 0 bytes in 334 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 15:46:30.132905 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f593eba-9cd8-4fc9-a80c-f15f3149b899 None admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:46:30.149644 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f59119dc-830b-44fb-88f3-507b0d627d7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:46:30.150493 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f59119dc-830b-44fb-88f3-507b0d627d7e None admin] REQUEST_METHOD: `GET` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:46:30.150775 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f59119dc-830b-44fb-88f3-507b0d627d7e None admin] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:46:30.151048 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f59119dc-830b-44fb-88f3-507b0d627d7e None admin] PATH_INFO: `/v3/projects/service` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:46:30.167444 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f59119dc-830b-44fb-88f3-507b0d627d7e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:46:30.169120 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f59119dc-830b-44fb-88f3-507b0d627d7e None admin] RBAC: Authorization granted {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:46:30.191974 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:46:30.207020 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application [None req-f59119dc-830b-44fb-88f3-507b0d627d7e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 02 15:46:30.207020 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 15:46:30.207020 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 15:46:30.207020 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 15:46:30.207020 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 15:46:30.207020 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 15:46:30.207020 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 15:46:30.207020 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 15:46:30.207020 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 15:46:30.207020 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 15:46:30.207020 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 15:46:30.207020 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 15:46:30.207020 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 02 15:46:30.207020 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 02 15:46:30.207020 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 02 15:46:30.207956 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 02 15:46:30.207956 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 15:46:30.207956 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 15:46:30.207956 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 15:46:30.207956 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 15:46:30.207956 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 15:46:30.207956 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 15:46:30.207956 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 15:46:30.207956 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application with Lock( Jun 02 15:46:30.207956 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 15:46:30.207956 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application return self._enter() Jun 02 15:46:30.207956 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 15:46:30.207956 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 15:46:30.207956 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 15:46:30.207956 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application return self.creator() Jun 02 15:46:30.207956 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 15:46:30.207956 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application created_value = creator( Jun 02 15:46:30.208827 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 02 15:46:30.208827 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 02 15:46:30.208827 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 02 15:46:30.208827 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 02 15:46:30.208827 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 02 15:46:30.208827 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 02 15:46:30.208827 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 02 15:46:30.208827 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application Jun 02 15:46:30.208827 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 301/609] 10.222.0.59 () {56 vars in 1111 bytes} [Thu Jun 2 15:46:29 2022] GET /identity/v3/projects/service => generated 88 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 15:46:30.215966 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f59119dc-830b-44fb-88f3-507b0d627d7e None admin] Authenticating user token {{(pid=80396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:46:30.275736 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f593eba-9cd8-4fc9-a80c-f15f3149b899 None admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:46:30.360221 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bbdbb53-074c-4db6-be69-0c17275fb92d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:46:30.360944 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bbdbb53-074c-4db6-be69-0c17275fb92d None admin] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:46:30.361224 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bbdbb53-074c-4db6-be69-0c17275fb92d None admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:46:30.361495 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bbdbb53-074c-4db6-be69-0c17275fb92d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:46:30.378718 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bbdbb53-074c-4db6-be69-0c17275fb92d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:46:30.380181 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bbdbb53-074c-4db6-be69-0c17275fb92d None admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:46:30.403908 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application [None req-0bbdbb53-074c-4db6-be69-0c17275fb92d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 15:46:30.403908 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 15:46:30.403908 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 15:46:30.403908 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 15:46:30.403908 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 15:46:30.403908 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 15:46:30.403908 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 15:46:30.403908 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 15:46:30.403908 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 15:46:30.403908 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 15:46:30.403908 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 15:46:30.403908 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 15:46:30.403908 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 02 15:46:30.403908 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 02 15:46:30.403908 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 02 15:46:30.404847 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 02 15:46:30.404847 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 15:46:30.404847 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 15:46:30.404847 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 15:46:30.404847 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 15:46:30.404847 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 15:46:30.404847 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 15:46:30.404847 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 15:46:30.404847 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application with Lock( Jun 02 15:46:30.404847 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 15:46:30.404847 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self._enter() Jun 02 15:46:30.404847 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 15:46:30.404847 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 15:46:30.404847 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 15:46:30.404847 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self.creator() Jun 02 15:46:30.404847 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 15:46:30.404847 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application created_value = creator( Jun 02 15:46:30.405766 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 02 15:46:30.405766 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 02 15:46:30.405766 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 15:46:30.405766 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application Jun 02 15:46:30.405766 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 309/610] 10.222.0.59 () {56 vars in 1108 bytes} [Thu Jun 2 15:46:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 274 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 15:46:30.413169 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bbdbb53-074c-4db6-be69-0c17275fb92d None admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:46:30.420241 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f59119dc-830b-44fb-88f3-507b0d627d7e None admin] Validating token access rules against request {{(pid=80396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:46:30.471890 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b48dc3b-7812-4d55-8b6d-cde021f29930 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:46:30.472950 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b48dc3b-7812-4d55-8b6d-cde021f29930 None admin] REQUEST_METHOD: `GET` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:46:30.473596 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b48dc3b-7812-4d55-8b6d-cde021f29930 None admin] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:46:30.474100 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b48dc3b-7812-4d55-8b6d-cde021f29930 None admin] PATH_INFO: `/v3/projects` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:46:30.475728 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b48dc3b-7812-4d55-8b6d-cde021f29930 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80396) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 15:46:30.478163 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b48dc3b-7812-4d55-8b6d-cde021f29930 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:46:30.479858 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b48dc3b-7812-4d55-8b6d-cde021f29930 None admin] RBAC: Authorization granted {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:46:30.498576 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 302/611] 10.222.0.59 () {56 vars in 1148 bytes} [Thu Jun 2 15:46:30 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 283 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 15:46:30.505334 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b48dc3b-7812-4d55-8b6d-cde021f29930 None admin] Authenticating user token {{(pid=80396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:46:30.556967 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG dbcounter [-] [80396] Writing DB stats keystone:SELECT=100 {{(pid=80396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:46:30.576246 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writing DB stats keystone:SELECT=100 {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:46:30.605797 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bbdbb53-074c-4db6-be69-0c17275fb92d None admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:46:30.650045 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b48dc3b-7812-4d55-8b6d-cde021f29930 None admin] Validating token access rules against request {{(pid=80396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:46:30.688303 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14767cf9-253b-4bb5-8a95-3aea0f838db9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:46:30.688980 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14767cf9-253b-4bb5-8a95-3aea0f838db9 None admin] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:46:30.689263 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14767cf9-253b-4bb5-8a95-3aea0f838db9 None admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:46:30.689538 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14767cf9-253b-4bb5-8a95-3aea0f838db9 None admin] PATH_INFO: `/v3/domains` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:46:30.690292 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14767cf9-253b-4bb5-8a95-3aea0f838db9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80395) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 15:46:30.690600 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14767cf9-253b-4bb5-8a95-3aea0f838db9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:46:30.691990 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14767cf9-253b-4bb5-8a95-3aea0f838db9 None admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:46:30.710972 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 310/612] 10.222.0.59 () {56 vars in 1109 bytes} [Thu Jun 2 15:46:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 299 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 15:46:30.715227 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edd49b08-c1f1-43fe-853e-b00d5b483505 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:46:30.716197 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd49b08-c1f1-43fe-853e-b00d5b483505 None admin] REQUEST_METHOD: `PUT` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:46:30.716485 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd49b08-c1f1-43fe-853e-b00d5b483505 None admin] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:46:30.716758 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd49b08-c1f1-43fe-853e-b00d5b483505 None admin] PATH_INFO: `/v3/projects/9c87c981909d4b8db02783421818c79b/users/9af40ddfe9ff4be3887b068f13a28dc0/roles/36214aa6067e4493a555da410f965c5e` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:46:30.718155 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14767cf9-253b-4bb5-8a95-3aea0f838db9 None admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:46:30.733756 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edd49b08-c1f1-43fe-853e-b00d5b483505 None admin] RBAC: Authorizing `identity:create_grant(project_id=9c87c981909d4b8db02783421818c79b, user_id=9af40ddfe9ff4be3887b068f13a28dc0, role_id=36214aa6067e4493a555da410f965c5e)` {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:46:30.736252 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edd49b08-c1f1-43fe-853e-b00d5b483505 None admin] RBAC: Authorization granted {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:46:30.840143 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 303/613] 10.222.0.59 () {58 vars in 1439 bytes} [Thu Jun 2 15:46:30 2022] PUT /identity/v3/projects/9c87c981909d4b8db02783421818c79b/users/9af40ddfe9ff4be3887b068f13a28dc0/roles/36214aa6067e4493a555da410f965c5e => generated 0 bytes in 335 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 15:46:30.862840 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14767cf9-253b-4bb5-8a95-3aea0f838db9 None admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:46:30.916992 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fa6fbfc-fc42-447f-955c-27d86742178b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:46:30.918216 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa6fbfc-fc42-447f-955c-27d86742178b None admin] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:46:30.918719 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa6fbfc-fc42-447f-955c-27d86742178b None admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:46:30.919201 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa6fbfc-fc42-447f-955c-27d86742178b None admin] PATH_INFO: `/v3/users/swift` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:46:30.930944 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fa6fbfc-fc42-447f-955c-27d86742178b None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:46:30.932809 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fa6fbfc-fc42-447f-955c-27d86742178b None admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:46:30.951966 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application [None req-4fa6fbfc-fc42-447f-955c-27d86742178b None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jun 02 15:46:30.951966 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 15:46:30.951966 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 15:46:30.951966 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 15:46:30.951966 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 15:46:30.951966 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 15:46:30.951966 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 15:46:30.951966 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 15:46:30.951966 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 15:46:30.951966 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 15:46:30.951966 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 15:46:30.951966 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 15:46:30.951966 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 02 15:46:30.951966 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 02 15:46:30.951966 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 02 15:46:30.951966 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 02 15:46:30.952993 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 15:46:30.952993 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 15:46:30.952993 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 02 15:46:30.952993 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 02 15:46:30.952993 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 02 15:46:30.952993 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 02 15:46:30.952993 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 15:46:30.952993 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 15:46:30.952993 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 15:46:30.952993 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 15:46:30.952993 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 15:46:30.952993 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application with Lock( Jun 02 15:46:30.952993 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 15:46:30.952993 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self._enter() Jun 02 15:46:30.952993 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 15:46:30.952993 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 15:46:30.952993 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 15:46:30.952993 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self.creator() Jun 02 15:46:30.953913 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 15:46:30.953913 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application created_value = creator( Jun 02 15:46:30.953913 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 02 15:46:30.953913 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 02 15:46:30.953913 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 02 15:46:30.953913 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 02 15:46:30.953913 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 02 15:46:30.953913 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 02 15:46:30.953913 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jun 02 15:46:30.953913 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application Jun 02 15:46:30.953913 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 311/614] 10.222.0.59 () {56 vars in 1096 bytes} [Thu Jun 2 15:46:30 2022] GET /identity/v3/users/swift => generated 83 bytes in 236 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 15:46:30.959328 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edd49b08-c1f1-43fe-853e-b00d5b483505 None admin] Authenticating user token {{(pid=80396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:46:31.098444 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG dbcounter [-] [80396] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:46:31.127281 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edd49b08-c1f1-43fe-853e-b00d5b483505 None admin] Validating token access rules against request {{(pid=80396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:46:31.191461 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baccc09e-423e-4b05-8a1a-a05131695cab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:46:31.192399 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baccc09e-423e-4b05-8a1a-a05131695cab None admin] REQUEST_METHOD: `GET` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:46:31.192852 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baccc09e-423e-4b05-8a1a-a05131695cab None admin] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:46:31.193282 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baccc09e-423e-4b05-8a1a-a05131695cab None admin] PATH_INFO: `/v3/users` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:46:31.194923 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baccc09e-423e-4b05-8a1a-a05131695cab None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80396) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 15:46:31.195383 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baccc09e-423e-4b05-8a1a-a05131695cab None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:46:31.197137 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baccc09e-423e-4b05-8a1a-a05131695cab None admin] RBAC: Authorization granted {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:46:31.229821 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 304/615] 10.222.0.59 () {56 vars in 1135 bytes} [Thu Jun 2 15:46:30 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 271 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 15:46:31.235105 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fa6fbfc-fc42-447f-955c-27d86742178b None admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:46:31.251622 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writing DB stats keystone:SELECT=100 {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:46:31.382607 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fa6fbfc-fc42-447f-955c-27d86742178b None admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:46:31.410086 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2fab782-bef0-40e9-941b-9a599da12d5c None None] REQUEST_METHOD: `GET` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:46:31.410635 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2fab782-bef0-40e9-941b-9a599da12d5c None None] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:46:31.411057 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2fab782-bef0-40e9-941b-9a599da12d5c None None] PATH_INFO: `/` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:46:31.413519 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 305/616] 10.222.0.59 () {54 vars in 926 bytes} [Thu Jun 2 15:46:31 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 02 15:46:31.418810 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c11688-fed2-4a77-9d9f-3f340eef65c4 None None] REQUEST_METHOD: `POST` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:46:31.419210 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c11688-fed2-4a77-9d9f-3f340eef65c4 None None] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:46:31.419583 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c11688-fed2-4a77-9d9f-3f340eef65c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:46:31.437076 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5610f2a4-d050-4400-a569-7e0937bf4815 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:46:31.438121 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5610f2a4-d050-4400-a569-7e0937bf4815 None admin] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:46:31.438548 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5610f2a4-d050-4400-a569-7e0937bf4815 None admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:46:31.439052 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5610f2a4-d050-4400-a569-7e0937bf4815 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:46:31.451117 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.auth.core [None req-93c11688-fed2-4a77-9d9f-3f340eef65c4 None None] MFA Rules not processed for user `400d1f4db9de49638549e5db29a041e1`. Rule list: `[]` (Enabled: `True`). {{(pid=80396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 15:46:31.452337 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.fernet_utils [None req-93c11688-fed2-4a77-9d9f-3f340eef65c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 15:46:31.455169 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5610f2a4-d050-4400-a569-7e0937bf4815 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:46:31.456779 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5610f2a4-d050-4400-a569-7e0937bf4815 None admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:46:31.486638 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application [None req-5610f2a4-d050-4400-a569-7e0937bf4815 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 15:46:31.486638 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 15:46:31.486638 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 15:46:31.486638 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 15:46:31.486638 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 15:46:31.486638 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 15:46:31.486638 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 15:46:31.486638 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 15:46:31.486638 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 15:46:31.486638 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 15:46:31.486638 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 15:46:31.486638 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 15:46:31.486638 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 02 15:46:31.486638 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 02 15:46:31.486638 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 02 15:46:31.487811 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 02 15:46:31.487811 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 15:46:31.487811 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 15:46:31.487811 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 15:46:31.487811 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 15:46:31.487811 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 15:46:31.487811 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 15:46:31.487811 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 15:46:31.487811 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application with Lock( Jun 02 15:46:31.487811 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 15:46:31.487811 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self._enter() Jun 02 15:46:31.487811 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 15:46:31.487811 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 15:46:31.487811 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 15:46:31.487811 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self.creator() Jun 02 15:46:31.487811 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 15:46:31.487811 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application created_value = creator( Jun 02 15:46:31.488905 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 02 15:46:31.488905 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 02 15:46:31.488905 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 15:46:31.488905 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application Jun 02 15:46:31.501900 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 312/617] 10.222.0.59 () {56 vars in 1108 bytes} [Thu Jun 2 15:46:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 260 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 15:46:31.501900 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5610f2a4-d050-4400-a569-7e0937bf4815 None admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:46:31.570066 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 306/618] 10.222.0.59 () {58 vars in 1023 bytes} [Thu Jun 2 15:46:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 02 15:46:31.612359 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93c11688-fed2-4a77-9d9f-3f340eef65c4 None None] Authenticating user token {{(pid=80396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:46:31.618645 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writing DB stats keystone:SELECT=100 {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:46:31.699451 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5610f2a4-d050-4400-a569-7e0937bf4815 None admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:46:31.706097 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG dbcounter [-] [80396] Writing DB stats keystone:SELECT=100 {{(pid=80396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:46:31.735601 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5431bd6-c750-4320-82ea-9f9134334161 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:46:31.736278 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5431bd6-c750-4320-82ea-9f9134334161 None admin] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:46:31.736817 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5431bd6-c750-4320-82ea-9f9134334161 None admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:46:31.737170 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5431bd6-c750-4320-82ea-9f9134334161 None admin] PATH_INFO: `/v3/domains` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:46:31.737973 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5431bd6-c750-4320-82ea-9f9134334161 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80395) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 15:46:31.738377 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5431bd6-c750-4320-82ea-9f9134334161 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:46:31.739822 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5431bd6-c750-4320-82ea-9f9134334161 None admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:46:31.751100 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93c11688-fed2-4a77-9d9f-3f340eef65c4 None None] Validating token access rules against request {{(pid=80396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:46:31.757406 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 313/619] 10.222.0.59 () {56 vars in 1109 bytes} [Thu Jun 2 15:46:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 252 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 15:46:31.757406 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca734561-f2dc-40ed-a0c7-093e6065aca3 None None] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:46:31.757406 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca734561-f2dc-40ed-a0c7-093e6065aca3 None None] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:46:31.757406 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca734561-f2dc-40ed-a0c7-093e6065aca3 None None] PATH_INFO: `/` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:46:31.763038 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 314/620] 10.222.0.59 () {54 vars in 926 bytes} [Thu Jun 2 15:46:31 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 15:46:31.763859 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca734561-f2dc-40ed-a0c7-093e6065aca3 None None] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:46:31.800591 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-237bc4cd-f631-47bd-9e0d-f75fbd6d446b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:46:31.801925 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-237bc4cd-f631-47bd-9e0d-f75fbd6d446b None admin] REQUEST_METHOD: `GET` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:46:31.802381 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-237bc4cd-f631-47bd-9e0d-f75fbd6d446b None admin] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:46:31.802854 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-237bc4cd-f631-47bd-9e0d-f75fbd6d446b None admin] PATH_INFO: `/v3/roles/service` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:46:31.819223 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-237bc4cd-f631-47bd-9e0d-f75fbd6d446b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 02 15:46:31.829732 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application [None req-237bc4cd-f631-47bd-9e0d-f75fbd6d446b None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 02 15:46:31.829732 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 15:46:31.829732 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 15:46:31.829732 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 15:46:31.829732 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 15:46:31.829732 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 15:46:31.829732 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 15:46:31.829732 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 15:46:31.829732 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 15:46:31.829732 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 15:46:31.829732 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 15:46:31.829732 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 15:46:31.829732 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 02 15:46:31.829732 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 02 15:46:31.829732 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 02 15:46:31.829732 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 02 15:46:31.830907 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 02 15:46:31.830907 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 02 15:46:31.830907 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 02 15:46:31.830907 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 02 15:46:31.830907 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 15:46:31.830907 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 15:46:31.830907 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 15:46:31.830907 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 15:46:31.830907 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 15:46:31.830907 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 15:46:31.830907 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 15:46:31.830907 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application with Lock( Jun 02 15:46:31.830907 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 15:46:31.830907 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application return self._enter() Jun 02 15:46:31.830907 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 15:46:31.830907 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 15:46:31.831923 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 15:46:31.831923 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application return self.creator() Jun 02 15:46:31.831923 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 15:46:31.831923 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application created_value = creator( Jun 02 15:46:31.831923 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 02 15:46:31.831923 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 02 15:46:31.831923 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 02 15:46:31.831923 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 02 15:46:31.831923 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 02 15:46:31.831923 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 02 15:46:31.831923 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 02 15:46:31.831923 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application Jun 02 15:46:31.840348 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 307/621] 10.222.0.59 () {56 vars in 1102 bytes} [Thu Jun 2 15:46:31 2022] GET /identity/v3/roles/service => generated 85 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 15:46:31.841054 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39ca23c-53c6-4524-8ff7-074465432e5c None None] REQUEST_METHOD: `POST` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:46:31.841348 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39ca23c-53c6-4524-8ff7-074465432e5c None None] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:46:31.841629 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39ca23c-53c6-4524-8ff7-074465432e5c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:46:31.859894 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.auth.core [None req-c39ca23c-53c6-4524-8ff7-074465432e5c None None] MFA Rules not processed for user `400d1f4db9de49638549e5db29a041e1`. Rule list: `[]` (Enabled: `True`). {{(pid=80396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 15:46:31.861087 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.fernet_utils [None req-c39ca23c-53c6-4524-8ff7-074465432e5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 15:46:31.905421 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca734561-f2dc-40ed-a0c7-093e6065aca3 None None] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:46:31.927336 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writing DB stats keystone:SELECT=100 {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:46:31.938625 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 308/622] 10.222.0.59 () {58 vars in 1023 bytes} [Thu Jun 2 15:46:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 02 15:46:31.943395 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1ba4d09-bbbb-48fb-b759-1f9d73ae3f99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:46:31.944571 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ba4d09-bbbb-48fb-b759-1f9d73ae3f99 None admin] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:46:31.945078 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ba4d09-bbbb-48fb-b759-1f9d73ae3f99 None admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:46:31.945624 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ba4d09-bbbb-48fb-b759-1f9d73ae3f99 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:46:31.946938 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c39ca23c-53c6-4524-8ff7-074465432e5c None None] Authenticating user token {{(pid=80396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:46:31.953186 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1ba4d09-bbbb-48fb-b759-1f9d73ae3f99 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:46:31.954987 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1ba4d09-bbbb-48fb-b759-1f9d73ae3f99 None admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:46:31.970776 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application [None req-a1ba4d09-bbbb-48fb-b759-1f9d73ae3f99 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 02 15:46:31.970776 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 15:46:31.970776 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 15:46:31.970776 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 15:46:31.970776 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 15:46:31.970776 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 15:46:31.970776 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 15:46:31.970776 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 15:46:31.970776 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 15:46:31.970776 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 15:46:31.970776 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 15:46:31.970776 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 15:46:31.970776 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 02 15:46:31.970776 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 02 15:46:31.970776 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 02 15:46:31.971695 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 02 15:46:31.971695 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 15:46:31.971695 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 15:46:31.971695 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 15:46:31.971695 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 15:46:31.971695 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 15:46:31.971695 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 15:46:31.971695 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 15:46:31.971695 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application with Lock( Jun 02 15:46:31.971695 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 15:46:31.971695 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self._enter() Jun 02 15:46:31.971695 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 15:46:31.971695 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 15:46:31.971695 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 15:46:31.971695 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self.creator() Jun 02 15:46:31.971695 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 15:46:31.971695 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application created_value = creator( Jun 02 15:46:31.972574 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 02 15:46:31.972574 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 02 15:46:31.972574 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 02 15:46:31.972574 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 02 15:46:31.972574 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 02 15:46:31.972574 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 02 15:46:31.972574 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 02 15:46:31.972574 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application Jun 02 15:46:31.975883 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 315/623] 10.222.0.59 () {56 vars in 1111 bytes} [Thu Jun 2 15:46:31 2022] GET /identity/v3/projects/service => generated 88 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 15:46:31.981623 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1ba4d09-bbbb-48fb-b759-1f9d73ae3f99 None admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:46:32.020100 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG dbcounter [-] [80396] Writing DB stats keystone:SELECT=100 {{(pid=80396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:46:32.066202 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c39ca23c-53c6-4524-8ff7-074465432e5c None None] Validating token access rules against request {{(pid=80396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:46:32.096334 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1ba4d09-bbbb-48fb-b759-1f9d73ae3f99 None admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:46:32.102600 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-966cf97e-d954-439f-b4ce-3dae324c732b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:46:32.103265 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966cf97e-d954-439f-b4ce-3dae324c732b None admin] REQUEST_METHOD: `GET` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:46:32.103549 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966cf97e-d954-439f-b4ce-3dae324c732b None admin] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:46:32.103827 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966cf97e-d954-439f-b4ce-3dae324c732b None admin] PATH_INFO: `/v3/roles` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:46:32.104576 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-966cf97e-d954-439f-b4ce-3dae324c732b None admin] RBAC: Adding query filter params (name=service) {{(pid=80396) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 15:46:32.104883 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-966cf97e-d954-439f-b4ce-3dae324c732b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:46:32.106534 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-966cf97e-d954-439f-b4ce-3dae324c732b None admin] RBAC: Authorization granted {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:46:32.119474 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 309/624] 10.222.0.59 () {56 vars in 1103 bytes} [Thu Jun 2 15:46:31 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 15:46:32.119474 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-966cf97e-d954-439f-b4ce-3dae324c732b None admin] Authenticating user token {{(pid=80396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:46:32.140870 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c6dd138-de6a-481a-876d-f92d54a75465 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:46:32.141984 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c6dd138-de6a-481a-876d-f92d54a75465 None admin] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:46:32.142570 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c6dd138-de6a-481a-876d-f92d54a75465 None admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:46:32.143051 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c6dd138-de6a-481a-876d-f92d54a75465 None admin] PATH_INFO: `/v3/projects` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:46:32.144038 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c6dd138-de6a-481a-876d-f92d54a75465 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80395) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 15:46:32.144644 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c6dd138-de6a-481a-876d-f92d54a75465 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:46:32.146499 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c6dd138-de6a-481a-876d-f92d54a75465 None admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:46:32.160913 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 316/625] 10.222.0.59 () {56 vars in 1148 bytes} [Thu Jun 2 15:46:31 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 15:46:32.167301 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c6dd138-de6a-481a-876d-f92d54a75465 None admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:46:32.217728 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writing DB stats keystone:SELECT=100 {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:46:32.236155 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-966cf97e-d954-439f-b4ce-3dae324c732b None admin] Validating token access rules against request {{(pid=80396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:46:32.254460 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG dbcounter [-] [80396] Writing DB stats keystone:SELECT=100 {{(pid=80396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:46:32.272948 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d0c89a-11b9-4c28-9e3f-9f18bc5411dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:46:32.273829 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d0c89a-11b9-4c28-9e3f-9f18bc5411dd None admin] REQUEST_METHOD: `GET` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:46:32.274165 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d0c89a-11b9-4c28-9e3f-9f18bc5411dd None admin] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:46:32.274400 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d0c89a-11b9-4c28-9e3f-9f18bc5411dd None admin] PATH_INFO: `/v3/roles/service` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:46:32.285563 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54d0c89a-11b9-4c28-9e3f-9f18bc5411dd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 02 15:46:32.289417 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c6dd138-de6a-481a-876d-f92d54a75465 None admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:46:32.294753 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application [None req-54d0c89a-11b9-4c28-9e3f-9f18bc5411dd None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 02 15:46:32.294753 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 15:46:32.294753 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 15:46:32.294753 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 15:46:32.294753 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 15:46:32.294753 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 15:46:32.294753 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 15:46:32.294753 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 15:46:32.294753 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 15:46:32.294753 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 15:46:32.294753 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 15:46:32.294753 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 15:46:32.294753 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 02 15:46:32.294753 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 02 15:46:32.294753 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 02 15:46:32.294753 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 02 15:46:32.295862 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 02 15:46:32.295862 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 02 15:46:32.295862 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 02 15:46:32.295862 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 02 15:46:32.295862 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 15:46:32.295862 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 15:46:32.295862 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 15:46:32.295862 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 15:46:32.295862 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 15:46:32.295862 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 15:46:32.295862 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 15:46:32.295862 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application with Lock( Jun 02 15:46:32.295862 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 15:46:32.295862 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application return self._enter() Jun 02 15:46:32.295862 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 15:46:32.295862 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 15:46:32.296885 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 15:46:32.296885 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application return self.creator() Jun 02 15:46:32.296885 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 15:46:32.296885 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application created_value = creator( Jun 02 15:46:32.296885 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 02 15:46:32.296885 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 02 15:46:32.296885 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 02 15:46:32.296885 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 02 15:46:32.296885 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 02 15:46:32.296885 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 02 15:46:32.296885 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 02 15:46:32.296885 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application Jun 02 15:46:32.304326 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 310/626] 10.222.0.59 () {56 vars in 1102 bytes} [Thu Jun 2 15:46:32 2022] GET /identity/v3/roles/service => generated 85 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 15:46:32.305316 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d0c89a-11b9-4c28-9e3f-9f18bc5411dd None admin] Authenticating user token {{(pid=80396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:46:32.331564 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df46c42e-d3c0-4421-aab5-efdb1761594b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:46:32.332631 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df46c42e-d3c0-4421-aab5-efdb1761594b None admin] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:46:32.333060 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df46c42e-d3c0-4421-aab5-efdb1761594b None admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:46:32.333484 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df46c42e-d3c0-4421-aab5-efdb1761594b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:46:32.348028 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df46c42e-d3c0-4421-aab5-efdb1761594b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:46:32.350596 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df46c42e-d3c0-4421-aab5-efdb1761594b None admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:46:32.371065 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application [None req-df46c42e-d3c0-4421-aab5-efdb1761594b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 15:46:32.371065 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 15:46:32.371065 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 15:46:32.371065 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 15:46:32.371065 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 15:46:32.371065 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 15:46:32.371065 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 15:46:32.371065 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 15:46:32.371065 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 15:46:32.371065 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 15:46:32.371065 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 15:46:32.371065 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 15:46:32.371065 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 02 15:46:32.371065 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 02 15:46:32.371065 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 02 15:46:32.372205 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 02 15:46:32.372205 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 15:46:32.372205 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 15:46:32.372205 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 15:46:32.372205 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 15:46:32.372205 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 15:46:32.372205 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 15:46:32.372205 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 15:46:32.372205 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application with Lock( Jun 02 15:46:32.372205 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 15:46:32.372205 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self._enter() Jun 02 15:46:32.372205 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 15:46:32.372205 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 15:46:32.372205 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 15:46:32.372205 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self.creator() Jun 02 15:46:32.372205 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 15:46:32.372205 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application created_value = creator( Jun 02 15:46:32.373291 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 02 15:46:32.373291 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 02 15:46:32.373291 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 15:46:32.373291 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application Jun 02 15:46:32.375579 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 317/627] 10.222.0.59 () {56 vars in 1108 bytes} [Thu Jun 2 15:46:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 15:46:32.381172 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df46c42e-d3c0-4421-aab5-efdb1761594b None admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:46:32.419129 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d0c89a-11b9-4c28-9e3f-9f18bc5411dd None admin] Validating token access rules against request {{(pid=80396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:46:32.454935 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f5f5976-a1ff-4d7f-bf8f-c9a6ca686a05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:46:32.455995 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f5f5976-a1ff-4d7f-bf8f-c9a6ca686a05 None admin] REQUEST_METHOD: `PUT` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:46:32.456392 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f5f5976-a1ff-4d7f-bf8f-c9a6ca686a05 None admin] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:46:32.456785 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f5f5976-a1ff-4d7f-bf8f-c9a6ca686a05 None admin] PATH_INFO: `/v3/projects/9c87c981909d4b8db02783421818c79b/users/31bd858bf7674f43a99b77d11bc3c1a3/roles/36214aa6067e4493a555da410f965c5e` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:46:32.472604 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f5f5976-a1ff-4d7f-bf8f-c9a6ca686a05 None admin] RBAC: Authorizing `identity:create_grant(project_id=9c87c981909d4b8db02783421818c79b, user_id=31bd858bf7674f43a99b77d11bc3c1a3, role_id=36214aa6067e4493a555da410f965c5e)` {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:46:32.474146 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f5f5976-a1ff-4d7f-bf8f-c9a6ca686a05 None admin] RBAC: Authorization granted {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:46:32.485609 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writing DB stats keystone:SELECT=100 {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:46:32.494766 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df46c42e-d3c0-4421-aab5-efdb1761594b None admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:46:32.528522 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d261b0b9-f1a9-4670-96ac-9ba269b989b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:46:32.529183 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d261b0b9-f1a9-4670-96ac-9ba269b989b4 None admin] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:46:32.529466 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d261b0b9-f1a9-4670-96ac-9ba269b989b4 None admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:46:32.529747 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d261b0b9-f1a9-4670-96ac-9ba269b989b4 None admin] PATH_INFO: `/v3/roles` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:46:32.530522 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d261b0b9-f1a9-4670-96ac-9ba269b989b4 None admin] RBAC: Adding query filter params (name=service) {{(pid=80395) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 15:46:32.530826 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d261b0b9-f1a9-4670-96ac-9ba269b989b4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:46:32.532192 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d261b0b9-f1a9-4670-96ac-9ba269b989b4 None admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:46:32.541740 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 318/628] 10.222.0.59 () {56 vars in 1103 bytes} [Thu Jun 2 15:46:32 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 15:46:32.546591 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d261b0b9-f1a9-4670-96ac-9ba269b989b4 None admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:46:32.562125 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 311/629] 10.222.0.59 () {58 vars in 1439 bytes} [Thu Jun 2 15:46:32 2022] PUT /identity/v3/projects/9c87c981909d4b8db02783421818c79b/users/31bd858bf7674f43a99b77d11bc3c1a3/roles/36214aa6067e4493a555da410f965c5e => generated 0 bytes in 252 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 15:46:32.562946 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f5f5976-a1ff-4d7f-bf8f-c9a6ca686a05 None admin] Authenticating user token {{(pid=80396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:46:32.627708 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG dbcounter [-] [80396] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:46:32.726299 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d261b0b9-f1a9-4670-96ac-9ba269b989b4 None admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:46:32.746513 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f5f5976-a1ff-4d7f-bf8f-c9a6ca686a05 None admin] Validating token access rules against request {{(pid=80396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:46:32.764112 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f1d6b32-6cc9-49fd-b19d-a7f2a170f5bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:46:32.764889 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f1d6b32-6cc9-49fd-b19d-a7f2a170f5bf None admin] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:46:32.765173 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f1d6b32-6cc9-49fd-b19d-a7f2a170f5bf None admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:46:32.765447 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f1d6b32-6cc9-49fd-b19d-a7f2a170f5bf None admin] PATH_INFO: `/v3/domains` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:46:32.766237 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f1d6b32-6cc9-49fd-b19d-a7f2a170f5bf None admin] RBAC: Adding query filter params (name=Default) {{(pid=80395) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 15:46:32.766545 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f1d6b32-6cc9-49fd-b19d-a7f2a170f5bf None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:46:32.768177 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f1d6b32-6cc9-49fd-b19d-a7f2a170f5bf None admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:46:32.783727 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 319/630] 10.222.0.59 () {56 vars in 1109 bytes} [Thu Jun 2 15:46:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 15:46:32.785074 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00baecb4-a09b-4e65-908e-2be365d4226d None None] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:46:32.785366 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00baecb4-a09b-4e65-908e-2be365d4226d None None] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:46:32.785645 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00baecb4-a09b-4e65-908e-2be365d4226d None None] PATH_INFO: `/` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:46:32.786620 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4f83664-ff46-4528-841f-223c316980b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:46:32.788210 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f83664-ff46-4528-841f-223c316980b9 None admin] REQUEST_METHOD: `GET` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:46:32.788641 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f83664-ff46-4528-841f-223c316980b9 None admin] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:46:32.788978 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f83664-ff46-4528-841f-223c316980b9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:46:32.792331 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 320/631] 10.222.0.59 () {54 vars in 926 bytes} [Thu Jun 2 15:46:32 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 15:46:32.793155 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00baecb4-a09b-4e65-908e-2be365d4226d None None] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:46:32.800754 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4f83664-ff46-4528-841f-223c316980b9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:46:32.803062 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4f83664-ff46-4528-841f-223c316980b9 None admin] RBAC: Authorization granted {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:46:32.810153 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writing DB stats keystone:SELECT=100 {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:46:32.823356 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application [None req-c4f83664-ff46-4528-841f-223c316980b9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 15:46:32.823356 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 15:46:32.823356 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 15:46:32.823356 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 15:46:32.823356 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 15:46:32.823356 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 15:46:32.823356 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 15:46:32.823356 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 15:46:32.823356 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 15:46:32.823356 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 15:46:32.823356 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 15:46:32.823356 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 15:46:32.823356 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 02 15:46:32.823356 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 02 15:46:32.823356 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 02 15:46:32.825893 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 02 15:46:32.825893 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 15:46:32.825893 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 15:46:32.825893 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 15:46:32.825893 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 15:46:32.825893 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 15:46:32.825893 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 15:46:32.825893 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 15:46:32.825893 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application with Lock( Jun 02 15:46:32.825893 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 15:46:32.825893 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application return self._enter() Jun 02 15:46:32.825893 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 15:46:32.825893 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 15:46:32.825893 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 15:46:32.825893 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application return self.creator() Jun 02 15:46:32.825893 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 15:46:32.825893 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application created_value = creator( Jun 02 15:46:32.826924 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 02 15:46:32.826924 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 02 15:46:32.826924 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 15:46:32.826924 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application Jun 02 15:46:32.826924 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 312/632] 10.222.0.59 () {56 vars in 1108 bytes} [Thu Jun 2 15:46:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 262 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 15:46:32.826924 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e87af91d-d9f1-47bf-9d39-55a35d2cb67a None None] REQUEST_METHOD: `POST` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:46:32.826924 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e87af91d-d9f1-47bf-9d39-55a35d2cb67a None None] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:46:32.826924 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e87af91d-d9f1-47bf-9d39-55a35d2cb67a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:46:32.846158 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.auth.core [None req-e87af91d-d9f1-47bf-9d39-55a35d2cb67a None None] MFA Rules not processed for user `400d1f4db9de49638549e5db29a041e1`. Rule list: `[]` (Enabled: `True`). {{(pid=80396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 15:46:32.846158 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.fernet_utils [None req-e87af91d-d9f1-47bf-9d39-55a35d2cb67a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 15:46:32.918276 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00baecb4-a09b-4e65-908e-2be365d4226d None None] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:46:32.937869 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 313/633] 10.222.0.59 () {58 vars in 1023 bytes} [Thu Jun 2 15:46:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 02 15:46:32.939128 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e87af91d-d9f1-47bf-9d39-55a35d2cb67a None None] Authenticating user token {{(pid=80396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:46:32.954747 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG dbcounter [-] [80396] Writing DB stats keystone:SELECT=100 {{(pid=80396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:46:32.964673 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cedd8e7-4953-444e-84a6-bcda0ccb54ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:46:32.965754 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cedd8e7-4953-444e-84a6-bcda0ccb54ec None admin] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:46:32.966257 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cedd8e7-4953-444e-84a6-bcda0ccb54ec None admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:46:32.966715 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cedd8e7-4953-444e-84a6-bcda0ccb54ec None admin] PATH_INFO: `/v3/users/glance` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:46:32.979755 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cedd8e7-4953-444e-84a6-bcda0ccb54ec None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:46:32.981701 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cedd8e7-4953-444e-84a6-bcda0ccb54ec None admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:46:33.001778 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application [None req-9cedd8e7-4953-444e-84a6-bcda0ccb54ec None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Jun 02 15:46:33.001778 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 15:46:33.001778 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 15:46:33.001778 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 15:46:33.001778 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 15:46:33.001778 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 15:46:33.001778 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 15:46:33.001778 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 15:46:33.001778 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 15:46:33.001778 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 15:46:33.001778 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 15:46:33.001778 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 15:46:33.001778 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 02 15:46:33.001778 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 02 15:46:33.001778 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 02 15:46:33.001778 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 02 15:46:33.002990 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 15:46:33.002990 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 15:46:33.002990 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 02 15:46:33.002990 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 02 15:46:33.002990 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 02 15:46:33.002990 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 02 15:46:33.002990 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 15:46:33.002990 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 15:46:33.002990 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 15:46:33.002990 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 15:46:33.002990 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 15:46:33.002990 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application with Lock( Jun 02 15:46:33.002990 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 15:46:33.002990 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self._enter() Jun 02 15:46:33.002990 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 15:46:33.002990 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 15:46:33.002990 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 15:46:33.002990 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self.creator() Jun 02 15:46:33.004195 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 15:46:33.004195 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application created_value = creator( Jun 02 15:46:33.004195 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 02 15:46:33.004195 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 02 15:46:33.004195 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 02 15:46:33.004195 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 02 15:46:33.004195 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 02 15:46:33.004195 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 02 15:46:33.004195 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Jun 02 15:46:33.004195 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application Jun 02 15:46:33.007320 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 321/634] 10.222.0.59 () {56 vars in 1099 bytes} [Thu Jun 2 15:46:32 2022] GET /identity/v3/users/glance => generated 84 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 15:46:33.012617 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cedd8e7-4953-444e-84a6-bcda0ccb54ec None admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:46:33.061327 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e87af91d-d9f1-47bf-9d39-55a35d2cb67a None None] Validating token access rules against request {{(pid=80396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:46:33.101382 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writing DB stats keystone:SELECT=100 {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:46:33.101694 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24d2dab6-7a19-4905-b45e-06132f2fcc64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:46:33.102591 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d2dab6-7a19-4905-b45e-06132f2fcc64 None admin] REQUEST_METHOD: `GET` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:46:33.103019 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d2dab6-7a19-4905-b45e-06132f2fcc64 None admin] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:46:33.103441 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d2dab6-7a19-4905-b45e-06132f2fcc64 None admin] PATH_INFO: `/v3/domains` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:46:33.104349 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24d2dab6-7a19-4905-b45e-06132f2fcc64 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80396) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 15:46:33.104808 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24d2dab6-7a19-4905-b45e-06132f2fcc64 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:46:33.106368 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24d2dab6-7a19-4905-b45e-06132f2fcc64 None admin] RBAC: Authorization granted {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:46:33.119715 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 314/635] 10.222.0.59 () {56 vars in 1109 bytes} [Thu Jun 2 15:46:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 15:46:33.120829 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24d2dab6-7a19-4905-b45e-06132f2fcc64 None admin] Authenticating user token {{(pid=80396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:46:33.130259 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cedd8e7-4953-444e-84a6-bcda0ccb54ec None admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:46:33.168249 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b41b83ae-1413-448e-9f89-c5d39028c9d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:46:33.170329 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41b83ae-1413-448e-9f89-c5d39028c9d5 None admin] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:46:33.170329 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41b83ae-1413-448e-9f89-c5d39028c9d5 None admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:46:33.170329 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41b83ae-1413-448e-9f89-c5d39028c9d5 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:46:33.183565 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b41b83ae-1413-448e-9f89-c5d39028c9d5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 02 15:46:33.191970 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application [None req-b41b83ae-1413-448e-9f89-c5d39028c9d5 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 02 15:46:33.191970 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 15:46:33.191970 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 15:46:33.191970 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 15:46:33.191970 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 15:46:33.191970 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 15:46:33.191970 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 15:46:33.191970 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 15:46:33.191970 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 15:46:33.191970 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 15:46:33.191970 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 15:46:33.191970 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 15:46:33.191970 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 02 15:46:33.191970 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 02 15:46:33.191970 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 02 15:46:33.191970 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 02 15:46:33.193130 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 02 15:46:33.193130 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 02 15:46:33.193130 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 02 15:46:33.193130 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 02 15:46:33.193130 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 15:46:33.193130 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 15:46:33.193130 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 15:46:33.193130 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 15:46:33.193130 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 15:46:33.193130 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 15:46:33.193130 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 15:46:33.193130 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application with Lock( Jun 02 15:46:33.193130 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 15:46:33.193130 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self._enter() Jun 02 15:46:33.193130 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 15:46:33.193130 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 15:46:33.194923 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 15:46:33.194923 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self.creator() Jun 02 15:46:33.194923 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 15:46:33.194923 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application created_value = creator( Jun 02 15:46:33.194923 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 02 15:46:33.194923 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 02 15:46:33.194923 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 02 15:46:33.194923 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 02 15:46:33.194923 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 02 15:46:33.194923 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 02 15:46:33.194923 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 02 15:46:33.194923 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application Jun 02 15:46:33.196081 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 322/636] 10.222.0.59 () {56 vars in 1102 bytes} [Thu Jun 2 15:46:33 2022] GET /identity/v3/roles/service => generated 85 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 15:46:33.201553 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b41b83ae-1413-448e-9f89-c5d39028c9d5 None admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:46:33.202548 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG dbcounter [-] [80396] Writing DB stats keystone:SELECT=100 {{(pid=80396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:46:33.236578 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24d2dab6-7a19-4905-b45e-06132f2fcc64 None admin] Validating token access rules against request {{(pid=80396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:46:33.273801 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d1adbb4-bef0-40b8-8ec5-6e7713c0c31b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:46:33.274796 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1adbb4-bef0-40b8-8ec5-6e7713c0c31b None admin] REQUEST_METHOD: `GET` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:46:33.275261 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1adbb4-bef0-40b8-8ec5-6e7713c0c31b None admin] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:46:33.275738 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1adbb4-bef0-40b8-8ec5-6e7713c0c31b None admin] PATH_INFO: `/v3/users` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:46:33.276750 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d1adbb4-bef0-40b8-8ec5-6e7713c0c31b None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=80396) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 15:46:33.277250 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d1adbb4-bef0-40b8-8ec5-6e7713c0c31b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:46:33.278881 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d1adbb4-bef0-40b8-8ec5-6e7713c0c31b None admin] RBAC: Authorization granted {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:46:33.301748 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 315/637] 10.222.0.59 () {56 vars in 1137 bytes} [Thu Jun 2 15:46:33 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 15:46:33.303515 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d1adbb4-bef0-40b8-8ec5-6e7713c0c31b None admin] Authenticating user token {{(pid=80396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:46:33.321209 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b41b83ae-1413-448e-9f89-c5d39028c9d5 None admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:46:33.359416 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d234933-869c-4431-9e0e-720d21e0cd0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:46:33.360266 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d234933-869c-4431-9e0e-720d21e0cd0a None admin] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:46:33.360476 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d234933-869c-4431-9e0e-720d21e0cd0a None admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:46:33.360758 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d234933-869c-4431-9e0e-720d21e0cd0a None admin] PATH_INFO: `/v3/users/nova` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:46:33.362842 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writing DB stats keystone:SELECT=100 {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:46:33.371053 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d234933-869c-4431-9e0e-720d21e0cd0a None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:46:33.386331 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d234933-869c-4431-9e0e-720d21e0cd0a None admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:46:33.388256 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application [None req-9d234933-869c-4431-9e0e-720d21e0cd0a None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 02 15:46:33.388256 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 15:46:33.388256 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 15:46:33.388256 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 15:46:33.388256 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 15:46:33.388256 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 15:46:33.388256 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 15:46:33.388256 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 15:46:33.388256 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 15:46:33.388256 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 15:46:33.388256 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 15:46:33.388256 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 15:46:33.388256 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 02 15:46:33.388256 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 02 15:46:33.388256 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 02 15:46:33.388256 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 02 15:46:33.389274 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 15:46:33.389274 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 15:46:33.389274 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 02 15:46:33.389274 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 02 15:46:33.389274 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 02 15:46:33.389274 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 02 15:46:33.389274 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 15:46:33.389274 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 15:46:33.389274 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 15:46:33.389274 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 15:46:33.389274 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 15:46:33.389274 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application with Lock( Jun 02 15:46:33.389274 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 15:46:33.389274 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self._enter() Jun 02 15:46:33.389274 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 15:46:33.389274 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 15:46:33.389274 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 15:46:33.389274 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self.creator() Jun 02 15:46:33.390358 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 15:46:33.390358 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application created_value = creator( Jun 02 15:46:33.390358 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 02 15:46:33.390358 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 02 15:46:33.390358 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 02 15:46:33.390358 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 02 15:46:33.390358 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 02 15:46:33.390358 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 02 15:46:33.390358 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 02 15:46:33.390358 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application Jun 02 15:46:33.392803 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 323/638] 10.222.0.59 () {56 vars in 1093 bytes} [Thu Jun 2 15:46:33 2022] GET /identity/v3/users/nova => generated 82 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 15:46:33.393834 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d234933-869c-4431-9e0e-720d21e0cd0a None admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:46:33.412047 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d1adbb4-bef0-40b8-8ec5-6e7713c0c31b None admin] Validating token access rules against request {{(pid=80396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:46:33.439990 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG dbcounter [-] [80396] Writing DB stats keystone:SELECT=100 {{(pid=80396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:46:33.447967 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f0bafac-27ff-47ae-ad23-4b65c7421b98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:46:33.448808 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0bafac-27ff-47ae-ad23-4b65c7421b98 None admin] REQUEST_METHOD: `GET` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:46:33.449090 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0bafac-27ff-47ae-ad23-4b65c7421b98 None admin] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:46:33.458677 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0bafac-27ff-47ae-ad23-4b65c7421b98 None admin] PATH_INFO: `/v3/roles` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:46:33.458677 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f0bafac-27ff-47ae-ad23-4b65c7421b98 None admin] RBAC: Adding query filter params (name=service) {{(pid=80396) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 15:46:33.458677 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f0bafac-27ff-47ae-ad23-4b65c7421b98 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:46:33.458677 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f0bafac-27ff-47ae-ad23-4b65c7421b98 None admin] RBAC: Authorization granted {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:46:33.459883 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 316/639] 10.222.0.59 () {56 vars in 1103 bytes} [Thu Jun 2 15:46:33 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 15:46:33.460879 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f0bafac-27ff-47ae-ad23-4b65c7421b98 None admin] Authenticating user token {{(pid=80396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:46:33.507319 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d234933-869c-4431-9e0e-720d21e0cd0a None admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:46:33.545036 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a981952-d9c4-4d2a-8a68-1034da1bd0eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:46:33.545839 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a981952-d9c4-4d2a-8a68-1034da1bd0eb None admin] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:46:33.546264 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a981952-d9c4-4d2a-8a68-1034da1bd0eb None admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:46:33.546668 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a981952-d9c4-4d2a-8a68-1034da1bd0eb None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:46:33.571179 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f0bafac-27ff-47ae-ad23-4b65c7421b98 None admin] Validating token access rules against request {{(pid=80396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:46:33.607248 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2102b43-d439-439e-baea-6c00e14a89d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:46:33.608050 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2102b43-d439-439e-baea-6c00e14a89d1 None admin] REQUEST_METHOD: `GET` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:46:33.608460 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2102b43-d439-439e-baea-6c00e14a89d1 None admin] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:46:33.608824 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2102b43-d439-439e-baea-6c00e14a89d1 None admin] PATH_INFO: `/v3/users` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:46:33.609771 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2102b43-d439-439e-baea-6c00e14a89d1 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80396) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 15:46:33.610234 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2102b43-d439-439e-baea-6c00e14a89d1 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:46:33.611303 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writing DB stats keystone:SELECT=100 {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:46:33.612025 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2102b43-d439-439e-baea-6c00e14a89d1 None admin] RBAC: Authorization granted {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:46:33.619194 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a981952-d9c4-4d2a-8a68-1034da1bd0eb None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:46:33.620653 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a981952-d9c4-4d2a-8a68-1034da1bd0eb None admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:46:33.634533 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 317/640] 10.222.0.59 () {56 vars in 1133 bytes} [Thu Jun 2 15:46:33 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 15:46:33.636482 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52dbbdc6-1b98-42d9-8ff1-1ee71ab91a23 None None] REQUEST_METHOD: `GET` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:46:33.636843 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52dbbdc6-1b98-42d9-8ff1-1ee71ab91a23 None None] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:46:33.637130 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52dbbdc6-1b98-42d9-8ff1-1ee71ab91a23 None None] PATH_INFO: `/` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:46:33.638658 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 318/641] 10.222.0.59 () {54 vars in 926 bytes} [Thu Jun 2 15:46:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 15:46:33.639260 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52dbbdc6-1b98-42d9-8ff1-1ee71ab91a23 None None] Authenticating user token {{(pid=80396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:46:33.695455 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG dbcounter [-] [80396] Writing DB stats keystone:SELECT=100 {{(pid=80396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:46:33.729806 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 324/642] 10.222.0.59 () {58 vars in 1282 bytes} [Thu Jun 2 15:46:33 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 336 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 02 15:46:33.730898 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a981952-d9c4-4d2a-8a68-1034da1bd0eb None admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:46:33.752329 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52dbbdc6-1b98-42d9-8ff1-1ee71ab91a23 None None] Validating token access rules against request {{(pid=80396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:46:33.790983 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd5cdac5-035f-45b2-b4a8-8aae37899de9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:46:33.791702 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd5cdac5-035f-45b2-b4a8-8aae37899de9 None admin] REQUEST_METHOD: `GET` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:46:33.791988 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd5cdac5-035f-45b2-b4a8-8aae37899de9 None admin] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:46:33.792268 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd5cdac5-035f-45b2-b4a8-8aae37899de9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:46:33.804284 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd5cdac5-035f-45b2-b4a8-8aae37899de9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:46:33.805744 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd5cdac5-035f-45b2-b4a8-8aae37899de9 None admin] RBAC: Authorization granted {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:46:33.824621 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application [None req-bd5cdac5-035f-45b2-b4a8-8aae37899de9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 15:46:33.824621 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 15:46:33.824621 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 15:46:33.824621 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 15:46:33.824621 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 15:46:33.824621 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 15:46:33.824621 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 15:46:33.824621 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 15:46:33.824621 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 15:46:33.824621 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 15:46:33.824621 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 15:46:33.824621 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 15:46:33.824621 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 02 15:46:33.824621 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 02 15:46:33.824621 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 02 15:46:33.825750 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 02 15:46:33.825750 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 15:46:33.825750 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 15:46:33.825750 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 15:46:33.825750 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 15:46:33.825750 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 15:46:33.825750 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 15:46:33.825750 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 15:46:33.825750 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application with Lock( Jun 02 15:46:33.825750 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 15:46:33.825750 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application return self._enter() Jun 02 15:46:33.825750 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 15:46:33.825750 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 15:46:33.825750 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 15:46:33.825750 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application return self.creator() Jun 02 15:46:33.825750 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 15:46:33.825750 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application created_value = creator( Jun 02 15:46:33.826710 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 02 15:46:33.826710 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 02 15:46:33.826710 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 15:46:33.826710 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application Jun 02 15:46:33.826710 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 319/643] 10.222.0.59 () {56 vars in 1108 bytes} [Thu Jun 2 15:46:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 15:46:33.827376 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a78edf-378e-4588-b3b8-4624886ad916 None None] REQUEST_METHOD: `POST` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:46:33.827665 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a78edf-378e-4588-b3b8-4624886ad916 None None] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:46:33.827941 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a78edf-378e-4588-b3b8-4624886ad916 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:46:33.839793 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writing DB stats keystone:SELECT=100 {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:46:33.846361 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.auth.core [None req-35a78edf-378e-4588-b3b8-4624886ad916 None None] MFA Rules not processed for user `400d1f4db9de49638549e5db29a041e1`. Rule list: `[]` (Enabled: `True`). {{(pid=80396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 15:46:33.847308 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a981952-d9c4-4d2a-8a68-1034da1bd0eb None admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:46:33.847550 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.fernet_utils [None req-35a78edf-378e-4588-b3b8-4624886ad916 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 15:46:33.885601 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62a37f5d-2628-41b2-bf09-5370b00564bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:46:33.886284 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a37f5d-2628-41b2-bf09-5370b00564bb None admin] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:46:33.886568 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a37f5d-2628-41b2-bf09-5370b00564bb None admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:46:33.886844 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a37f5d-2628-41b2-bf09-5370b00564bb None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:46:33.930101 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 320/644] 10.222.0.59 () {58 vars in 1023 bytes} [Thu Jun 2 15:46:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 02 15:46:33.930101 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35a78edf-378e-4588-b3b8-4624886ad916 None None] Authenticating user token {{(pid=80396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:46:33.966531 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG dbcounter [-] [80396] Writing DB stats keystone:SELECT=100 {{(pid=80396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:46:33.978268 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62a37f5d-2628-41b2-bf09-5370b00564bb None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:46:33.985988 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62a37f5d-2628-41b2-bf09-5370b00564bb None admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:46:34.043723 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35a78edf-378e-4588-b3b8-4624886ad916 None None] Validating token access rules against request {{(pid=80396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:46:34.079768 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-810436dd-d0d7-47ae-a3de-55e487b7c8fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:46:34.079965 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writing DB stats keystone:SELECT=100 {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:46:34.080978 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-810436dd-d0d7-47ae-a3de-55e487b7c8fb None admin] REQUEST_METHOD: `GET` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:46:34.081266 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-810436dd-d0d7-47ae-a3de-55e487b7c8fb None admin] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:46:34.081535 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-810436dd-d0d7-47ae-a3de-55e487b7c8fb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:46:34.090366 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 325/645] 10.222.0.59 () {58 vars in 1282 bytes} [Thu Jun 2 15:46:33 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 360 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 02 15:46:34.091056 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62a37f5d-2628-41b2-bf09-5370b00564bb None admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:46:34.094813 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-810436dd-d0d7-47ae-a3de-55e487b7c8fb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:46:34.100341 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-810436dd-d0d7-47ae-a3de-55e487b7c8fb None admin] RBAC: Authorization granted {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:46:34.114457 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application [None req-810436dd-d0d7-47ae-a3de-55e487b7c8fb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 15:46:34.114457 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 15:46:34.114457 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 15:46:34.114457 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 15:46:34.114457 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 15:46:34.114457 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 15:46:34.114457 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 15:46:34.114457 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 15:46:34.114457 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 15:46:34.114457 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 15:46:34.114457 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 15:46:34.114457 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 15:46:34.114457 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 02 15:46:34.114457 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 02 15:46:34.114457 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 02 15:46:34.116255 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 02 15:46:34.116255 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 15:46:34.116255 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 15:46:34.116255 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 15:46:34.116255 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 15:46:34.116255 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 15:46:34.116255 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 15:46:34.116255 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 15:46:34.116255 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application with Lock( Jun 02 15:46:34.116255 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 15:46:34.116255 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application return self._enter() Jun 02 15:46:34.116255 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 15:46:34.116255 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 15:46:34.116255 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 15:46:34.116255 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application return self.creator() Jun 02 15:46:34.116255 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 15:46:34.116255 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application created_value = creator( Jun 02 15:46:34.117429 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 02 15:46:34.117429 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 02 15:46:34.117429 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 15:46:34.117429 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application Jun 02 15:46:34.117429 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 321/646] 10.222.0.59 () {56 vars in 1108 bytes} [Thu Jun 2 15:46:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 15:46:34.117429 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-810436dd-d0d7-47ae-a3de-55e487b7c8fb None admin] Authenticating user token {{(pid=80396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:46:34.203433 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG dbcounter [-] [80396] Writing DB stats keystone:SELECT=100 {{(pid=80396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:46:34.212575 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62a37f5d-2628-41b2-bf09-5370b00564bb None admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:46:34.222099 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-810436dd-d0d7-47ae-a3de-55e487b7c8fb None admin] Validating token access rules against request {{(pid=80396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:46:34.250511 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0bec049-5a89-4b4c-90a1-cde5eb030742 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:46:34.251269 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0bec049-5a89-4b4c-90a1-cde5eb030742 None admin] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:46:34.251818 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0bec049-5a89-4b4c-90a1-cde5eb030742 None admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:46:34.252201 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0bec049-5a89-4b4c-90a1-cde5eb030742 None admin] PATH_INFO: `/v3/domains` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:46:34.253586 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0bec049-5a89-4b4c-90a1-cde5eb030742 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80395) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 15:46:34.253967 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0bec049-5a89-4b4c-90a1-cde5eb030742 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:46:34.255694 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0bec049-5a89-4b4c-90a1-cde5eb030742 None admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:46:34.257836 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5d5090a-fb72-4b61-b1a1-b8cc64adeb74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:46:34.258653 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d5090a-fb72-4b61-b1a1-b8cc64adeb74 None admin] REQUEST_METHOD: `GET` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:46:34.258932 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d5090a-fb72-4b61-b1a1-b8cc64adeb74 None admin] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:46:34.259205 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d5090a-fb72-4b61-b1a1-b8cc64adeb74 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:46:34.269926 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5d5090a-fb72-4b61-b1a1-b8cc64adeb74 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 02 15:46:34.275578 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 326/647] 10.222.0.59 () {56 vars in 1109 bytes} [Thu Jun 2 15:46:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 15:46:34.275578 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0bec049-5a89-4b4c-90a1-cde5eb030742 None admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:46:34.280120 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application [None req-e5d5090a-fb72-4b61-b1a1-b8cc64adeb74 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 02 15:46:34.280120 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 15:46:34.280120 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 15:46:34.280120 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 15:46:34.280120 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 15:46:34.280120 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 15:46:34.280120 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 15:46:34.280120 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 15:46:34.280120 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 15:46:34.280120 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 15:46:34.280120 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 15:46:34.280120 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 15:46:34.280120 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 02 15:46:34.280120 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 02 15:46:34.280120 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 02 15:46:34.280120 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 02 15:46:34.281031 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 02 15:46:34.281031 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 02 15:46:34.281031 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 02 15:46:34.281031 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 02 15:46:34.281031 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 15:46:34.281031 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 15:46:34.281031 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 15:46:34.281031 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 15:46:34.281031 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 15:46:34.281031 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 15:46:34.281031 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 15:46:34.281031 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application with Lock( Jun 02 15:46:34.281031 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 15:46:34.281031 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application return self._enter() Jun 02 15:46:34.281031 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 15:46:34.281031 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 15:46:34.281876 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 15:46:34.281876 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application return self.creator() Jun 02 15:46:34.281876 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 15:46:34.281876 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application created_value = creator( Jun 02 15:46:34.281876 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 02 15:46:34.281876 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 02 15:46:34.281876 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 02 15:46:34.281876 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 02 15:46:34.281876 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 02 15:46:34.281876 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 02 15:46:34.281876 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 02 15:46:34.281876 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application Jun 02 15:46:34.285981 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 322/648] 10.222.0.59 () {56 vars in 1102 bytes} [Thu Jun 2 15:46:34 2022] GET /identity/v3/roles/service => generated 85 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 15:46:34.286712 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5d5090a-fb72-4b61-b1a1-b8cc64adeb74 None admin] Authenticating user token {{(pid=80396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:46:34.338126 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writing DB stats keystone:SELECT=100 {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:46:34.387187 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0bec049-5a89-4b4c-90a1-cde5eb030742 None admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:46:34.394739 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5d5090a-fb72-4b61-b1a1-b8cc64adeb74 None admin] Validating token access rules against request {{(pid=80396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:46:34.426657 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b8f49bb-4b43-4822-a51a-03619fb72512 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:46:34.427462 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b8f49bb-4b43-4822-a51a-03619fb72512 None admin] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:46:34.428236 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b8f49bb-4b43-4822-a51a-03619fb72512 None admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:46:34.428522 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b8f49bb-4b43-4822-a51a-03619fb72512 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:46:34.430804 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bdf377a-9459-46c6-95bd-3b9c84457fc3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:46:34.431467 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bdf377a-9459-46c6-95bd-3b9c84457fc3 None admin] REQUEST_METHOD: `GET` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:46:34.431749 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bdf377a-9459-46c6-95bd-3b9c84457fc3 None admin] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:46:34.432023 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bdf377a-9459-46c6-95bd-3b9c84457fc3 None admin] PATH_INFO: `/v3/domains` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:46:34.432748 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bdf377a-9459-46c6-95bd-3b9c84457fc3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80396) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 15:46:34.433055 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bdf377a-9459-46c6-95bd-3b9c84457fc3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:46:34.434467 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bdf377a-9459-46c6-95bd-3b9c84457fc3 None admin] RBAC: Authorization granted {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:46:34.439105 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b8f49bb-4b43-4822-a51a-03619fb72512 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:46:34.440543 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b8f49bb-4b43-4822-a51a-03619fb72512 None admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:46:34.451520 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 323/649] 10.222.0.59 () {56 vars in 1109 bytes} [Thu Jun 2 15:46:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 15:46:34.451520 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bdf377a-9459-46c6-95bd-3b9c84457fc3 None admin] Authenticating user token {{(pid=80396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:46:34.454289 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG dbcounter [-] [80396] Writing DB stats keystone:SELECT=100 {{(pid=80396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:46:34.458352 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application [None req-0b8f49bb-4b43-4822-a51a-03619fb72512 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 15:46:34.458352 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 15:46:34.458352 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 15:46:34.458352 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 15:46:34.458352 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 15:46:34.458352 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 15:46:34.458352 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 15:46:34.458352 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 15:46:34.458352 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 15:46:34.458352 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 15:46:34.458352 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 15:46:34.458352 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 15:46:34.458352 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 02 15:46:34.458352 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 02 15:46:34.458352 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 02 15:46:34.465354 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 02 15:46:34.465354 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 15:46:34.465354 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 15:46:34.465354 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 15:46:34.465354 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 15:46:34.465354 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 15:46:34.465354 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 15:46:34.465354 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 15:46:34.465354 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application with Lock( Jun 02 15:46:34.465354 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 15:46:34.465354 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self._enter() Jun 02 15:46:34.465354 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 15:46:34.465354 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 15:46:34.465354 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 15:46:34.465354 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self.creator() Jun 02 15:46:34.465354 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 15:46:34.465354 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application created_value = creator( Jun 02 15:46:34.466808 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 02 15:46:34.466808 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 02 15:46:34.466808 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 15:46:34.466808 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application Jun 02 15:46:34.466808 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 327/650] 10.222.0.59 () {56 vars in 1108 bytes} [Thu Jun 2 15:46:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 15:46:34.466808 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b8f49bb-4b43-4822-a51a-03619fb72512 None admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:46:34.563525 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bdf377a-9459-46c6-95bd-3b9c84457fc3 None admin] Validating token access rules against request {{(pid=80396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:46:34.576577 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b8f49bb-4b43-4822-a51a-03619fb72512 None admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:46:34.587115 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writing DB stats keystone:SELECT=100 {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:46:34.603110 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2523559-cfc3-43fc-bfec-7afdf29d37a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:46:34.603110 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2523559-cfc3-43fc-bfec-7afdf29d37a1 None admin] REQUEST_METHOD: `GET` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:46:34.603110 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2523559-cfc3-43fc-bfec-7afdf29d37a1 None admin] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:46:34.603110 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2523559-cfc3-43fc-bfec-7afdf29d37a1 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:46:34.611201 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2523559-cfc3-43fc-bfec-7afdf29d37a1 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:46:34.612665 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2523559-cfc3-43fc-bfec-7afdf29d37a1 None admin] RBAC: Authorization granted {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:46:34.623393 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0128436f-d2be-433d-97e6-395e417051b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:46:34.624067 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0128436f-d2be-433d-97e6-395e417051b8 None admin] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:46:34.624350 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0128436f-d2be-433d-97e6-395e417051b8 None admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:46:34.624628 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0128436f-d2be-433d-97e6-395e417051b8 None admin] PATH_INFO: `/v3/roles` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:46:34.625385 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0128436f-d2be-433d-97e6-395e417051b8 None admin] RBAC: Adding query filter params (name=service) {{(pid=80395) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 15:46:34.625694 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0128436f-d2be-433d-97e6-395e417051b8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:46:34.627108 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0128436f-d2be-433d-97e6-395e417051b8 None admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:46:34.628978 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application [None req-c2523559-cfc3-43fc-bfec-7afdf29d37a1 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jun 02 15:46:34.628978 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 15:46:34.628978 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 15:46:34.628978 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 15:46:34.628978 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 15:46:34.628978 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 15:46:34.628978 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 15:46:34.628978 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 15:46:34.628978 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 15:46:34.628978 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 15:46:34.628978 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 15:46:34.628978 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 15:46:34.628978 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 02 15:46:34.628978 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 02 15:46:34.628978 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 02 15:46:34.628978 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 02 15:46:34.629861 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 15:46:34.629861 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 15:46:34.629861 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 02 15:46:34.629861 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 02 15:46:34.629861 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 02 15:46:34.629861 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 02 15:46:34.629861 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 15:46:34.629861 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 15:46:34.629861 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 15:46:34.629861 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 15:46:34.629861 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 15:46:34.629861 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application with Lock( Jun 02 15:46:34.629861 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 15:46:34.629861 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application return self._enter() Jun 02 15:46:34.629861 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 15:46:34.629861 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 15:46:34.629861 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 15:46:34.629861 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application return self.creator() Jun 02 15:46:34.630828 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 15:46:34.630828 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application created_value = creator( Jun 02 15:46:34.630828 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 02 15:46:34.630828 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 02 15:46:34.630828 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 02 15:46:34.630828 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 02 15:46:34.630828 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 02 15:46:34.630828 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 02 15:46:34.630828 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jun 02 15:46:34.630828 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application Jun 02 15:46:34.630828 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 324/651] 10.222.0.59 () {56 vars in 1099 bytes} [Thu Jun 2 15:46:34 2022] GET /identity/v3/users/cinder => generated 84 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 15:46:34.634439 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2523559-cfc3-43fc-bfec-7afdf29d37a1 None admin] Authenticating user token {{(pid=80396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:46:34.643401 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 328/652] 10.222.0.59 () {56 vars in 1103 bytes} [Thu Jun 2 15:46:34 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 15:46:34.644229 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0128436f-d2be-433d-97e6-395e417051b8 None admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:46:34.703279 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG dbcounter [-] [80396] Writing DB stats keystone:SELECT=100 {{(pid=80396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:46:34.750263 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0128436f-d2be-433d-97e6-395e417051b8 None admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:46:34.752000 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2523559-cfc3-43fc-bfec-7afdf29d37a1 None admin] Validating token access rules against request {{(pid=80396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:46:34.786169 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54504c8e-03f9-4010-bc3d-0a80a5b436ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:46:34.786918 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54504c8e-03f9-4010-bc3d-0a80a5b436ae None admin] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:46:34.787818 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54504c8e-03f9-4010-bc3d-0a80a5b436ae None admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:46:34.788091 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54504c8e-03f9-4010-bc3d-0a80a5b436ae None admin] PATH_INFO: `/v3/domains` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:46:34.788906 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54504c8e-03f9-4010-bc3d-0a80a5b436ae None admin] RBAC: Adding query filter params (name=Default) {{(pid=80395) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 15:46:34.789209 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54504c8e-03f9-4010-bc3d-0a80a5b436ae None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:46:34.790001 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcee7156-7f20-48fb-bd95-0d86e428771f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:46:34.790733 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54504c8e-03f9-4010-bc3d-0a80a5b436ae None admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:46:34.790851 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcee7156-7f20-48fb-bd95-0d86e428771f None admin] REQUEST_METHOD: `GET` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:46:34.791095 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcee7156-7f20-48fb-bd95-0d86e428771f None admin] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:46:34.791369 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcee7156-7f20-48fb-bd95-0d86e428771f None admin] PATH_INFO: `/v3/projects/service` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:46:34.798232 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcee7156-7f20-48fb-bd95-0d86e428771f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:46:34.799667 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcee7156-7f20-48fb-bd95-0d86e428771f None admin] RBAC: Authorization granted {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:46:34.805393 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 329/653] 10.222.0.59 () {56 vars in 1109 bytes} [Thu Jun 2 15:46:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 15:46:34.810338 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54504c8e-03f9-4010-bc3d-0a80a5b436ae None admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:46:34.815031 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application [None req-dcee7156-7f20-48fb-bd95-0d86e428771f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 02 15:46:34.815031 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 15:46:34.815031 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 15:46:34.815031 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 15:46:34.815031 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 15:46:34.815031 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 15:46:34.815031 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 15:46:34.815031 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 15:46:34.815031 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 15:46:34.815031 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 15:46:34.815031 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 15:46:34.815031 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 15:46:34.815031 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 02 15:46:34.815031 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 02 15:46:34.815031 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 02 15:46:34.815910 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 02 15:46:34.815910 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 15:46:34.815910 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 15:46:34.815910 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 15:46:34.815910 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 15:46:34.815910 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 15:46:34.815910 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 15:46:34.815910 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 15:46:34.815910 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application with Lock( Jun 02 15:46:34.815910 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 15:46:34.815910 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application return self._enter() Jun 02 15:46:34.815910 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 15:46:34.815910 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 15:46:34.815910 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 15:46:34.815910 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application return self.creator() Jun 02 15:46:34.815910 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 15:46:34.815910 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application created_value = creator( Jun 02 15:46:34.816822 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 02 15:46:34.816822 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 02 15:46:34.816822 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 02 15:46:34.816822 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 02 15:46:34.816822 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 02 15:46:34.816822 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 02 15:46:34.816822 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 02 15:46:34.816822 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application Jun 02 15:46:34.816822 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 325/654] 10.222.0.59 () {56 vars in 1111 bytes} [Thu Jun 2 15:46:34 2022] GET /identity/v3/projects/service => generated 88 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 15:46:34.817324 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcee7156-7f20-48fb-bd95-0d86e428771f None admin] Authenticating user token {{(pid=80396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:46:34.844747 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writing DB stats keystone:SELECT=100 {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:46:34.921616 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54504c8e-03f9-4010-bc3d-0a80a5b436ae None admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:46:34.924024 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcee7156-7f20-48fb-bd95-0d86e428771f None admin] Validating token access rules against request {{(pid=80396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:46:34.948710 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG dbcounter [-] [80396] Writing DB stats keystone:SELECT=100 {{(pid=80396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:46:34.956461 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62edd722-5376-4798-845d-b0809b83bea3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:46:34.957122 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62edd722-5376-4798-845d-b0809b83bea3 None admin] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:46:34.957400 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62edd722-5376-4798-845d-b0809b83bea3 None admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:46:34.957669 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62edd722-5376-4798-845d-b0809b83bea3 None admin] PATH_INFO: `/v3/users` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:46:34.958527 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62edd722-5376-4798-845d-b0809b83bea3 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=80395) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 15:46:34.958829 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62edd722-5376-4798-845d-b0809b83bea3 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:46:34.959833 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31118433-92f9-4b44-9199-6a8b729cd0ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:46:34.960296 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62edd722-5376-4798-845d-b0809b83bea3 None admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:46:34.960621 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31118433-92f9-4b44-9199-6a8b729cd0ba None admin] REQUEST_METHOD: `GET` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:46:34.960906 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31118433-92f9-4b44-9199-6a8b729cd0ba None admin] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:46:34.961192 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31118433-92f9-4b44-9199-6a8b729cd0ba None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:46:34.971339 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31118433-92f9-4b44-9199-6a8b729cd0ba None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:46:34.972790 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31118433-92f9-4b44-9199-6a8b729cd0ba None admin] RBAC: Authorization granted {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:46:34.977928 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 330/655] 10.222.0.59 () {56 vars in 1137 bytes} [Thu Jun 2 15:46:34 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 15:46:34.978745 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62edd722-5376-4798-845d-b0809b83bea3 None admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:46:34.992855 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application [None req-31118433-92f9-4b44-9199-6a8b729cd0ba None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 15:46:34.992855 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 15:46:34.992855 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 15:46:34.992855 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 15:46:34.992855 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 15:46:34.992855 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 15:46:34.992855 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 15:46:34.992855 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 15:46:34.992855 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 15:46:34.992855 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 15:46:34.992855 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 15:46:34.992855 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 15:46:34.992855 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 02 15:46:34.992855 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 02 15:46:34.992855 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 02 15:46:34.993951 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 02 15:46:34.993951 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 15:46:34.993951 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 15:46:34.993951 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 15:46:34.993951 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 15:46:34.993951 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 15:46:34.993951 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 15:46:34.993951 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 15:46:34.993951 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application with Lock( Jun 02 15:46:34.993951 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 15:46:34.993951 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application return self._enter() Jun 02 15:46:34.993951 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 15:46:34.993951 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 15:46:34.993951 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 15:46:34.993951 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application return self.creator() Jun 02 15:46:34.993951 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 15:46:34.993951 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application created_value = creator( Jun 02 15:46:35.000583 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 02 15:46:35.000583 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 02 15:46:35.000583 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 15:46:35.000583 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application Jun 02 15:46:35.000583 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 326/656] 10.222.0.59 () {56 vars in 1108 bytes} [Thu Jun 2 15:46:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 15:46:35.000583 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31118433-92f9-4b44-9199-6a8b729cd0ba None admin] Authenticating user token {{(pid=80396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:46:35.061946 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writing DB stats keystone:SELECT=100 {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:46:35.076710 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62edd722-5376-4798-845d-b0809b83bea3 None admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:46:35.097776 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31118433-92f9-4b44-9199-6a8b729cd0ba None admin] Validating token access rules against request {{(pid=80396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:46:35.111416 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66f94ef7-bbc2-4ef1-b4b1-bf3958ed70c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:46:35.112203 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f94ef7-bbc2-4ef1-b4b1-bf3958ed70c7 None admin] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:46:35.112485 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f94ef7-bbc2-4ef1-b4b1-bf3958ed70c7 None admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:46:35.112762 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f94ef7-bbc2-4ef1-b4b1-bf3958ed70c7 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:46:35.119633 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66f94ef7-bbc2-4ef1-b4b1-bf3958ed70c7 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:46:35.121067 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66f94ef7-bbc2-4ef1-b4b1-bf3958ed70c7 None admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:46:35.130568 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d0b445c-83ea-4611-8908-2bc010561ae4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:46:35.131521 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0b445c-83ea-4611-8908-2bc010561ae4 None admin] REQUEST_METHOD: `GET` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:46:35.132008 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0b445c-83ea-4611-8908-2bc010561ae4 None admin] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:46:35.132350 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0b445c-83ea-4611-8908-2bc010561ae4 None admin] PATH_INFO: `/v3/projects` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:46:35.133128 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d0b445c-83ea-4611-8908-2bc010561ae4 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80396) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 15:46:35.133434 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d0b445c-83ea-4611-8908-2bc010561ae4 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:46:35.134615 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application [None req-66f94ef7-bbc2-4ef1-b4b1-bf3958ed70c7 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 02 15:46:35.134615 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 15:46:35.134615 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 15:46:35.134615 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 15:46:35.134615 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 15:46:35.134615 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 15:46:35.134615 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 15:46:35.134615 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 15:46:35.134615 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 15:46:35.134615 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 15:46:35.134615 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 15:46:35.134615 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 15:46:35.134615 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 02 15:46:35.134615 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 02 15:46:35.134615 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 02 15:46:35.135613 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 02 15:46:35.135613 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 15:46:35.135613 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 15:46:35.135613 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 15:46:35.135613 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 15:46:35.135613 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 15:46:35.135613 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 15:46:35.135613 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 15:46:35.135613 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application with Lock( Jun 02 15:46:35.135613 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 15:46:35.135613 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self._enter() Jun 02 15:46:35.135613 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 15:46:35.135613 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 15:46:35.135613 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 15:46:35.135613 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self.creator() Jun 02 15:46:35.135613 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 15:46:35.135613 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application created_value = creator( Jun 02 15:46:35.136711 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 02 15:46:35.136711 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 02 15:46:35.136711 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 02 15:46:35.136711 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 02 15:46:35.136711 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 02 15:46:35.136711 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 02 15:46:35.136711 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 02 15:46:35.136711 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application Jun 02 15:46:35.137215 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d0b445c-83ea-4611-8908-2bc010561ae4 None admin] RBAC: Authorization granted {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:46:35.137298 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 331/657] 10.222.0.59 () {56 vars in 1111 bytes} [Thu Jun 2 15:46:34 2022] GET /identity/v3/projects/service => generated 88 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 15:46:35.137298 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b85df7-3f40-4184-a6b2-f96ad6c5a659 None None] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:46:35.137616 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b85df7-3f40-4184-a6b2-f96ad6c5a659 None None] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:46:35.137896 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b85df7-3f40-4184-a6b2-f96ad6c5a659 None None] PATH_INFO: `/` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:46:35.139188 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 332/658] 10.222.0.59 () {54 vars in 926 bytes} [Thu Jun 2 15:46:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 15:46:35.139877 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07b85df7-3f40-4184-a6b2-f96ad6c5a659 None None] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:46:35.152062 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 327/659] 10.222.0.59 () {56 vars in 1148 bytes} [Thu Jun 2 15:46:34 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 15:46:35.153046 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d0b445c-83ea-4611-8908-2bc010561ae4 None admin] Authenticating user token {{(pid=80396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:46:35.192100 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG dbcounter [-] [80396] Writing DB stats keystone:SELECT=100 {{(pid=80396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:46:35.246029 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07b85df7-3f40-4184-a6b2-f96ad6c5a659 None None] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:46:35.259998 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d0b445c-83ea-4611-8908-2bc010561ae4 None admin] Validating token access rules against request {{(pid=80396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:46:35.279973 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1959d02c-3b12-4e3b-8005-9b0c708a46c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:46:35.280614 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1959d02c-3b12-4e3b-8005-9b0c708a46c1 None admin] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:46:35.280894 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1959d02c-3b12-4e3b-8005-9b0c708a46c1 None admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:46:35.281163 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1959d02c-3b12-4e3b-8005-9b0c708a46c1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:46:35.294307 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfcc38e8-83f1-48d3-b3ad-fe3c1b55909f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:46:35.295246 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfcc38e8-83f1-48d3-b3ad-fe3c1b55909f None admin] REQUEST_METHOD: `GET` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:46:35.295706 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfcc38e8-83f1-48d3-b3ad-fe3c1b55909f None admin] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:46:35.296198 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfcc38e8-83f1-48d3-b3ad-fe3c1b55909f None admin] PATH_INFO: `/v3/domains` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:46:35.297413 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfcc38e8-83f1-48d3-b3ad-fe3c1b55909f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80396) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 15:46:35.297931 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfcc38e8-83f1-48d3-b3ad-fe3c1b55909f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:46:35.299988 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writing DB stats keystone:SELECT=100 {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:46:35.300311 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfcc38e8-83f1-48d3-b3ad-fe3c1b55909f None admin] RBAC: Authorization granted {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:46:35.319794 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 328/660] 10.222.0.59 () {56 vars in 1109 bytes} [Thu Jun 2 15:46:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 15:46:35.321178 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfcc38e8-83f1-48d3-b3ad-fe3c1b55909f None admin] Authenticating user token {{(pid=80396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:46:35.366555 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1959d02c-3b12-4e3b-8005-9b0c708a46c1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:46:35.368006 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1959d02c-3b12-4e3b-8005-9b0c708a46c1 None admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:46:35.419857 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG dbcounter [-] [80396] Writing DB stats keystone:SELECT=100 {{(pid=80396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:46:35.425945 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfcc38e8-83f1-48d3-b3ad-fe3c1b55909f None admin] Validating token access rules against request {{(pid=80396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:46:35.462084 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2591e263-479f-483b-a5d9-f63a7a0fee04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:46:35.462948 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2591e263-479f-483b-a5d9-f63a7a0fee04 None admin] REQUEST_METHOD: `GET` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:46:35.463234 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2591e263-479f-483b-a5d9-f63a7a0fee04 None admin] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:46:35.463514 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2591e263-479f-483b-a5d9-f63a7a0fee04 None admin] PATH_INFO: `/v3/projects` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:46:35.464301 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2591e263-479f-483b-a5d9-f63a7a0fee04 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80396) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 15:46:35.464614 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2591e263-479f-483b-a5d9-f63a7a0fee04 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:46:35.466034 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2591e263-479f-483b-a5d9-f63a7a0fee04 None admin] RBAC: Authorization granted {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:46:35.467265 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 333/661] 10.222.0.59 () {58 vars in 1282 bytes} [Thu Jun 2 15:46:35 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 328 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 02 15:46:35.471838 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f3a617-df11-443b-85a1-b096cb90eef3 None None] REQUEST_METHOD: `POST` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:46:35.471838 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f3a617-df11-443b-85a1-b096cb90eef3 None None] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:46:35.471838 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f3a617-df11-443b-85a1-b096cb90eef3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:46:35.478808 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 329/662] 10.222.0.59 () {56 vars in 1148 bytes} [Thu Jun 2 15:46:35 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 15:46:35.479917 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2591e263-479f-483b-a5d9-f63a7a0fee04 None admin] Authenticating user token {{(pid=80396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:46:35.485514 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.auth.core [None req-a7f3a617-df11-443b-85a1-b096cb90eef3 None None] MFA Rules not processed for user `400d1f4db9de49638549e5db29a041e1`. Rule list: `[]` (Enabled: `True`). {{(pid=80395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 15:46:35.486727 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.fernet_utils [None req-a7f3a617-df11-443b-85a1-b096cb90eef3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 15:46:35.529430 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writing DB stats keystone:SELECT=100 {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:46:35.553036 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 334/663] 10.222.0.59 () {58 vars in 1023 bytes} [Thu Jun 2 15:46:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 02 15:46:35.553939 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7f3a617-df11-443b-85a1-b096cb90eef3 None None] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:46:35.586120 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2591e263-479f-483b-a5d9-f63a7a0fee04 None admin] Validating token access rules against request {{(pid=80396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:46:35.619304 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10b3366a-9e7c-4239-be1e-96137e67b07f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:46:35.619954 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b3366a-9e7c-4239-be1e-96137e67b07f None admin] REQUEST_METHOD: `GET` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:46:35.620237 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b3366a-9e7c-4239-be1e-96137e67b07f None admin] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:46:35.620514 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b3366a-9e7c-4239-be1e-96137e67b07f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:46:35.621345 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10b3366a-9e7c-4239-be1e-96137e67b07f None admin] RBAC: Adding query filter params (role.id=36214aa6067e4493a555da410f965c5e, scope.project.id=9c87c981909d4b8db02783421818c79b, user.id=e673e7e0a4bf4c77bdb3e5325d0d3275) {{(pid=80396) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 15:46:35.621656 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10b3366a-9e7c-4239-be1e-96137e67b07f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:46:35.623132 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10b3366a-9e7c-4239-be1e-96137e67b07f None admin] RBAC: Authorization granted {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:46:35.628808 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 330/664] 10.222.0.59 () {56 vars in 1374 bytes} [Thu Jun 2 15:46:35 2022] GET /identity/v3/role_assignments?user.id=e673e7e0a4bf4c77bdb3e5325d0d3275&scope.project.id=9c87c981909d4b8db02783421818c79b&role.id=36214aa6067e4493a555da410f965c5e => generated 608 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 15:46:35.629577 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10b3366a-9e7c-4239-be1e-96137e67b07f None admin] Authenticating user token {{(pid=80396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:46:35.658159 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG dbcounter [-] [80396] Writing DB stats keystone:SELECT=100 {{(pid=80396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:46:35.659519 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7f3a617-df11-443b-85a1-b096cb90eef3 None None] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:46:35.700029 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08891ad3-747a-4ca8-b340-6e34b91a75fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:46:35.701120 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08891ad3-747a-4ca8-b340-6e34b91a75fb None admin] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:46:35.701460 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08891ad3-747a-4ca8-b340-6e34b91a75fb None admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:46:35.701737 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08891ad3-747a-4ca8-b340-6e34b91a75fb None admin] PATH_INFO: `/v3/users/neutron` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:46:35.710361 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08891ad3-747a-4ca8-b340-6e34b91a75fb None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:46:35.711818 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08891ad3-747a-4ca8-b340-6e34b91a75fb None admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:46:35.729405 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application [None req-08891ad3-747a-4ca8-b340-6e34b91a75fb None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Jun 02 15:46:35.729405 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 15:46:35.729405 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 15:46:35.729405 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 15:46:35.729405 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 15:46:35.729405 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 15:46:35.729405 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 15:46:35.729405 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 15:46:35.729405 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 15:46:35.729405 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 15:46:35.729405 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 15:46:35.729405 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 15:46:35.729405 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 02 15:46:35.729405 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 02 15:46:35.729405 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 02 15:46:35.729405 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 02 15:46:35.730607 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 15:46:35.730607 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 15:46:35.730607 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 02 15:46:35.730607 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 02 15:46:35.730607 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 02 15:46:35.730607 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 02 15:46:35.730607 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 15:46:35.730607 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 15:46:35.730607 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 15:46:35.730607 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 15:46:35.730607 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 15:46:35.730607 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application with Lock( Jun 02 15:46:35.730607 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 15:46:35.730607 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self._enter() Jun 02 15:46:35.730607 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 15:46:35.730607 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 15:46:35.730607 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 15:46:35.730607 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self.creator() Jun 02 15:46:35.731541 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 15:46:35.731541 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application created_value = creator( Jun 02 15:46:35.731541 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 02 15:46:35.731541 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 02 15:46:35.731541 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 02 15:46:35.731541 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 02 15:46:35.731541 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 02 15:46:35.731541 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 02 15:46:35.731541 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Jun 02 15:46:35.731541 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application Jun 02 15:46:35.731541 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 335/665] 10.222.0.59 () {56 vars in 1102 bytes} [Thu Jun 2 15:46:35 2022] GET /identity/v3/users/neutron => generated 85 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 15:46:35.731541 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08891ad3-747a-4ca8-b340-6e34b91a75fb None admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:46:35.758888 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10b3366a-9e7c-4239-be1e-96137e67b07f None admin] Validating token access rules against request {{(pid=80396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:46:35.771765 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writing DB stats keystone:SELECT=100 {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:46:35.799546 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28f1a317-272f-4fcd-8d5c-037f7222cd01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:46:35.800342 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f1a317-272f-4fcd-8d5c-037f7222cd01 None admin] REQUEST_METHOD: `GET` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:46:35.800616 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f1a317-272f-4fcd-8d5c-037f7222cd01 None admin] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:46:35.801016 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f1a317-272f-4fcd-8d5c-037f7222cd01 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:46:35.812597 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28f1a317-272f-4fcd-8d5c-037f7222cd01 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:46:35.814178 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28f1a317-272f-4fcd-8d5c-037f7222cd01 None admin] RBAC: Authorization granted {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:46:35.833465 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application [None req-28f1a317-272f-4fcd-8d5c-037f7222cd01 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 15:46:35.833465 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 15:46:35.833465 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 15:46:35.833465 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 15:46:35.833465 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 15:46:35.833465 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 15:46:35.833465 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 15:46:35.833465 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 15:46:35.833465 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 15:46:35.833465 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 15:46:35.833465 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 15:46:35.833465 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 15:46:35.833465 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 02 15:46:35.833465 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 02 15:46:35.833465 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 02 15:46:35.835722 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 02 15:46:35.835722 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 15:46:35.835722 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 15:46:35.835722 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 15:46:35.835722 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 15:46:35.835722 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 15:46:35.835722 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 15:46:35.835722 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 15:46:35.835722 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application with Lock( Jun 02 15:46:35.835722 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 15:46:35.835722 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application return self._enter() Jun 02 15:46:35.835722 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 15:46:35.835722 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 15:46:35.835722 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 15:46:35.835722 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application return self.creator() Jun 02 15:46:35.835722 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 15:46:35.835722 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application created_value = creator( Jun 02 15:46:35.836997 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 02 15:46:35.836997 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 02 15:46:35.836997 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 15:46:35.836997 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application Jun 02 15:46:35.836997 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 331/666] 10.222.0.59 () {56 vars in 1108 bytes} [Thu Jun 2 15:46:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 15:46:35.836997 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28f1a317-272f-4fcd-8d5c-037f7222cd01 None admin] Authenticating user token {{(pid=80396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:46:35.850722 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08891ad3-747a-4ca8-b340-6e34b91a75fb None admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:46:35.895167 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2584b39d-f622-4875-bdc1-8e67d75c6a9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:46:35.895824 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2584b39d-f622-4875-bdc1-8e67d75c6a9c None admin] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:46:35.896109 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2584b39d-f622-4875-bdc1-8e67d75c6a9c None admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:46:35.896900 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2584b39d-f622-4875-bdc1-8e67d75c6a9c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:46:35.897912 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2584b39d-f622-4875-bdc1-8e67d75c6a9c None admin] RBAC: Adding query filter params (role.id=36214aa6067e4493a555da410f965c5e, scope.project.id=9c87c981909d4b8db02783421818c79b, user.id=52f9fe4b13574516bb0a8e2aa11a61e8) {{(pid=80395) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 15:46:35.898266 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2584b39d-f622-4875-bdc1-8e67d75c6a9c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:46:35.899701 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2584b39d-f622-4875-bdc1-8e67d75c6a9c None admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:46:35.906420 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 336/667] 10.222.0.59 () {56 vars in 1374 bytes} [Thu Jun 2 15:46:35 2022] GET /identity/v3/role_assignments?user.id=52f9fe4b13574516bb0a8e2aa11a61e8&scope.project.id=9c87c981909d4b8db02783421818c79b&role.id=36214aa6067e4493a555da410f965c5e => generated 608 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 15:46:35.907233 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2584b39d-f622-4875-bdc1-8e67d75c6a9c None admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:46:35.921506 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG dbcounter [-] [80396] Writing DB stats keystone:SELECT=100 {{(pid=80396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:46:35.970927 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28f1a317-272f-4fcd-8d5c-037f7222cd01 None admin] Validating token access rules against request {{(pid=80396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:46:36.025085 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c99a31ea-0f08-4184-a30c-6d93f3e7c70a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:46:36.026464 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c99a31ea-0f08-4184-a30c-6d93f3e7c70a None admin] REQUEST_METHOD: `GET` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:46:36.027358 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c99a31ea-0f08-4184-a30c-6d93f3e7c70a None admin] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:46:36.027962 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c99a31ea-0f08-4184-a30c-6d93f3e7c70a None admin] PATH_INFO: `/v3/roles/service` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:46:36.030773 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writing DB stats keystone:SELECT=100 {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:46:36.034428 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2584b39d-f622-4875-bdc1-8e67d75c6a9c None admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:46:36.046578 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c99a31ea-0f08-4184-a30c-6d93f3e7c70a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 02 15:46:36.057018 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application [None req-c99a31ea-0f08-4184-a30c-6d93f3e7c70a None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 02 15:46:36.057018 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 15:46:36.057018 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 15:46:36.057018 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 15:46:36.057018 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 15:46:36.057018 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 15:46:36.057018 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 15:46:36.057018 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 15:46:36.057018 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 15:46:36.057018 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 15:46:36.057018 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 15:46:36.057018 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 15:46:36.057018 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 02 15:46:36.057018 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 02 15:46:36.057018 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 02 15:46:36.057018 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 02 15:46:36.058210 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 02 15:46:36.058210 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 02 15:46:36.058210 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 02 15:46:36.058210 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 02 15:46:36.058210 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 15:46:36.058210 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 15:46:36.058210 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 15:46:36.058210 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 15:46:36.058210 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 15:46:36.058210 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 15:46:36.058210 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 15:46:36.058210 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application with Lock( Jun 02 15:46:36.058210 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 15:46:36.058210 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application return self._enter() Jun 02 15:46:36.058210 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 15:46:36.058210 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 15:46:36.059250 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 15:46:36.059250 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application return self.creator() Jun 02 15:46:36.059250 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 15:46:36.059250 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application created_value = creator( Jun 02 15:46:36.059250 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 02 15:46:36.059250 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 02 15:46:36.059250 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 02 15:46:36.059250 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 02 15:46:36.059250 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 02 15:46:36.059250 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 02 15:46:36.059250 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 02 15:46:36.059250 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application Jun 02 15:46:36.062376 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 332/668] 10.222.0.59 () {56 vars in 1102 bytes} [Thu Jun 2 15:46:35 2022] GET /identity/v3/roles/service => generated 85 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 15:46:36.063434 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c99a31ea-0f08-4184-a30c-6d93f3e7c70a None admin] Authenticating user token {{(pid=80396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:46:36.091734 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c690669a-e04a-442c-a4ab-d440bdb4b369 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:46:36.092721 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c690669a-e04a-442c-a4ab-d440bdb4b369 None admin] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:46:36.093413 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c690669a-e04a-442c-a4ab-d440bdb4b369 None admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:46:36.094335 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c690669a-e04a-442c-a4ab-d440bdb4b369 None admin] PATH_INFO: `/v3/users` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:46:36.095620 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c690669a-e04a-442c-a4ab-d440bdb4b369 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=80395) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 15:46:36.096088 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c690669a-e04a-442c-a4ab-d440bdb4b369 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:46:36.098826 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c690669a-e04a-442c-a4ab-d440bdb4b369 None admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:46:36.121629 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 337/669] 10.222.0.59 () {56 vars in 1139 bytes} [Thu Jun 2 15:46:35 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 15:46:36.123557 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c690669a-e04a-442c-a4ab-d440bdb4b369 None admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:46:36.200628 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c99a31ea-0f08-4184-a30c-6d93f3e7c70a None admin] Validating token access rules against request {{(pid=80396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:46:36.239021 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG dbcounter [-] [80396] Writing DB stats keystone:SELECT=100 {{(pid=80396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:46:36.245673 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3002cd8-7de6-45f8-8b17-87dd14c730db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:46:36.246407 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3002cd8-7de6-45f8-8b17-87dd14c730db None admin] REQUEST_METHOD: `GET` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:46:36.246726 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3002cd8-7de6-45f8-8b17-87dd14c730db None admin] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:46:36.247007 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3002cd8-7de6-45f8-8b17-87dd14c730db None admin] PATH_INFO: `/v3/domains` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:46:36.247783 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3002cd8-7de6-45f8-8b17-87dd14c730db None admin] RBAC: Adding query filter params (name=Default) {{(pid=80396) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 15:46:36.248091 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3002cd8-7de6-45f8-8b17-87dd14c730db None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:46:36.249493 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3002cd8-7de6-45f8-8b17-87dd14c730db None admin] RBAC: Authorization granted {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:46:36.253032 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c690669a-e04a-442c-a4ab-d440bdb4b369 None admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:46:36.261728 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 333/670] 10.222.0.59 () {56 vars in 1109 bytes} [Thu Jun 2 15:46:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 15:46:36.262592 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3002cd8-7de6-45f8-8b17-87dd14c730db None admin] Authenticating user token {{(pid=80396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:46:36.301967 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d17d792b-68a3-4181-a57b-823128b283b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:46:36.303600 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d17d792b-68a3-4181-a57b-823128b283b1 None admin] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:46:36.304087 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d17d792b-68a3-4181-a57b-823128b283b1 None admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:46:36.304541 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d17d792b-68a3-4181-a57b-823128b283b1 None admin] PATH_INFO: `/v3/roles` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:46:36.305524 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d17d792b-68a3-4181-a57b-823128b283b1 None admin] RBAC: Adding query filter params (name=service) {{(pid=80395) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 15:46:36.306018 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d17d792b-68a3-4181-a57b-823128b283b1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:46:36.307632 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d17d792b-68a3-4181-a57b-823128b283b1 None admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:46:36.317066 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 338/671] 10.222.0.59 () {56 vars in 1103 bytes} [Thu Jun 2 15:46:36 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 15:46:36.322439 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d17d792b-68a3-4181-a57b-823128b283b1 None admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:46:36.345655 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writing DB stats keystone:SELECT=100 {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:46:36.371556 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3002cd8-7de6-45f8-8b17-87dd14c730db None admin] Validating token access rules against request {{(pid=80396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:46:36.407452 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b751a914-d908-4384-b860-555cf22d6a02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:46:36.408096 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b751a914-d908-4384-b860-555cf22d6a02 None admin] REQUEST_METHOD: `GET` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:46:36.408377 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b751a914-d908-4384-b860-555cf22d6a02 None admin] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:46:36.408702 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b751a914-d908-4384-b860-555cf22d6a02 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:46:36.429352 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d17d792b-68a3-4181-a57b-823128b283b1 None admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:46:36.465124 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82759ab3-73b1-46fb-a742-60e5e7993f12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:46:36.466343 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82759ab3-73b1-46fb-a742-60e5e7993f12 None admin] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:46:36.466845 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82759ab3-73b1-46fb-a742-60e5e7993f12 None admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:46:36.467314 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82759ab3-73b1-46fb-a742-60e5e7993f12 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:46:36.470921 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG dbcounter [-] [80396] Writing DB stats keystone:SELECT=100 {{(pid=80396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:46:36.475406 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82759ab3-73b1-46fb-a742-60e5e7993f12 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:46:36.477259 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82759ab3-73b1-46fb-a742-60e5e7993f12 None admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:46:36.482502 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b751a914-d908-4384-b860-555cf22d6a02 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:46:36.483950 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b751a914-d908-4384-b860-555cf22d6a02 None admin] RBAC: Authorization granted {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:46:36.493504 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application [None req-82759ab3-73b1-46fb-a742-60e5e7993f12 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 02 15:46:36.493504 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 15:46:36.493504 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 15:46:36.493504 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 15:46:36.493504 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 15:46:36.493504 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 15:46:36.493504 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 15:46:36.493504 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 15:46:36.493504 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 15:46:36.493504 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 15:46:36.493504 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 15:46:36.493504 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 15:46:36.493504 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 02 15:46:36.493504 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 02 15:46:36.493504 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 02 15:46:36.494502 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 02 15:46:36.494502 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 15:46:36.494502 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 15:46:36.494502 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 15:46:36.494502 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 15:46:36.494502 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 15:46:36.494502 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 15:46:36.494502 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 15:46:36.494502 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application with Lock( Jun 02 15:46:36.494502 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 15:46:36.494502 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self._enter() Jun 02 15:46:36.494502 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 15:46:36.494502 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 15:46:36.494502 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 15:46:36.494502 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self.creator() Jun 02 15:46:36.494502 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 15:46:36.494502 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application created_value = creator( Jun 02 15:46:36.495375 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 02 15:46:36.495375 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 02 15:46:36.495375 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 02 15:46:36.495375 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 02 15:46:36.495375 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 02 15:46:36.495375 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 02 15:46:36.495375 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 02 15:46:36.495375 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application Jun 02 15:46:36.497838 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 339/672] 10.222.0.59 () {56 vars in 1111 bytes} [Thu Jun 2 15:46:36 2022] GET /identity/v3/projects/service => generated 88 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 15:46:36.498877 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82759ab3-73b1-46fb-a742-60e5e7993f12 None admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:46:36.592728 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 334/673] 10.222.0.59 () {58 vars in 1282 bytes} [Thu Jun 2 15:46:36 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 330 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 02 15:46:36.593549 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b751a914-d908-4384-b860-555cf22d6a02 None admin] Authenticating user token {{(pid=80396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:46:36.596910 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writing DB stats keystone:SELECT=100 {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:46:36.606541 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82759ab3-73b1-46fb-a742-60e5e7993f12 None admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:46:36.654023 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46642ad3-3423-4e98-aae8-e9b0c6c62d85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:46:36.654976 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46642ad3-3423-4e98-aae8-e9b0c6c62d85 None admin] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:46:36.655514 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46642ad3-3423-4e98-aae8-e9b0c6c62d85 None admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:46:36.655796 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46642ad3-3423-4e98-aae8-e9b0c6c62d85 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:46:36.669998 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46642ad3-3423-4e98-aae8-e9b0c6c62d85 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:46:36.671484 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46642ad3-3423-4e98-aae8-e9b0c6c62d85 None admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:46:36.689886 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG dbcounter [-] [80396] Writing DB stats keystone:SELECT=100 {{(pid=80396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:46:36.697894 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application [None req-46642ad3-3423-4e98-aae8-e9b0c6c62d85 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 15:46:36.697894 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 15:46:36.697894 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 15:46:36.697894 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 15:46:36.697894 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 15:46:36.697894 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 15:46:36.697894 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 15:46:36.697894 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 15:46:36.697894 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 15:46:36.697894 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 15:46:36.697894 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 15:46:36.697894 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 15:46:36.697894 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 02 15:46:36.697894 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 02 15:46:36.697894 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 02 15:46:36.704345 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 02 15:46:36.704345 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 15:46:36.704345 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 15:46:36.704345 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 15:46:36.704345 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 15:46:36.704345 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 15:46:36.704345 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 15:46:36.704345 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 15:46:36.704345 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application with Lock( Jun 02 15:46:36.704345 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 15:46:36.704345 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self._enter() Jun 02 15:46:36.704345 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 15:46:36.704345 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 15:46:36.704345 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 15:46:36.704345 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self.creator() Jun 02 15:46:36.704345 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 15:46:36.704345 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application created_value = creator( Jun 02 15:46:36.705271 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 02 15:46:36.705271 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 02 15:46:36.705271 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 15:46:36.705271 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application Jun 02 15:46:36.705271 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 340/674] 10.222.0.59 () {56 vars in 1108 bytes} [Thu Jun 2 15:46:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 15:46:36.705564 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b751a914-d908-4384-b860-555cf22d6a02 None admin] Validating token access rules against request {{(pid=80396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:46:36.705638 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46642ad3-3423-4e98-aae8-e9b0c6c62d85 None admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:46:36.737962 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a162b8-58ce-46d6-b9f4-d4c7ab66b047 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:46:36.738635 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a162b8-58ce-46d6-b9f4-d4c7ab66b047 None admin] REQUEST_METHOD: `GET` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:46:36.738910 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a162b8-58ce-46d6-b9f4-d4c7ab66b047 None admin] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:46:36.739180 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a162b8-58ce-46d6-b9f4-d4c7ab66b047 None admin] PATH_INFO: `/v3/projects` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:46:36.740580 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2a162b8-58ce-46d6-b9f4-d4c7ab66b047 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80396) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 15:46:36.741114 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2a162b8-58ce-46d6-b9f4-d4c7ab66b047 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:46:36.742845 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2a162b8-58ce-46d6-b9f4-d4c7ab66b047 None admin] RBAC: Authorization granted {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:46:36.765680 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 335/675] 10.222.0.59 () {56 vars in 1148 bytes} [Thu Jun 2 15:46:36 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 15:46:36.765680 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a162b8-58ce-46d6-b9f4-d4c7ab66b047 None admin] Authenticating user token {{(pid=80396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:46:36.845552 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46642ad3-3423-4e98-aae8-e9b0c6c62d85 None admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:46:36.880921 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writing DB stats keystone:SELECT=100 {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:46:36.884019 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a162b8-58ce-46d6-b9f4-d4c7ab66b047 None admin] Validating token access rules against request {{(pid=80396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:46:36.886635 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1268e1e-4a07-4daa-a1a4-6f52afe6a090 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:46:36.887646 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1268e1e-4a07-4daa-a1a4-6f52afe6a090 None admin] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:46:36.887956 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1268e1e-4a07-4daa-a1a4-6f52afe6a090 None admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:46:36.888554 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1268e1e-4a07-4daa-a1a4-6f52afe6a090 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:46:36.899896 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1268e1e-4a07-4daa-a1a4-6f52afe6a090 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:46:36.901478 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1268e1e-4a07-4daa-a1a4-6f52afe6a090 None admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:46:36.920788 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application [None req-c1268e1e-4a07-4daa-a1a4-6f52afe6a090 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 15:46:36.920788 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 15:46:36.920788 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 15:46:36.920788 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 15:46:36.920788 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 15:46:36.920788 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 15:46:36.920788 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 15:46:36.920788 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 15:46:36.920788 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 15:46:36.920788 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 15:46:36.920788 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 15:46:36.920788 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 15:46:36.920788 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 02 15:46:36.920788 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 02 15:46:36.920788 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 02 15:46:36.921833 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 02 15:46:36.921833 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 15:46:36.921833 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 15:46:36.921833 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 15:46:36.921833 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 15:46:36.921833 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 15:46:36.921833 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 15:46:36.921833 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 15:46:36.921833 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application with Lock( Jun 02 15:46:36.921833 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 15:46:36.921833 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self._enter() Jun 02 15:46:36.921833 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 15:46:36.921833 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 15:46:36.921833 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 15:46:36.921833 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self.creator() Jun 02 15:46:36.921833 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 15:46:36.921833 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application created_value = creator( Jun 02 15:46:36.923164 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 02 15:46:36.923164 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 02 15:46:36.923164 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 15:46:36.923164 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application Jun 02 15:46:36.923164 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 341/676] 10.222.0.59 () {56 vars in 1108 bytes} [Thu Jun 2 15:46:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 15:46:36.923908 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1268e1e-4a07-4daa-a1a4-6f52afe6a090 None admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:46:36.929770 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1245517f-4a83-445a-b8d7-b2a6743e07ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:46:36.930472 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1245517f-4a83-445a-b8d7-b2a6743e07ba None admin] REQUEST_METHOD: `GET` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:46:36.930755 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1245517f-4a83-445a-b8d7-b2a6743e07ba None admin] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:46:36.931033 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1245517f-4a83-445a-b8d7-b2a6743e07ba None admin] PATH_INFO: `/v3/domains` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:46:36.931760 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1245517f-4a83-445a-b8d7-b2a6743e07ba None admin] RBAC: Adding query filter params (name=Default) {{(pid=80396) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 15:46:36.932066 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1245517f-4a83-445a-b8d7-b2a6743e07ba None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:46:36.933442 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1245517f-4a83-445a-b8d7-b2a6743e07ba None admin] RBAC: Authorization granted {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:46:36.946552 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 336/677] 10.222.0.59 () {56 vars in 1109 bytes} [Thu Jun 2 15:46:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 15:46:36.947407 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1245517f-4a83-445a-b8d7-b2a6743e07ba None admin] Authenticating user token {{(pid=80396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:46:36.959583 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG dbcounter [-] [80396] Writing DB stats keystone:SELECT=100 {{(pid=80396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:46:37.039971 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1268e1e-4a07-4daa-a1a4-6f52afe6a090 None admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:46:37.051923 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1245517f-4a83-445a-b8d7-b2a6743e07ba None admin] Validating token access rules against request {{(pid=80396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:46:37.078327 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffee447e-f705-45ea-a75d-53cb543eedab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:46:37.079410 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffee447e-f705-45ea-a75d-53cb543eedab None admin] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:46:37.079988 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffee447e-f705-45ea-a75d-53cb543eedab None admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:46:37.080493 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffee447e-f705-45ea-a75d-53cb543eedab None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:46:37.081520 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffee447e-f705-45ea-a75d-53cb543eedab None admin] RBAC: Adding query filter params (role.id=36214aa6067e4493a555da410f965c5e, scope.project.id=9c87c981909d4b8db02783421818c79b, user.id=6534961c369940a5b88f310c6450250b) {{(pid=80395) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 15:46:37.082157 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffee447e-f705-45ea-a75d-53cb543eedab None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:46:37.084004 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffee447e-f705-45ea-a75d-53cb543eedab None admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:46:37.087485 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbd98f30-2a51-4afd-9fe0-f19d4c4088ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:46:37.088551 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd98f30-2a51-4afd-9fe0-f19d4c4088ae None admin] REQUEST_METHOD: `GET` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:46:37.088664 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd98f30-2a51-4afd-9fe0-f19d4c4088ae None admin] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:46:37.088941 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd98f30-2a51-4afd-9fe0-f19d4c4088ae None admin] PATH_INFO: `/v3/domains` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:46:37.089655 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbd98f30-2a51-4afd-9fe0-f19d4c4088ae None admin] RBAC: Adding query filter params (name=Default) {{(pid=80396) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 15:46:37.089962 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbd98f30-2a51-4afd-9fe0-f19d4c4088ae None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:46:37.091334 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbd98f30-2a51-4afd-9fe0-f19d4c4088ae None admin] RBAC: Authorization granted {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:46:37.098339 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 342/678] 10.222.0.59 () {56 vars in 1374 bytes} [Thu Jun 2 15:46:36 2022] GET /identity/v3/role_assignments?user.id=6534961c369940a5b88f310c6450250b&scope.project.id=9c87c981909d4b8db02783421818c79b&role.id=36214aa6067e4493a555da410f965c5e => generated 608 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 15:46:37.100092 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffee447e-f705-45ea-a75d-53cb543eedab None admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:46:37.104749 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 337/679] 10.222.0.59 () {56 vars in 1109 bytes} [Thu Jun 2 15:46:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 15:46:37.110106 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbd98f30-2a51-4afd-9fe0-f19d4c4088ae None admin] Authenticating user token {{(pid=80396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:46:37.192526 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG dbcounter [-] [80396] Writing DB stats keystone:SELECT=100 {{(pid=80396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:46:37.194681 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writing DB stats keystone:SELECT=100 {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:46:37.226606 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbd98f30-2a51-4afd-9fe0-f19d4c4088ae None admin] Validating token access rules against request {{(pid=80396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:46:37.292969 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daaaf0ed-732d-4b20-8628-6cffc410bd12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:46:37.294302 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daaaf0ed-732d-4b20-8628-6cffc410bd12 None admin] REQUEST_METHOD: `GET` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:46:37.294666 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daaaf0ed-732d-4b20-8628-6cffc410bd12 None admin] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:46:37.295147 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daaaf0ed-732d-4b20-8628-6cffc410bd12 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:46:37.301700 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffee447e-f705-45ea-a75d-53cb543eedab None admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:46:37.303806 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daaaf0ed-732d-4b20-8628-6cffc410bd12 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:46:37.305699 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daaaf0ed-732d-4b20-8628-6cffc410bd12 None admin] RBAC: Authorization granted {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:46:37.322138 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application [None req-daaaf0ed-732d-4b20-8628-6cffc410bd12 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 02 15:46:37.322138 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 15:46:37.322138 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 15:46:37.322138 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 15:46:37.322138 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 15:46:37.322138 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 15:46:37.322138 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 15:46:37.322138 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 15:46:37.322138 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 15:46:37.322138 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 15:46:37.322138 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 15:46:37.322138 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 15:46:37.322138 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 02 15:46:37.322138 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 02 15:46:37.322138 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 02 15:46:37.323110 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 02 15:46:37.323110 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 15:46:37.323110 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 15:46:37.323110 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 15:46:37.323110 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 15:46:37.323110 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 15:46:37.323110 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 15:46:37.323110 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 15:46:37.323110 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application with Lock( Jun 02 15:46:37.323110 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 15:46:37.323110 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application return self._enter() Jun 02 15:46:37.323110 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 15:46:37.323110 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 15:46:37.323110 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 15:46:37.323110 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application return self.creator() Jun 02 15:46:37.323110 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 15:46:37.323110 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application created_value = creator( Jun 02 15:46:37.324003 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 02 15:46:37.324003 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 02 15:46:37.324003 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 02 15:46:37.324003 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 02 15:46:37.324003 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 02 15:46:37.324003 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 02 15:46:37.324003 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 02 15:46:37.324003 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application Jun 02 15:46:37.324003 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 338/680] 10.222.0.59 () {56 vars in 1111 bytes} [Thu Jun 2 15:46:37 2022] GET /identity/v3/projects/service => generated 88 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 15:46:37.329822 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daaaf0ed-732d-4b20-8628-6cffc410bd12 None admin] Authenticating user token {{(pid=80396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:46:37.397624 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9600f82c-c52a-4504-877f-45b920a1cfeb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:46:37.398407 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9600f82c-c52a-4504-877f-45b920a1cfeb None admin] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:46:37.398684 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9600f82c-c52a-4504-877f-45b920a1cfeb None admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:46:37.398954 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9600f82c-c52a-4504-877f-45b920a1cfeb None admin] PATH_INFO: `/v3/users/swift` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:46:37.408422 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9600f82c-c52a-4504-877f-45b920a1cfeb None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:46:37.409887 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9600f82c-c52a-4504-877f-45b920a1cfeb None admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:46:37.429181 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application [None req-9600f82c-c52a-4504-877f-45b920a1cfeb None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jun 02 15:46:37.429181 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 15:46:37.429181 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 15:46:37.429181 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 15:46:37.429181 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 15:46:37.429181 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 15:46:37.429181 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 15:46:37.429181 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 15:46:37.429181 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 15:46:37.429181 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 15:46:37.429181 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 15:46:37.429181 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 15:46:37.429181 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 02 15:46:37.429181 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 02 15:46:37.429181 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 02 15:46:37.429181 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 02 15:46:37.430300 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 15:46:37.430300 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 15:46:37.430300 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 02 15:46:37.430300 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 02 15:46:37.430300 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 02 15:46:37.430300 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 02 15:46:37.430300 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 15:46:37.430300 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 15:46:37.430300 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 15:46:37.430300 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 15:46:37.430300 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 15:46:37.430300 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application with Lock( Jun 02 15:46:37.430300 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 15:46:37.430300 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self._enter() Jun 02 15:46:37.430300 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 15:46:37.430300 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 15:46:37.430300 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 15:46:37.430300 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self.creator() Jun 02 15:46:37.431235 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 15:46:37.431235 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application created_value = creator( Jun 02 15:46:37.431235 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 02 15:46:37.431235 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 02 15:46:37.431235 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 02 15:46:37.431235 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 02 15:46:37.431235 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 02 15:46:37.431235 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 02 15:46:37.431235 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jun 02 15:46:37.431235 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application Jun 02 15:46:37.431235 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 343/681] 10.222.0.59 () {56 vars in 1096 bytes} [Thu Jun 2 15:46:37 2022] GET /identity/v3/users/swift => generated 83 bytes in 331 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 15:46:37.436256 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9600f82c-c52a-4504-877f-45b920a1cfeb None admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:46:37.437926 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daaaf0ed-732d-4b20-8628-6cffc410bd12 None admin] Validating token access rules against request {{(pid=80396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:46:37.471367 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG dbcounter [-] [80396] Writing DB stats keystone:SELECT=100 {{(pid=80396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:46:37.486138 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c1969a8-e4f4-4ef1-88a6-c95898e55b1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:46:37.486832 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c1969a8-e4f4-4ef1-88a6-c95898e55b1e None admin] REQUEST_METHOD: `GET` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:46:37.487113 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c1969a8-e4f4-4ef1-88a6-c95898e55b1e None admin] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:46:37.487388 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c1969a8-e4f4-4ef1-88a6-c95898e55b1e None admin] PATH_INFO: `/v3/projects` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:46:37.488180 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c1969a8-e4f4-4ef1-88a6-c95898e55b1e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80396) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 15:46:37.488487 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c1969a8-e4f4-4ef1-88a6-c95898e55b1e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:46:37.489926 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c1969a8-e4f4-4ef1-88a6-c95898e55b1e None admin] RBAC: Authorization granted {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:46:37.505922 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 339/682] 10.222.0.59 () {56 vars in 1148 bytes} [Thu Jun 2 15:46:37 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 15:46:37.512838 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c1969a8-e4f4-4ef1-88a6-c95898e55b1e None admin] Authenticating user token {{(pid=80396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:46:37.577066 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9600f82c-c52a-4504-877f-45b920a1cfeb None admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:46:37.589444 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writing DB stats keystone:SELECT=100 {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:46:37.627023 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67324641-fcb4-4dba-a633-81b47610f2a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:46:37.627023 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67324641-fcb4-4dba-a633-81b47610f2a7 None admin] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:46:37.627023 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67324641-fcb4-4dba-a633-81b47610f2a7 None admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:46:37.627023 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67324641-fcb4-4dba-a633-81b47610f2a7 None admin] PATH_INFO: `/v3/users` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:46:37.627850 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67324641-fcb4-4dba-a633-81b47610f2a7 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80395) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 15:46:37.628155 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67324641-fcb4-4dba-a633-81b47610f2a7 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:46:37.630264 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67324641-fcb4-4dba-a633-81b47610f2a7 None admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:46:37.649488 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c1969a8-e4f4-4ef1-88a6-c95898e55b1e None admin] Validating token access rules against request {{(pid=80396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:46:37.654500 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 344/683] 10.222.0.59 () {56 vars in 1135 bytes} [Thu Jun 2 15:46:37 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 15:46:37.660732 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67324641-fcb4-4dba-a633-81b47610f2a7 None admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:46:37.705376 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db8be600-b286-441d-8efc-f288da155c2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:46:37.710187 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8be600-b286-441d-8efc-f288da155c2b None admin] REQUEST_METHOD: `GET` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:46:37.710728 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8be600-b286-441d-8efc-f288da155c2b None admin] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:46:37.711211 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8be600-b286-441d-8efc-f288da155c2b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:46:37.712257 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db8be600-b286-441d-8efc-f288da155c2b None admin] RBAC: Adding query filter params (role.id=36214aa6067e4493a555da410f965c5e, scope.project.id=9c87c981909d4b8db02783421818c79b, user.id=9af40ddfe9ff4be3887b068f13a28dc0) {{(pid=80396) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 15:46:37.713026 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db8be600-b286-441d-8efc-f288da155c2b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:46:37.714697 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db8be600-b286-441d-8efc-f288da155c2b None admin] RBAC: Authorization granted {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:46:37.728865 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 340/684] 10.222.0.59 () {56 vars in 1374 bytes} [Thu Jun 2 15:46:37 2022] GET /identity/v3/role_assignments?user.id=9af40ddfe9ff4be3887b068f13a28dc0&scope.project.id=9c87c981909d4b8db02783421818c79b&role.id=36214aa6067e4493a555da410f965c5e => generated 608 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 15:46:37.822013 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67324641-fcb4-4dba-a633-81b47610f2a7 None admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:46:37.882980 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-305b3cb0-94ff-4801-b405-974817b69723 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:46:37.883666 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-305b3cb0-94ff-4801-b405-974817b69723 None admin] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:46:37.883953 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-305b3cb0-94ff-4801-b405-974817b69723 None admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:46:37.884233 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-305b3cb0-94ff-4801-b405-974817b69723 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:46:37.929583 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writing DB stats keystone:SELECT=100 {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:46:37.986094 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-305b3cb0-94ff-4801-b405-974817b69723 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:46:37.987807 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-305b3cb0-94ff-4801-b405-974817b69723 None admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:46:38.119106 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 345/685] 10.222.0.59 () {58 vars in 1282 bytes} [Thu Jun 2 15:46:37 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 459 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 02 15:46:38.124976 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db8be600-b286-441d-8efc-f288da155c2b None admin] Authenticating user token {{(pid=80396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:46:38.161104 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d1e886a-7abc-4828-b2df-533dd2f742af None None] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:46:38.162640 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d1e886a-7abc-4828-b2df-533dd2f742af None None] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:46:38.162854 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d1e886a-7abc-4828-b2df-533dd2f742af None None] PATH_INFO: `/` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:46:38.164540 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 346/686] 10.222.0.59 () {54 vars in 926 bytes} [Thu Jun 2 15:46:38 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 15:46:38.171289 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e8334d6-760c-4fc1-b2af-9fb0362d16be None None] REQUEST_METHOD: `POST` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:46:38.186279 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e8334d6-760c-4fc1-b2af-9fb0362d16be None None] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:46:38.186279 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e8334d6-760c-4fc1-b2af-9fb0362d16be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:46:38.200382 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.auth.core [None req-5e8334d6-760c-4fc1-b2af-9fb0362d16be None None] MFA Rules not processed for user `400d1f4db9de49638549e5db29a041e1`. Rule list: `[]` (Enabled: `True`). {{(pid=80395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 15:46:38.201610 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.fernet_utils [None req-5e8334d6-760c-4fc1-b2af-9fb0362d16be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 15:46:38.220336 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG dbcounter [-] [80396] Writing DB stats keystone:SELECT=100 {{(pid=80396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:46:38.277414 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writing DB stats keystone:SELECT=100 {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:46:38.281525 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db8be600-b286-441d-8efc-f288da155c2b None admin] Validating token access rules against request {{(pid=80396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:46:38.286337 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 347/687] 10.222.0.59 () {58 vars in 1023 bytes} [Thu Jun 2 15:46:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 02 15:46:38.311825 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e8334d6-760c-4fc1-b2af-9fb0362d16be None None] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:46:38.329754 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23c553e0-7ab1-4668-88ca-a0dfd50cb5de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:46:38.330610 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c553e0-7ab1-4668-88ca-a0dfd50cb5de None admin] REQUEST_METHOD: `GET` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:46:38.330889 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c553e0-7ab1-4668-88ca-a0dfd50cb5de None admin] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:46:38.331160 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c553e0-7ab1-4668-88ca-a0dfd50cb5de None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:46:38.343374 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23c553e0-7ab1-4668-88ca-a0dfd50cb5de None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:46:38.344837 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23c553e0-7ab1-4668-88ca-a0dfd50cb5de None admin] RBAC: Authorization granted {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:46:38.363386 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application [None req-23c553e0-7ab1-4668-88ca-a0dfd50cb5de None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 15:46:38.363386 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 15:46:38.363386 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 15:46:38.363386 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 15:46:38.363386 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 15:46:38.363386 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 15:46:38.363386 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 15:46:38.363386 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 15:46:38.363386 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 15:46:38.363386 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 15:46:38.363386 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 15:46:38.363386 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 15:46:38.363386 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 02 15:46:38.363386 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 02 15:46:38.363386 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 02 15:46:38.364313 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 02 15:46:38.364313 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 15:46:38.364313 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 15:46:38.364313 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 15:46:38.364313 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 15:46:38.364313 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 15:46:38.364313 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 15:46:38.364313 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 15:46:38.364313 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application with Lock( Jun 02 15:46:38.364313 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 15:46:38.364313 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application return self._enter() Jun 02 15:46:38.364313 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 15:46:38.364313 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 15:46:38.364313 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 15:46:38.364313 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application return self.creator() Jun 02 15:46:38.364313 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 15:46:38.364313 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application created_value = creator( Jun 02 15:46:38.365317 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 02 15:46:38.365317 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 02 15:46:38.365317 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 15:46:38.365317 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application Jun 02 15:46:38.365317 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 341/688] 10.222.0.59 () {56 vars in 1108 bytes} [Thu Jun 2 15:46:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 240 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 15:46:38.371012 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23c553e0-7ab1-4668-88ca-a0dfd50cb5de None admin] Authenticating user token {{(pid=80396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:46:38.426885 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e8334d6-760c-4fc1-b2af-9fb0362d16be None None] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:46:38.470219 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-696f93f1-e3d2-4098-9216-73be1a9f5f1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:46:38.471344 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-696f93f1-e3d2-4098-9216-73be1a9f5f1b None admin] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:46:38.471824 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-696f93f1-e3d2-4098-9216-73be1a9f5f1b None admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:46:38.472295 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-696f93f1-e3d2-4098-9216-73be1a9f5f1b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:46:38.490402 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-696f93f1-e3d2-4098-9216-73be1a9f5f1b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:46:38.493031 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-696f93f1-e3d2-4098-9216-73be1a9f5f1b None admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:46:38.527642 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application [None req-696f93f1-e3d2-4098-9216-73be1a9f5f1b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 15:46:38.527642 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 15:46:38.527642 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 15:46:38.527642 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 15:46:38.527642 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 15:46:38.527642 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 15:46:38.527642 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 15:46:38.527642 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 15:46:38.527642 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 15:46:38.527642 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 15:46:38.527642 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 15:46:38.527642 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 15:46:38.527642 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 02 15:46:38.527642 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 02 15:46:38.527642 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 02 15:46:38.528575 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 02 15:46:38.528575 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 15:46:38.528575 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 15:46:38.528575 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 15:46:38.528575 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 15:46:38.528575 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 15:46:38.528575 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 15:46:38.528575 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 15:46:38.528575 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application with Lock( Jun 02 15:46:38.528575 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 15:46:38.528575 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self._enter() Jun 02 15:46:38.528575 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 15:46:38.528575 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 15:46:38.528575 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 15:46:38.528575 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self.creator() Jun 02 15:46:38.528575 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 15:46:38.528575 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application created_value = creator( Jun 02 15:46:38.529491 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 02 15:46:38.529491 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 02 15:46:38.529491 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 15:46:38.529491 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application Jun 02 15:46:38.531623 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 348/689] 10.222.0.59 () {56 vars in 1108 bytes} [Thu Jun 2 15:46:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 02 15:46:38.538978 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-696f93f1-e3d2-4098-9216-73be1a9f5f1b None admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:46:38.572226 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23c553e0-7ab1-4668-88ca-a0dfd50cb5de None admin] Validating token access rules against request {{(pid=80396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:46:38.590449 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG dbcounter [-] [80396] Writing DB stats keystone:SELECT=100 {{(pid=80396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:46:38.593835 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writing DB stats keystone:SELECT=100 {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:46:38.628185 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5e373c9-beb1-4dff-820c-e887950d2e9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:46:38.629550 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e373c9-beb1-4dff-820c-e887950d2e9f None admin] REQUEST_METHOD: `GET` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:46:38.630202 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e373c9-beb1-4dff-820c-e887950d2e9f None admin] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:46:38.631555 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e373c9-beb1-4dff-820c-e887950d2e9f None admin] PATH_INFO: `/v3/domains` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:46:38.632624 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5e373c9-beb1-4dff-820c-e887950d2e9f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80396) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 15:46:38.633109 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5e373c9-beb1-4dff-820c-e887950d2e9f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:46:38.635367 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5e373c9-beb1-4dff-820c-e887950d2e9f None admin] RBAC: Authorization granted {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:46:38.650583 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 342/690] 10.222.0.59 () {56 vars in 1109 bytes} [Thu Jun 2 15:46:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 280 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 15:46:38.652294 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c275ae-d9b8-43b5-8ba1-8fc4fe79d1ec None None] REQUEST_METHOD: `GET` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:46:38.653067 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c275ae-d9b8-43b5-8ba1-8fc4fe79d1ec None None] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:46:38.653522 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c275ae-d9b8-43b5-8ba1-8fc4fe79d1ec None None] PATH_INFO: `/` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:46:38.655456 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 343/691] 10.222.0.59 () {54 vars in 926 bytes} [Thu Jun 2 15:46:38 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 15:46:38.656314 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4c275ae-d9b8-43b5-8ba1-8fc4fe79d1ec None None] Authenticating user token {{(pid=80396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:46:38.660083 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-696f93f1-e3d2-4098-9216-73be1a9f5f1b None admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:46:38.708231 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e47653f-1d4d-4861-bbab-79ddb5647182 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:46:38.709061 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e47653f-1d4d-4861-bbab-79ddb5647182 None admin] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:46:38.709434 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e47653f-1d4d-4861-bbab-79ddb5647182 None admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:46:38.709773 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e47653f-1d4d-4861-bbab-79ddb5647182 None admin] PATH_INFO: `/v3/domains` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:46:38.711048 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e47653f-1d4d-4861-bbab-79ddb5647182 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80395) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 15:46:38.711429 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e47653f-1d4d-4861-bbab-79ddb5647182 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:46:38.713745 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e47653f-1d4d-4861-bbab-79ddb5647182 None admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:46:38.729724 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 349/692] 10.222.0.59 () {56 vars in 1109 bytes} [Thu Jun 2 15:46:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 15:46:38.731645 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7970f311-5e59-4c48-b2cf-55bc13ba44ff None None] REQUEST_METHOD: `POST` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:46:38.732016 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7970f311-5e59-4c48-b2cf-55bc13ba44ff None None] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:46:38.732371 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7970f311-5e59-4c48-b2cf-55bc13ba44ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:46:38.752707 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.auth.core [None req-7970f311-5e59-4c48-b2cf-55bc13ba44ff None None] MFA Rules not processed for user `400d1f4db9de49638549e5db29a041e1`. Rule list: `[]` (Enabled: `True`). {{(pid=80395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 15:46:38.753877 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.fernet_utils [None req-7970f311-5e59-4c48-b2cf-55bc13ba44ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 15:46:38.780319 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4c275ae-d9b8-43b5-8ba1-8fc4fe79d1ec None None] Validating token access rules against request {{(pid=80396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:46:38.818732 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1a675da-5ce5-4e83-b530-2990f2210189 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:46:38.819951 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a675da-5ce5-4e83-b530-2990f2210189 None admin] REQUEST_METHOD: `GET` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:46:38.820432 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a675da-5ce5-4e83-b530-2990f2210189 None admin] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:46:38.821019 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a675da-5ce5-4e83-b530-2990f2210189 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:46:38.828469 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1a675da-5ce5-4e83-b530-2990f2210189 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:46:38.830317 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1a675da-5ce5-4e83-b530-2990f2210189 None admin] RBAC: Authorization granted {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:46:38.841601 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 350/693] 10.222.0.59 () {58 vars in 1023 bytes} [Thu Jun 2 15:46:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 02 15:46:38.842460 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7970f311-5e59-4c48-b2cf-55bc13ba44ff None None] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:46:38.846466 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application [None req-f1a675da-5ce5-4e83-b530-2990f2210189 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 02 15:46:38.846466 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 15:46:38.846466 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 15:46:38.846466 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 15:46:38.846466 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 15:46:38.846466 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 15:46:38.846466 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 15:46:38.846466 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 15:46:38.846466 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 15:46:38.846466 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 15:46:38.846466 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 15:46:38.846466 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 15:46:38.846466 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 02 15:46:38.846466 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 02 15:46:38.846466 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 02 15:46:38.847322 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 02 15:46:38.847322 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 15:46:38.847322 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 15:46:38.847322 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 15:46:38.847322 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 15:46:38.847322 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 15:46:38.847322 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 15:46:38.847322 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 15:46:38.847322 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application with Lock( Jun 02 15:46:38.847322 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 15:46:38.847322 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application return self._enter() Jun 02 15:46:38.847322 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 15:46:38.847322 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 15:46:38.847322 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 15:46:38.847322 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application return self.creator() Jun 02 15:46:38.847322 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 15:46:38.847322 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application created_value = creator( Jun 02 15:46:38.848190 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 02 15:46:38.848190 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 02 15:46:38.848190 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 02 15:46:38.848190 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 02 15:46:38.848190 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 02 15:46:38.848190 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 02 15:46:38.848190 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 02 15:46:38.848190 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application Jun 02 15:46:38.850699 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 344/694] 10.222.0.59 () {56 vars in 1111 bytes} [Thu Jun 2 15:46:38 2022] GET /identity/v3/projects/service => generated 88 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 15:46:38.859131 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1a675da-5ce5-4e83-b530-2990f2210189 None admin] Authenticating user token {{(pid=80396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:46:38.900604 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writing DB stats keystone:SELECT=100 {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:46:38.901924 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG dbcounter [-] [80396] Writing DB stats keystone:SELECT=100 {{(pid=80396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:46:38.957121 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7970f311-5e59-4c48-b2cf-55bc13ba44ff None None] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:46:38.999115 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1a675da-5ce5-4e83-b530-2990f2210189 None admin] Validating token access rules against request {{(pid=80396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:46:39.000232 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e1c9ed-5f82-4ecf-a1ec-e1cd4f014645 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:46:39.001065 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e1c9ed-5f82-4ecf-a1ec-e1cd4f014645 None admin] REQUEST_METHOD: `POST` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:46:39.002143 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e1c9ed-5f82-4ecf-a1ec-e1cd4f014645 None admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:46:39.002432 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e1c9ed-5f82-4ecf-a1ec-e1cd4f014645 None admin] PATH_INFO: `/v3/users` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:46:39.003137 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56e1c9ed-5f82-4ecf-a1ec-e1cd4f014645 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:46:39.004582 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56e1c9ed-5f82-4ecf-a1ec-e1cd4f014645 None admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:46:39.039566 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14ef6b77-62b6-484a-b519-71759c2a6c2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:46:39.040230 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ef6b77-62b6-484a-b519-71759c2a6c2e None admin] REQUEST_METHOD: `GET` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:46:39.040516 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ef6b77-62b6-484a-b519-71759c2a6c2e None admin] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:46:39.040789 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ef6b77-62b6-484a-b519-71759c2a6c2e None admin] PATH_INFO: `/v3/projects` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:46:39.041571 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14ef6b77-62b6-484a-b519-71759c2a6c2e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80396) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 15:46:39.041878 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14ef6b77-62b6-484a-b519-71759c2a6c2e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:46:39.043344 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14ef6b77-62b6-484a-b519-71759c2a6c2e None admin] RBAC: Authorization granted {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:46:39.056257 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 345/695] 10.222.0.59 () {56 vars in 1148 bytes} [Thu Jun 2 15:46:38 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 15:46:39.057158 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14ef6b77-62b6-484a-b519-71759c2a6c2e None admin] Authenticating user token {{(pid=80396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:46:39.106354 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 351/696] 10.222.0.59 () {60 vars in 1132 bytes} [Thu Jun 2 15:46:38 2022] POST /identity/v3/users => generated 254 bytes in 264 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 15:46:39.108667 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e1c9ed-5f82-4ecf-a1ec-e1cd4f014645 None admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:46:39.206745 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG dbcounter [-] [80396] Writing DB stats keystone:SELECT=100 {{(pid=80396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:46:39.236789 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14ef6b77-62b6-484a-b519-71759c2a6c2e None admin] Validating token access rules against request {{(pid=80396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:46:39.277356 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-966e4de5-1338-4f79-aa94-f5c9874de289 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:46:39.278264 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966e4de5-1338-4f79-aa94-f5c9874de289 None admin] REQUEST_METHOD: `GET` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:46:39.278560 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966e4de5-1338-4f79-aa94-f5c9874de289 None admin] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:46:39.278821 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966e4de5-1338-4f79-aa94-f5c9874de289 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:46:39.291390 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-966e4de5-1338-4f79-aa94-f5c9874de289 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 02 15:46:39.299625 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application [None req-966e4de5-1338-4f79-aa94-f5c9874de289 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 02 15:46:39.299625 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 15:46:39.299625 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 15:46:39.299625 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 15:46:39.299625 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 15:46:39.299625 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 15:46:39.299625 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 15:46:39.299625 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 15:46:39.299625 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 15:46:39.299625 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 15:46:39.299625 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 15:46:39.299625 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 15:46:39.299625 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 02 15:46:39.299625 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 02 15:46:39.299625 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 02 15:46:39.299625 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 02 15:46:39.300620 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 02 15:46:39.300620 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 02 15:46:39.300620 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 02 15:46:39.300620 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 02 15:46:39.300620 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 15:46:39.300620 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 15:46:39.300620 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 15:46:39.300620 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 15:46:39.300620 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 15:46:39.300620 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 15:46:39.300620 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 15:46:39.300620 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application with Lock( Jun 02 15:46:39.300620 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 15:46:39.300620 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application return self._enter() Jun 02 15:46:39.300620 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 15:46:39.300620 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 15:46:39.301460 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 15:46:39.301460 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application return self.creator() Jun 02 15:46:39.301460 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 15:46:39.301460 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application created_value = creator( Jun 02 15:46:39.301460 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 02 15:46:39.301460 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 02 15:46:39.301460 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 02 15:46:39.301460 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 02 15:46:39.301460 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 02 15:46:39.301460 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 02 15:46:39.301460 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 02 15:46:39.301460 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application Jun 02 15:46:39.304919 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 346/697] 10.222.0.59 () {56 vars in 1096 bytes} [Thu Jun 2 15:46:39 2022] GET /identity/v3/roles/admin => generated 83 bytes in 244 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 15:46:39.307358 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-966e4de5-1338-4f79-aa94-f5c9874de289 None admin] Authenticating user token {{(pid=80396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:46:39.323278 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:46:39.336034 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e1c9ed-5f82-4ecf-a1ec-e1cd4f014645 None admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:46:39.387169 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2bccf08-3d34-4cf0-ac0b-e13168aec58d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:46:39.387822 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2bccf08-3d34-4cf0-ac0b-e13168aec58d None admin] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:46:39.388103 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2bccf08-3d34-4cf0-ac0b-e13168aec58d None admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:46:39.388378 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2bccf08-3d34-4cf0-ac0b-e13168aec58d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:46:39.389233 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2bccf08-3d34-4cf0-ac0b-e13168aec58d None admin] RBAC: Adding query filter params (role.id=36214aa6067e4493a555da410f965c5e, scope.project.id=9c87c981909d4b8db02783421818c79b, user.id=31bd858bf7674f43a99b77d11bc3c1a3) {{(pid=80395) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 15:46:39.389516 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2bccf08-3d34-4cf0-ac0b-e13168aec58d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:46:39.391022 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2bccf08-3d34-4cf0-ac0b-e13168aec58d None admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:46:39.398474 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 352/698] 10.222.0.59 () {56 vars in 1374 bytes} [Thu Jun 2 15:46:39 2022] GET /identity/v3/role_assignments?user.id=31bd858bf7674f43a99b77d11bc3c1a3&scope.project.id=9c87c981909d4b8db02783421818c79b&role.id=36214aa6067e4493a555da410f965c5e => generated 608 bytes in 291 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 15:46:39.430736 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-966e4de5-1338-4f79-aa94-f5c9874de289 None admin] Validating token access rules against request {{(pid=80396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:46:39.469984 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d94458c-c7bd-4176-a0d4-fba75d2cb225 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:46:39.471103 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d94458c-c7bd-4176-a0d4-fba75d2cb225 None admin] REQUEST_METHOD: `GET` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:46:39.471613 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d94458c-c7bd-4176-a0d4-fba75d2cb225 None admin] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:46:39.472095 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d94458c-c7bd-4176-a0d4-fba75d2cb225 None admin] PATH_INFO: `/v3/roles` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:46:39.473076 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d94458c-c7bd-4176-a0d4-fba75d2cb225 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80396) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 15:46:39.473652 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d94458c-c7bd-4176-a0d4-fba75d2cb225 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:46:39.476045 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d94458c-c7bd-4176-a0d4-fba75d2cb225 None admin] RBAC: Authorization granted {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:46:39.490711 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 347/699] 10.222.0.59 () {56 vars in 1099 bytes} [Thu Jun 2 15:46:39 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 15:46:39.493613 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2bccf08-3d34-4cf0-ac0b-e13168aec58d None admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:46:39.608770 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2bccf08-3d34-4cf0-ac0b-e13168aec58d None admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:46:39.651118 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b9efa04-c246-490d-beac-62e6786c2a26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:46:39.652356 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9efa04-c246-490d-beac-62e6786c2a26 None admin] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:46:39.652847 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9efa04-c246-490d-beac-62e6786c2a26 None admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:46:39.653329 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9efa04-c246-490d-beac-62e6786c2a26 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:46:39.667395 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b9efa04-c246-490d-beac-62e6786c2a26 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:46:39.669336 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b9efa04-c246-490d-beac-62e6786c2a26 None admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:46:39.690292 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application [None req-0b9efa04-c246-490d-beac-62e6786c2a26 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 15:46:39.690292 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 15:46:39.690292 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 15:46:39.690292 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 15:46:39.690292 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 15:46:39.690292 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 15:46:39.690292 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 15:46:39.690292 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 15:46:39.690292 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 15:46:39.690292 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 15:46:39.690292 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 15:46:39.690292 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 15:46:39.690292 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 02 15:46:39.690292 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 02 15:46:39.690292 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 02 15:46:39.691233 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 02 15:46:39.691233 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 15:46:39.691233 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 15:46:39.691233 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 15:46:39.691233 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 15:46:39.691233 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 15:46:39.691233 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 15:46:39.691233 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 15:46:39.691233 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application with Lock( Jun 02 15:46:39.691233 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 15:46:39.691233 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self._enter() Jun 02 15:46:39.691233 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 15:46:39.691233 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 15:46:39.691233 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 15:46:39.691233 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self.creator() Jun 02 15:46:39.691233 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 15:46:39.691233 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application created_value = creator( Jun 02 15:46:39.692135 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 02 15:46:39.692135 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 02 15:46:39.692135 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 15:46:39.692135 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application Jun 02 15:46:39.693114 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 353/700] 10.222.0.59 () {56 vars in 1108 bytes} [Thu Jun 2 15:46:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 15:46:39.697702 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d94458c-c7bd-4176-a0d4-fba75d2cb225 None admin] Authenticating user token {{(pid=80396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:46:39.710834 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG dbcounter [-] [80396] Writing DB stats keystone:SELECT=100 {{(pid=80396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:46:39.812595 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d94458c-c7bd-4176-a0d4-fba75d2cb225 None admin] Validating token access rules against request {{(pid=80396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:46:39.848734 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d67a1206-d793-46cd-a3e2-fd854330de1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:46:39.850274 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d67a1206-d793-46cd-a3e2-fd854330de1c None admin] REQUEST_METHOD: `GET` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:46:39.850702 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d67a1206-d793-46cd-a3e2-fd854330de1c None admin] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:46:39.851145 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d67a1206-d793-46cd-a3e2-fd854330de1c None admin] PATH_INFO: `/v3/domains` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:46:39.852037 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d67a1206-d793-46cd-a3e2-fd854330de1c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80396) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 15:46:39.852491 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d67a1206-d793-46cd-a3e2-fd854330de1c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:46:39.854006 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d67a1206-d793-46cd-a3e2-fd854330de1c None admin] RBAC: Authorization granted {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:46:39.867462 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 348/701] 10.222.0.59 () {56 vars in 1109 bytes} [Thu Jun 2 15:46:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 15:46:39.872714 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b9efa04-c246-490d-beac-62e6786c2a26 None admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:46:39.896044 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writing DB stats keystone:SELECT=100 {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:46:39.992959 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b9efa04-c246-490d-beac-62e6786c2a26 None admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:46:40.002578 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2702f43e-c4cb-4e85-ab28-0a693af29c94 None None] REQUEST_METHOD: `GET` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:46:40.002863 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2702f43e-c4cb-4e85-ab28-0a693af29c94 None None] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:46:40.003136 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2702f43e-c4cb-4e85-ab28-0a693af29c94 None None] PATH_INFO: `/` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:46:40.006617 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 349/702] 10.222.0.59 () {54 vars in 926 bytes} [Thu Jun 2 15:46:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 15:46:40.010951 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5adc235b-a923-4dc0-84b7-c890ea935a8a None None] REQUEST_METHOD: `POST` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:46:40.011234 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5adc235b-a923-4dc0-84b7-c890ea935a8a None None] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:46:40.011509 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5adc235b-a923-4dc0-84b7-c890ea935a8a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:46:40.034328 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6ec9104-94f9-4ad0-8ba1-ae45602af6e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:46:40.034573 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.auth.core [None req-5adc235b-a923-4dc0-84b7-c890ea935a8a None None] MFA Rules not processed for user `400d1f4db9de49638549e5db29a041e1`. Rule list: `[]` (Enabled: `True`). {{(pid=80396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 15:46:40.035121 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ec9104-94f9-4ad0-8ba1-ae45602af6e2 None admin] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:46:40.035399 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ec9104-94f9-4ad0-8ba1-ae45602af6e2 None admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:46:40.035503 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.fernet_utils [None req-5adc235b-a923-4dc0-84b7-c890ea935a8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 15:46:40.035675 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ec9104-94f9-4ad0-8ba1-ae45602af6e2 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:46:40.043867 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6ec9104-94f9-4ad0-8ba1-ae45602af6e2 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:46:40.045304 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6ec9104-94f9-4ad0-8ba1-ae45602af6e2 None admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:46:40.059876 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application [None req-e6ec9104-94f9-4ad0-8ba1-ae45602af6e2 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 02 15:46:40.059876 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 15:46:40.059876 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 15:46:40.059876 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 15:46:40.059876 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 15:46:40.059876 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 15:46:40.059876 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 15:46:40.059876 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 15:46:40.059876 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 15:46:40.059876 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 15:46:40.059876 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 15:46:40.059876 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 15:46:40.059876 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 02 15:46:40.059876 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 02 15:46:40.059876 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 02 15:46:40.059876 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 02 15:46:40.061118 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 15:46:40.061118 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 15:46:40.061118 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 02 15:46:40.061118 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 02 15:46:40.061118 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 02 15:46:40.061118 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 02 15:46:40.061118 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 15:46:40.061118 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 15:46:40.061118 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 15:46:40.061118 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 15:46:40.061118 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 15:46:40.061118 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application with Lock( Jun 02 15:46:40.061118 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 15:46:40.061118 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self._enter() Jun 02 15:46:40.061118 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 15:46:40.061118 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 15:46:40.061118 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 15:46:40.061118 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self.creator() Jun 02 15:46:40.062106 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 15:46:40.062106 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application created_value = creator( Jun 02 15:46:40.062106 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 02 15:46:40.062106 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 02 15:46:40.062106 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 02 15:46:40.062106 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 02 15:46:40.062106 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 02 15:46:40.062106 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 02 15:46:40.062106 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 02 15:46:40.062106 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application Jun 02 15:46:40.062106 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 354/703] 10.222.0.59 () {56 vars in 1093 bytes} [Thu Jun 2 15:46:39 2022] GET /identity/v3/users/nova => generated 82 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 15:46:40.068839 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6ec9104-94f9-4ad0-8ba1-ae45602af6e2 None admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:46:40.122780 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG dbcounter [-] [80396] Writing DB stats keystone:SELECT=100 {{(pid=80396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:46:40.134297 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 350/704] 10.222.0.59 () {58 vars in 1023 bytes} [Thu Jun 2 15:46:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 02 15:46:40.153270 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5adc235b-a923-4dc0-84b7-c890ea935a8a None None] Authenticating user token {{(pid=80396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:46:40.194336 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writing DB stats keystone:SELECT=100 {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:46:40.251544 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6ec9104-94f9-4ad0-8ba1-ae45602af6e2 None admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:46:40.319385 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fcaba80-bae0-4f3f-b357-0793a708f844 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:46:40.320494 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fcaba80-bae0-4f3f-b357-0793a708f844 None admin] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:46:40.320933 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fcaba80-bae0-4f3f-b357-0793a708f844 None admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:46:40.321349 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fcaba80-bae0-4f3f-b357-0793a708f844 None admin] PATH_INFO: `/v3/users` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:46:40.322366 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fcaba80-bae0-4f3f-b357-0793a708f844 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80395) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 15:46:40.322829 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fcaba80-bae0-4f3f-b357-0793a708f844 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:46:40.324266 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fcaba80-bae0-4f3f-b357-0793a708f844 None admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:46:40.332344 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5adc235b-a923-4dc0-84b7-c890ea935a8a None None] Validating token access rules against request {{(pid=80396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:46:40.354656 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 355/705] 10.222.0.59 () {56 vars in 1133 bytes} [Thu Jun 2 15:46:40 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 287 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 15:46:40.360403 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fcaba80-bae0-4f3f-b357-0793a708f844 None admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:46:40.398377 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35ffd389-c766-40bc-bd69-1eaed29ae553 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:46:40.399553 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ffd389-c766-40bc-bd69-1eaed29ae553 None admin] REQUEST_METHOD: `GET` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:46:40.400079 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ffd389-c766-40bc-bd69-1eaed29ae553 None admin] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:46:40.400719 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ffd389-c766-40bc-bd69-1eaed29ae553 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:46:40.403589 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35ffd389-c766-40bc-bd69-1eaed29ae553 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:46:40.405990 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35ffd389-c766-40bc-bd69-1eaed29ae553 None admin] RBAC: Authorization granted {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:46:40.432338 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application [None req-35ffd389-c766-40bc-bd69-1eaed29ae553 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 02 15:46:40.432338 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 15:46:40.432338 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 02 15:46:40.432338 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 02 15:46:40.432338 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 02 15:46:40.432338 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 02 15:46:40.432338 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 02 15:46:40.432338 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 02 15:46:40.432338 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 02 15:46:40.432338 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application Jun 02 15:46:40.432338 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 02 15:46:40.432338 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application Jun 02 15:46:40.432338 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 15:46:40.432338 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 15:46:40.432338 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 15:46:40.432338 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 15:46:40.433805 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 15:46:40.433805 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 15:46:40.433805 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 15:46:40.433805 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 15:46:40.433805 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 15:46:40.433805 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 15:46:40.433805 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 15:46:40.433805 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 02 15:46:40.433805 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 02 15:46:40.433805 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 02 15:46:40.433805 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 02 15:46:40.433805 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 15:46:40.433805 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 15:46:40.433805 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 15:46:40.433805 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 15:46:40.433805 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 15:46:40.434704 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 15:46:40.434704 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 15:46:40.434704 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application with Lock( Jun 02 15:46:40.434704 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 15:46:40.434704 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application return self._enter() Jun 02 15:46:40.434704 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 15:46:40.434704 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 15:46:40.434704 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 15:46:40.434704 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application return self.creator() Jun 02 15:46:40.434704 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 15:46:40.434704 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application created_value = creator( Jun 02 15:46:40.434704 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 02 15:46:40.434704 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 02 15:46:40.434704 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 02 15:46:40.434704 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application Jun 02 15:46:40.438390 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 351/706] 10.222.0.59 () {56 vars in 1129 bytes} [Thu Jun 2 15:46:40 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 286 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 02 15:46:40.444693 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35ffd389-c766-40bc-bd69-1eaed29ae553 None admin] Authenticating user token {{(pid=80396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:46:40.532923 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fcaba80-bae0-4f3f-b357-0793a708f844 None admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:46:40.556849 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG dbcounter [-] [80396] Writing DB stats keystone:SELECT=100 {{(pid=80396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:46:40.581781 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writing DB stats keystone:SELECT=100 {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:46:40.599553 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d358d737-a592-4d15-a336-af365f275b4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:46:40.600655 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d358d737-a592-4d15-a336-af365f275b4b None admin] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:46:40.601032 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d358d737-a592-4d15-a336-af365f275b4b None admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:46:40.601423 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d358d737-a592-4d15-a336-af365f275b4b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:46:40.608484 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35ffd389-c766-40bc-bd69-1eaed29ae553 None admin] Validating token access rules against request {{(pid=80396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:46:40.666395 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cceebbaf-a833-481d-aea4-390e9f0e48b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:46:40.666976 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cceebbaf-a833-481d-aea4-390e9f0e48b9 None admin] REQUEST_METHOD: `GET` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:46:40.667418 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cceebbaf-a833-481d-aea4-390e9f0e48b9 None admin] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:46:40.667698 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cceebbaf-a833-481d-aea4-390e9f0e48b9 None admin] PATH_INFO: `/v3/services` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:46:40.668700 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cceebbaf-a833-481d-aea4-390e9f0e48b9 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=80396) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 15:46:40.669009 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cceebbaf-a833-481d-aea4-390e9f0e48b9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:46:40.670399 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cceebbaf-a833-481d-aea4-390e9f0e48b9 None admin] RBAC: Authorization granted {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:46:40.676834 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 352/707] 10.222.0.59 () {56 vars in 1124 bytes} [Thu Jun 2 15:46:40 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 15:46:40.678966 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e5de36-cc5d-4418-aea6-2a2a23ef3d5d None None] REQUEST_METHOD: `GET` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:46:40.679254 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e5de36-cc5d-4418-aea6-2a2a23ef3d5d None None] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:46:40.679530 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e5de36-cc5d-4418-aea6-2a2a23ef3d5d None None] PATH_INFO: `/` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:46:40.681066 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 353/708] 10.222.0.59 () {54 vars in 926 bytes} [Thu Jun 2 15:46:40 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 15:46:40.682485 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1e5de36-cc5d-4418-aea6-2a2a23ef3d5d None None] Authenticating user token {{(pid=80396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:46:40.696527 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d358d737-a592-4d15-a336-af365f275b4b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:46:40.698276 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d358d737-a592-4d15-a336-af365f275b4b None admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:46:40.805617 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 356/709] 10.222.0.59 () {58 vars in 1282 bytes} [Thu Jun 2 15:46:40 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 445 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 02 15:46:40.806968 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0384c4d4-1d7e-40dd-92df-33a3adeedf55 None None] REQUEST_METHOD: `POST` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:46:40.807251 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0384c4d4-1d7e-40dd-92df-33a3adeedf55 None None] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:46:40.807525 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0384c4d4-1d7e-40dd-92df-33a3adeedf55 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:46:40.812718 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1e5de36-cc5d-4418-aea6-2a2a23ef3d5d None None] Validating token access rules against request {{(pid=80396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:46:40.825689 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.auth.core [None req-0384c4d4-1d7e-40dd-92df-33a3adeedf55 None None] MFA Rules not processed for user `400d1f4db9de49638549e5db29a041e1`. Rule list: `[]` (Enabled: `True`). {{(pid=80395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 15:46:40.827047 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.fernet_utils [None req-0384c4d4-1d7e-40dd-92df-33a3adeedf55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 15:46:40.846286 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG dbcounter [-] [80396] Writing DB stats keystone:SELECT=100 {{(pid=80396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:46:40.855169 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writing DB stats keystone:SELECT=100 {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:46:40.857298 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c4ee65d-c239-48fd-bae1-366ace3b993e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:46:40.858100 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c4ee65d-c239-48fd-bae1-366ace3b993e None admin] REQUEST_METHOD: `GET` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:46:40.858397 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c4ee65d-c239-48fd-bae1-366ace3b993e None admin] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:46:40.858828 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c4ee65d-c239-48fd-bae1-366ace3b993e None admin] PATH_INFO: `/v3/services` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:46:40.863032 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c4ee65d-c239-48fd-bae1-366ace3b993e None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=80396) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 15:46:40.863032 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c4ee65d-c239-48fd-bae1-366ace3b993e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:46:40.863032 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c4ee65d-c239-48fd-bae1-366ace3b993e None admin] RBAC: Authorization granted {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:46:40.878330 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 354/710] 10.222.0.59 () {56 vars in 1124 bytes} [Thu Jun 2 15:46:40 2022] GET /identity/v3/services?type=block-storage => generated 130 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 15:46:40.878330 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c4ee65d-c239-48fd-bae1-366ace3b993e None admin] Authenticating user token {{(pid=80396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:46:40.945030 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 357/711] 10.222.0.59 () {58 vars in 1023 bytes} [Thu Jun 2 15:46:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 02 15:46:41.006651 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0384c4d4-1d7e-40dd-92df-33a3adeedf55 None None] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:46:41.075740 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c4ee65d-c239-48fd-bae1-366ace3b993e None admin] Validating token access rules against request {{(pid=80396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:46:41.134053 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f25faaa0-205d-4974-9108-12bfb0fcd12d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:46:41.134877 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f25faaa0-205d-4974-9108-12bfb0fcd12d None admin] REQUEST_METHOD: `GET` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:46:41.135161 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f25faaa0-205d-4974-9108-12bfb0fcd12d None admin] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:46:41.135441 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f25faaa0-205d-4974-9108-12bfb0fcd12d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:46:41.157014 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f25faaa0-205d-4974-9108-12bfb0fcd12d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:46:41.158685 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f25faaa0-205d-4974-9108-12bfb0fcd12d None admin] RBAC: Authorization granted {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:46:41.175960 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0384c4d4-1d7e-40dd-92df-33a3adeedf55 None None] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:46:41.181469 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application [None req-f25faaa0-205d-4974-9108-12bfb0fcd12d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 15:46:41.181469 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 15:46:41.181469 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 15:46:41.181469 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 15:46:41.181469 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 15:46:41.181469 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 15:46:41.181469 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 15:46:41.181469 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 15:46:41.181469 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 15:46:41.181469 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 15:46:41.181469 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 15:46:41.181469 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 15:46:41.181469 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 02 15:46:41.181469 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 02 15:46:41.181469 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 02 15:46:41.182401 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 02 15:46:41.182401 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 15:46:41.182401 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 15:46:41.182401 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 15:46:41.182401 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 15:46:41.182401 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 15:46:41.182401 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 15:46:41.182401 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 15:46:41.182401 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application with Lock( Jun 02 15:46:41.182401 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 15:46:41.182401 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application return self._enter() Jun 02 15:46:41.182401 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 15:46:41.182401 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 15:46:41.182401 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 15:46:41.182401 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application return self.creator() Jun 02 15:46:41.182401 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 15:46:41.182401 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application created_value = creator( Jun 02 15:46:41.183282 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 02 15:46:41.183282 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 02 15:46:41.183282 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 15:46:41.183282 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application Jun 02 15:46:41.183282 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 355/712] 10.222.0.59 () {56 vars in 1108 bytes} [Thu Jun 2 15:46:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 312 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 15:46:41.188447 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f25faaa0-205d-4974-9108-12bfb0fcd12d None admin] Authenticating user token {{(pid=80396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:46:41.215953 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f17b211e-8b28-4db4-a12a-0d40dc22bc89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:46:41.217092 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f17b211e-8b28-4db4-a12a-0d40dc22bc89 None admin] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:46:41.217598 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f17b211e-8b28-4db4-a12a-0d40dc22bc89 None admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:46:41.218200 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f17b211e-8b28-4db4-a12a-0d40dc22bc89 None admin] PATH_INFO: `/v3/services/network` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:46:41.219185 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f17b211e-8b28-4db4-a12a-0d40dc22bc89 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:46:41.220760 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f17b211e-8b28-4db4-a12a-0d40dc22bc89 None admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:46:41.235556 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application [None req-f17b211e-8b28-4db4-a12a-0d40dc22bc89 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Jun 02 15:46:41.235556 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 15:46:41.235556 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 02 15:46:41.235556 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 02 15:46:41.235556 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 02 15:46:41.235556 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 02 15:46:41.235556 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 02 15:46:41.235556 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 02 15:46:41.235556 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jun 02 15:46:41.235556 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application Jun 02 15:46:41.235556 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 02 15:46:41.235556 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application Jun 02 15:46:41.235556 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 15:46:41.235556 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 15:46:41.235556 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 15:46:41.235556 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 15:46:41.235556 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 15:46:41.236581 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 15:46:41.236581 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 15:46:41.236581 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 15:46:41.236581 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 15:46:41.236581 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 15:46:41.236581 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 15:46:41.236581 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 02 15:46:41.236581 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 02 15:46:41.236581 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 02 15:46:41.236581 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 02 15:46:41.236581 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 15:46:41.236581 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 15:46:41.236581 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 15:46:41.236581 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 15:46:41.236581 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 15:46:41.236581 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 15:46:41.237489 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 15:46:41.237489 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application with Lock( Jun 02 15:46:41.237489 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 15:46:41.237489 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self._enter() Jun 02 15:46:41.237489 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 15:46:41.237489 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 15:46:41.237489 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 15:46:41.237489 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self.creator() Jun 02 15:46:41.237489 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 15:46:41.237489 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application created_value = creator( Jun 02 15:46:41.237489 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 02 15:46:41.237489 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 02 15:46:41.237489 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jun 02 15:46:41.237489 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application Jun 02 15:46:41.239081 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG dbcounter [-] [80396] Writing DB stats keystone:SELECT=100 {{(pid=80396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:46:41.245865 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 358/713] 10.222.0.59 () {56 vars in 1111 bytes} [Thu Jun 2 15:46:41 2022] GET /identity/v3/services/network => generated 88 bytes in 236 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 02 15:46:41.246839 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f17b211e-8b28-4db4-a12a-0d40dc22bc89 None admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:46:41.284979 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writing DB stats keystone:SELECT=100 {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:46:41.341844 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f25faaa0-205d-4974-9108-12bfb0fcd12d None admin] Validating token access rules against request {{(pid=80396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:46:41.413166 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5965e2c-6e65-45d3-aa5a-071ce65fe2ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:46:41.413839 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5965e2c-6e65-45d3-aa5a-071ce65fe2ea None admin] REQUEST_METHOD: `GET` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:46:41.414145 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5965e2c-6e65-45d3-aa5a-071ce65fe2ea None admin] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:46:41.414478 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5965e2c-6e65-45d3-aa5a-071ce65fe2ea None admin] PATH_INFO: `/v3/domains` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:46:41.415153 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5965e2c-6e65-45d3-aa5a-071ce65fe2ea None admin] RBAC: Adding query filter params (name=Default) {{(pid=80396) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 15:46:41.415458 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5965e2c-6e65-45d3-aa5a-071ce65fe2ea None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:46:41.417153 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5965e2c-6e65-45d3-aa5a-071ce65fe2ea None admin] RBAC: Authorization granted {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:46:41.430870 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f17b211e-8b28-4db4-a12a-0d40dc22bc89 None admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:46:41.434228 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 356/714] 10.222.0.59 () {56 vars in 1109 bytes} [Thu Jun 2 15:46:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 15:46:41.440321 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5965e2c-6e65-45d3-aa5a-071ce65fe2ea None admin] Authenticating user token {{(pid=80396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:46:41.502457 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fc6ad4a-c0cd-4af2-8b20-fe8faa28348c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:46:41.503052 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc6ad4a-c0cd-4af2-8b20-fe8faa28348c None admin] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:46:41.503336 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc6ad4a-c0cd-4af2-8b20-fe8faa28348c None admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:46:41.503613 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc6ad4a-c0cd-4af2-8b20-fe8faa28348c None admin] PATH_INFO: `/v3/services` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:46:41.504332 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fc6ad4a-c0cd-4af2-8b20-fe8faa28348c None admin] RBAC: Adding query filter params (name=network) {{(pid=80395) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 15:46:41.504642 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fc6ad4a-c0cd-4af2-8b20-fe8faa28348c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:46:41.506619 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fc6ad4a-c0cd-4af2-8b20-fe8faa28348c None admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:46:41.512075 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 359/715] 10.222.0.59 () {56 vars in 1112 bytes} [Thu Jun 2 15:46:41 2022] GET /identity/v3/services?name=network => generated 124 bytes in 265 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 15:46:41.517219 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fc6ad4a-c0cd-4af2-8b20-fe8faa28348c None admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:46:41.642879 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5965e2c-6e65-45d3-aa5a-071ce65fe2ea None admin] Validating token access rules against request {{(pid=80396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:46:41.644673 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG dbcounter [-] [80396] Writing DB stats keystone:SELECT=100 {{(pid=80396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:46:41.683190 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-464a627b-9d4f-40ef-8ac4-917cdb6fd63a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:46:41.684262 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-464a627b-9d4f-40ef-8ac4-917cdb6fd63a None admin] REQUEST_METHOD: `GET` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:46:41.684608 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-464a627b-9d4f-40ef-8ac4-917cdb6fd63a None admin] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:46:41.684984 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-464a627b-9d4f-40ef-8ac4-917cdb6fd63a None admin] PATH_INFO: `/v3/projects/service` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:46:41.688733 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writing DB stats keystone:SELECT=100 {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:46:41.698718 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-464a627b-9d4f-40ef-8ac4-917cdb6fd63a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:46:41.698718 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-464a627b-9d4f-40ef-8ac4-917cdb6fd63a None admin] RBAC: Authorization granted {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:46:41.713185 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application [None req-464a627b-9d4f-40ef-8ac4-917cdb6fd63a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 02 15:46:41.713185 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 15:46:41.713185 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 15:46:41.713185 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 15:46:41.713185 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 15:46:41.713185 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 15:46:41.713185 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 15:46:41.713185 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 15:46:41.713185 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 15:46:41.713185 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 15:46:41.713185 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 15:46:41.713185 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 15:46:41.713185 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 02 15:46:41.713185 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 02 15:46:41.713185 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 02 15:46:41.714358 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 02 15:46:41.714358 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 15:46:41.714358 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 15:46:41.714358 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 15:46:41.714358 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 15:46:41.714358 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 15:46:41.714358 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 15:46:41.714358 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 15:46:41.714358 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application with Lock( Jun 02 15:46:41.714358 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 15:46:41.714358 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application return self._enter() Jun 02 15:46:41.714358 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 15:46:41.714358 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 15:46:41.714358 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 15:46:41.714358 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application return self.creator() Jun 02 15:46:41.714358 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 15:46:41.714358 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application created_value = creator( Jun 02 15:46:41.715436 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 02 15:46:41.715436 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 02 15:46:41.715436 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 02 15:46:41.715436 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 02 15:46:41.715436 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 02 15:46:41.715436 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 02 15:46:41.715436 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 02 15:46:41.715436 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application Jun 02 15:46:41.717362 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 357/716] 10.222.0.59 () {56 vars in 1111 bytes} [Thu Jun 2 15:46:41 2022] GET /identity/v3/projects/service => generated 88 bytes in 282 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 15:46:41.723139 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-464a627b-9d4f-40ef-8ac4-917cdb6fd63a None admin] Authenticating user token {{(pid=80396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:46:41.724141 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fc6ad4a-c0cd-4af2-8b20-fe8faa28348c None admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:46:41.803312 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73e7f605-5a94-4fa9-b6c0-4661a2e7fd48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:46:41.803904 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e7f605-5a94-4fa9-b6c0-4661a2e7fd48 None admin] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:46:41.804192 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e7f605-5a94-4fa9-b6c0-4661a2e7fd48 None admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:46:41.804468 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e7f605-5a94-4fa9-b6c0-4661a2e7fd48 None admin] PATH_INFO: `/v3/services` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:46:41.805186 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73e7f605-5a94-4fa9-b6c0-4661a2e7fd48 None admin] RBAC: Adding query filter params (type=network) {{(pid=80395) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 15:46:41.806356 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73e7f605-5a94-4fa9-b6c0-4661a2e7fd48 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:46:41.807748 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73e7f605-5a94-4fa9-b6c0-4661a2e7fd48 None admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:46:41.825804 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 360/717] 10.222.0.59 () {56 vars in 1112 bytes} [Thu Jun 2 15:46:41 2022] GET /identity/v3/services?type=network => generated 124 bytes in 309 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 15:46:41.859212 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-464a627b-9d4f-40ef-8ac4-917cdb6fd63a None admin] Validating token access rules against request {{(pid=80396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:46:41.902147 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa0fec58-47d6-4f2e-8a58-ca5522aba834 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:46:41.903134 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa0fec58-47d6-4f2e-8a58-ca5522aba834 None admin] REQUEST_METHOD: `GET` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:46:41.903570 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa0fec58-47d6-4f2e-8a58-ca5522aba834 None admin] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:46:41.903996 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa0fec58-47d6-4f2e-8a58-ca5522aba834 None admin] PATH_INFO: `/v3/projects` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:46:41.904945 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa0fec58-47d6-4f2e-8a58-ca5522aba834 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80396) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 15:46:41.905419 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa0fec58-47d6-4f2e-8a58-ca5522aba834 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:46:41.907169 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa0fec58-47d6-4f2e-8a58-ca5522aba834 None admin] RBAC: Authorization granted {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:46:41.921775 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 358/718] 10.222.0.59 () {56 vars in 1148 bytes} [Thu Jun 2 15:46:41 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 15:46:41.928712 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73e7f605-5a94-4fa9-b6c0-4661a2e7fd48 None admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:46:42.032632 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b866d96-20bd-4ad4-a052-fc6f61de3dae None None] REQUEST_METHOD: `GET` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:46:42.033200 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b866d96-20bd-4ad4-a052-fc6f61de3dae None None] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:46:42.033675 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b866d96-20bd-4ad4-a052-fc6f61de3dae None None] PATH_INFO: `/` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:46:42.035570 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 359/719] 10.222.0.59 () {54 vars in 926 bytes} [Thu Jun 2 15:46:42 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 15:46:42.041106 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c3eabab-7bc8-4674-8e05-fc1f031973ff None None] REQUEST_METHOD: `POST` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:46:42.041637 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c3eabab-7bc8-4674-8e05-fc1f031973ff None None] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:46:42.042105 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c3eabab-7bc8-4674-8e05-fc1f031973ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:46:42.071657 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73e7f605-5a94-4fa9-b6c0-4661a2e7fd48 None admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:46:42.075608 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.auth.core [None req-1c3eabab-7bc8-4674-8e05-fc1f031973ff None None] MFA Rules not processed for user `400d1f4db9de49638549e5db29a041e1`. Rule list: `[]` (Enabled: `True`). {{(pid=80396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 15:46:42.077112 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.fernet_utils [None req-1c3eabab-7bc8-4674-8e05-fc1f031973ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 15:46:42.120209 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG dbcounter [-] [80396] Writing DB stats keystone:SELECT=100 {{(pid=80396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:46:42.135767 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c31af0-2c1f-4b32-ad35-878d336f5e85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:46:42.140763 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c31af0-2c1f-4b32-ad35-878d336f5e85 None admin] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:46:42.140763 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c31af0-2c1f-4b32-ad35-878d336f5e85 None admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:46:42.140763 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c31af0-2c1f-4b32-ad35-878d336f5e85 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:46:42.140763 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1c31af0-2c1f-4b32-ad35-878d336f5e85 None admin] RBAC: Adding query filter params (role.id=f1e0c25f6e9049e897cb7350c7e54ab3, scope.project.id=9c87c981909d4b8db02783421818c79b, user.id=52f9fe4b13574516bb0a8e2aa11a61e8) {{(pid=80395) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 15:46:42.140763 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1c31af0-2c1f-4b32-ad35-878d336f5e85 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:46:42.141765 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1c31af0-2c1f-4b32-ad35-878d336f5e85 None admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:46:42.154660 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 361/720] 10.222.0.59 () {56 vars in 1374 bytes} [Thu Jun 2 15:46:41 2022] GET /identity/v3/role_assignments?user.id=52f9fe4b13574516bb0a8e2aa11a61e8&scope.project.id=9c87c981909d4b8db02783421818c79b&role.id=f1e0c25f6e9049e897cb7350c7e54ab3 => generated 259 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 15:46:42.199415 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 360/721] 10.222.0.59 () {58 vars in 1023 bytes} [Thu Jun 2 15:46:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 02 15:46:42.225311 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c31af0-2c1f-4b32-ad35-878d336f5e85 None admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:46:42.261789 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00defbbc-cd75-4a85-aac0-5e9e28436c3b None None] REQUEST_METHOD: `GET` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:46:42.262381 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00defbbc-cd75-4a85-aac0-5e9e28436c3b None None] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:46:42.262804 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00defbbc-cd75-4a85-aac0-5e9e28436c3b None None] PATH_INFO: `/` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:46:42.264609 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 361/722] 10.222.0.59 () {54 vars in 926 bytes} [Thu Jun 2 15:46:42 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 15:46:42.270337 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62dc7df8-7e21-4799-b0ed-b94709a2bfd1 None None] REQUEST_METHOD: `POST` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:46:42.270877 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62dc7df8-7e21-4799-b0ed-b94709a2bfd1 None None] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:46:42.271907 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62dc7df8-7e21-4799-b0ed-b94709a2bfd1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:46:42.276655 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writing DB stats keystone:SELECT=100 {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:46:42.291597 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.auth.core [None req-62dc7df8-7e21-4799-b0ed-b94709a2bfd1 None None] MFA Rules not processed for user `400d1f4db9de49638549e5db29a041e1`. Rule list: `[]` (Enabled: `True`). {{(pid=80396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 15:46:42.293044 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.fernet_utils [None req-62dc7df8-7e21-4799-b0ed-b94709a2bfd1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 15:46:42.379469 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 362/723] 10.222.0.59 () {58 vars in 1023 bytes} [Thu Jun 2 15:46:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 02 15:46:42.409709 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62dc7df8-7e21-4799-b0ed-b94709a2bfd1 None None] Authenticating user token {{(pid=80396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:46:42.437557 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c31af0-2c1f-4b32-ad35-878d336f5e85 None admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:46:42.482436 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cd571d3-5abe-4c2f-aa82-73ebfb1b70e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:46:42.483242 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd571d3-5abe-4c2f-aa82-73ebfb1b70e9 None admin] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:46:42.483526 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd571d3-5abe-4c2f-aa82-73ebfb1b70e9 None admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:46:42.483805 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd571d3-5abe-4c2f-aa82-73ebfb1b70e9 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:46:42.506885 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cd571d3-5abe-4c2f-aa82-73ebfb1b70e9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 02 15:46:42.523175 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application [None req-3cd571d3-5abe-4c2f-aa82-73ebfb1b70e9 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 02 15:46:42.523175 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 15:46:42.523175 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 15:46:42.523175 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 15:46:42.523175 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 15:46:42.523175 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 15:46:42.523175 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 15:46:42.523175 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 15:46:42.523175 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 15:46:42.523175 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 15:46:42.523175 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 15:46:42.523175 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 15:46:42.523175 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 02 15:46:42.523175 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 02 15:46:42.523175 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 02 15:46:42.523175 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 02 15:46:42.524173 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 02 15:46:42.524173 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 02 15:46:42.524173 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 02 15:46:42.524173 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 02 15:46:42.524173 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 15:46:42.524173 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 15:46:42.524173 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 15:46:42.524173 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 15:46:42.524173 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 15:46:42.524173 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 15:46:42.524173 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 15:46:42.524173 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application with Lock( Jun 02 15:46:42.524173 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 15:46:42.524173 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self._enter() Jun 02 15:46:42.524173 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 15:46:42.524173 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 15:46:42.524990 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 15:46:42.524990 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self.creator() Jun 02 15:46:42.524990 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 15:46:42.524990 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application created_value = creator( Jun 02 15:46:42.524990 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 02 15:46:42.524990 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 02 15:46:42.524990 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 02 15:46:42.524990 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 02 15:46:42.524990 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 02 15:46:42.524990 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 02 15:46:42.524990 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 02 15:46:42.524990 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application Jun 02 15:46:42.529708 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 362/724] 10.222.0.59 () {56 vars in 1102 bytes} [Thu Jun 2 15:46:42 2022] GET /identity/v3/roles/service => generated 85 bytes in 305 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 15:46:42.535060 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cd571d3-5abe-4c2f-aa82-73ebfb1b70e9 None admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:46:42.545025 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG dbcounter [-] [80396] Writing DB stats keystone:SELECT=100 {{(pid=80396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:46:42.580199 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62dc7df8-7e21-4799-b0ed-b94709a2bfd1 None None] Validating token access rules against request {{(pid=80396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:46:42.658291 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ae37862-2dfc-4c18-a285-bbf6e99bb1d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:46:42.659018 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae37862-2dfc-4c18-a285-bbf6e99bb1d7 None admin] REQUEST_METHOD: `GET` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:46:42.659302 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae37862-2dfc-4c18-a285-bbf6e99bb1d7 None admin] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:46:42.659580 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae37862-2dfc-4c18-a285-bbf6e99bb1d7 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:46:42.666877 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writing DB stats keystone:SELECT=100 {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:46:42.689202 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ae37862-2dfc-4c18-a285-bbf6e99bb1d7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 02 15:46:42.694783 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cd571d3-5abe-4c2f-aa82-73ebfb1b70e9 None admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:46:42.697131 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application [None req-9ae37862-2dfc-4c18-a285-bbf6e99bb1d7 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 02 15:46:42.697131 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 15:46:42.697131 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 15:46:42.697131 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 15:46:42.697131 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 15:46:42.697131 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 15:46:42.697131 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 15:46:42.697131 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 15:46:42.697131 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 15:46:42.697131 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 15:46:42.697131 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 15:46:42.697131 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 15:46:42.697131 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 02 15:46:42.697131 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 02 15:46:42.697131 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 02 15:46:42.697131 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 02 15:46:42.698201 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 02 15:46:42.698201 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 02 15:46:42.698201 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 02 15:46:42.698201 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 02 15:46:42.698201 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 15:46:42.698201 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 15:46:42.698201 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 15:46:42.698201 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 15:46:42.698201 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 15:46:42.698201 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 15:46:42.698201 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 15:46:42.698201 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application with Lock( Jun 02 15:46:42.698201 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 15:46:42.698201 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application return self._enter() Jun 02 15:46:42.698201 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 15:46:42.698201 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 15:46:42.699084 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 15:46:42.699084 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application return self.creator() Jun 02 15:46:42.699084 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 15:46:42.699084 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application created_value = creator( Jun 02 15:46:42.699084 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 02 15:46:42.699084 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 02 15:46:42.699084 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 02 15:46:42.699084 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 02 15:46:42.699084 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 02 15:46:42.699084 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 02 15:46:42.699084 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 02 15:46:42.699084 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application Jun 02 15:46:42.699084 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 363/725] 10.222.0.59 () {56 vars in 1096 bytes} [Thu Jun 2 15:46:42 2022] GET /identity/v3/roles/admin => generated 83 bytes in 290 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 02 15:46:42.706274 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ae37862-2dfc-4c18-a285-bbf6e99bb1d7 None admin] Authenticating user token {{(pid=80396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:46:42.756157 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5711ad44-62d1-43e4-a2c1-923668d971f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:46:42.756823 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5711ad44-62d1-43e4-a2c1-923668d971f0 None admin] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:46:42.757105 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5711ad44-62d1-43e4-a2c1-923668d971f0 None admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:46:42.757378 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5711ad44-62d1-43e4-a2c1-923668d971f0 None admin] PATH_INFO: `/v3/roles` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:46:42.758152 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5711ad44-62d1-43e4-a2c1-923668d971f0 None admin] RBAC: Adding query filter params (name=service) {{(pid=80395) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 15:46:42.758459 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5711ad44-62d1-43e4-a2c1-923668d971f0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:46:42.759846 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5711ad44-62d1-43e4-a2c1-923668d971f0 None admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:46:42.768250 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 363/726] 10.222.0.59 () {56 vars in 1103 bytes} [Thu Jun 2 15:46:42 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 15:46:42.774271 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5711ad44-62d1-43e4-a2c1-923668d971f0 None admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:46:42.861162 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ae37862-2dfc-4c18-a285-bbf6e99bb1d7 None admin] Validating token access rules against request {{(pid=80396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:46:42.919200 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63e14d6f-f6a1-4ca4-81c5-6ebab9396747 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:46:42.920218 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e14d6f-f6a1-4ca4-81c5-6ebab9396747 None admin] REQUEST_METHOD: `GET` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:46:42.922054 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e14d6f-f6a1-4ca4-81c5-6ebab9396747 None admin] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:46:42.922567 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e14d6f-f6a1-4ca4-81c5-6ebab9396747 None admin] PATH_INFO: `/v3/roles` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:46:42.923514 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63e14d6f-f6a1-4ca4-81c5-6ebab9396747 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80396) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 15:46:42.924885 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63e14d6f-f6a1-4ca4-81c5-6ebab9396747 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:46:42.928875 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63e14d6f-f6a1-4ca4-81c5-6ebab9396747 None admin] RBAC: Authorization granted {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:46:42.949124 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 364/727] 10.222.0.59 () {56 vars in 1099 bytes} [Thu Jun 2 15:46:42 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 15:46:42.955754 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63e14d6f-f6a1-4ca4-81c5-6ebab9396747 None admin] Authenticating user token {{(pid=80396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:46:42.966155 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG dbcounter [-] [80396] Writing DB stats keystone:SELECT=100 {{(pid=80396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:46:42.981635 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5711ad44-62d1-43e4-a2c1-923668d971f0 None admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:46:43.021428 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-378c9ee1-7672-4d55-90aa-bd809a1b1635 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:46:43.022726 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378c9ee1-7672-4d55-90aa-bd809a1b1635 None admin] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:46:43.023164 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378c9ee1-7672-4d55-90aa-bd809a1b1635 None admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:46:43.023611 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378c9ee1-7672-4d55-90aa-bd809a1b1635 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:46:43.026780 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writing DB stats keystone:SELECT=100 {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:46:43.037219 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-378c9ee1-7672-4d55-90aa-bd809a1b1635 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:46:43.041990 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-378c9ee1-7672-4d55-90aa-bd809a1b1635 None admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:46:43.060314 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application [None req-378c9ee1-7672-4d55-90aa-bd809a1b1635 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 15:46:43.060314 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 15:46:43.060314 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 15:46:43.060314 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 15:46:43.060314 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 15:46:43.060314 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 15:46:43.060314 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 15:46:43.060314 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 15:46:43.060314 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 15:46:43.060314 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 15:46:43.060314 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 15:46:43.060314 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 15:46:43.060314 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 02 15:46:43.060314 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 02 15:46:43.060314 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 02 15:46:43.061264 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 02 15:46:43.061264 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 15:46:43.061264 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 15:46:43.061264 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 15:46:43.061264 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 15:46:43.061264 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 15:46:43.061264 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 15:46:43.061264 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 15:46:43.061264 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application with Lock( Jun 02 15:46:43.061264 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 15:46:43.061264 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self._enter() Jun 02 15:46:43.061264 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 15:46:43.061264 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 15:46:43.061264 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 15:46:43.061264 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self.creator() Jun 02 15:46:43.061264 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 15:46:43.061264 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application created_value = creator( Jun 02 15:46:43.062228 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 02 15:46:43.062228 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 02 15:46:43.062228 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 15:46:43.062228 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application Jun 02 15:46:43.064821 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 364/728] 10.222.0.59 () {56 vars in 1108 bytes} [Thu Jun 2 15:46:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 291 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 15:46:43.070776 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-378c9ee1-7672-4d55-90aa-bd809a1b1635 None admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:46:43.185932 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63e14d6f-f6a1-4ca4-81c5-6ebab9396747 None admin] Validating token access rules against request {{(pid=80396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:46:43.239830 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-378c9ee1-7672-4d55-90aa-bd809a1b1635 None admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:46:43.243374 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e49452a-ba8f-4717-af7f-3e1c0a5b8ba3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:46:43.244316 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e49452a-ba8f-4717-af7f-3e1c0a5b8ba3 None admin] REQUEST_METHOD: `GET` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:46:43.244667 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e49452a-ba8f-4717-af7f-3e1c0a5b8ba3 None admin] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:46:43.245008 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e49452a-ba8f-4717-af7f-3e1c0a5b8ba3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:46:43.256473 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e49452a-ba8f-4717-af7f-3e1c0a5b8ba3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:46:43.258116 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e49452a-ba8f-4717-af7f-3e1c0a5b8ba3 None admin] RBAC: Authorization granted {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:46:43.283030 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application [None req-7e49452a-ba8f-4717-af7f-3e1c0a5b8ba3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 15:46:43.283030 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 15:46:43.283030 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 15:46:43.283030 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 15:46:43.283030 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 15:46:43.283030 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 15:46:43.283030 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 15:46:43.283030 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 15:46:43.283030 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 15:46:43.283030 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 15:46:43.283030 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 15:46:43.283030 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 15:46:43.283030 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 02 15:46:43.283030 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 02 15:46:43.283030 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 02 15:46:43.283972 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 02 15:46:43.283972 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 15:46:43.283972 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 15:46:43.283972 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 15:46:43.283972 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 15:46:43.283972 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 15:46:43.283972 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 15:46:43.283972 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 15:46:43.283972 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application with Lock( Jun 02 15:46:43.283972 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 15:46:43.283972 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application return self._enter() Jun 02 15:46:43.283972 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 15:46:43.283972 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 15:46:43.283972 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 15:46:43.283972 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application return self.creator() Jun 02 15:46:43.283972 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 15:46:43.283972 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application created_value = creator( Jun 02 15:46:43.285440 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 02 15:46:43.285440 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 02 15:46:43.285440 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 15:46:43.285440 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application Jun 02 15:46:43.285440 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 365/729] 10.222.0.59 () {56 vars in 1108 bytes} [Thu Jun 2 15:46:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 329 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 15:46:43.290726 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e49452a-ba8f-4717-af7f-3e1c0a5b8ba3 None admin] Authenticating user token {{(pid=80396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:46:43.323373 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4787e408-34e4-48ab-b2a2-df13b3ff107c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:46:43.324048 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4787e408-34e4-48ab-b2a2-df13b3ff107c None admin] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:46:43.324334 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4787e408-34e4-48ab-b2a2-df13b3ff107c None admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:46:43.324612 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4787e408-34e4-48ab-b2a2-df13b3ff107c None admin] PATH_INFO: `/v3/domains` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:46:43.325452 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4787e408-34e4-48ab-b2a2-df13b3ff107c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80395) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 15:46:43.325762 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4787e408-34e4-48ab-b2a2-df13b3ff107c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:46:43.327258 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4787e408-34e4-48ab-b2a2-df13b3ff107c None admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:46:43.352881 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 365/730] 10.222.0.59 () {56 vars in 1109 bytes} [Thu Jun 2 15:46:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 283 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 15:46:43.358592 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG dbcounter [-] [80396] Writing DB stats keystone:SELECT=100 {{(pid=80396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:46:43.360657 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4787e408-34e4-48ab-b2a2-df13b3ff107c None admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:46:43.436785 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writing DB stats keystone:SELECT=100 {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:46:43.450225 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e49452a-ba8f-4717-af7f-3e1c0a5b8ba3 None admin] Validating token access rules against request {{(pid=80396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:46:43.493403 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4787e408-34e4-48ab-b2a2-df13b3ff107c None admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:46:43.525827 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6670eaf6-3523-432e-b1d5-d671eff4ad06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:46:43.526824 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6670eaf6-3523-432e-b1d5-d671eff4ad06 None admin] REQUEST_METHOD: `GET` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:46:43.527118 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6670eaf6-3523-432e-b1d5-d671eff4ad06 None admin] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:46:43.527403 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6670eaf6-3523-432e-b1d5-d671eff4ad06 None admin] PATH_INFO: `/v3/domains` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:46:43.528131 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6670eaf6-3523-432e-b1d5-d671eff4ad06 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80396) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 15:46:43.528439 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6670eaf6-3523-432e-b1d5-d671eff4ad06 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:46:43.529811 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6670eaf6-3523-432e-b1d5-d671eff4ad06 None admin] RBAC: Authorization granted {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:46:43.532211 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afcdbd6e-ad58-4af0-a088-8500fec5efc7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:46:43.533236 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afcdbd6e-ad58-4af0-a088-8500fec5efc7 None admin] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:46:43.533740 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afcdbd6e-ad58-4af0-a088-8500fec5efc7 None admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:46:43.534220 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afcdbd6e-ad58-4af0-a088-8500fec5efc7 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:46:43.542141 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afcdbd6e-ad58-4af0-a088-8500fec5efc7 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:46:43.543848 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afcdbd6e-ad58-4af0-a088-8500fec5efc7 None admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:46:43.558125 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 366/731] 10.222.0.59 () {56 vars in 1109 bytes} [Thu Jun 2 15:46:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 264 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 15:46:43.566426 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application [None req-afcdbd6e-ad58-4af0-a088-8500fec5efc7 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 02 15:46:43.566426 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 15:46:43.566426 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 15:46:43.566426 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 15:46:43.566426 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 15:46:43.566426 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 15:46:43.566426 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 15:46:43.566426 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 15:46:43.566426 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 15:46:43.566426 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 15:46:43.566426 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 15:46:43.566426 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 15:46:43.566426 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 02 15:46:43.566426 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 02 15:46:43.566426 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 02 15:46:43.566426 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 02 15:46:43.567318 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 15:46:43.567318 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 15:46:43.567318 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 02 15:46:43.567318 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 02 15:46:43.567318 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 02 15:46:43.567318 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 02 15:46:43.567318 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 15:46:43.567318 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 15:46:43.567318 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 15:46:43.567318 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 15:46:43.567318 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 15:46:43.567318 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application with Lock( Jun 02 15:46:43.567318 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 15:46:43.567318 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self._enter() Jun 02 15:46:43.567318 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 15:46:43.567318 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 15:46:43.567318 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 15:46:43.567318 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self.creator() Jun 02 15:46:43.568410 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 15:46:43.568410 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application created_value = creator( Jun 02 15:46:43.568410 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 02 15:46:43.568410 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 02 15:46:43.568410 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 02 15:46:43.568410 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 02 15:46:43.568410 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 02 15:46:43.568410 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 02 15:46:43.568410 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 02 15:46:43.568410 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application Jun 02 15:46:43.570932 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 366/732] 10.222.0.59 () {56 vars in 1117 bytes} [Thu Jun 2 15:46:43 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 15:46:43.575107 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6670eaf6-3523-432e-b1d5-d671eff4ad06 None admin] Authenticating user token {{(pid=80396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:46:43.576339 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afcdbd6e-ad58-4af0-a088-8500fec5efc7 None admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:46:43.680737 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afcdbd6e-ad58-4af0-a088-8500fec5efc7 None admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:46:43.691728 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writing DB stats keystone:SELECT=100 {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:46:43.718713 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34a109e2-e550-46cd-9287-0e673ed9e446 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:46:43.719667 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a109e2-e550-46cd-9287-0e673ed9e446 None admin] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:46:43.720151 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a109e2-e550-46cd-9287-0e673ed9e446 None admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:46:43.720635 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a109e2-e550-46cd-9287-0e673ed9e446 None admin] PATH_INFO: `/v3/users` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:46:43.721694 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34a109e2-e550-46cd-9287-0e673ed9e446 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80395) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 15:46:43.722272 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34a109e2-e550-46cd-9287-0e673ed9e446 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:46:43.724714 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34a109e2-e550-46cd-9287-0e673ed9e446 None admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:46:43.743318 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 367/733] 10.222.0.59 () {56 vars in 1149 bytes} [Thu Jun 2 15:46:43 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 15:46:43.750202 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34a109e2-e550-46cd-9287-0e673ed9e446 None admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:46:43.800336 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6670eaf6-3523-432e-b1d5-d671eff4ad06 None admin] Validating token access rules against request {{(pid=80396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:46:43.825924 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG dbcounter [-] [80396] Writing DB stats keystone:SELECT=100 {{(pid=80396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:46:43.860419 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8293302a-67a4-4aa0-8ebf-29a47dcb044e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:46:43.861167 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8293302a-67a4-4aa0-8ebf-29a47dcb044e None admin] REQUEST_METHOD: `GET` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:46:43.861518 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8293302a-67a4-4aa0-8ebf-29a47dcb044e None admin] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:46:43.861900 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8293302a-67a4-4aa0-8ebf-29a47dcb044e None admin] PATH_INFO: `/v3/users/swift` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:46:43.867343 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34a109e2-e550-46cd-9287-0e673ed9e446 None admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:46:43.870367 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8293302a-67a4-4aa0-8ebf-29a47dcb044e None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:46:43.871321 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8293302a-67a4-4aa0-8ebf-29a47dcb044e None admin] RBAC: Authorization granted {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:46:43.887279 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application [None req-8293302a-67a4-4aa0-8ebf-29a47dcb044e None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jun 02 15:46:43.887279 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 15:46:43.887279 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 15:46:43.887279 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 15:46:43.887279 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 15:46:43.887279 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 15:46:43.887279 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 15:46:43.887279 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 15:46:43.887279 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 15:46:43.887279 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 15:46:43.887279 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 15:46:43.887279 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 15:46:43.887279 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 02 15:46:43.887279 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 02 15:46:43.887279 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 02 15:46:43.887279 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 02 15:46:43.888261 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 15:46:43.888261 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 15:46:43.888261 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 02 15:46:43.888261 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 02 15:46:43.888261 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 02 15:46:43.888261 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 02 15:46:43.888261 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 15:46:43.888261 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 15:46:43.888261 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 15:46:43.888261 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 15:46:43.888261 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 15:46:43.888261 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application with Lock( Jun 02 15:46:43.888261 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 15:46:43.888261 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application return self._enter() Jun 02 15:46:43.888261 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 15:46:43.888261 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 15:46:43.888261 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 15:46:43.888261 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application return self.creator() Jun 02 15:46:43.889205 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 15:46:43.889205 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application created_value = creator( Jun 02 15:46:43.889205 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 02 15:46:43.889205 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 02 15:46:43.889205 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 02 15:46:43.889205 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 02 15:46:43.889205 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 02 15:46:43.889205 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 02 15:46:43.889205 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jun 02 15:46:43.889205 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application Jun 02 15:46:43.893240 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 367/734] 10.222.0.59 () {56 vars in 1096 bytes} [Thu Jun 2 15:46:43 2022] GET /identity/v3/users/swift => generated 83 bytes in 314 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 15:46:43.894617 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3230c5c-18e3-4d10-9ea7-288d25c2aa28 None None] REQUEST_METHOD: `GET` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:46:43.894990 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3230c5c-18e3-4d10-9ea7-288d25c2aa28 None None] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:46:43.895272 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3230c5c-18e3-4d10-9ea7-288d25c2aa28 None None] PATH_INFO: `/` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:46:43.897399 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 368/735] 10.222.0.59 () {54 vars in 926 bytes} [Thu Jun 2 15:46:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 15:46:43.898278 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3230c5c-18e3-4d10-9ea7-288d25c2aa28 None None] Authenticating user token {{(pid=80396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:46:43.908064 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3686265-d582-4e29-a513-faabaee2c3b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:46:43.908948 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3686265-d582-4e29-a513-faabaee2c3b0 None admin] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:46:43.909522 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3686265-d582-4e29-a513-faabaee2c3b0 None admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:46:43.909986 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3686265-d582-4e29-a513-faabaee2c3b0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:46:43.948671 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writing DB stats keystone:SELECT=100 {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:46:43.986719 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3686265-d582-4e29-a513-faabaee2c3b0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:46:43.988762 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3686265-d582-4e29-a513-faabaee2c3b0 None admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:46:44.011601 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3230c5c-18e3-4d10-9ea7-288d25c2aa28 None None] Validating token access rules against request {{(pid=80396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:46:44.049103 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca4e2465-f2e5-4fcf-b8c9-f4121ca03d54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:46:44.049937 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca4e2465-f2e5-4fcf-b8c9-f4121ca03d54 None admin] REQUEST_METHOD: `GET` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:46:44.050207 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca4e2465-f2e5-4fcf-b8c9-f4121ca03d54 None admin] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:46:44.050489 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca4e2465-f2e5-4fcf-b8c9-f4121ca03d54 None admin] PATH_INFO: `/v3/users` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:46:44.051383 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca4e2465-f2e5-4fcf-b8c9-f4121ca03d54 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80396) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 15:46:44.051646 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca4e2465-f2e5-4fcf-b8c9-f4121ca03d54 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:46:44.053668 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca4e2465-f2e5-4fcf-b8c9-f4121ca03d54 None admin] RBAC: Authorization granted {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:46:44.074579 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 369/736] 10.222.0.59 () {56 vars in 1135 bytes} [Thu Jun 2 15:46:43 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 15:46:44.076086 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a7aa5e-7466-429c-89e3-fc72828f2e97 None None] REQUEST_METHOD: `POST` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:46:44.076379 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a7aa5e-7466-429c-89e3-fc72828f2e97 None None] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:46:44.076655 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a7aa5e-7466-429c-89e3-fc72828f2e97 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:46:44.094728 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.auth.core [None req-05a7aa5e-7466-429c-89e3-fc72828f2e97 None None] MFA Rules not processed for user `400d1f4db9de49638549e5db29a041e1`. Rule list: `[]` (Enabled: `True`). {{(pid=80396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 15:46:44.095889 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.fernet_utils [None req-05a7aa5e-7466-429c-89e3-fc72828f2e97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 15:46:44.101328 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 368/737] 10.222.0.59 () {58 vars in 1282 bytes} [Thu Jun 2 15:46:43 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 351 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 02 15:46:44.102499 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3686265-d582-4e29-a513-faabaee2c3b0 None admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:46:44.125616 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG dbcounter [-] [80396] Writing DB stats keystone:SELECT=100 {{(pid=80396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:46:44.178577 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 370/738] 10.222.0.59 () {58 vars in 1023 bytes} [Thu Jun 2 15:46:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 02 15:46:44.179774 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05a7aa5e-7466-429c-89e3-fc72828f2e97 None None] Authenticating user token {{(pid=80396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:46:44.181614 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writing DB stats keystone:SELECT=100 {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:46:44.248773 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3686265-d582-4e29-a513-faabaee2c3b0 None admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:46:44.288219 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2f18507-3c45-4eb6-9c35-5a4bbef48e91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:46:44.289226 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f18507-3c45-4eb6-9c35-5a4bbef48e91 None admin] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:46:44.289708 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f18507-3c45-4eb6-9c35-5a4bbef48e91 None admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:46:44.290339 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f18507-3c45-4eb6-9c35-5a4bbef48e91 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:46:44.294109 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05a7aa5e-7466-429c-89e3-fc72828f2e97 None None] Validating token access rules against request {{(pid=80396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:46:44.331460 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6e35964-d4f7-4d1c-9f7f-b4559148bef2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:46:44.332258 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e35964-d4f7-4d1c-9f7f-b4559148bef2 None admin] REQUEST_METHOD: `GET` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:46:44.332540 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e35964-d4f7-4d1c-9f7f-b4559148bef2 None admin] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:46:44.332819 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e35964-d4f7-4d1c-9f7f-b4559148bef2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:46:44.344263 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6e35964-d4f7-4d1c-9f7f-b4559148bef2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:46:44.345919 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6e35964-d4f7-4d1c-9f7f-b4559148bef2 None admin] RBAC: Authorization granted {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:46:44.365268 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2f18507-3c45-4eb6-9c35-5a4bbef48e91 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:46:44.365946 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application [None req-a6e35964-d4f7-4d1c-9f7f-b4559148bef2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 15:46:44.365946 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 15:46:44.365946 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 15:46:44.365946 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 15:46:44.365946 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 15:46:44.365946 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 15:46:44.365946 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 15:46:44.365946 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 15:46:44.365946 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 15:46:44.365946 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 15:46:44.365946 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 15:46:44.365946 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 15:46:44.365946 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 02 15:46:44.365946 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 02 15:46:44.365946 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 02 15:46:44.366825 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 02 15:46:44.366825 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 15:46:44.366825 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 15:46:44.366825 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 15:46:44.366825 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 15:46:44.366825 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 15:46:44.366825 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 15:46:44.366825 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 15:46:44.366825 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application with Lock( Jun 02 15:46:44.366825 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 15:46:44.366825 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application return self._enter() Jun 02 15:46:44.366825 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 15:46:44.366825 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 15:46:44.366825 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 15:46:44.366825 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application return self.creator() Jun 02 15:46:44.366825 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 15:46:44.366825 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application created_value = creator( Jun 02 15:46:44.367700 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 02 15:46:44.367700 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 02 15:46:44.367700 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 15:46:44.367700 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application Jun 02 15:46:44.367928 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2f18507-3c45-4eb6-9c35-5a4bbef48e91 None admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:46:44.367998 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 371/739] 10.222.0.59 () {56 vars in 1108 bytes} [Thu Jun 2 15:46:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 15:46:44.368514 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6e35964-d4f7-4d1c-9f7f-b4559148bef2 None admin] Authenticating user token {{(pid=80396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:46:44.388643 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG dbcounter [-] [80396] Writing DB stats keystone:SELECT=100 {{(pid=80396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:46:44.437348 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writing DB stats keystone:SELECT=100 {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:46:44.481549 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 369/740] 10.222.0.59 () {58 vars in 1282 bytes} [Thu Jun 2 15:46:44 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 379 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 02 15:46:44.482685 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2f18507-3c45-4eb6-9c35-5a4bbef48e91 None admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:46:44.484589 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6e35964-d4f7-4d1c-9f7f-b4559148bef2 None admin] Validating token access rules against request {{(pid=80396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:46:44.522739 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66a9d20c-0331-404a-b71d-d1102d11dd7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:46:44.523329 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a9d20c-0331-404a-b71d-d1102d11dd7f None admin] REQUEST_METHOD: `POST` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:46:44.523610 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a9d20c-0331-404a-b71d-d1102d11dd7f None admin] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:46:44.523891 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a9d20c-0331-404a-b71d-d1102d11dd7f None admin] PATH_INFO: `/v3/services` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:46:44.524616 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66a9d20c-0331-404a-b71d-d1102d11dd7f None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:46:44.526140 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66a9d20c-0331-404a-b71d-d1102d11dd7f None admin] RBAC: Authorization granted {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:46:44.590618 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2f18507-3c45-4eb6-9c35-5a4bbef48e91 None admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:46:44.618515 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 372/741] 10.222.0.59 () {60 vars in 1141 bytes} [Thu Jun 2 15:46:44 2022] POST /identity/v3/services => generated 251 bytes in 250 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 15:46:44.619617 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66a9d20c-0331-404a-b71d-d1102d11dd7f None admin] Authenticating user token {{(pid=80396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:46:44.639943 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6773359b-b01c-42f1-95ec-5eb235562789 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:46:44.640675 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6773359b-b01c-42f1-95ec-5eb235562789 None admin] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:46:44.640958 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6773359b-b01c-42f1-95ec-5eb235562789 None admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:46:44.641228 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6773359b-b01c-42f1-95ec-5eb235562789 None admin] PATH_INFO: `/v3/domains` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:46:44.643198 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6773359b-b01c-42f1-95ec-5eb235562789 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80395) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 15:46:44.643415 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6773359b-b01c-42f1-95ec-5eb235562789 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:46:44.644864 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6773359b-b01c-42f1-95ec-5eb235562789 None admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:46:44.659960 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 370/742] 10.222.0.59 () {56 vars in 1109 bytes} [Thu Jun 2 15:46:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 15:46:44.661227 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09529ef7-2c0c-46ad-b689-45bd94b5ea12 None None] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:46:44.662222 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09529ef7-2c0c-46ad-b689-45bd94b5ea12 None None] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:46:44.662514 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09529ef7-2c0c-46ad-b689-45bd94b5ea12 None None] PATH_INFO: `/` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:46:44.666124 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 371/743] 10.222.0.59 () {54 vars in 926 bytes} [Thu Jun 2 15:46:44 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 15:46:44.666124 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09529ef7-2c0c-46ad-b689-45bd94b5ea12 None None] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:46:44.698580 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writing DB stats keystone:SELECT=100 {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:46:44.753383 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG dbcounter [-] [80396] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:46:44.780198 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66a9d20c-0331-404a-b71d-d1102d11dd7f None admin] Validating token access rules against request {{(pid=80396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:46:44.813059 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09529ef7-2c0c-46ad-b689-45bd94b5ea12 None None] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:46:44.831121 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3293aa3-abb3-4b9f-a12b-05319739362c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:46:44.831911 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3293aa3-abb3-4b9f-a12b-05319739362c None admin] REQUEST_METHOD: `GET` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:46:44.832195 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3293aa3-abb3-4b9f-a12b-05319739362c None admin] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:46:44.832473 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3293aa3-abb3-4b9f-a12b-05319739362c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:46:44.846159 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3293aa3-abb3-4b9f-a12b-05319739362c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:46:44.847642 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3293aa3-abb3-4b9f-a12b-05319739362c None admin] RBAC: Authorization granted {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:46:44.854260 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08c319e4-9e29-43d4-8a2a-17fa0050aee8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:46:44.855552 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c319e4-9e29-43d4-8a2a-17fa0050aee8 None admin] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:46:44.855834 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c319e4-9e29-43d4-8a2a-17fa0050aee8 None admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:46:44.856104 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c319e4-9e29-43d4-8a2a-17fa0050aee8 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:46:44.865852 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08c319e4-9e29-43d4-8a2a-17fa0050aee8 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:46:44.865852 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08c319e4-9e29-43d4-8a2a-17fa0050aee8 None admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:46:44.868713 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application [None req-f3293aa3-abb3-4b9f-a12b-05319739362c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 15:46:44.868713 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 15:46:44.868713 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 15:46:44.868713 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 15:46:44.868713 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 15:46:44.868713 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 15:46:44.868713 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 15:46:44.868713 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 15:46:44.868713 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 15:46:44.868713 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 15:46:44.868713 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 15:46:44.868713 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 15:46:44.868713 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 02 15:46:44.868713 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 02 15:46:44.868713 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 02 15:46:44.869555 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 02 15:46:44.869555 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 15:46:44.869555 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 15:46:44.869555 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 15:46:44.869555 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 15:46:44.869555 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 15:46:44.869555 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 15:46:44.869555 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 15:46:44.869555 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application with Lock( Jun 02 15:46:44.869555 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 15:46:44.869555 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application return self._enter() Jun 02 15:46:44.869555 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 15:46:44.869555 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 15:46:44.869555 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 15:46:44.869555 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application return self.creator() Jun 02 15:46:44.869555 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 15:46:44.869555 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application created_value = creator( Jun 02 15:46:44.870880 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 02 15:46:44.870880 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 02 15:46:44.870880 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 15:46:44.870880 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application Jun 02 15:46:44.870880 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 373/744] 10.222.0.59 () {56 vars in 1108 bytes} [Thu Jun 2 15:46:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 251 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 15:46:44.872385 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1573fb2c-7816-42fe-bc60-9470f2d350d9 None None] REQUEST_METHOD: `POST` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:46:44.872385 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1573fb2c-7816-42fe-bc60-9470f2d350d9 None None] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:46:44.872385 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1573fb2c-7816-42fe-bc60-9470f2d350d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:46:44.881065 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application [None req-08c319e4-9e29-43d4-8a2a-17fa0050aee8 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 02 15:46:44.881065 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 15:46:44.881065 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 15:46:44.881065 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 15:46:44.881065 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 15:46:44.881065 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 15:46:44.881065 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 15:46:44.881065 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 15:46:44.881065 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 15:46:44.881065 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 15:46:44.881065 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 15:46:44.881065 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 15:46:44.881065 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 02 15:46:44.881065 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 02 15:46:44.881065 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 02 15:46:44.882024 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 02 15:46:44.882024 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 15:46:44.882024 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 15:46:44.882024 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 15:46:44.882024 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 15:46:44.882024 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 15:46:44.882024 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 15:46:44.882024 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 15:46:44.882024 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application with Lock( Jun 02 15:46:44.882024 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 15:46:44.882024 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self._enter() Jun 02 15:46:44.882024 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 15:46:44.882024 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 15:46:44.882024 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 15:46:44.882024 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self.creator() Jun 02 15:46:44.882024 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 15:46:44.882024 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application created_value = creator( Jun 02 15:46:44.883131 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 02 15:46:44.883131 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 02 15:46:44.883131 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 02 15:46:44.883131 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 02 15:46:44.883131 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 02 15:46:44.883131 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 02 15:46:44.883131 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 02 15:46:44.883131 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application Jun 02 15:46:44.883131 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 372/745] 10.222.0.59 () {56 vars in 1111 bytes} [Thu Jun 2 15:46:44 2022] GET /identity/v3/projects/service => generated 88 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 02 15:46:44.885204 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4539f5dd-bca8-419d-8027-ad15974f2694 None None] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:46:44.885204 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4539f5dd-bca8-419d-8027-ad15974f2694 None None] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:46:44.885204 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4539f5dd-bca8-419d-8027-ad15974f2694 None None] PATH_INFO: `/` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:46:44.886102 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 373/746] 10.222.0.59 () {54 vars in 926 bytes} [Thu Jun 2 15:46:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 15:46:44.886834 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4539f5dd-bca8-419d-8027-ad15974f2694 None None] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:46:44.892098 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.auth.core [None req-1573fb2c-7816-42fe-bc60-9470f2d350d9 None None] MFA Rules not processed for user `400d1f4db9de49638549e5db29a041e1`. Rule list: `[]` (Enabled: `True`). {{(pid=80396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 15:46:44.893411 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.fernet_utils [None req-1573fb2c-7816-42fe-bc60-9470f2d350d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 15:46:44.966446 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 374/747] 10.222.0.59 () {58 vars in 1023 bytes} [Thu Jun 2 15:46:44 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 02 15:46:44.967562 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa95228a-5230-43d3-b46d-8e1da10f619c None None] REQUEST_METHOD: `POST` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:46:44.967853 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa95228a-5230-43d3-b46d-8e1da10f619c None None] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:46:44.968137 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa95228a-5230-43d3-b46d-8e1da10f619c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:46:44.984239 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writing DB stats keystone:SELECT=100 {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:46:44.992815 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.auth.core [None req-aa95228a-5230-43d3-b46d-8e1da10f619c None None] MFA Rules not processed for user `400d1f4db9de49638549e5db29a041e1`. Rule list: `[]` (Enabled: `True`). {{(pid=80396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 15:46:44.996607 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.fernet_utils [None req-aa95228a-5230-43d3-b46d-8e1da10f619c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 15:46:45.004003 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4539f5dd-bca8-419d-8027-ad15974f2694 None None] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:46:45.040804 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc11c79a-eeea-41cd-b4ef-7de5c96eeb98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:46:45.041394 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc11c79a-eeea-41cd-b4ef-7de5c96eeb98 None admin] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:46:45.041675 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc11c79a-eeea-41cd-b4ef-7de5c96eeb98 None admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:46:45.041952 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc11c79a-eeea-41cd-b4ef-7de5c96eeb98 None admin] PATH_INFO: `/v3/domains` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:46:45.042728 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc11c79a-eeea-41cd-b4ef-7de5c96eeb98 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80395) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 15:46:45.043039 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc11c79a-eeea-41cd-b4ef-7de5c96eeb98 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:46:45.044911 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc11c79a-eeea-41cd-b4ef-7de5c96eeb98 None admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:46:45.054519 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG dbcounter [-] [80396] Writing DB stats keystone:SELECT=100 {{(pid=80396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:46:45.064134 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 374/748] 10.222.0.59 () {56 vars in 1109 bytes} [Thu Jun 2 15:46:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 15:46:45.064134 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc11c79a-eeea-41cd-b4ef-7de5c96eeb98 None admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:46:45.078102 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 375/749] 10.222.0.59 () {58 vars in 1023 bytes} [Thu Jun 2 15:46:44 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 02 15:46:45.078102 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa95228a-5230-43d3-b46d-8e1da10f619c None None] Authenticating user token {{(pid=80396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:46:45.175560 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc11c79a-eeea-41cd-b4ef-7de5c96eeb98 None admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:46:45.187395 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa95228a-5230-43d3-b46d-8e1da10f619c None None] Validating token access rules against request {{(pid=80396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:46:45.217045 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1004f8d-2c74-4a4b-912f-9cd35d331818 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:46:45.217705 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1004f8d-2c74-4a4b-912f-9cd35d331818 None admin] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:46:45.217992 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1004f8d-2c74-4a4b-912f-9cd35d331818 None admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:46:45.218339 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1004f8d-2c74-4a4b-912f-9cd35d331818 None admin] PATH_INFO: `/v3/projects` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:46:45.219091 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1004f8d-2c74-4a4b-912f-9cd35d331818 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80395) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 15:46:45.219402 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1004f8d-2c74-4a4b-912f-9cd35d331818 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:46:45.220954 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1004f8d-2c74-4a4b-912f-9cd35d331818 None admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:46:45.227181 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2860dee9-9a98-47f9-aedc-6728e205d4ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:46:45.227847 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2860dee9-9a98-47f9-aedc-6728e205d4ad None admin] REQUEST_METHOD: `POST` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:46:45.228132 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2860dee9-9a98-47f9-aedc-6728e205d4ad None admin] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:46:45.228410 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2860dee9-9a98-47f9-aedc-6728e205d4ad None admin] PATH_INFO: `/v3/services` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:46:45.229137 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2860dee9-9a98-47f9-aedc-6728e205d4ad None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:46:45.230537 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2860dee9-9a98-47f9-aedc-6728e205d4ad None admin] RBAC: Authorization granted {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:46:45.234945 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 375/750] 10.222.0.59 () {56 vars in 1148 bytes} [Thu Jun 2 15:46:45 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 15:46:45.235767 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1004f8d-2c74-4a4b-912f-9cd35d331818 None admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:46:45.238383 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writing DB stats keystone:SELECT=100 {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:46:45.307330 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 376/751] 10.222.0.59 () {60 vars in 1141 bytes} [Thu Jun 2 15:46:45 2022] POST /identity/v3/services => generated 240 bytes in 236 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 15:46:45.308194 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2860dee9-9a98-47f9-aedc-6728e205d4ad None admin] Authenticating user token {{(pid=80396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:46:45.347997 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1004f8d-2c74-4a4b-912f-9cd35d331818 None admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:46:45.391426 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG dbcounter [-] [80396] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:46:45.409165 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4fab497-6c0d-42cc-b40f-89e246ddf548 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:46:45.410524 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4fab497-6c0d-42cc-b40f-89e246ddf548 None admin] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:46:45.410979 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4fab497-6c0d-42cc-b40f-89e246ddf548 None admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:46:45.412052 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4fab497-6c0d-42cc-b40f-89e246ddf548 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:46:45.422584 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4fab497-6c0d-42cc-b40f-89e246ddf548 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:46:45.424570 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4fab497-6c0d-42cc-b40f-89e246ddf548 None admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:46:45.444729 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application [None req-d4fab497-6c0d-42cc-b40f-89e246ddf548 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 02 15:46:45.444729 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 15:46:45.444729 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 15:46:45.444729 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 15:46:45.444729 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 15:46:45.444729 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 15:46:45.444729 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 15:46:45.444729 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 15:46:45.444729 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 15:46:45.444729 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 15:46:45.444729 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 15:46:45.444729 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 15:46:45.444729 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 02 15:46:45.444729 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 02 15:46:45.444729 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 02 15:46:45.445743 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 02 15:46:45.445743 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 15:46:45.445743 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 15:46:45.445743 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 15:46:45.445743 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 15:46:45.445743 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 15:46:45.445743 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 15:46:45.445743 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 15:46:45.445743 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application with Lock( Jun 02 15:46:45.445743 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 15:46:45.445743 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self._enter() Jun 02 15:46:45.445743 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 15:46:45.445743 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 15:46:45.445743 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 15:46:45.445743 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self.creator() Jun 02 15:46:45.445743 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 15:46:45.445743 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application created_value = creator( Jun 02 15:46:45.446808 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 02 15:46:45.446808 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 02 15:46:45.446808 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 02 15:46:45.446808 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 02 15:46:45.446808 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 02 15:46:45.446808 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 02 15:46:45.446808 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 02 15:46:45.446808 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application Jun 02 15:46:45.446808 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 376/752] 10.222.0.59 () {56 vars in 1111 bytes} [Thu Jun 2 15:46:45 2022] GET /identity/v3/projects/service => generated 88 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 15:46:45.447969 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4fab497-6c0d-42cc-b40f-89e246ddf548 None admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:46:45.460920 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2860dee9-9a98-47f9-aedc-6728e205d4ad None admin] Validating token access rules against request {{(pid=80396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:46:45.500895 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03357be3-628d-4d36-a528-eef0067e90c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:46:45.502192 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03357be3-628d-4d36-a528-eef0067e90c0 None admin] REQUEST_METHOD: `GET` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:46:45.502735 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03357be3-628d-4d36-a528-eef0067e90c0 None admin] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:46:45.503198 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03357be3-628d-4d36-a528-eef0067e90c0 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:46:45.515739 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03357be3-628d-4d36-a528-eef0067e90c0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 02 15:46:45.516812 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writing DB stats keystone:SELECT=100 {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:46:45.524867 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application [None req-03357be3-628d-4d36-a528-eef0067e90c0 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 02 15:46:45.524867 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 15:46:45.524867 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 15:46:45.524867 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 15:46:45.524867 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 15:46:45.524867 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 15:46:45.524867 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 15:46:45.524867 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 15:46:45.524867 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 15:46:45.524867 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 15:46:45.524867 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 15:46:45.524867 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 15:46:45.524867 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 02 15:46:45.524867 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 02 15:46:45.524867 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 02 15:46:45.524867 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 02 15:46:45.525972 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 02 15:46:45.525972 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 02 15:46:45.525972 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 02 15:46:45.525972 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 02 15:46:45.525972 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 15:46:45.525972 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 15:46:45.525972 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 15:46:45.525972 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 15:46:45.525972 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 15:46:45.525972 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 15:46:45.525972 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 15:46:45.525972 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application with Lock( Jun 02 15:46:45.525972 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 15:46:45.525972 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application return self._enter() Jun 02 15:46:45.525972 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 15:46:45.525972 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 15:46:45.527014 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 15:46:45.527014 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application return self.creator() Jun 02 15:46:45.527014 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 15:46:45.527014 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application created_value = creator( Jun 02 15:46:45.527014 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 02 15:46:45.527014 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 02 15:46:45.527014 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 02 15:46:45.527014 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 02 15:46:45.527014 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 02 15:46:45.527014 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 02 15:46:45.527014 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 02 15:46:45.527014 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application Jun 02 15:46:45.531954 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 377/753] 10.222.0.59 () {56 vars in 1096 bytes} [Thu Jun 2 15:46:45 2022] GET /identity/v3/roles/admin => generated 83 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 15:46:45.532762 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03357be3-628d-4d36-a528-eef0067e90c0 None admin] Authenticating user token {{(pid=80396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:46:45.576038 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4fab497-6c0d-42cc-b40f-89e246ddf548 None admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:46:45.617755 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8734da63-9b81-4271-90fc-4b254c8a52ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:46:45.618844 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8734da63-9b81-4271-90fc-4b254c8a52ba None admin] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:46:45.619389 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8734da63-9b81-4271-90fc-4b254c8a52ba None admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:46:45.620391 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8734da63-9b81-4271-90fc-4b254c8a52ba None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:46:45.621426 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8734da63-9b81-4271-90fc-4b254c8a52ba None admin] RBAC: Adding query filter params (role.id=36214aa6067e4493a555da410f965c5e, scope.project.id=9c87c981909d4b8db02783421818c79b, user.id=11b714eb2dda4460a8ff52215e671bfa) {{(pid=80395) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 15:46:45.622402 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8734da63-9b81-4271-90fc-4b254c8a52ba None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:46:45.624724 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8734da63-9b81-4271-90fc-4b254c8a52ba None admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:46:45.632282 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 377/754] 10.222.0.59 () {56 vars in 1374 bytes} [Thu Jun 2 15:46:45 2022] GET /identity/v3/role_assignments?user.id=11b714eb2dda4460a8ff52215e671bfa&scope.project.id=9c87c981909d4b8db02783421818c79b&role.id=36214aa6067e4493a555da410f965c5e => generated 259 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 15:46:45.633390 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8734da63-9b81-4271-90fc-4b254c8a52ba None admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:46:45.678600 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03357be3-628d-4d36-a528-eef0067e90c0 None admin] Validating token access rules against request {{(pid=80396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:46:45.697012 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG dbcounter [-] [80396] Writing DB stats keystone:SELECT=100 {{(pid=80396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:46:45.757223 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8734da63-9b81-4271-90fc-4b254c8a52ba None admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:46:45.766551 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90d991bf-a077-4580-89a2-d55adcac4d61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:46:45.767228 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d991bf-a077-4580-89a2-d55adcac4d61 None admin] REQUEST_METHOD: `GET` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:46:45.767509 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d991bf-a077-4580-89a2-d55adcac4d61 None admin] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:46:45.767783 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d991bf-a077-4580-89a2-d55adcac4d61 None admin] PATH_INFO: `/v3/projects` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:46:45.768582 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90d991bf-a077-4580-89a2-d55adcac4d61 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80396) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 15:46:45.768889 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90d991bf-a077-4580-89a2-d55adcac4d61 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:46:45.770499 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90d991bf-a077-4580-89a2-d55adcac4d61 None admin] RBAC: Authorization granted {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:46:45.790462 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writing DB stats keystone:SELECT=100 {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:46:45.797862 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 378/755] 10.222.0.59 () {56 vars in 1148 bytes} [Thu Jun 2 15:46:45 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 265 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 15:46:45.800627 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e624c2a-7abd-4201-b556-ebbbcda1be3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:46:45.801596 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e624c2a-7abd-4201-b556-ebbbcda1be3c None admin] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:46:45.802848 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e624c2a-7abd-4201-b556-ebbbcda1be3c None admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:46:45.803332 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e624c2a-7abd-4201-b556-ebbbcda1be3c None admin] PATH_INFO: `/v3/roles` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:46:45.804343 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90d991bf-a077-4580-89a2-d55adcac4d61 None admin] Authenticating user token {{(pid=80396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:46:45.810606 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e624c2a-7abd-4201-b556-ebbbcda1be3c None admin] RBAC: Adding query filter params (name=admin) {{(pid=80395) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 15:46:45.810606 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e624c2a-7abd-4201-b556-ebbbcda1be3c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:46:45.810606 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e624c2a-7abd-4201-b556-ebbbcda1be3c None admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:46:45.819427 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 378/756] 10.222.0.59 () {56 vars in 1099 bytes} [Thu Jun 2 15:46:45 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 15:46:45.825037 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e624c2a-7abd-4201-b556-ebbbcda1be3c None admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:46:45.938319 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90d991bf-a077-4580-89a2-d55adcac4d61 None admin] Validating token access rules against request {{(pid=80396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:46:45.977064 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc045c3d-1f06-4772-9863-a4edc244ffa2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:46:45.977742 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc045c3d-1f06-4772-9863-a4edc244ffa2 None admin] REQUEST_METHOD: `GET` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:46:45.978021 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc045c3d-1f06-4772-9863-a4edc244ffa2 None admin] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:46:45.978314 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc045c3d-1f06-4772-9863-a4edc244ffa2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:46:45.979150 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc045c3d-1f06-4772-9863-a4edc244ffa2 None admin] RBAC: Adding query filter params (role.id=f1e0c25f6e9049e897cb7350c7e54ab3, scope.project.id=9c87c981909d4b8db02783421818c79b, user.id=31bd858bf7674f43a99b77d11bc3c1a3) {{(pid=80396) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 15:46:45.979456 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc045c3d-1f06-4772-9863-a4edc244ffa2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:46:45.980878 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc045c3d-1f06-4772-9863-a4edc244ffa2 None admin] RBAC: Authorization granted {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:46:45.995297 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e624c2a-7abd-4201-b556-ebbbcda1be3c None admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:46:46.000370 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 379/757] 10.222.0.59 () {56 vars in 1374 bytes} [Thu Jun 2 15:46:45 2022] GET /identity/v3/role_assignments?user.id=31bd858bf7674f43a99b77d11bc3c1a3&scope.project.id=9c87c981909d4b8db02783421818c79b&role.id=f1e0c25f6e9049e897cb7350c7e54ab3 => generated 259 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 15:46:46.031269 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b83e8248-160f-4019-add5-4622d2a86de6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:46:46.032229 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b83e8248-160f-4019-add5-4622d2a86de6 None admin] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:46:46.032607 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b83e8248-160f-4019-add5-4622d2a86de6 None admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:46:46.032980 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b83e8248-160f-4019-add5-4622d2a86de6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:46:46.047661 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b83e8248-160f-4019-add5-4622d2a86de6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:46:46.049297 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b83e8248-160f-4019-add5-4622d2a86de6 None admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:46:46.068764 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application [None req-b83e8248-160f-4019-add5-4622d2a86de6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 15:46:46.068764 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 15:46:46.068764 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 15:46:46.068764 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 15:46:46.068764 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 15:46:46.068764 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 15:46:46.068764 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 15:46:46.068764 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 15:46:46.068764 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 15:46:46.068764 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 15:46:46.068764 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 15:46:46.068764 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 15:46:46.068764 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 02 15:46:46.068764 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 02 15:46:46.068764 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 02 15:46:46.069727 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 02 15:46:46.069727 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 15:46:46.069727 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 15:46:46.069727 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 15:46:46.069727 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 15:46:46.069727 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 15:46:46.069727 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 15:46:46.069727 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 15:46:46.069727 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application with Lock( Jun 02 15:46:46.069727 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 15:46:46.069727 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self._enter() Jun 02 15:46:46.069727 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 15:46:46.069727 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 15:46:46.069727 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 15:46:46.069727 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self.creator() Jun 02 15:46:46.069727 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 15:46:46.069727 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application created_value = creator( Jun 02 15:46:46.070997 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 02 15:46:46.070997 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 02 15:46:46.070997 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 15:46:46.070997 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application Jun 02 15:46:46.070997 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 379/758] 10.222.0.59 () {56 vars in 1108 bytes} [Thu Jun 2 15:46:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 246 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 15:46:46.077172 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc045c3d-1f06-4772-9863-a4edc244ffa2 None admin] Authenticating user token {{(pid=80396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:46:46.138393 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG dbcounter [-] [80396] Writing DB stats keystone:SELECT=100 {{(pid=80396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:46:46.255625 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc045c3d-1f06-4772-9863-a4edc244ffa2 None admin] Validating token access rules against request {{(pid=80396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:46:46.293596 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39e9a8e0-e74a-42a5-8090-8753e8f83044 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:46:46.294299 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e9a8e0-e74a-42a5-8090-8753e8f83044 None admin] REQUEST_METHOD: `GET` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:46:46.294584 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e9a8e0-e74a-42a5-8090-8753e8f83044 None admin] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:46:46.294859 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e9a8e0-e74a-42a5-8090-8753e8f83044 None admin] PATH_INFO: `/v3/domains` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:46:46.295580 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39e9a8e0-e74a-42a5-8090-8753e8f83044 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80396) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 15:46:46.295883 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39e9a8e0-e74a-42a5-8090-8753e8f83044 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:46:46.297251 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39e9a8e0-e74a-42a5-8090-8753e8f83044 None admin] RBAC: Authorization granted {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:46:46.315372 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 380/759] 10.222.0.59 () {56 vars in 1109 bytes} [Thu Jun 2 15:46:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 15:46:46.321518 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b83e8248-160f-4019-add5-4622d2a86de6 None admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:46:46.400043 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writing DB stats keystone:SELECT=100 {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:46:46.494749 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b83e8248-160f-4019-add5-4622d2a86de6 None admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:46:46.544620 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f79ee693-c074-4f1a-b464-cbf66fd3cb05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:46:46.545767 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f79ee693-c074-4f1a-b464-cbf66fd3cb05 None admin] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:46:46.546287 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f79ee693-c074-4f1a-b464-cbf66fd3cb05 None admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:46:46.546767 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f79ee693-c074-4f1a-b464-cbf66fd3cb05 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:46:46.554832 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f79ee693-c074-4f1a-b464-cbf66fd3cb05 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:46:46.556552 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f79ee693-c074-4f1a-b464-cbf66fd3cb05 None admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:46:46.571776 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application [None req-f79ee693-c074-4f1a-b464-cbf66fd3cb05 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 02 15:46:46.571776 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 15:46:46.571776 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 15:46:46.571776 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 15:46:46.571776 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 15:46:46.571776 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 15:46:46.571776 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 15:46:46.571776 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 15:46:46.571776 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 15:46:46.571776 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 15:46:46.571776 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 15:46:46.571776 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 15:46:46.571776 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 02 15:46:46.571776 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 02 15:46:46.571776 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 02 15:46:46.571776 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 02 15:46:46.572722 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 15:46:46.572722 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 15:46:46.572722 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 02 15:46:46.572722 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 02 15:46:46.572722 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 02 15:46:46.572722 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 02 15:46:46.572722 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 15:46:46.572722 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 15:46:46.572722 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 15:46:46.572722 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 15:46:46.572722 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 15:46:46.572722 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application with Lock( Jun 02 15:46:46.572722 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 15:46:46.572722 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self._enter() Jun 02 15:46:46.572722 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 15:46:46.572722 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 15:46:46.572722 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 15:46:46.572722 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self.creator() Jun 02 15:46:46.573698 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 15:46:46.573698 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application created_value = creator( Jun 02 15:46:46.573698 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 02 15:46:46.573698 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 02 15:46:46.573698 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 02 15:46:46.573698 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 02 15:46:46.573698 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 02 15:46:46.573698 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 02 15:46:46.573698 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 02 15:46:46.573698 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application Jun 02 15:46:46.580713 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 380/760] 10.222.0.59 () {56 vars in 1093 bytes} [Thu Jun 2 15:46:46 2022] GET /identity/v3/users/nova => generated 82 bytes in 255 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 15:46:46.582394 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39e9a8e0-e74a-42a5-8090-8753e8f83044 None admin] Authenticating user token {{(pid=80396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:46:46.726403 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG dbcounter [-] [80396] Writing DB stats keystone:SELECT=100 {{(pid=80396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:46:46.736198 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39e9a8e0-e74a-42a5-8090-8753e8f83044 None admin] Validating token access rules against request {{(pid=80396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:46:46.790391 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a69ae99-417f-43d5-bab6-0b857009e3de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:46:46.791087 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a69ae99-417f-43d5-bab6-0b857009e3de None admin] REQUEST_METHOD: `GET` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:46:46.791427 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a69ae99-417f-43d5-bab6-0b857009e3de None admin] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:46:46.791705 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a69ae99-417f-43d5-bab6-0b857009e3de None admin] PATH_INFO: `/v3/users` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:46:46.792613 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a69ae99-417f-43d5-bab6-0b857009e3de None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80396) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 15:46:46.792921 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a69ae99-417f-43d5-bab6-0b857009e3de None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:46:46.794535 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a69ae99-417f-43d5-bab6-0b857009e3de None admin] RBAC: Authorization granted {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:46:46.823160 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 381/761] 10.222.0.59 () {56 vars in 1133 bytes} [Thu Jun 2 15:46:46 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 15:46:46.828587 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f79ee693-c074-4f1a-b464-cbf66fd3cb05 None admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:46:46.940665 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writing DB stats keystone:SELECT=100 {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:46:46.947772 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f79ee693-c074-4f1a-b464-cbf66fd3cb05 None admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:46:46.995811 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d85192a-51fc-47e9-9ce9-a745b052129e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:46:46.996608 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d85192a-51fc-47e9-9ce9-a745b052129e None admin] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:46:46.996888 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d85192a-51fc-47e9-9ce9-a745b052129e None admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:46:46.997157 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d85192a-51fc-47e9-9ce9-a745b052129e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:46:47.011433 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d85192a-51fc-47e9-9ce9-a745b052129e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:46:47.012910 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d85192a-51fc-47e9-9ce9-a745b052129e None admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:46:47.035267 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application [None req-9d85192a-51fc-47e9-9ce9-a745b052129e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 15:46:47.035267 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 15:46:47.035267 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 15:46:47.035267 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 15:46:47.035267 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 15:46:47.035267 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 15:46:47.035267 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 15:46:47.035267 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 15:46:47.035267 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 15:46:47.035267 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 15:46:47.035267 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 15:46:47.035267 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 15:46:47.035267 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 02 15:46:47.035267 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 02 15:46:47.035267 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 02 15:46:47.036245 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 02 15:46:47.036245 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 15:46:47.036245 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 15:46:47.036245 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 15:46:47.036245 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 15:46:47.036245 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 15:46:47.036245 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 15:46:47.036245 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 15:46:47.036245 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application with Lock( Jun 02 15:46:47.036245 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 15:46:47.036245 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self._enter() Jun 02 15:46:47.036245 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 15:46:47.036245 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 15:46:47.036245 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 15:46:47.036245 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self.creator() Jun 02 15:46:47.036245 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 15:46:47.036245 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application created_value = creator( Jun 02 15:46:47.037123 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 02 15:46:47.037123 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 02 15:46:47.037123 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 15:46:47.037123 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application Jun 02 15:46:47.037123 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 381/762] 10.222.0.59 () {56 vars in 1108 bytes} [Thu Jun 2 15:46:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 02 15:46:47.043140 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a69ae99-417f-43d5-bab6-0b857009e3de None admin] Authenticating user token {{(pid=80396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:46:47.187204 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a69ae99-417f-43d5-bab6-0b857009e3de None admin] Validating token access rules against request {{(pid=80396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:46:47.227399 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d837f368-6022-4ab7-8a66-0152f52eac14 None None] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:46:47.227740 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d837f368-6022-4ab7-8a66-0152f52eac14 None None] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:46:47.227951 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d837f368-6022-4ab7-8a66-0152f52eac14 None None] PATH_INFO: `/` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:46:47.229457 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 382/763] 10.222.0.59 () {54 vars in 926 bytes} [Thu Jun 2 15:46:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 02 15:46:47.234578 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d857034a-e98b-4ba6-99d6-9d96ff82edb6 None None] REQUEST_METHOD: `POST` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:46:47.234853 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d857034a-e98b-4ba6-99d6-9d96ff82edb6 None None] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:46:47.235124 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d857034a-e98b-4ba6-99d6-9d96ff82edb6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:46:47.257250 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.auth.core [None req-d857034a-e98b-4ba6-99d6-9d96ff82edb6 None None] MFA Rules not processed for user `400d1f4db9de49638549e5db29a041e1`. Rule list: `[]` (Enabled: `True`). {{(pid=80395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 15:46:47.258442 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.fernet_utils [None req-d857034a-e98b-4ba6-99d6-9d96ff82edb6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 15:46:47.264814 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd1441d6-03fe-4cc2-9644-c1b6818d0e04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:46:47.265469 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1441d6-03fe-4cc2-9644-c1b6818d0e04 None admin] REQUEST_METHOD: `GET` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:46:47.265750 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1441d6-03fe-4cc2-9644-c1b6818d0e04 None admin] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:46:47.266019 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1441d6-03fe-4cc2-9644-c1b6818d0e04 None admin] PATH_INFO: `/v3/domains` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:46:47.266758 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd1441d6-03fe-4cc2-9644-c1b6818d0e04 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80396) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 15:46:47.267060 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd1441d6-03fe-4cc2-9644-c1b6818d0e04 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:46:47.269255 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd1441d6-03fe-4cc2-9644-c1b6818d0e04 None admin] RBAC: Authorization granted {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:46:47.305223 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 382/764] 10.222.0.59 () {56 vars in 1109 bytes} [Thu Jun 2 15:46:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 258 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 15:46:47.308235 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd1441d6-03fe-4cc2-9644-c1b6818d0e04 None admin] Authenticating user token {{(pid=80396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:46:47.330452 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG dbcounter [-] [80396] Writing DB stats keystone:SELECT=100 {{(pid=80396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:46:47.348539 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 383/765] 10.222.0.59 () {58 vars in 1023 bytes} [Thu Jun 2 15:46:47 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 02 15:46:47.384568 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d857034a-e98b-4ba6-99d6-9d96ff82edb6 None None] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:46:47.457268 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd1441d6-03fe-4cc2-9644-c1b6818d0e04 None admin] Validating token access rules against request {{(pid=80396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:46:47.512822 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-245f7c01-6f74-4e0c-971a-14638e42c2b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:46:47.513995 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245f7c01-6f74-4e0c-971a-14638e42c2b9 None admin] REQUEST_METHOD: `GET` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:46:47.515481 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245f7c01-6f74-4e0c-971a-14638e42c2b9 None admin] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:46:47.516052 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245f7c01-6f74-4e0c-971a-14638e42c2b9 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:46:47.532327 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-245f7c01-6f74-4e0c-971a-14638e42c2b9 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:46:47.534404 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-245f7c01-6f74-4e0c-971a-14638e42c2b9 None admin] RBAC: Authorization granted {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:46:47.572611 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application [None req-245f7c01-6f74-4e0c-971a-14638e42c2b9 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 02 15:46:47.572611 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 15:46:47.572611 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 15:46:47.572611 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 15:46:47.572611 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 15:46:47.572611 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 15:46:47.572611 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 15:46:47.572611 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 15:46:47.572611 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 15:46:47.572611 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 15:46:47.572611 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 15:46:47.572611 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 15:46:47.572611 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 02 15:46:47.572611 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 02 15:46:47.572611 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 02 15:46:47.573555 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 02 15:46:47.573555 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 15:46:47.573555 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 15:46:47.573555 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 15:46:47.573555 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 15:46:47.573555 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 15:46:47.573555 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 15:46:47.573555 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 15:46:47.573555 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application with Lock( Jun 02 15:46:47.573555 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 15:46:47.573555 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application return self._enter() Jun 02 15:46:47.573555 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 15:46:47.573555 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 15:46:47.573555 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 15:46:47.573555 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application return self.creator() Jun 02 15:46:47.573555 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 15:46:47.573555 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application created_value = creator( Jun 02 15:46:47.574476 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 02 15:46:47.574476 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 02 15:46:47.574476 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 02 15:46:47.574476 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 02 15:46:47.574476 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 02 15:46:47.574476 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 02 15:46:47.574476 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 02 15:46:47.574476 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application Jun 02 15:46:47.581427 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 383/766] 10.222.0.59 () {56 vars in 1111 bytes} [Thu Jun 2 15:46:47 2022] GET /identity/v3/projects/service => generated 88 bytes in 269 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 02 15:46:47.586330 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writing DB stats keystone:SELECT=100 {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:46:47.591427 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-245f7c01-6f74-4e0c-971a-14638e42c2b9 None admin] Authenticating user token {{(pid=80396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:46:47.624494 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d857034a-e98b-4ba6-99d6-9d96ff82edb6 None None] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:46:47.664176 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5087bf6-000b-43c2-a23b-7f6830076681 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:46:47.665341 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5087bf6-000b-43c2-a23b-7f6830076681 None admin] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:46:47.665954 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5087bf6-000b-43c2-a23b-7f6830076681 None admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:46:47.666465 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5087bf6-000b-43c2-a23b-7f6830076681 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:46:47.667323 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5087bf6-000b-43c2-a23b-7f6830076681 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:46:47.668931 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5087bf6-000b-43c2-a23b-7f6830076681 None admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:46:47.683156 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application [None req-a5087bf6-000b-43c2-a23b-7f6830076681 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 02 15:46:47.683156 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 15:46:47.683156 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 02 15:46:47.683156 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 02 15:46:47.683156 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 02 15:46:47.683156 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 02 15:46:47.683156 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 02 15:46:47.683156 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 02 15:46:47.683156 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 02 15:46:47.683156 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application Jun 02 15:46:47.683156 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 02 15:46:47.683156 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application Jun 02 15:46:47.683156 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 15:46:47.683156 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 15:46:47.683156 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 15:46:47.683156 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 15:46:47.684139 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 15:46:47.684139 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 15:46:47.684139 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 15:46:47.684139 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 15:46:47.684139 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 15:46:47.684139 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 15:46:47.684139 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 15:46:47.684139 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 02 15:46:47.684139 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 02 15:46:47.684139 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 02 15:46:47.684139 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 02 15:46:47.684139 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 15:46:47.684139 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 15:46:47.684139 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 15:46:47.684139 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 15:46:47.684139 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 15:46:47.684968 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 15:46:47.684968 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 15:46:47.684968 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application with Lock( Jun 02 15:46:47.684968 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 15:46:47.684968 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self._enter() Jun 02 15:46:47.684968 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 15:46:47.684968 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 15:46:47.684968 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 15:46:47.684968 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self.creator() Jun 02 15:46:47.684968 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 15:46:47.684968 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application created_value = creator( Jun 02 15:46:47.684968 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 02 15:46:47.684968 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 02 15:46:47.684968 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 02 15:46:47.684968 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application Jun 02 15:46:47.688894 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 384/767] 10.222.0.59 () {56 vars in 1129 bytes} [Thu Jun 2 15:46:47 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 305 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 02 15:46:47.695929 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5087bf6-000b-43c2-a23b-7f6830076681 None admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:46:47.767826 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG dbcounter [-] [80396] Writing DB stats keystone:SELECT=100 {{(pid=80396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:46:47.820151 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5087bf6-000b-43c2-a23b-7f6830076681 None admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:46:47.844196 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-245f7c01-6f74-4e0c-971a-14638e42c2b9 None admin] Validating token access rules against request {{(pid=80396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:46:47.870770 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ef58507-7a94-43fc-993a-90663a583165 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:46:47.872098 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef58507-7a94-43fc-993a-90663a583165 None admin] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:46:47.873912 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef58507-7a94-43fc-993a-90663a583165 None admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:46:47.874497 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef58507-7a94-43fc-993a-90663a583165 None admin] PATH_INFO: `/v3/services` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:46:47.875437 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ef58507-7a94-43fc-993a-90663a583165 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=80395) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 15:46:47.876951 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ef58507-7a94-43fc-993a-90663a583165 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:46:47.880600 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ef58507-7a94-43fc-993a-90663a583165 None admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:46:47.893306 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 385/768] 10.222.0.59 () {56 vars in 1124 bytes} [Thu Jun 2 15:46:47 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 15:46:47.910761 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ef58507-7a94-43fc-993a-90663a583165 None admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:46:47.921632 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writing DB stats keystone:SELECT=100 {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:46:47.926934 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e18d3bd0-0483-4d93-bd28-9b18c9db20ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:46:47.928569 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18d3bd0-0483-4d93-bd28-9b18c9db20ef None admin] REQUEST_METHOD: `GET` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:46:47.929074 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18d3bd0-0483-4d93-bd28-9b18c9db20ef None admin] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:46:47.929556 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18d3bd0-0483-4d93-bd28-9b18c9db20ef None admin] PATH_INFO: `/v3/projects` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:46:47.930862 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e18d3bd0-0483-4d93-bd28-9b18c9db20ef None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80396) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 15:46:47.932064 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e18d3bd0-0483-4d93-bd28-9b18c9db20ef None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:46:47.946899 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e18d3bd0-0483-4d93-bd28-9b18c9db20ef None admin] RBAC: Authorization granted {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:46:47.955262 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 384/769] 10.222.0.59 () {56 vars in 1148 bytes} [Thu Jun 2 15:46:47 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 364 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 15:46:47.961301 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e18d3bd0-0483-4d93-bd28-9b18c9db20ef None admin] Authenticating user token {{(pid=80396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:46:48.047053 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ef58507-7a94-43fc-993a-90663a583165 None admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:46:48.102854 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e8ce167-5b58-4728-a988-24b4fc269621 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:46:48.103549 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8ce167-5b58-4728-a988-24b4fc269621 None admin] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:46:48.103846 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8ce167-5b58-4728-a988-24b4fc269621 None admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:46:48.104132 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8ce167-5b58-4728-a988-24b4fc269621 None admin] PATH_INFO: `/v3/services` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:46:48.104865 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e8ce167-5b58-4728-a988-24b4fc269621 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=80395) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 15:46:48.105181 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e8ce167-5b58-4728-a988-24b4fc269621 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:46:48.106608 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e8ce167-5b58-4728-a988-24b4fc269621 None admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:46:48.124711 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 386/770] 10.222.0.59 () {56 vars in 1124 bytes} [Thu Jun 2 15:46:47 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 15:46:48.131730 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e8ce167-5b58-4728-a988-24b4fc269621 None admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:46:48.132743 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e18d3bd0-0483-4d93-bd28-9b18c9db20ef None admin] Validating token access rules against request {{(pid=80396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:46:48.171858 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG dbcounter [-] [80396] Writing DB stats keystone:SELECT=100 {{(pid=80396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:46:48.180189 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-236a6520-c470-4e90-97d4-f149e0239786 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:46:48.181248 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-236a6520-c470-4e90-97d4-f149e0239786 None admin] REQUEST_METHOD: `PUT` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:46:48.181535 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-236a6520-c470-4e90-97d4-f149e0239786 None admin] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:46:48.181812 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-236a6520-c470-4e90-97d4-f149e0239786 None admin] PATH_INFO: `/v3/projects/9c87c981909d4b8db02783421818c79b/users/52f9fe4b13574516bb0a8e2aa11a61e8/roles/f1e0c25f6e9049e897cb7350c7e54ab3` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:46:48.184878 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-236a6520-c470-4e90-97d4-f149e0239786 None admin] RBAC: Authorizing `identity:create_grant(project_id=9c87c981909d4b8db02783421818c79b, user_id=52f9fe4b13574516bb0a8e2aa11a61e8, role_id=f1e0c25f6e9049e897cb7350c7e54ab3)` {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:46:48.186869 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-236a6520-c470-4e90-97d4-f149e0239786 None admin] RBAC: Authorization granted {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:46:48.210907 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writing DB stats keystone:SELECT=100 {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:46:48.243344 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e8ce167-5b58-4728-a988-24b4fc269621 None admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:46:48.261806 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 385/771] 10.222.0.59 () {58 vars in 1439 bytes} [Thu Jun 2 15:46:47 2022] PUT /identity/v3/projects/9c87c981909d4b8db02783421818c79b/users/52f9fe4b13574516bb0a8e2aa11a61e8/roles/f1e0c25f6e9049e897cb7350c7e54ab3 => generated 0 bytes in 301 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 02 15:46:48.273759 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f683e8-dfc8-4888-ac57-083441b135e3 None None] REQUEST_METHOD: `GET` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:46:48.274131 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f683e8-dfc8-4888-ac57-083441b135e3 None None] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:46:48.274356 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f683e8-dfc8-4888-ac57-083441b135e3 None None] PATH_INFO: `/` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:46:48.280853 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 386/772] 10.222.0.59 () {54 vars in 926 bytes} [Thu Jun 2 15:46:48 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 15:46:48.303485 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538b93d1-f366-4465-ae66-8a668e58c266 None None] REQUEST_METHOD: `POST` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:46:48.303485 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538b93d1-f366-4465-ae66-8a668e58c266 None None] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:46:48.303485 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538b93d1-f366-4465-ae66-8a668e58c266 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:46:48.311995 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12b279d9-343f-4a50-bc56-4253481e433e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:46:48.312672 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b279d9-343f-4a50-bc56-4253481e433e None admin] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:46:48.314378 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b279d9-343f-4a50-bc56-4253481e433e None admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:46:48.314676 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b279d9-343f-4a50-bc56-4253481e433e None admin] PATH_INFO: `/v3/endpoints` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:46:48.315499 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12b279d9-343f-4a50-bc56-4253481e433e None admin] RBAC: Adding query filter params (interface=public, service_id=c373e71a0af6415d8789806a36667a64, region_id=RegionOne) {{(pid=80395) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 15:46:48.316899 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12b279d9-343f-4a50-bc56-4253481e433e None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:46:48.320484 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12b279d9-343f-4a50-bc56-4253481e433e None admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:46:48.328472 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.auth.core [None req-538b93d1-f366-4465-ae66-8a668e58c266 None None] MFA Rules not processed for user `400d1f4db9de49638549e5db29a041e1`. Rule list: `[]` (Enabled: `True`). {{(pid=80396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 15:46:48.332510 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.fernet_utils [None req-538b93d1-f366-4465-ae66-8a668e58c266 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 15:46:48.339463 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 387/773] 10.222.0.59 () {56 vars in 1251 bytes} [Thu Jun 2 15:46:48 2022] GET /identity/v3/endpoints?service_id=c373e71a0af6415d8789806a36667a64&interface=public®ion_id=RegionOne => generated 194 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 15:46:48.349846 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12b279d9-343f-4a50-bc56-4253481e433e None admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:46:48.455083 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 387/774] 10.222.0.59 () {58 vars in 1023 bytes} [Thu Jun 2 15:46:48 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 02 15:46:48.487033 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-538b93d1-f366-4465-ae66-8a668e58c266 None None] Authenticating user token {{(pid=80396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:46:48.510488 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12b279d9-343f-4a50-bc56-4253481e433e None admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:46:48.546510 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b397731-8457-46ba-9d22-4bab5f0893ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:46:48.547490 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b397731-8457-46ba-9d22-4bab5f0893ad None admin] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:46:48.547945 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b397731-8457-46ba-9d22-4bab5f0893ad None admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:46:48.548398 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b397731-8457-46ba-9d22-4bab5f0893ad None admin] PATH_INFO: `/v3/services` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:46:48.549288 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b397731-8457-46ba-9d22-4bab5f0893ad None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:46:48.550914 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b397731-8457-46ba-9d22-4bab5f0893ad None admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:46:48.554904 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writing DB stats keystone:SELECT=100 {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:46:48.557749 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 388/775] 10.222.0.59 () {56 vars in 1087 bytes} [Thu Jun 2 15:46:48 2022] GET /identity/v3/services => generated 772 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 15:46:48.637987 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c00badf8-cdac-4ed9-9738-01d84c118678 None None] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:46:48.639123 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c00badf8-cdac-4ed9-9738-01d84c118678 None None] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:46:48.639613 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c00badf8-cdac-4ed9-9738-01d84c118678 None None] PATH_INFO: `/` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:46:48.641638 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 389/776] 10.222.0.59 () {54 vars in 926 bytes} [Thu Jun 2 15:46:48 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 02 15:46:48.644068 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-538b93d1-f366-4465-ae66-8a668e58c266 None None] Validating token access rules against request {{(pid=80396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:46:48.647950 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a3a2e6-db52-4587-b183-52cf54fc2b9f None None] REQUEST_METHOD: `POST` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:46:48.648283 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a3a2e6-db52-4587-b183-52cf54fc2b9f None None] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:46:48.648518 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a3a2e6-db52-4587-b183-52cf54fc2b9f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:46:48.672905 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.auth.core [None req-e7a3a2e6-db52-4587-b183-52cf54fc2b9f None None] MFA Rules not processed for user `400d1f4db9de49638549e5db29a041e1`. Rule list: `[]` (Enabled: `True`). {{(pid=80395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 15:46:48.674725 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.fernet_utils [None req-e7a3a2e6-db52-4587-b183-52cf54fc2b9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 15:46:48.683070 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG dbcounter [-] [80396] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:46:48.715860 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5277d355-671c-40ce-b647-ddf95c5b58ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:46:48.716667 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5277d355-671c-40ce-b647-ddf95c5b58ca None admin] REQUEST_METHOD: `GET` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:46:48.716952 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5277d355-671c-40ce-b647-ddf95c5b58ca None admin] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:46:48.717234 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5277d355-671c-40ce-b647-ddf95c5b58ca None admin] PATH_INFO: `/v3/services/network` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:46:48.717902 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5277d355-671c-40ce-b647-ddf95c5b58ca None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:46:48.719348 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5277d355-671c-40ce-b647-ddf95c5b58ca None admin] RBAC: Authorization granted {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:46:48.737341 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application [None req-5277d355-671c-40ce-b647-ddf95c5b58ca None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Jun 02 15:46:48.737341 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 15:46:48.737341 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 02 15:46:48.737341 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 02 15:46:48.737341 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 02 15:46:48.737341 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 02 15:46:48.737341 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 02 15:46:48.737341 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 02 15:46:48.737341 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jun 02 15:46:48.737341 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application Jun 02 15:46:48.737341 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 02 15:46:48.737341 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application Jun 02 15:46:48.737341 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 15:46:48.737341 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 15:46:48.737341 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 15:46:48.737341 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 15:46:48.737341 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 15:46:48.738445 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 15:46:48.738445 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 15:46:48.738445 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 15:46:48.738445 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 15:46:48.738445 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 15:46:48.738445 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 15:46:48.738445 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 02 15:46:48.738445 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 02 15:46:48.738445 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 02 15:46:48.738445 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 02 15:46:48.738445 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 15:46:48.738445 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 15:46:48.738445 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 15:46:48.738445 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 15:46:48.738445 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 15:46:48.738445 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 15:46:48.739339 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 15:46:48.739339 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application with Lock( Jun 02 15:46:48.739339 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 15:46:48.739339 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application return self._enter() Jun 02 15:46:48.739339 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 15:46:48.739339 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 15:46:48.739339 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 15:46:48.739339 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application return self.creator() Jun 02 15:46:48.739339 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 15:46:48.739339 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application created_value = creator( Jun 02 15:46:48.739339 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 02 15:46:48.739339 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 02 15:46:48.739339 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jun 02 15:46:48.739339 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application Jun 02 15:46:48.740644 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 388/777] 10.222.0.59 () {56 vars in 1111 bytes} [Thu Jun 2 15:46:48 2022] GET /identity/v3/services/network => generated 88 bytes in 254 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 15:46:48.749490 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5277d355-671c-40ce-b647-ddf95c5b58ca None admin] Authenticating user token {{(pid=80396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:46:48.810335 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 390/778] 10.222.0.59 () {58 vars in 1023 bytes} [Thu Jun 2 15:46:48 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 02 15:46:48.811732 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffcd53c5-dad3-4029-8b33-fdf6d385a7fb None None] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:46:48.812026 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffcd53c5-dad3-4029-8b33-fdf6d385a7fb None None] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:46:48.812303 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffcd53c5-dad3-4029-8b33-fdf6d385a7fb None None] PATH_INFO: `/` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:46:48.813813 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 391/779] 10.222.0.59 () {54 vars in 926 bytes} [Thu Jun 2 15:46:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 15:46:48.820039 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6fd6ac1-3679-4135-8f94-fcd8380ffb75 None None] REQUEST_METHOD: `POST` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:46:48.820554 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6fd6ac1-3679-4135-8f94-fcd8380ffb75 None None] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:46:48.820981 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6fd6ac1-3679-4135-8f94-fcd8380ffb75 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:46:48.842168 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.auth.core [None req-f6fd6ac1-3679-4135-8f94-fcd8380ffb75 None None] MFA Rules not processed for user `400d1f4db9de49638549e5db29a041e1`. Rule list: `[]` (Enabled: `True`). {{(pid=80395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 15:46:48.843584 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.fernet_utils [None req-f6fd6ac1-3679-4135-8f94-fcd8380ffb75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 15:46:48.891881 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5277d355-671c-40ce-b647-ddf95c5b58ca None admin] Validating token access rules against request {{(pid=80396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:46:48.920188 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 392/780] 10.222.0.59 () {58 vars in 1023 bytes} [Thu Jun 2 15:46:48 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 02 15:46:48.926909 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6fd6ac1-3679-4135-8f94-fcd8380ffb75 None None] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:46:48.936222 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a322c255-280f-4947-bcab-35958d6962de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:46:48.937294 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a322c255-280f-4947-bcab-35958d6962de None admin] REQUEST_METHOD: `GET` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:46:48.937778 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a322c255-280f-4947-bcab-35958d6962de None admin] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:46:48.938251 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a322c255-280f-4947-bcab-35958d6962de None admin] PATH_INFO: `/v3/services` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:46:48.938970 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a322c255-280f-4947-bcab-35958d6962de None admin] RBAC: Adding query filter params (name=network) {{(pid=80396) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 15:46:48.939277 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a322c255-280f-4947-bcab-35958d6962de None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:46:48.940700 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a322c255-280f-4947-bcab-35958d6962de None admin] RBAC: Authorization granted {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:46:48.947024 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 389/781] 10.222.0.59 () {56 vars in 1112 bytes} [Thu Jun 2 15:46:48 2022] GET /identity/v3/services?name=network => generated 124 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 15:46:48.952217 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a322c255-280f-4947-bcab-35958d6962de None admin] Authenticating user token {{(pid=80396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:46:49.008439 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writing DB stats keystone:SELECT=100 {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:46:49.011064 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG dbcounter [-] [80396] Writing DB stats keystone:SELECT=100 {{(pid=80396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:46:49.054497 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6fd6ac1-3679-4135-8f94-fcd8380ffb75 None None] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:46:49.080923 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a322c255-280f-4947-bcab-35958d6962de None admin] Validating token access rules against request {{(pid=80396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:46:49.093836 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7178a403-e801-42d3-bb04-616ab5438eaa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:46:49.094858 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7178a403-e801-42d3-bb04-616ab5438eaa None admin] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:46:49.095374 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7178a403-e801-42d3-bb04-616ab5438eaa None admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:46:49.095791 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7178a403-e801-42d3-bb04-616ab5438eaa None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:46:49.109643 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7178a403-e801-42d3-bb04-616ab5438eaa None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 02 15:46:49.118979 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application [None req-7178a403-e801-42d3-bb04-616ab5438eaa None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 02 15:46:49.118979 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 15:46:49.118979 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 15:46:49.118979 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 15:46:49.118979 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 15:46:49.118979 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 15:46:49.118979 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 15:46:49.118979 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 15:46:49.118979 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 15:46:49.118979 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 15:46:49.118979 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 15:46:49.118979 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 15:46:49.118979 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 02 15:46:49.118979 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 02 15:46:49.118979 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 02 15:46:49.118979 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 02 15:46:49.119945 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 02 15:46:49.119945 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 02 15:46:49.119945 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 02 15:46:49.119945 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 02 15:46:49.119945 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 15:46:49.119945 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 15:46:49.119945 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 15:46:49.119945 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 15:46:49.119945 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 15:46:49.119945 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 15:46:49.119945 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 15:46:49.119945 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application with Lock( Jun 02 15:46:49.119945 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 15:46:49.119945 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self._enter() Jun 02 15:46:49.119945 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 15:46:49.119945 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 15:46:49.120776 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 15:46:49.120776 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self.creator() Jun 02 15:46:49.120776 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 15:46:49.120776 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application created_value = creator( Jun 02 15:46:49.120776 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 02 15:46:49.120776 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 02 15:46:49.120776 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 02 15:46:49.120776 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 02 15:46:49.120776 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 02 15:46:49.120776 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 02 15:46:49.120776 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 02 15:46:49.120776 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application Jun 02 15:46:49.123043 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cd49ce4-d23c-4096-97c4-ba0eac14dd80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:46:49.123777 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd49ce4-d23c-4096-97c4-ba0eac14dd80 None admin] REQUEST_METHOD: `GET` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:46:49.123930 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 393/782] 10.222.0.59 () {56 vars in 1096 bytes} [Thu Jun 2 15:46:48 2022] GET /identity/v3/roles/admin => generated 83 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 15:46:49.124343 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd49ce4-d23c-4096-97c4-ba0eac14dd80 None admin] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:46:49.124851 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd49ce4-d23c-4096-97c4-ba0eac14dd80 None admin] PATH_INFO: `/v3/services` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:46:49.124963 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7178a403-e801-42d3-bb04-616ab5438eaa None admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:46:49.125899 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cd49ce4-d23c-4096-97c4-ba0eac14dd80 None admin] RBAC: Adding query filter params (type=network) {{(pid=80396) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 15:46:49.126377 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cd49ce4-d23c-4096-97c4-ba0eac14dd80 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:46:49.128265 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cd49ce4-d23c-4096-97c4-ba0eac14dd80 None admin] RBAC: Authorization granted {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:46:49.135601 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 390/783] 10.222.0.59 () {56 vars in 1112 bytes} [Thu Jun 2 15:46:48 2022] GET /identity/v3/services?type=network => generated 350 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 15:46:49.136631 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cd49ce4-d23c-4096-97c4-ba0eac14dd80 None admin] Authenticating user token {{(pid=80396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:46:49.260717 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cd49ce4-d23c-4096-97c4-ba0eac14dd80 None admin] Validating token access rules against request {{(pid=80396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:46:49.262259 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7178a403-e801-42d3-bb04-616ab5438eaa None admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:46:49.274667 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG dbcounter [-] [80396] Writing DB stats keystone:SELECT=100 {{(pid=80396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:46:49.284093 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writing DB stats keystone:SELECT=100 {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:46:49.301453 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1c69a6f-925d-4fff-b50d-a8586354ef3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:46:49.302285 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c69a6f-925d-4fff-b50d-a8586354ef3a None admin] REQUEST_METHOD: `GET` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:46:49.302647 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c69a6f-925d-4fff-b50d-a8586354ef3a None admin] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:46:49.302996 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c69a6f-925d-4fff-b50d-a8586354ef3a None admin] PATH_INFO: `/v3/roles` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:46:49.303243 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e921e28-a111-48e3-ac4e-33605eeeca8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:46:49.303898 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1c69a6f-925d-4fff-b50d-a8586354ef3a None admin] RBAC: Adding query filter params (name=admin) {{(pid=80396) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 15:46:49.304271 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1c69a6f-925d-4fff-b50d-a8586354ef3a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:46:49.304494 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e921e28-a111-48e3-ac4e-33605eeeca8f None admin] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:46:49.304946 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e921e28-a111-48e3-ac4e-33605eeeca8f None admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:46:49.305374 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e921e28-a111-48e3-ac4e-33605eeeca8f None admin] PATH_INFO: `/v3/roles/service` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:46:49.306002 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1c69a6f-925d-4fff-b50d-a8586354ef3a None admin] RBAC: Authorization granted {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:46:49.321626 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 391/784] 10.222.0.59 () {56 vars in 1099 bytes} [Thu Jun 2 15:46:49 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 15:46:49.321626 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1c69a6f-925d-4fff-b50d-a8586354ef3a None admin] Authenticating user token {{(pid=80396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:46:49.323450 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e921e28-a111-48e3-ac4e-33605eeeca8f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 02 15:46:49.331881 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application [None req-0e921e28-a111-48e3-ac4e-33605eeeca8f None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 02 15:46:49.331881 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 15:46:49.331881 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 15:46:49.331881 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 15:46:49.331881 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 15:46:49.331881 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 15:46:49.331881 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 15:46:49.331881 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 15:46:49.331881 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 15:46:49.331881 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 15:46:49.331881 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 15:46:49.331881 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 15:46:49.331881 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 02 15:46:49.331881 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 02 15:46:49.331881 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 02 15:46:49.331881 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 02 15:46:49.332774 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 02 15:46:49.332774 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 02 15:46:49.332774 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 02 15:46:49.332774 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 02 15:46:49.332774 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 15:46:49.332774 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 15:46:49.332774 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 15:46:49.332774 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 15:46:49.332774 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 15:46:49.332774 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 15:46:49.332774 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 15:46:49.332774 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application with Lock( Jun 02 15:46:49.332774 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 15:46:49.332774 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self._enter() Jun 02 15:46:49.332774 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 15:46:49.332774 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 15:46:49.333727 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 15:46:49.333727 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self.creator() Jun 02 15:46:49.333727 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 15:46:49.333727 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application created_value = creator( Jun 02 15:46:49.333727 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 02 15:46:49.333727 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 02 15:46:49.333727 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 02 15:46:49.333727 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 02 15:46:49.333727 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 02 15:46:49.333727 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 02 15:46:49.333727 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 02 15:46:49.333727 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application Jun 02 15:46:49.336283 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 394/785] 10.222.0.59 () {56 vars in 1102 bytes} [Thu Jun 2 15:46:49 2022] GET /identity/v3/roles/service => generated 85 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 15:46:49.337619 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e921e28-a111-48e3-ac4e-33605eeeca8f None admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:46:49.459441 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1c69a6f-925d-4fff-b50d-a8586354ef3a None admin] Validating token access rules against request {{(pid=80396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:46:49.463660 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e921e28-a111-48e3-ac4e-33605eeeca8f None admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:46:49.502383 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d0bb2ed-3b1c-4d19-bcca-3984a9a64f3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:46:49.503478 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d0bb2ed-3b1c-4d19-bcca-3984a9a64f3a None admin] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:46:49.503943 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d0bb2ed-3b1c-4d19-bcca-3984a9a64f3a None admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:46:49.504401 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d0bb2ed-3b1c-4d19-bcca-3984a9a64f3a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:46:49.504530 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a959719-787b-4a6b-8c92-7586c81d9b96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:46:49.505260 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a959719-787b-4a6b-8c92-7586c81d9b96 None admin] REQUEST_METHOD: `GET` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:46:49.505597 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a959719-787b-4a6b-8c92-7586c81d9b96 None admin] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:46:49.505931 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a959719-787b-4a6b-8c92-7586c81d9b96 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:46:49.506766 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a959719-787b-4a6b-8c92-7586c81d9b96 None admin] RBAC: Adding query filter params (interface=public, service_id=b1605920aa9245ec98d794fc5b488245, region_id=RegionOne) {{(pid=80396) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 15:46:49.507079 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a959719-787b-4a6b-8c92-7586c81d9b96 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:46:49.509189 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a959719-787b-4a6b-8c92-7586c81d9b96 None admin] RBAC: Authorization granted {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:46:49.516620 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d0bb2ed-3b1c-4d19-bcca-3984a9a64f3a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:46:49.518332 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d0bb2ed-3b1c-4d19-bcca-3984a9a64f3a None admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:46:49.519712 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 392/786] 10.222.0.59 () {56 vars in 1251 bytes} [Thu Jun 2 15:46:49 2022] GET /identity/v3/endpoints?service_id=b1605920aa9245ec98d794fc5b488245&interface=public®ion_id=RegionOne => generated 194 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 15:46:49.521391 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a959719-787b-4a6b-8c92-7586c81d9b96 None admin] Authenticating user token {{(pid=80396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:46:49.538645 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application [None req-6d0bb2ed-3b1c-4d19-bcca-3984a9a64f3a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 15:46:49.538645 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 15:46:49.538645 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 15:46:49.538645 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 15:46:49.538645 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 15:46:49.538645 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 15:46:49.538645 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 15:46:49.538645 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 15:46:49.538645 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 15:46:49.538645 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 15:46:49.538645 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 15:46:49.538645 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 15:46:49.538645 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 02 15:46:49.538645 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 02 15:46:49.538645 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 02 15:46:49.539566 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 02 15:46:49.539566 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 15:46:49.539566 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 15:46:49.539566 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 15:46:49.539566 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 15:46:49.539566 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 15:46:49.539566 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 15:46:49.539566 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 15:46:49.539566 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application with Lock( Jun 02 15:46:49.539566 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 15:46:49.539566 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self._enter() Jun 02 15:46:49.539566 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 15:46:49.539566 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 15:46:49.539566 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 15:46:49.539566 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self.creator() Jun 02 15:46:49.539566 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 15:46:49.539566 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application created_value = creator( Jun 02 15:46:49.540463 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 02 15:46:49.540463 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 02 15:46:49.540463 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 15:46:49.540463 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application Jun 02 15:46:49.546172 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 395/787] 10.222.0.59 () {56 vars in 1108 bytes} [Thu Jun 2 15:46:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 15:46:49.547214 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d0bb2ed-3b1c-4d19-bcca-3984a9a64f3a None admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:46:49.569406 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG dbcounter [-] [80396] Writing DB stats keystone:SELECT=100 {{(pid=80396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:46:49.580411 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writing DB stats keystone:SELECT=100 {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:46:49.652578 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a959719-787b-4a6b-8c92-7586c81d9b96 None admin] Validating token access rules against request {{(pid=80396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:46:49.661638 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d0bb2ed-3b1c-4d19-bcca-3984a9a64f3a None admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:46:49.697030 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-899a2e45-b514-4910-87cb-0525a3c25b9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:46:49.697851 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-899a2e45-b514-4910-87cb-0525a3c25b9e None admin] REQUEST_METHOD: `GET` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:46:49.698268 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-899a2e45-b514-4910-87cb-0525a3c25b9e None admin] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:46:49.698690 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-899a2e45-b514-4910-87cb-0525a3c25b9e None admin] PATH_INFO: `/v3/roles` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:46:49.699524 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-899a2e45-b514-4910-87cb-0525a3c25b9e None admin] RBAC: Adding query filter params (name=service) {{(pid=80396) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 15:46:49.700011 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-899a2e45-b514-4910-87cb-0525a3c25b9e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:46:49.700366 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25f1b1dc-0e1d-480f-b250-605d36fd8571 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:46:49.701191 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f1b1dc-0e1d-480f-b250-605d36fd8571 None admin] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:46:49.701631 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f1b1dc-0e1d-480f-b250-605d36fd8571 None admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:46:49.701743 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-899a2e45-b514-4910-87cb-0525a3c25b9e None admin] RBAC: Authorization granted {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:46:49.702191 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f1b1dc-0e1d-480f-b250-605d36fd8571 None admin] PATH_INFO: `/v3/services` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:46:49.703056 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25f1b1dc-0e1d-480f-b250-605d36fd8571 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:46:49.704559 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25f1b1dc-0e1d-480f-b250-605d36fd8571 None admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:46:49.710628 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 396/788] 10.222.0.59 () {56 vars in 1087 bytes} [Thu Jun 2 15:46:49 2022] GET /identity/v3/services => generated 772 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 15:46:49.711614 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25f1b1dc-0e1d-480f-b250-605d36fd8571 None admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:46:49.716837 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 393/789] 10.222.0.59 () {56 vars in 1103 bytes} [Thu Jun 2 15:46:49 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 15:46:49.725925 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-899a2e45-b514-4910-87cb-0525a3c25b9e None admin] Authenticating user token {{(pid=80396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:46:49.890855 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writing DB stats keystone:SELECT=100 {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:46:49.917096 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25f1b1dc-0e1d-480f-b250-605d36fd8571 None admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:46:49.941104 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG dbcounter [-] [80396] Writing DB stats keystone:SELECT=100 {{(pid=80396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:46:49.946065 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-899a2e45-b514-4910-87cb-0525a3c25b9e None admin] Validating token access rules against request {{(pid=80396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:46:49.953523 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23ac4195-7841-4574-acb6-bf23f9fff94b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:46:49.954223 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ac4195-7841-4574-acb6-bf23f9fff94b None admin] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:46:49.954506 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ac4195-7841-4574-acb6-bf23f9fff94b None admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:46:49.955229 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ac4195-7841-4574-acb6-bf23f9fff94b None admin] PATH_INFO: `/v3/domains` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:46:49.955964 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23ac4195-7841-4574-acb6-bf23f9fff94b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80395) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 15:46:49.956368 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23ac4195-7841-4574-acb6-bf23f9fff94b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:46:49.958206 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23ac4195-7841-4574-acb6-bf23f9fff94b None admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:46:49.978565 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 397/790] 10.222.0.59 () {56 vars in 1109 bytes} [Thu Jun 2 15:46:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 267 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 15:46:49.983956 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23ac4195-7841-4574-acb6-bf23f9fff94b None admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:46:49.990846 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d62dd667-b525-416c-9690-4ff35193b50d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:46:49.991553 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d62dd667-b525-416c-9690-4ff35193b50d None admin] REQUEST_METHOD: `GET` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:46:49.991832 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d62dd667-b525-416c-9690-4ff35193b50d None admin] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:46:49.992104 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d62dd667-b525-416c-9690-4ff35193b50d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:46:50.004751 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d62dd667-b525-416c-9690-4ff35193b50d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:46:50.006963 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d62dd667-b525-416c-9690-4ff35193b50d None admin] RBAC: Authorization granted {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:46:50.029165 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application [None req-d62dd667-b525-416c-9690-4ff35193b50d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 15:46:50.029165 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 15:46:50.029165 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 15:46:50.029165 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 15:46:50.029165 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 15:46:50.029165 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 15:46:50.029165 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 15:46:50.029165 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 15:46:50.029165 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 15:46:50.029165 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 15:46:50.029165 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 15:46:50.029165 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 15:46:50.029165 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 02 15:46:50.029165 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 02 15:46:50.029165 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 02 15:46:50.030183 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 02 15:46:50.030183 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 15:46:50.030183 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 15:46:50.030183 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 15:46:50.030183 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 15:46:50.030183 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 15:46:50.030183 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 15:46:50.030183 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 15:46:50.030183 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application with Lock( Jun 02 15:46:50.030183 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 15:46:50.030183 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application return self._enter() Jun 02 15:46:50.030183 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 15:46:50.030183 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 15:46:50.030183 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 15:46:50.030183 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application return self.creator() Jun 02 15:46:50.030183 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 15:46:50.030183 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application created_value = creator( Jun 02 15:46:50.031099 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 02 15:46:50.031099 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 02 15:46:50.031099 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 15:46:50.031099 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application Jun 02 15:46:50.031099 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 394/791] 10.222.0.59 () {56 vars in 1108 bytes} [Thu Jun 2 15:46:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 308 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 02 15:46:50.037804 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d62dd667-b525-416c-9690-4ff35193b50d None admin] Authenticating user token {{(pid=80396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:46:50.151954 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23ac4195-7841-4574-acb6-bf23f9fff94b None admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:46:50.158096 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d62dd667-b525-416c-9690-4ff35193b50d None admin] Validating token access rules against request {{(pid=80396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:46:50.223988 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-396df585-a4ac-4906-8886-b082dcd96ac0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:46:50.225916 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a4c363f-7afc-42f6-9b6b-8558b700fb28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:46:50.226376 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-396df585-a4ac-4906-8886-b082dcd96ac0 None admin] REQUEST_METHOD: `GET` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:46:50.226686 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-396df585-a4ac-4906-8886-b082dcd96ac0 None admin] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:46:50.226860 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a4c363f-7afc-42f6-9b6b-8558b700fb28 None admin] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:46:50.227017 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-396df585-a4ac-4906-8886-b082dcd96ac0 None admin] PATH_INFO: `/v3/domains` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:46:50.227170 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a4c363f-7afc-42f6-9b6b-8558b700fb28 None admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:46:50.227332 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a4c363f-7afc-42f6-9b6b-8558b700fb28 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:46:50.227715 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-396df585-a4ac-4906-8886-b082dcd96ac0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80396) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 15:46:50.228084 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-396df585-a4ac-4906-8886-b082dcd96ac0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:46:50.229415 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-396df585-a4ac-4906-8886-b082dcd96ac0 None admin] RBAC: Authorization granted {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:46:50.235858 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a4c363f-7afc-42f6-9b6b-8558b700fb28 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:46:50.237618 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a4c363f-7afc-42f6-9b6b-8558b700fb28 None admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:46:50.253118 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 395/792] 10.222.0.59 () {56 vars in 1109 bytes} [Thu Jun 2 15:46:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 15:46:50.267367 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-396df585-a4ac-4906-8886-b082dcd96ac0 None admin] Authenticating user token {{(pid=80396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:46:50.276864 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application [None req-7a4c363f-7afc-42f6-9b6b-8558b700fb28 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jun 02 15:46:50.276864 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 15:46:50.276864 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 15:46:50.276864 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 15:46:50.276864 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 15:46:50.276864 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 15:46:50.276864 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 15:46:50.276864 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 15:46:50.276864 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 15:46:50.276864 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 15:46:50.276864 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 15:46:50.276864 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 15:46:50.276864 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 02 15:46:50.276864 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 02 15:46:50.276864 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 02 15:46:50.276864 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 02 15:46:50.277820 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 15:46:50.277820 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 15:46:50.277820 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 02 15:46:50.277820 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 02 15:46:50.277820 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 02 15:46:50.277820 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 02 15:46:50.277820 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 15:46:50.277820 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 15:46:50.277820 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 15:46:50.277820 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 15:46:50.277820 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 15:46:50.277820 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application with Lock( Jun 02 15:46:50.277820 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 15:46:50.277820 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self._enter() Jun 02 15:46:50.277820 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 15:46:50.277820 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 15:46:50.277820 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 15:46:50.277820 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self.creator() Jun 02 15:46:50.278799 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 15:46:50.278799 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application created_value = creator( Jun 02 15:46:50.278799 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 02 15:46:50.278799 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 02 15:46:50.278799 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 02 15:46:50.278799 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 02 15:46:50.278799 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 02 15:46:50.278799 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 02 15:46:50.278799 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jun 02 15:46:50.278799 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application Jun 02 15:46:50.285139 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 398/793] 10.222.0.59 () {56 vars in 1096 bytes} [Thu Jun 2 15:46:49 2022] GET /identity/v3/users/swift => generated 83 bytes in 297 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 15:46:50.290303 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG dbcounter [-] [80396] Writing DB stats keystone:SELECT=100 {{(pid=80396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:46:50.291538 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a4c363f-7afc-42f6-9b6b-8558b700fb28 None admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:46:50.326433 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writing DB stats keystone:SELECT=100 {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:46:50.391459 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-396df585-a4ac-4906-8886-b082dcd96ac0 None admin] Validating token access rules against request {{(pid=80396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:46:50.435027 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-243b436b-b03f-46b0-803e-f1d22d62ca36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:46:50.436219 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-243b436b-b03f-46b0-803e-f1d22d62ca36 None admin] REQUEST_METHOD: `GET` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:46:50.436713 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-243b436b-b03f-46b0-803e-f1d22d62ca36 None admin] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:46:50.437210 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-243b436b-b03f-46b0-803e-f1d22d62ca36 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:46:50.446666 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-243b436b-b03f-46b0-803e-f1d22d62ca36 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:46:50.448408 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-243b436b-b03f-46b0-803e-f1d22d62ca36 None admin] RBAC: Authorization granted {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:46:50.464870 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application [None req-243b436b-b03f-46b0-803e-f1d22d62ca36 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 02 15:46:50.464870 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 15:46:50.464870 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 15:46:50.464870 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 15:46:50.464870 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 15:46:50.464870 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 15:46:50.464870 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 15:46:50.464870 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 15:46:50.464870 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 15:46:50.464870 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 15:46:50.464870 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 15:46:50.464870 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 15:46:50.464870 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 02 15:46:50.464870 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 02 15:46:50.464870 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 02 15:46:50.464870 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 02 15:46:50.465838 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 15:46:50.465838 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 15:46:50.465838 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 02 15:46:50.465838 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 02 15:46:50.465838 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 02 15:46:50.465838 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 02 15:46:50.465838 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 15:46:50.465838 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 15:46:50.465838 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 15:46:50.465838 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 15:46:50.465838 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 15:46:50.465838 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application with Lock( Jun 02 15:46:50.465838 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 15:46:50.465838 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application return self._enter() Jun 02 15:46:50.465838 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 15:46:50.465838 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 15:46:50.465838 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 15:46:50.465838 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application return self.creator() Jun 02 15:46:50.466811 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 15:46:50.466811 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application created_value = creator( Jun 02 15:46:50.466811 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 02 15:46:50.466811 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 02 15:46:50.466811 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 02 15:46:50.466811 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 02 15:46:50.466811 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 02 15:46:50.466811 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 02 15:46:50.466811 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 02 15:46:50.466811 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application Jun 02 15:46:50.469494 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 396/794] 10.222.0.59 () {56 vars in 1117 bytes} [Thu Jun 2 15:46:50 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 15:46:50.476355 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-243b436b-b03f-46b0-803e-f1d22d62ca36 None admin] Authenticating user token {{(pid=80396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:46:50.525632 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a4c363f-7afc-42f6-9b6b-8558b700fb28 None admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:46:50.596074 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-886f39bb-5971-4ff5-bba6-aa2a4555ece2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:46:50.597112 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-886f39bb-5971-4ff5-bba6-aa2a4555ece2 None admin] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:46:50.597606 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-886f39bb-5971-4ff5-bba6-aa2a4555ece2 None admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:46:50.598111 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-886f39bb-5971-4ff5-bba6-aa2a4555ece2 None admin] PATH_INFO: `/v3/users` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:46:50.599631 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-886f39bb-5971-4ff5-bba6-aa2a4555ece2 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80395) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 15:46:50.601107 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-886f39bb-5971-4ff5-bba6-aa2a4555ece2 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:46:50.603785 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-886f39bb-5971-4ff5-bba6-aa2a4555ece2 None admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:46:50.608599 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG dbcounter [-] [80396] Writing DB stats keystone:SELECT=100 {{(pid=80396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:46:50.638525 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 399/795] 10.222.0.59 () {56 vars in 1135 bytes} [Thu Jun 2 15:46:50 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 347 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 15:46:50.644263 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-886f39bb-5971-4ff5-bba6-aa2a4555ece2 None admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:46:50.671164 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-243b436b-b03f-46b0-803e-f1d22d62ca36 None admin] Validating token access rules against request {{(pid=80396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:46:50.735028 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae4a5168-0ed4-4baf-9ab4-db6944fbee7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:46:50.736741 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4a5168-0ed4-4baf-9ab4-db6944fbee7d None admin] REQUEST_METHOD: `GET` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:46:50.737449 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4a5168-0ed4-4baf-9ab4-db6944fbee7d None admin] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:46:50.738746 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4a5168-0ed4-4baf-9ab4-db6944fbee7d None admin] PATH_INFO: `/v3/users` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:46:50.740473 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae4a5168-0ed4-4baf-9ab4-db6944fbee7d None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80396) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 15:46:50.742221 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae4a5168-0ed4-4baf-9ab4-db6944fbee7d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:46:50.744127 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae4a5168-0ed4-4baf-9ab4-db6944fbee7d None admin] RBAC: Authorization granted {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:46:50.780451 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 397/796] 10.222.0.59 () {56 vars in 1149 bytes} [Thu Jun 2 15:46:50 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 304 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 15:46:50.787224 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writing DB stats keystone:SELECT=100 {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:46:50.789413 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae4a5168-0ed4-4baf-9ab4-db6944fbee7d None admin] Authenticating user token {{(pid=80396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:46:50.823622 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-886f39bb-5971-4ff5-bba6-aa2a4555ece2 None admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:46:50.863383 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33658898-1ebc-4eb0-9e69-38176356568e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:46:50.864891 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33658898-1ebc-4eb0-9e69-38176356568e None admin] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:46:50.865165 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33658898-1ebc-4eb0-9e69-38176356568e None admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:46:50.865445 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33658898-1ebc-4eb0-9e69-38176356568e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:46:50.878327 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33658898-1ebc-4eb0-9e69-38176356568e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:46:50.880658 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33658898-1ebc-4eb0-9e69-38176356568e None admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:46:50.902454 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application [None req-33658898-1ebc-4eb0-9e69-38176356568e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 15:46:50.902454 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 15:46:50.902454 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 15:46:50.902454 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 15:46:50.902454 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 15:46:50.902454 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 15:46:50.902454 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 15:46:50.902454 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 15:46:50.902454 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 15:46:50.902454 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 15:46:50.902454 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 15:46:50.902454 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 15:46:50.902454 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 02 15:46:50.902454 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 02 15:46:50.902454 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 02 15:46:50.903425 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 02 15:46:50.903425 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 15:46:50.903425 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 15:46:50.903425 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 15:46:50.903425 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 15:46:50.903425 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 15:46:50.903425 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 15:46:50.903425 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 15:46:50.903425 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application with Lock( Jun 02 15:46:50.903425 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 15:46:50.903425 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self._enter() Jun 02 15:46:50.903425 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 15:46:50.903425 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 15:46:50.903425 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 15:46:50.903425 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self.creator() Jun 02 15:46:50.903425 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 15:46:50.903425 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application created_value = creator( Jun 02 15:46:50.904313 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 02 15:46:50.904313 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 02 15:46:50.904313 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 15:46:50.904313 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application Jun 02 15:46:50.904313 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 400/797] 10.222.0.59 () {56 vars in 1108 bytes} [Thu Jun 2 15:46:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 260 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 15:46:50.909175 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33658898-1ebc-4eb0-9e69-38176356568e None admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:46:50.962710 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae4a5168-0ed4-4baf-9ab4-db6944fbee7d None admin] Validating token access rules against request {{(pid=80396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:46:50.999959 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG dbcounter [-] [80396] Writing DB stats keystone:SELECT=100 {{(pid=80396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:46:51.007440 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb063500-367a-4297-aca3-6c81f02dbd9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:46:51.008493 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb063500-367a-4297-aca3-6c81f02dbd9f None admin] REQUEST_METHOD: `GET` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:46:51.008778 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb063500-367a-4297-aca3-6c81f02dbd9f None admin] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:46:51.009056 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb063500-367a-4297-aca3-6c81f02dbd9f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:46:51.023036 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb063500-367a-4297-aca3-6c81f02dbd9f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:46:51.025146 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb063500-367a-4297-aca3-6c81f02dbd9f None admin] RBAC: Authorization granted {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:46:51.031000 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33658898-1ebc-4eb0-9e69-38176356568e None admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:46:51.053456 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application [None req-fb063500-367a-4297-aca3-6c81f02dbd9f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 15:46:51.053456 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 15:46:51.053456 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 15:46:51.053456 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 15:46:51.053456 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 15:46:51.053456 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 15:46:51.053456 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 15:46:51.053456 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 15:46:51.053456 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 15:46:51.053456 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 15:46:51.053456 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 15:46:51.053456 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 15:46:51.053456 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 02 15:46:51.053456 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 02 15:46:51.053456 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 02 15:46:51.054477 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 02 15:46:51.054477 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 15:46:51.054477 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 15:46:51.054477 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 15:46:51.054477 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 15:46:51.054477 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 15:46:51.054477 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 15:46:51.054477 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 15:46:51.054477 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application with Lock( Jun 02 15:46:51.054477 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 15:46:51.054477 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application return self._enter() Jun 02 15:46:51.054477 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 15:46:51.054477 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 15:46:51.054477 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 15:46:51.054477 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application return self.creator() Jun 02 15:46:51.054477 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 15:46:51.054477 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application created_value = creator( Jun 02 15:46:51.055369 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 02 15:46:51.055369 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 02 15:46:51.055369 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 15:46:51.055369 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application Jun 02 15:46:51.058225 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 398/798] 10.222.0.59 () {56 vars in 1108 bytes} [Thu Jun 2 15:46:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 268 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 15:46:51.060018 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-473577a6-b3f1-4716-8cb4-cdbb131545cf None None] REQUEST_METHOD: `GET` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:46:51.061043 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-473577a6-b3f1-4716-8cb4-cdbb131545cf None None] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:46:51.061336 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-473577a6-b3f1-4716-8cb4-cdbb131545cf None None] PATH_INFO: `/` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:46:51.063085 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 399/799] 10.222.0.59 () {54 vars in 926 bytes} [Thu Jun 2 15:46:51 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 15:46:51.064084 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-473577a6-b3f1-4716-8cb4-cdbb131545cf None None] Authenticating user token {{(pid=80396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:46:51.065427 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writing DB stats keystone:SELECT=100 {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:46:51.081478 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcfd74a1-8140-4cfa-adb1-c253ed951e58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:46:51.082523 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcfd74a1-8140-4cfa-adb1-c253ed951e58 None admin] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:46:51.083628 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcfd74a1-8140-4cfa-adb1-c253ed951e58 None admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:46:51.084154 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcfd74a1-8140-4cfa-adb1-c253ed951e58 None admin] PATH_INFO: `/v3/domains` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:46:51.085202 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcfd74a1-8140-4cfa-adb1-c253ed951e58 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80395) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 15:46:51.085734 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcfd74a1-8140-4cfa-adb1-c253ed951e58 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:46:51.087693 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcfd74a1-8140-4cfa-adb1-c253ed951e58 None admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:46:51.102167 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 401/800] 10.222.0.59 () {56 vars in 1109 bytes} [Thu Jun 2 15:46:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 15:46:51.103990 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f4d54a8-55f7-43d0-9450-e4475faadacd None None] REQUEST_METHOD: `POST` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:46:51.104602 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f4d54a8-55f7-43d0-9450-e4475faadacd None None] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:46:51.105147 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f4d54a8-55f7-43d0-9450-e4475faadacd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:46:51.129171 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.auth.core [None req-5f4d54a8-55f7-43d0-9450-e4475faadacd None None] MFA Rules not processed for user `400d1f4db9de49638549e5db29a041e1`. Rule list: `[]` (Enabled: `True`). {{(pid=80395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 15:46:51.131287 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.fernet_utils [None req-5f4d54a8-55f7-43d0-9450-e4475faadacd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 15:46:51.204804 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-473577a6-b3f1-4716-8cb4-cdbb131545cf None None] Validating token access rules against request {{(pid=80396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:46:51.209704 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 402/801] 10.222.0.59 () {58 vars in 1023 bytes} [Thu Jun 2 15:46:51 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 02 15:46:51.210849 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f4d54a8-55f7-43d0-9450-e4475faadacd None None] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:46:51.249815 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2be29ce9-3135-4527-82ff-03a56d5c6024 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:46:51.250563 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be29ce9-3135-4527-82ff-03a56d5c6024 None admin] REQUEST_METHOD: `GET` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:46:51.250792 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be29ce9-3135-4527-82ff-03a56d5c6024 None admin] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:46:51.251069 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be29ce9-3135-4527-82ff-03a56d5c6024 None admin] PATH_INFO: `/v3/domains` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:46:51.251800 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2be29ce9-3135-4527-82ff-03a56d5c6024 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80396) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 15:46:51.252108 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2be29ce9-3135-4527-82ff-03a56d5c6024 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:46:51.253474 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2be29ce9-3135-4527-82ff-03a56d5c6024 None admin] RBAC: Authorization granted {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:46:51.268544 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 400/802] 10.222.0.59 () {56 vars in 1109 bytes} [Thu Jun 2 15:46:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 15:46:51.269363 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2be29ce9-3135-4527-82ff-03a56d5c6024 None admin] Authenticating user token {{(pid=80396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:46:51.315428 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG dbcounter [-] [80396] Writing DB stats keystone:SELECT=100 {{(pid=80396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:46:51.323685 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f4d54a8-55f7-43d0-9450-e4475faadacd None None] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:46:51.339461 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writing DB stats keystone:SELECT=100 {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:46:51.360932 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12129e5e-b9de-4ce9-ae71-d0e9e219de51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:46:51.361761 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12129e5e-b9de-4ce9-ae71-d0e9e219de51 None admin] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:46:51.362048 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12129e5e-b9de-4ce9-ae71-d0e9e219de51 None admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:46:51.362327 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12129e5e-b9de-4ce9-ae71-d0e9e219de51 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:46:51.369807 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12129e5e-b9de-4ce9-ae71-d0e9e219de51 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:46:51.371275 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12129e5e-b9de-4ce9-ae71-d0e9e219de51 None admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:46:51.375584 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2be29ce9-3135-4527-82ff-03a56d5c6024 None admin] Validating token access rules against request {{(pid=80396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:46:51.385736 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application [None req-12129e5e-b9de-4ce9-ae71-d0e9e219de51 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 02 15:46:51.385736 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 15:46:51.385736 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 15:46:51.385736 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 15:46:51.385736 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 15:46:51.385736 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 15:46:51.385736 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 15:46:51.385736 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 15:46:51.385736 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 15:46:51.385736 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 15:46:51.385736 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 15:46:51.385736 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 15:46:51.385736 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 02 15:46:51.385736 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 02 15:46:51.385736 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 02 15:46:51.386692 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 02 15:46:51.386692 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 15:46:51.386692 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 15:46:51.386692 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 15:46:51.386692 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 15:46:51.386692 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 15:46:51.386692 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 15:46:51.386692 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 15:46:51.386692 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application with Lock( Jun 02 15:46:51.386692 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 15:46:51.386692 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self._enter() Jun 02 15:46:51.386692 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 15:46:51.386692 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 15:46:51.386692 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 15:46:51.386692 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self.creator() Jun 02 15:46:51.386692 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 15:46:51.386692 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application created_value = creator( Jun 02 15:46:51.387581 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 02 15:46:51.387581 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 02 15:46:51.387581 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 02 15:46:51.387581 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 02 15:46:51.387581 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 02 15:46:51.387581 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 02 15:46:51.387581 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 02 15:46:51.387581 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application Jun 02 15:46:51.387581 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 403/803] 10.222.0.59 () {56 vars in 1111 bytes} [Thu Jun 2 15:46:51 2022] GET /identity/v3/projects/service => generated 88 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 15:46:51.388453 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f825fe07-42d3-4ed1-a6af-18a24f6d806c None None] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:46:51.388453 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f825fe07-42d3-4ed1-a6af-18a24f6d806c None None] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:46:51.388698 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f825fe07-42d3-4ed1-a6af-18a24f6d806c None None] PATH_INFO: `/` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:46:51.393864 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 404/804] 10.222.0.59 () {54 vars in 926 bytes} [Thu Jun 2 15:46:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 15:46:51.393864 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f825fe07-42d3-4ed1-a6af-18a24f6d806c None None] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:46:51.419208 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d77f12ce-8fdb-44f1-bf21-4317b671682e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:46:51.419995 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d77f12ce-8fdb-44f1-bf21-4317b671682e None admin] REQUEST_METHOD: `GET` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:46:51.420276 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d77f12ce-8fdb-44f1-bf21-4317b671682e None admin] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:46:51.420549 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d77f12ce-8fdb-44f1-bf21-4317b671682e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:46:51.432010 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d77f12ce-8fdb-44f1-bf21-4317b671682e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 02 15:46:51.439133 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application [None req-d77f12ce-8fdb-44f1-bf21-4317b671682e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 02 15:46:51.439133 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 15:46:51.439133 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 15:46:51.439133 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 15:46:51.439133 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 15:46:51.439133 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 15:46:51.439133 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 15:46:51.439133 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 15:46:51.439133 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 15:46:51.439133 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 15:46:51.439133 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 15:46:51.439133 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 15:46:51.439133 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 02 15:46:51.439133 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 02 15:46:51.439133 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 02 15:46:51.439133 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 02 15:46:51.440039 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 02 15:46:51.440039 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 02 15:46:51.440039 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 02 15:46:51.440039 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 02 15:46:51.440039 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 15:46:51.440039 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 15:46:51.440039 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 15:46:51.440039 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 15:46:51.440039 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 15:46:51.440039 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 15:46:51.440039 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 15:46:51.440039 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application with Lock( Jun 02 15:46:51.440039 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 15:46:51.440039 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application return self._enter() Jun 02 15:46:51.440039 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 15:46:51.440039 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 15:46:51.440904 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 15:46:51.440904 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application return self.creator() Jun 02 15:46:51.440904 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 15:46:51.440904 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application created_value = creator( Jun 02 15:46:51.440904 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 02 15:46:51.440904 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 02 15:46:51.440904 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 02 15:46:51.440904 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 02 15:46:51.440904 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 02 15:46:51.440904 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 02 15:46:51.440904 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 02 15:46:51.440904 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application Jun 02 15:46:51.440904 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 401/805] 10.222.0.59 () {56 vars in 1096 bytes} [Thu Jun 2 15:46:51 2022] GET /identity/v3/roles/admin => generated 83 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 15:46:51.441583 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d77f12ce-8fdb-44f1-bf21-4317b671682e None admin] Authenticating user token {{(pid=80396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:46:51.518047 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f825fe07-42d3-4ed1-a6af-18a24f6d806c None None] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:46:51.547462 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d77f12ce-8fdb-44f1-bf21-4317b671682e None admin] Validating token access rules against request {{(pid=80396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:46:51.548989 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG dbcounter [-] [80396] Writing DB stats keystone:SELECT=100 {{(pid=80396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:46:51.557886 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a20e7a-96d1-48d6-93e5-827093d8756d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:46:51.559047 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a20e7a-96d1-48d6-93e5-827093d8756d None admin] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:46:51.563752 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a20e7a-96d1-48d6-93e5-827093d8756d None admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:46:51.563752 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a20e7a-96d1-48d6-93e5-827093d8756d None admin] PATH_INFO: `/v3/projects/service` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:46:51.568520 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86a20e7a-96d1-48d6-93e5-827093d8756d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:46:51.570734 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86a20e7a-96d1-48d6-93e5-827093d8756d None admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:46:51.584137 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6712212a-201e-43ff-acde-02318c4a72d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:46:51.584790 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6712212a-201e-43ff-acde-02318c4a72d9 None admin] REQUEST_METHOD: `GET` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:46:51.585076 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6712212a-201e-43ff-acde-02318c4a72d9 None admin] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:46:51.585357 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6712212a-201e-43ff-acde-02318c4a72d9 None admin] PATH_INFO: `/v3/projects` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:46:51.586165 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6712212a-201e-43ff-acde-02318c4a72d9 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80396) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 15:46:51.586479 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6712212a-201e-43ff-acde-02318c4a72d9 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:46:51.588116 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application [None req-86a20e7a-96d1-48d6-93e5-827093d8756d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 02 15:46:51.588116 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 15:46:51.588116 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 15:46:51.588116 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 15:46:51.588116 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 15:46:51.588116 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 15:46:51.588116 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 15:46:51.588116 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 15:46:51.588116 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 15:46:51.588116 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 15:46:51.588116 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 15:46:51.588116 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 15:46:51.588116 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 02 15:46:51.588116 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 02 15:46:51.588116 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 02 15:46:51.588955 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 02 15:46:51.588955 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 15:46:51.588955 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 15:46:51.588955 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 15:46:51.588955 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 15:46:51.588955 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 15:46:51.588955 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 15:46:51.588955 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 15:46:51.588955 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application with Lock( Jun 02 15:46:51.588955 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 15:46:51.588955 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self._enter() Jun 02 15:46:51.588955 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 15:46:51.588955 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 15:46:51.588955 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 15:46:51.588955 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self.creator() Jun 02 15:46:51.588955 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 15:46:51.588955 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application created_value = creator( Jun 02 15:46:51.589874 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 02 15:46:51.589874 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 02 15:46:51.589874 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 02 15:46:51.589874 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 02 15:46:51.589874 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 02 15:46:51.589874 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 02 15:46:51.589874 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 02 15:46:51.589874 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application Jun 02 15:46:51.590349 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6712212a-201e-43ff-acde-02318c4a72d9 None admin] RBAC: Authorization granted {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:46:51.593967 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 405/806] 10.222.0.59 () {56 vars in 1111 bytes} [Thu Jun 2 15:46:51 2022] GET /identity/v3/projects/service => generated 88 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 15:46:51.595242 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bdf78f4-73ec-428a-9766-77a5e5d55e22 None None] REQUEST_METHOD: `POST` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:46:51.595528 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bdf78f4-73ec-428a-9766-77a5e5d55e22 None None] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:46:51.595801 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bdf78f4-73ec-428a-9766-77a5e5d55e22 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:46:51.601314 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 402/807] 10.222.0.59 () {56 vars in 1148 bytes} [Thu Jun 2 15:46:51 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 15:46:51.606823 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6712212a-201e-43ff-acde-02318c4a72d9 None admin] Authenticating user token {{(pid=80396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:46:51.613967 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.auth.core [None req-9bdf78f4-73ec-428a-9766-77a5e5d55e22 None None] MFA Rules not processed for user `400d1f4db9de49638549e5db29a041e1`. Rule list: `[]` (Enabled: `True`). {{(pid=80395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 15:46:51.615196 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.fernet_utils [None req-9bdf78f4-73ec-428a-9766-77a5e5d55e22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 15:46:51.641852 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writing DB stats keystone:SELECT=100 {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:46:51.688402 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 406/808] 10.222.0.59 () {58 vars in 1023 bytes} [Thu Jun 2 15:46:51 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 02 15:46:51.689676 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bdf78f4-73ec-428a-9766-77a5e5d55e22 None None] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:46:51.729625 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6712212a-201e-43ff-acde-02318c4a72d9 None admin] Validating token access rules against request {{(pid=80396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:46:51.768231 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d441f37-eeec-4ff5-9297-a287fddf38eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:46:51.768817 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d441f37-eeec-4ff5-9297-a287fddf38eb None admin] REQUEST_METHOD: `GET` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:46:51.769102 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d441f37-eeec-4ff5-9297-a287fddf38eb None admin] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:46:51.769379 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d441f37-eeec-4ff5-9297-a287fddf38eb None admin] PATH_INFO: `/v3/roles` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:46:51.770162 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d441f37-eeec-4ff5-9297-a287fddf38eb None admin] RBAC: Adding query filter params (name=admin) {{(pid=80396) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 15:46:51.771015 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d441f37-eeec-4ff5-9297-a287fddf38eb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:46:51.772513 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d441f37-eeec-4ff5-9297-a287fddf38eb None admin] RBAC: Authorization granted {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:46:51.785687 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 403/809] 10.222.0.59 () {56 vars in 1099 bytes} [Thu Jun 2 15:46:51 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 15:46:51.785687 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d441f37-eeec-4ff5-9297-a287fddf38eb None admin] Authenticating user token {{(pid=80396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:46:51.812199 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG dbcounter [-] [80396] Writing DB stats keystone:SELECT=100 {{(pid=80396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:46:51.812522 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bdf78f4-73ec-428a-9766-77a5e5d55e22 None None] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:46:51.849115 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d23ea243-6f5e-4a21-9b31-05df979ec0ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:46:51.849842 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23ea243-6f5e-4a21-9b31-05df979ec0ac None admin] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:46:51.850158 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23ea243-6f5e-4a21-9b31-05df979ec0ac None admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:46:51.850445 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23ea243-6f5e-4a21-9b31-05df979ec0ac None admin] PATH_INFO: `/v3/projects` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:46:51.851227 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d23ea243-6f5e-4a21-9b31-05df979ec0ac None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80395) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 15:46:51.851543 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d23ea243-6f5e-4a21-9b31-05df979ec0ac None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:46:51.852983 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d23ea243-6f5e-4a21-9b31-05df979ec0ac None admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:46:51.865832 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 407/810] 10.222.0.59 () {56 vars in 1148 bytes} [Thu Jun 2 15:46:51 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 15:46:51.866738 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d23ea243-6f5e-4a21-9b31-05df979ec0ac None admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:46:51.897673 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writing DB stats keystone:SELECT=100 {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:46:51.901120 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d441f37-eeec-4ff5-9297-a287fddf38eb None admin] Validating token access rules against request {{(pid=80396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:46:51.937390 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24ff2952-f431-4f64-920e-4e271d74ff18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:46:51.938299 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ff2952-f431-4f64-920e-4e271d74ff18 None admin] REQUEST_METHOD: `PUT` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:46:51.938590 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ff2952-f431-4f64-920e-4e271d74ff18 None admin] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:46:51.938868 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ff2952-f431-4f64-920e-4e271d74ff18 None admin] PATH_INFO: `/v3/projects/9c87c981909d4b8db02783421818c79b/users/31bd858bf7674f43a99b77d11bc3c1a3/roles/f1e0c25f6e9049e897cb7350c7e54ab3` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:46:51.940975 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24ff2952-f431-4f64-920e-4e271d74ff18 None admin] RBAC: Authorizing `identity:create_grant(project_id=9c87c981909d4b8db02783421818c79b, user_id=31bd858bf7674f43a99b77d11bc3c1a3, role_id=f1e0c25f6e9049e897cb7350c7e54ab3)` {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:46:51.942802 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24ff2952-f431-4f64-920e-4e271d74ff18 None admin] RBAC: Authorization granted {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:46:51.976166 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d23ea243-6f5e-4a21-9b31-05df979ec0ac None admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:46:51.996349 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 404/811] 10.222.0.59 () {58 vars in 1439 bytes} [Thu Jun 2 15:46:51 2022] PUT /identity/v3/projects/9c87c981909d4b8db02783421818c79b/users/31bd858bf7674f43a99b77d11bc3c1a3/roles/f1e0c25f6e9049e897cb7350c7e54ab3 => generated 0 bytes in 214 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 15:46:51.997730 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24ff2952-f431-4f64-920e-4e271d74ff18 None admin] Authenticating user token {{(pid=80396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:46:52.027571 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45b30fca-19da-4d12-860c-aed286db2192 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:46:52.027571 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b30fca-19da-4d12-860c-aed286db2192 None admin] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:46:52.027571 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b30fca-19da-4d12-860c-aed286db2192 None admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:46:52.027571 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b30fca-19da-4d12-860c-aed286db2192 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:46:52.028054 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45b30fca-19da-4d12-860c-aed286db2192 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:46:52.029338 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45b30fca-19da-4d12-860c-aed286db2192 None admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:46:52.048802 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application [None req-45b30fca-19da-4d12-860c-aed286db2192 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 02 15:46:52.048802 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 15:46:52.048802 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 02 15:46:52.048802 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 02 15:46:52.048802 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 02 15:46:52.048802 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 02 15:46:52.048802 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 02 15:46:52.048802 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 02 15:46:52.048802 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 02 15:46:52.048802 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application Jun 02 15:46:52.048802 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 02 15:46:52.048802 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application Jun 02 15:46:52.048802 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 15:46:52.048802 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 15:46:52.048802 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 15:46:52.048802 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 15:46:52.050021 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 15:46:52.050021 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 15:46:52.050021 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 15:46:52.050021 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 15:46:52.050021 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 15:46:52.050021 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 15:46:52.050021 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 15:46:52.050021 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 02 15:46:52.050021 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 02 15:46:52.050021 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 02 15:46:52.050021 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 02 15:46:52.050021 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 15:46:52.050021 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 15:46:52.050021 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 15:46:52.050021 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 15:46:52.050021 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 15:46:52.051088 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 15:46:52.051088 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 15:46:52.051088 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application with Lock( Jun 02 15:46:52.051088 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 15:46:52.051088 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self._enter() Jun 02 15:46:52.051088 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 15:46:52.051088 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 15:46:52.051088 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 15:46:52.051088 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self.creator() Jun 02 15:46:52.051088 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 15:46:52.051088 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application created_value = creator( Jun 02 15:46:52.051088 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 02 15:46:52.051088 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 02 15:46:52.051088 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 02 15:46:52.051088 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application Jun 02 15:46:52.054506 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 408/812] 10.222.0.59 () {56 vars in 1129 bytes} [Thu Jun 2 15:46:51 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 15:46:52.055398 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45b30fca-19da-4d12-860c-aed286db2192 None admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:46:52.125895 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG dbcounter [-] [80396] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:46:52.147567 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24ff2952-f431-4f64-920e-4e271d74ff18 None admin] Validating token access rules against request {{(pid=80396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:46:52.171694 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writing DB stats keystone:SELECT=100 {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:46:52.188138 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45b30fca-19da-4d12-860c-aed286db2192 None admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:46:52.204754 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53bb5b32-ec88-4b60-80b6-610e034e715d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:46:52.205782 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53bb5b32-ec88-4b60-80b6-610e034e715d None admin] REQUEST_METHOD: `GET` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:46:52.206179 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53bb5b32-ec88-4b60-80b6-610e034e715d None admin] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:46:52.206522 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53bb5b32-ec88-4b60-80b6-610e034e715d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:46:52.224885 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53bb5b32-ec88-4b60-80b6-610e034e715d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:46:52.227009 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53bb5b32-ec88-4b60-80b6-610e034e715d None admin] RBAC: Authorization granted {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:46:52.245327 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd5a31a1-4f41-48e7-838e-76a5cc14daf7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:46:52.246378 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd5a31a1-4f41-48e7-838e-76a5cc14daf7 None admin] REQUEST_METHOD: `PUT` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:46:52.246669 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd5a31a1-4f41-48e7-838e-76a5cc14daf7 None admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:46:52.246945 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd5a31a1-4f41-48e7-838e-76a5cc14daf7 None admin] PATH_INFO: `/v3/projects/9c87c981909d4b8db02783421818c79b/users/11b714eb2dda4460a8ff52215e671bfa/roles/36214aa6067e4493a555da410f965c5e` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:46:52.253397 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application [None req-53bb5b32-ec88-4b60-80b6-610e034e715d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 15:46:52.253397 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 15:46:52.253397 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 15:46:52.253397 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 15:46:52.253397 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 15:46:52.253397 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 15:46:52.253397 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 15:46:52.253397 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 15:46:52.253397 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 15:46:52.253397 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 15:46:52.253397 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 15:46:52.253397 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 15:46:52.253397 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 02 15:46:52.253397 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 02 15:46:52.253397 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 02 15:46:52.254527 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 02 15:46:52.254527 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 15:46:52.254527 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 15:46:52.254527 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 15:46:52.254527 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 15:46:52.254527 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 15:46:52.254527 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 15:46:52.254527 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 15:46:52.254527 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application with Lock( Jun 02 15:46:52.254527 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 15:46:52.254527 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application return self._enter() Jun 02 15:46:52.254527 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 15:46:52.254527 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 15:46:52.254527 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 15:46:52.254527 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application return self.creator() Jun 02 15:46:52.254527 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 15:46:52.254527 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application created_value = creator( Jun 02 15:46:52.256215 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 02 15:46:52.256215 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 02 15:46:52.256215 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 15:46:52.256215 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application Jun 02 15:46:52.257640 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 405/813] 10.222.0.59 () {56 vars in 1108 bytes} [Thu Jun 2 15:46:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 260 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 15:46:52.262984 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53bb5b32-ec88-4b60-80b6-610e034e715d None admin] Authenticating user token {{(pid=80396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:46:52.271196 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd5a31a1-4f41-48e7-838e-76a5cc14daf7 None admin] RBAC: Authorizing `identity:create_grant(project_id=9c87c981909d4b8db02783421818c79b, user_id=11b714eb2dda4460a8ff52215e671bfa, role_id=36214aa6067e4493a555da410f965c5e)` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:46:52.273233 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd5a31a1-4f41-48e7-838e-76a5cc14daf7 None admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:46:52.345781 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 409/814] 10.222.0.59 () {58 vars in 1439 bytes} [Thu Jun 2 15:46:52 2022] PUT /identity/v3/projects/9c87c981909d4b8db02783421818c79b/users/11b714eb2dda4460a8ff52215e671bfa/roles/36214aa6067e4493a555da410f965c5e => generated 0 bytes in 291 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 15:46:52.347409 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deab174c-72b3-4793-837a-4dda6797682a None None] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:46:52.347703 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deab174c-72b3-4793-837a-4dda6797682a None None] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:46:52.348614 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deab174c-72b3-4793-837a-4dda6797682a None None] PATH_INFO: `/` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:46:52.354696 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 410/815] 10.222.0.59 () {54 vars in 926 bytes} [Thu Jun 2 15:46:52 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 15:46:52.355805 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deab174c-72b3-4793-837a-4dda6797682a None None] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:46:52.391672 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53bb5b32-ec88-4b60-80b6-610e034e715d None admin] Validating token access rules against request {{(pid=80396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:46:52.437559 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aea9327c-b8ff-4baa-a6e3-e7e0aa83471b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:46:52.439147 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea9327c-b8ff-4baa-a6e3-e7e0aa83471b None admin] REQUEST_METHOD: `GET` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:46:52.439836 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea9327c-b8ff-4baa-a6e3-e7e0aa83471b None admin] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:46:52.440298 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea9327c-b8ff-4baa-a6e3-e7e0aa83471b None admin] PATH_INFO: `/v3/services` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:46:52.441288 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aea9327c-b8ff-4baa-a6e3-e7e0aa83471b None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=80396) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 15:46:52.441883 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aea9327c-b8ff-4baa-a6e3-e7e0aa83471b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:46:52.444278 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aea9327c-b8ff-4baa-a6e3-e7e0aa83471b None admin] RBAC: Authorization granted {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:46:52.447854 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG dbcounter [-] [80396] Writing DB stats keystone:SELECT=100 {{(pid=80396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:46:52.452647 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 406/816] 10.222.0.59 () {56 vars in 1124 bytes} [Thu Jun 2 15:46:52 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 15:46:52.454732 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c56c2ef-b0a8-45a7-b961-2769779a1d96 None None] REQUEST_METHOD: `POST` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:46:52.455223 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c56c2ef-b0a8-45a7-b961-2769779a1d96 None None] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:46:52.455664 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c56c2ef-b0a8-45a7-b961-2769779a1d96 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:46:52.493247 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deab174c-72b3-4793-837a-4dda6797682a None None] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:46:52.499276 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.auth.core [None req-4c56c2ef-b0a8-45a7-b961-2769779a1d96 None None] MFA Rules not processed for user `400d1f4db9de49638549e5db29a041e1`. Rule list: `[]` (Enabled: `True`). {{(pid=80396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 15:46:52.500517 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.fernet_utils [None req-4c56c2ef-b0a8-45a7-b961-2769779a1d96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 15:46:52.574367 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f4f63bd-4ffc-4c27-bc69-dbc275f47b72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:46:52.576616 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4f63bd-4ffc-4c27-bc69-dbc275f47b72 None admin] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:46:52.577139 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4f63bd-4ffc-4c27-bc69-dbc275f47b72 None admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:46:52.577623 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4f63bd-4ffc-4c27-bc69-dbc275f47b72 None admin] PATH_INFO: `/v3/domains` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:46:52.579543 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f4f63bd-4ffc-4c27-bc69-dbc275f47b72 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80395) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 15:46:52.579865 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f4f63bd-4ffc-4c27-bc69-dbc275f47b72 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:46:52.581270 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f4f63bd-4ffc-4c27-bc69-dbc275f47b72 None admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:46:52.593338 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:46:52.597220 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 411/817] 10.222.0.59 () {56 vars in 1109 bytes} [Thu Jun 2 15:46:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 15:46:52.597977 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f4f63bd-4ffc-4c27-bc69-dbc275f47b72 None admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:46:52.630416 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 407/818] 10.222.0.59 () {58 vars in 1023 bytes} [Thu Jun 2 15:46:52 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 02 15:46:52.631925 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c56c2ef-b0a8-45a7-b961-2769779a1d96 None None] Authenticating user token {{(pid=80396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:46:52.715548 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f4f63bd-4ffc-4c27-bc69-dbc275f47b72 None admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:46:52.750655 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d9bc8e7-6bb3-4605-b22e-99d96a2e76f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:46:52.751316 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9bc8e7-6bb3-4605-b22e-99d96a2e76f2 None admin] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:46:52.751599 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9bc8e7-6bb3-4605-b22e-99d96a2e76f2 None admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:46:52.751872 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9bc8e7-6bb3-4605-b22e-99d96a2e76f2 None admin] PATH_INFO: `/v3/services` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:46:52.752577 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d9bc8e7-6bb3-4605-b22e-99d96a2e76f2 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=80395) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 15:46:52.752878 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d9bc8e7-6bb3-4605-b22e-99d96a2e76f2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:46:52.754277 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d9bc8e7-6bb3-4605-b22e-99d96a2e76f2 None admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:46:52.759708 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 412/819] 10.222.0.59 () {56 vars in 1124 bytes} [Thu Jun 2 15:46:52 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 15:46:52.760509 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d9bc8e7-6bb3-4605-b22e-99d96a2e76f2 None admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:46:52.769944 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c56c2ef-b0a8-45a7-b961-2769779a1d96 None None] Validating token access rules against request {{(pid=80396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:46:52.807130 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG dbcounter [-] [80396] Writing DB stats keystone:SELECT=100 {{(pid=80396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:46:52.808957 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-162f09ec-cedf-4b4b-a0b7-089ae9c0b949 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:46:52.809763 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162f09ec-cedf-4b4b-a0b7-089ae9c0b949 None admin] REQUEST_METHOD: `GET` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:46:52.810049 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162f09ec-cedf-4b4b-a0b7-089ae9c0b949 None admin] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:46:52.810398 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162f09ec-cedf-4b4b-a0b7-089ae9c0b949 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:46:52.819186 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-162f09ec-cedf-4b4b-a0b7-089ae9c0b949 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:46:52.820649 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-162f09ec-cedf-4b4b-a0b7-089ae9c0b949 None admin] RBAC: Authorization granted {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:46:52.830850 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writing DB stats keystone:SELECT=100 {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:46:52.838045 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application [None req-162f09ec-cedf-4b4b-a0b7-089ae9c0b949 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 02 15:46:52.838045 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 15:46:52.838045 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 15:46:52.838045 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 15:46:52.838045 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 15:46:52.838045 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 15:46:52.838045 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 15:46:52.838045 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 15:46:52.838045 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 15:46:52.838045 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 15:46:52.838045 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 15:46:52.838045 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 15:46:52.838045 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 02 15:46:52.838045 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 02 15:46:52.838045 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 02 15:46:52.838045 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 02 15:46:52.839292 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 15:46:52.839292 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 15:46:52.839292 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 02 15:46:52.839292 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 02 15:46:52.839292 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 02 15:46:52.839292 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 02 15:46:52.839292 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 15:46:52.839292 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 15:46:52.839292 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 15:46:52.839292 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 15:46:52.839292 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 15:46:52.839292 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application with Lock( Jun 02 15:46:52.839292 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 15:46:52.839292 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application return self._enter() Jun 02 15:46:52.839292 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 15:46:52.839292 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 15:46:52.839292 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 15:46:52.839292 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application return self.creator() Jun 02 15:46:52.840430 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 15:46:52.840430 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application created_value = creator( Jun 02 15:46:52.840430 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 02 15:46:52.840430 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 02 15:46:52.840430 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 02 15:46:52.840430 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 02 15:46:52.840430 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 02 15:46:52.840430 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 02 15:46:52.840430 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 02 15:46:52.840430 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application Jun 02 15:46:52.843066 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 408/820] 10.222.0.59 () {56 vars in 1093 bytes} [Thu Jun 2 15:46:52 2022] GET /identity/v3/users/nova => generated 82 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 15:46:52.844271 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-162f09ec-cedf-4b4b-a0b7-089ae9c0b949 None admin] Authenticating user token {{(pid=80396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:46:52.884141 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d9bc8e7-6bb3-4605-b22e-99d96a2e76f2 None admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:46:52.933182 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaf15d6c-0c03-4d34-b974-24aea7cbb776 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:46:52.934572 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf15d6c-0c03-4d34-b974-24aea7cbb776 None admin] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:46:52.935052 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf15d6c-0c03-4d34-b974-24aea7cbb776 None admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:46:52.935761 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf15d6c-0c03-4d34-b974-24aea7cbb776 None admin] PATH_INFO: `/v3/services/network` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:46:52.937493 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaf15d6c-0c03-4d34-b974-24aea7cbb776 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:46:52.939047 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaf15d6c-0c03-4d34-b974-24aea7cbb776 None admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:46:52.955415 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application [None req-aaf15d6c-0c03-4d34-b974-24aea7cbb776 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Jun 02 15:46:52.955415 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 15:46:52.955415 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 02 15:46:52.955415 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 02 15:46:52.955415 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 02 15:46:52.955415 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 02 15:46:52.955415 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 02 15:46:52.955415 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 02 15:46:52.955415 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jun 02 15:46:52.955415 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application Jun 02 15:46:52.955415 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 02 15:46:52.955415 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application Jun 02 15:46:52.955415 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 15:46:52.955415 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 15:46:52.955415 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 15:46:52.955415 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 15:46:52.955415 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 15:46:52.956616 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 15:46:52.956616 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 15:46:52.956616 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 15:46:52.956616 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 15:46:52.956616 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 15:46:52.956616 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 15:46:52.956616 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 02 15:46:52.956616 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 02 15:46:52.956616 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 02 15:46:52.956616 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 02 15:46:52.956616 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 15:46:52.956616 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 15:46:52.956616 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 15:46:52.956616 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 15:46:52.956616 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 15:46:52.956616 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 15:46:52.957728 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 15:46:52.957728 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application with Lock( Jun 02 15:46:52.957728 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 15:46:52.957728 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self._enter() Jun 02 15:46:52.957728 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 15:46:52.957728 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 15:46:52.957728 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 15:46:52.957728 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self.creator() Jun 02 15:46:52.957728 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 15:46:52.957728 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application created_value = creator( Jun 02 15:46:52.957728 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 02 15:46:52.957728 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 02 15:46:52.957728 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jun 02 15:46:52.957728 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application Jun 02 15:46:52.960196 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 413/821] 10.222.0.59 () {56 vars in 1111 bytes} [Thu Jun 2 15:46:52 2022] GET /identity/v3/services/network => generated 88 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 15:46:52.961876 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaf15d6c-0c03-4d34-b974-24aea7cbb776 None admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:46:52.975714 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-162f09ec-cedf-4b4b-a0b7-089ae9c0b949 None admin] Validating token access rules against request {{(pid=80396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:46:53.019304 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d6c8b91-1dc3-4fe5-ba96-f9fde4425a2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:46:53.020157 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6c8b91-1dc3-4fe5-ba96-f9fde4425a2d None admin] REQUEST_METHOD: `POST` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:46:53.020571 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6c8b91-1dc3-4fe5-ba96-f9fde4425a2d None admin] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:46:53.020943 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6c8b91-1dc3-4fe5-ba96-f9fde4425a2d None admin] PATH_INFO: `/v3/endpoints` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:46:53.021994 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d6c8b91-1dc3-4fe5-ba96-f9fde4425a2d None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:46:53.023359 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d6c8b91-1dc3-4fe5-ba96-f9fde4425a2d None admin] RBAC: Authorization granted {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:46:53.084265 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaf15d6c-0c03-4d34-b974-24aea7cbb776 None admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:46:53.113143 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writing DB stats keystone:SELECT=100 {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:46:53.123216 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c200ee8-3a0e-4abf-aa1b-c3bcbedac495 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:46:53.124128 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c200ee8-3a0e-4abf-aa1b-c3bcbedac495 None admin] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:46:53.125836 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c200ee8-3a0e-4abf-aa1b-c3bcbedac495 None admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:46:53.125836 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c200ee8-3a0e-4abf-aa1b-c3bcbedac495 None admin] PATH_INFO: `/v3/users` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:46:53.126258 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c200ee8-3a0e-4abf-aa1b-c3bcbedac495 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80395) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 15:46:53.126713 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c200ee8-3a0e-4abf-aa1b-c3bcbedac495 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:46:53.128563 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c200ee8-3a0e-4abf-aa1b-c3bcbedac495 None admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:46:53.154870 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 414/822] 10.222.0.59 () {56 vars in 1133 bytes} [Thu Jun 2 15:46:52 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 15:46:53.154870 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c200ee8-3a0e-4abf-aa1b-c3bcbedac495 None admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:46:53.180662 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 409/823] 10.222.0.59 () {60 vars in 1144 bytes} [Thu Jun 2 15:46:52 2022] POST /identity/v3/endpoints => generated 346 bytes in 331 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 15:46:53.182100 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d6c8b91-1dc3-4fe5-ba96-f9fde4425a2d None admin] Authenticating user token {{(pid=80396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:46:53.290583 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG dbcounter [-] [80396] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:46:53.381606 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d6c8b91-1dc3-4fe5-ba96-f9fde4425a2d None admin] Validating token access rules against request {{(pid=80396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:46:53.408134 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c200ee8-3a0e-4abf-aa1b-c3bcbedac495 None admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:46:53.452722 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fd06582-e633-40f5-a7f0-6f9a3a8fd967 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:46:53.453855 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd06582-e633-40f5-a7f0-6f9a3a8fd967 None admin] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:46:53.454059 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d6d814d-ced0-4eac-80fe-42ff8d6f4e4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:46:53.454597 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd06582-e633-40f5-a7f0-6f9a3a8fd967 None admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:46:53.454721 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d6d814d-ced0-4eac-80fe-42ff8d6f4e4b None admin] REQUEST_METHOD: `GET` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:46:53.454986 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d6d814d-ced0-4eac-80fe-42ff8d6f4e4b None admin] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:46:53.455261 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d6d814d-ced0-4eac-80fe-42ff8d6f4e4b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:46:53.455628 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd06582-e633-40f5-a7f0-6f9a3a8fd967 None admin] PATH_INFO: `/v3/services` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:46:53.456612 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fd06582-e633-40f5-a7f0-6f9a3a8fd967 None admin] RBAC: Adding query filter params (name=network) {{(pid=80395) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 15:46:53.457229 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fd06582-e633-40f5-a7f0-6f9a3a8fd967 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:46:53.459013 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fd06582-e633-40f5-a7f0-6f9a3a8fd967 None admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:46:53.465564 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 415/824] 10.222.0.59 () {56 vars in 1112 bytes} [Thu Jun 2 15:46:53 2022] GET /identity/v3/services?name=network => generated 124 bytes in 315 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 15:46:53.471723 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fd06582-e633-40f5-a7f0-6f9a3a8fd967 None admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:46:53.544744 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writing DB stats keystone:SELECT=100 {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:46:53.566007 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d6d814d-ced0-4eac-80fe-42ff8d6f4e4b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:46:53.566220 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d6d814d-ced0-4eac-80fe-42ff8d6f4e4b None admin] RBAC: Authorization granted {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:46:53.607387 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fd06582-e633-40f5-a7f0-6f9a3a8fd967 None admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:46:53.645794 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a56eb2b0-1c7e-401a-bbae-315e4afdebc6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:46:53.647216 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56eb2b0-1c7e-401a-bbae-315e4afdebc6 None admin] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:46:53.647727 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56eb2b0-1c7e-401a-bbae-315e4afdebc6 None admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:46:53.648220 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56eb2b0-1c7e-401a-bbae-315e4afdebc6 None admin] PATH_INFO: `/v3/services` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:46:53.649172 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a56eb2b0-1c7e-401a-bbae-315e4afdebc6 None admin] RBAC: Adding query filter params (type=network) {{(pid=80395) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 15:46:53.649703 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a56eb2b0-1c7e-401a-bbae-315e4afdebc6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:46:53.651292 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG dbcounter [-] [80396] Writing DB stats keystone:SELECT=100 {{(pid=80396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:46:53.651561 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a56eb2b0-1c7e-401a-bbae-315e4afdebc6 None admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:46:53.666373 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 416/825] 10.222.0.59 () {56 vars in 1112 bytes} [Thu Jun 2 15:46:53 2022] GET /identity/v3/services?type=network => generated 350 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 15:46:53.666373 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a56eb2b0-1c7e-401a-bbae-315e4afdebc6 None admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:46:53.713908 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 410/826] 10.222.0.59 () {58 vars in 1282 bytes} [Thu Jun 2 15:46:53 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 532 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 02 15:46:53.719374 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d6d814d-ced0-4eac-80fe-42ff8d6f4e4b None admin] Authenticating user token {{(pid=80396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:46:53.779927 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a56eb2b0-1c7e-401a-bbae-315e4afdebc6 None admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:46:53.795517 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writing DB stats keystone:SELECT=100 {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:46:53.819855 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89eea4df-d0ee-4f43-91e6-cdc75bd9c8bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:46:53.820931 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89eea4df-d0ee-4f43-91e6-cdc75bd9c8bf None admin] REQUEST_METHOD: `POST` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:46:53.821440 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89eea4df-d0ee-4f43-91e6-cdc75bd9c8bf None admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:46:53.821936 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89eea4df-d0ee-4f43-91e6-cdc75bd9c8bf None admin] PATH_INFO: `/v3/endpoints` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:46:53.822989 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89eea4df-d0ee-4f43-91e6-cdc75bd9c8bf None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:46:53.824602 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89eea4df-d0ee-4f43-91e6-cdc75bd9c8bf None admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:46:53.878344 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d6d814d-ced0-4eac-80fe-42ff8d6f4e4b None admin] Validating token access rules against request {{(pid=80396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:46:53.916152 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8086940b-203b-4770-a1d5-393723db5dfb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:46:53.917042 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8086940b-203b-4770-a1d5-393723db5dfb None admin] REQUEST_METHOD: `GET` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:46:53.917275 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8086940b-203b-4770-a1d5-393723db5dfb None admin] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:46:53.917547 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8086940b-203b-4770-a1d5-393723db5dfb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:46:53.929741 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8086940b-203b-4770-a1d5-393723db5dfb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:46:53.931609 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8086940b-203b-4770-a1d5-393723db5dfb None admin] RBAC: Authorization granted {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:46:53.936627 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG dbcounter [-] [80396] Writing DB stats keystone:SELECT=100 {{(pid=80396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:46:53.946663 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 417/827] 10.222.0.59 () {60 vars in 1144 bytes} [Thu Jun 2 15:46:53 2022] POST /identity/v3/endpoints => generated 327 bytes in 283 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 15:46:53.952901 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application [None req-8086940b-203b-4770-a1d5-393723db5dfb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 15:46:53.952901 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 15:46:53.952901 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 15:46:53.952901 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 15:46:53.952901 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 15:46:53.952901 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 15:46:53.952901 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 15:46:53.952901 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 15:46:53.952901 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 15:46:53.952901 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 15:46:53.952901 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 15:46:53.952901 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 15:46:53.952901 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 02 15:46:53.952901 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 02 15:46:53.952901 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 02 15:46:53.953937 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 02 15:46:53.953937 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 15:46:53.953937 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 15:46:53.953937 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 15:46:53.953937 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 15:46:53.953937 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 15:46:53.953937 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 15:46:53.953937 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 15:46:53.953937 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application with Lock( Jun 02 15:46:53.953937 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 15:46:53.953937 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application return self._enter() Jun 02 15:46:53.953937 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 15:46:53.953937 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 15:46:53.953937 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 15:46:53.953937 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application return self.creator() Jun 02 15:46:53.953937 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 15:46:53.953937 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application created_value = creator( Jun 02 15:46:53.955410 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 02 15:46:53.955410 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 02 15:46:53.955410 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 15:46:53.955410 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application Jun 02 15:46:53.955410 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 411/828] 10.222.0.59 () {56 vars in 1108 bytes} [Thu Jun 2 15:46:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 235 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 02 15:46:53.960472 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89eea4df-d0ee-4f43-91e6-cdc75bd9c8bf None admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:46:54.088868 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89eea4df-d0ee-4f43-91e6-cdc75bd9c8bf None admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:46:54.130821 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-896c1db4-96f5-4934-aa36-fa12784faf90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:46:54.131507 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-896c1db4-96f5-4934-aa36-fa12784faf90 None admin] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:46:54.131790 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-896c1db4-96f5-4934-aa36-fa12784faf90 None admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:46:54.132068 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-896c1db4-96f5-4934-aa36-fa12784faf90 None admin] PATH_INFO: `/v3/domains` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:46:54.132818 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-896c1db4-96f5-4934-aa36-fa12784faf90 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80395) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 15:46:54.133123 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-896c1db4-96f5-4934-aa36-fa12784faf90 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:46:54.134569 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-896c1db4-96f5-4934-aa36-fa12784faf90 None admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:46:54.153424 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 418/829] 10.222.0.59 () {56 vars in 1109 bytes} [Thu Jun 2 15:46:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 15:46:54.159012 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8086940b-203b-4770-a1d5-393723db5dfb None admin] Authenticating user token {{(pid=80396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:46:54.272984 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8086940b-203b-4770-a1d5-393723db5dfb None admin] Validating token access rules against request {{(pid=80396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:46:54.309535 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ffce349-2672-4ea6-9964-a3717c320f23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:46:54.310401 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ffce349-2672-4ea6-9964-a3717c320f23 None admin] REQUEST_METHOD: `GET` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:46:54.310687 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ffce349-2672-4ea6-9964-a3717c320f23 None admin] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:46:54.310964 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ffce349-2672-4ea6-9964-a3717c320f23 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:46:54.318916 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ffce349-2672-4ea6-9964-a3717c320f23 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:46:54.320430 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ffce349-2672-4ea6-9964-a3717c320f23 None admin] RBAC: Authorization granted {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:46:54.335337 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application [None req-4ffce349-2672-4ea6-9964-a3717c320f23 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 02 15:46:54.335337 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 15:46:54.335337 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 15:46:54.335337 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 15:46:54.335337 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 15:46:54.335337 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 15:46:54.335337 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 15:46:54.335337 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 15:46:54.335337 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 15:46:54.335337 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 15:46:54.335337 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 15:46:54.335337 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 15:46:54.335337 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 02 15:46:54.335337 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 02 15:46:54.335337 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 02 15:46:54.336322 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 02 15:46:54.336322 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 15:46:54.336322 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 15:46:54.336322 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 15:46:54.336322 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 15:46:54.336322 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 15:46:54.336322 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 15:46:54.336322 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 15:46:54.336322 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application with Lock( Jun 02 15:46:54.336322 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 15:46:54.336322 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application return self._enter() Jun 02 15:46:54.336322 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 15:46:54.336322 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 15:46:54.336322 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 15:46:54.336322 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application return self.creator() Jun 02 15:46:54.336322 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 15:46:54.336322 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application created_value = creator( Jun 02 15:46:54.337448 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 02 15:46:54.337448 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 02 15:46:54.337448 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 02 15:46:54.337448 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 02 15:46:54.337448 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 02 15:46:54.337448 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 02 15:46:54.337448 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 02 15:46:54.337448 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application Jun 02 15:46:54.337448 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 412/830] 10.222.0.59 () {56 vars in 1111 bytes} [Thu Jun 2 15:46:54 2022] GET /identity/v3/projects/service => generated 88 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 15:46:54.342656 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-896c1db4-96f5-4934-aa36-fa12784faf90 None admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:46:54.370879 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:46:54.453370 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-896c1db4-96f5-4934-aa36-fa12784faf90 None admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:46:54.489814 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efc66650-4629-47e6-a2ea-d3d7223220fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:46:54.490514 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc66650-4629-47e6-a2ea-d3d7223220fb None admin] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:46:54.490795 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc66650-4629-47e6-a2ea-d3d7223220fb None admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:46:54.491069 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc66650-4629-47e6-a2ea-d3d7223220fb None admin] PATH_INFO: `/v3/projects` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:46:54.491857 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efc66650-4629-47e6-a2ea-d3d7223220fb None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80395) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 15:46:54.492166 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efc66650-4629-47e6-a2ea-d3d7223220fb None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:46:54.493666 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efc66650-4629-47e6-a2ea-d3d7223220fb None admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:46:54.506160 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 419/831] 10.222.0.59 () {56 vars in 1148 bytes} [Thu Jun 2 15:46:54 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 15:46:54.512186 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ffce349-2672-4ea6-9964-a3717c320f23 None admin] Authenticating user token {{(pid=80396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:46:54.572974 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG dbcounter [-] [80396] Writing DB stats keystone:SELECT=100 {{(pid=80396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:46:54.575538 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ea4de5-f9b7-4d0e-8fcd-844f2618797d None None] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:46:54.575787 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ea4de5-f9b7-4d0e-8fcd-844f2618797d None None] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:46:54.576319 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ea4de5-f9b7-4d0e-8fcd-844f2618797d None None] PATH_INFO: `/` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:46:54.578758 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 420/832] 10.222.0.59 () {54 vars in 926 bytes} [Thu Jun 2 15:46:54 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 15:46:54.590607 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6958481-a96d-49a4-90a0-a72689a95032 None None] REQUEST_METHOD: `POST` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:46:54.590923 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6958481-a96d-49a4-90a0-a72689a95032 None None] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:46:54.591174 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6958481-a96d-49a4-90a0-a72689a95032 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:46:54.616209 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.auth.core [None req-d6958481-a96d-49a4-90a0-a72689a95032 None None] MFA Rules not processed for user `400d1f4db9de49638549e5db29a041e1`. Rule list: `[]` (Enabled: `True`). {{(pid=80395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 15:46:54.618206 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.fernet_utils [None req-d6958481-a96d-49a4-90a0-a72689a95032 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 15:46:54.629674 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ffce349-2672-4ea6-9964-a3717c320f23 None admin] Validating token access rules against request {{(pid=80396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:46:54.670053 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c210692-e54f-4426-8873-9efc3e5b2dc0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:46:54.670753 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c210692-e54f-4426-8873-9efc3e5b2dc0 None admin] REQUEST_METHOD: `GET` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:46:54.671020 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c210692-e54f-4426-8873-9efc3e5b2dc0 None admin] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:46:54.671302 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c210692-e54f-4426-8873-9efc3e5b2dc0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:46:54.672139 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c210692-e54f-4426-8873-9efc3e5b2dc0 None admin] RBAC: Adding query filter params (role.id=f1e0c25f6e9049e897cb7350c7e54ab3, scope.project.id=9c87c981909d4b8db02783421818c79b, user.id=52f9fe4b13574516bb0a8e2aa11a61e8) {{(pid=80396) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 15:46:54.672454 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c210692-e54f-4426-8873-9efc3e5b2dc0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:46:54.674018 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c210692-e54f-4426-8873-9efc3e5b2dc0 None admin] RBAC: Authorization granted {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:46:54.682174 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 413/833] 10.222.0.59 () {56 vars in 1374 bytes} [Thu Jun 2 15:46:54 2022] GET /identity/v3/role_assignments?user.id=52f9fe4b13574516bb0a8e2aa11a61e8&scope.project.id=9c87c981909d4b8db02783421818c79b&role.id=f1e0c25f6e9049e897cb7350c7e54ab3 => generated 608 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 15:46:54.710740 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 421/834] 10.222.0.59 () {58 vars in 1023 bytes} [Thu Jun 2 15:46:54 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 02 15:46:54.734381 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c210692-e54f-4426-8873-9efc3e5b2dc0 None admin] Authenticating user token {{(pid=80396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:46:54.855594 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c210692-e54f-4426-8873-9efc3e5b2dc0 None admin] Validating token access rules against request {{(pid=80396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:46:54.875398 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG dbcounter [-] [80396] Writing DB stats keystone:SELECT=100 {{(pid=80396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:46:54.894717 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74a70e59-a184-4550-afa5-b22fae95f0a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:46:54.895750 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a70e59-a184-4550-afa5-b22fae95f0a8 None admin] REQUEST_METHOD: `GET` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:46:54.896263 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a70e59-a184-4550-afa5-b22fae95f0a8 None admin] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:46:54.896549 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a70e59-a184-4550-afa5-b22fae95f0a8 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:46:54.907894 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74a70e59-a184-4550-afa5-b22fae95f0a8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 02 15:46:54.919122 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application [None req-74a70e59-a184-4550-afa5-b22fae95f0a8 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 02 15:46:54.919122 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 15:46:54.919122 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 15:46:54.919122 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 15:46:54.919122 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 15:46:54.919122 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 15:46:54.919122 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 15:46:54.919122 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 15:46:54.919122 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 15:46:54.919122 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 15:46:54.919122 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 15:46:54.919122 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 15:46:54.919122 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 02 15:46:54.919122 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 02 15:46:54.919122 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 02 15:46:54.919122 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 02 15:46:54.920062 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 02 15:46:54.920062 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 02 15:46:54.920062 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 02 15:46:54.920062 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 02 15:46:54.920062 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 15:46:54.920062 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 15:46:54.920062 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 15:46:54.920062 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 15:46:54.920062 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 15:46:54.920062 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 15:46:54.920062 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 15:46:54.920062 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application with Lock( Jun 02 15:46:54.920062 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 15:46:54.920062 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application return self._enter() Jun 02 15:46:54.920062 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 15:46:54.920062 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 15:46:54.920888 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 15:46:54.920888 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application return self.creator() Jun 02 15:46:54.920888 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 15:46:54.920888 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application created_value = creator( Jun 02 15:46:54.920888 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 02 15:46:54.920888 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 02 15:46:54.920888 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 02 15:46:54.920888 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 02 15:46:54.920888 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 02 15:46:54.920888 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 02 15:46:54.920888 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 02 15:46:54.920888 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application Jun 02 15:46:54.921545 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 414/835] 10.222.0.59 () {56 vars in 1096 bytes} [Thu Jun 2 15:46:54 2022] GET /identity/v3/roles/admin => generated 83 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 15:46:54.927976 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6958481-a96d-49a4-90a0-a72689a95032 None None] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:46:54.946699 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writing DB stats keystone:SELECT=100 {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:46:55.038388 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6958481-a96d-49a4-90a0-a72689a95032 None None] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:46:55.074985 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c28c85e-e9ad-4f25-ac09-7141087a3a50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:46:55.075656 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c28c85e-e9ad-4f25-ac09-7141087a3a50 None admin] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:46:55.075941 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c28c85e-e9ad-4f25-ac09-7141087a3a50 None admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:46:55.076217 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c28c85e-e9ad-4f25-ac09-7141087a3a50 None admin] PATH_INFO: `/v3/roles` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:46:55.076976 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c28c85e-e9ad-4f25-ac09-7141087a3a50 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80395) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 15:46:55.077356 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c28c85e-e9ad-4f25-ac09-7141087a3a50 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:46:55.078759 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c28c85e-e9ad-4f25-ac09-7141087a3a50 None admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:46:55.088502 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 422/836] 10.222.0.59 () {56 vars in 1099 bytes} [Thu Jun 2 15:46:54 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 15:46:55.093875 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74a70e59-a184-4550-afa5-b22fae95f0a8 None admin] Authenticating user token {{(pid=80396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:46:55.121467 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b32531-0203-4467-9a62-72646c1dbb63 None None] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:46:55.121828 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b32531-0203-4467-9a62-72646c1dbb63 None None] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:46:55.122058 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b32531-0203-4467-9a62-72646c1dbb63 None None] PATH_INFO: `/` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:46:55.123773 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 423/837] 10.222.0.59 () {54 vars in 926 bytes} [Thu Jun 2 15:46:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 02 15:46:55.128681 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f9ca33-16d5-471a-8d51-9eafac5b356b None None] REQUEST_METHOD: `POST` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:46:55.128963 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f9ca33-16d5-471a-8d51-9eafac5b356b None None] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:46:55.129235 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f9ca33-16d5-471a-8d51-9eafac5b356b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:46:55.146442 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.auth.core [None req-46f9ca33-16d5-471a-8d51-9eafac5b356b None None] MFA Rules not processed for user `400d1f4db9de49638549e5db29a041e1`. Rule list: `[]` (Enabled: `True`). {{(pid=80395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 15:46:55.147562 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.fernet_utils [None req-46f9ca33-16d5-471a-8d51-9eafac5b356b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 15:46:55.222598 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74a70e59-a184-4550-afa5-b22fae95f0a8 None admin] Validating token access rules against request {{(pid=80396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:46:55.243842 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 424/838] 10.222.0.59 () {58 vars in 1023 bytes} [Thu Jun 2 15:46:55 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 02 15:46:55.267615 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46f9ca33-16d5-471a-8d51-9eafac5b356b None None] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:46:55.269427 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-966d9ca9-94a9-46fb-94d7-b4ac2bd70989 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:46:55.271048 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966d9ca9-94a9-46fb-94d7-b4ac2bd70989 None admin] REQUEST_METHOD: `GET` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:46:55.271660 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966d9ca9-94a9-46fb-94d7-b4ac2bd70989 None admin] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:46:55.272168 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966d9ca9-94a9-46fb-94d7-b4ac2bd70989 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:46:55.276774 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writing DB stats keystone:SELECT=100 {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:46:55.283594 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-966d9ca9-94a9-46fb-94d7-b4ac2bd70989 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:46:55.286873 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-966d9ca9-94a9-46fb-94d7-b4ac2bd70989 None admin] RBAC: Authorization granted {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:46:55.304444 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application [None req-966d9ca9-94a9-46fb-94d7-b4ac2bd70989 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 15:46:55.304444 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 15:46:55.304444 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 15:46:55.304444 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 15:46:55.304444 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 15:46:55.304444 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 15:46:55.304444 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 15:46:55.304444 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 15:46:55.304444 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 15:46:55.304444 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 15:46:55.304444 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 15:46:55.304444 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 15:46:55.304444 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 02 15:46:55.304444 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 02 15:46:55.304444 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 02 15:46:55.305366 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 02 15:46:55.305366 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 15:46:55.305366 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 15:46:55.305366 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 15:46:55.305366 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 15:46:55.305366 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 15:46:55.305366 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 15:46:55.305366 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 15:46:55.305366 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application with Lock( Jun 02 15:46:55.305366 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 15:46:55.305366 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application return self._enter() Jun 02 15:46:55.305366 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 15:46:55.305366 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 15:46:55.305366 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 15:46:55.305366 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application return self.creator() Jun 02 15:46:55.305366 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 15:46:55.305366 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application created_value = creator( Jun 02 15:46:55.306273 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 02 15:46:55.306273 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 02 15:46:55.306273 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 15:46:55.306273 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application Jun 02 15:46:55.308533 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 415/839] 10.222.0.59 () {56 vars in 1108 bytes} [Thu Jun 2 15:46:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 15:46:55.314357 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-966d9ca9-94a9-46fb-94d7-b4ac2bd70989 None admin] Authenticating user token {{(pid=80396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:46:55.347628 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG dbcounter [-] [80396] Writing DB stats keystone:SELECT=100 {{(pid=80396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:46:55.377785 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46f9ca33-16d5-471a-8d51-9eafac5b356b None None] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:46:55.417153 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0533bf49-4aea-4b0e-be75-0d43b60bfd08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:46:55.418121 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0533bf49-4aea-4b0e-be75-0d43b60bfd08 None admin] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:46:55.418408 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0533bf49-4aea-4b0e-be75-0d43b60bfd08 None admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:46:55.418684 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0533bf49-4aea-4b0e-be75-0d43b60bfd08 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:46:55.422479 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-966d9ca9-94a9-46fb-94d7-b4ac2bd70989 None admin] Validating token access rules against request {{(pid=80396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:46:55.430509 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0533bf49-4aea-4b0e-be75-0d43b60bfd08 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 02 15:46:55.438691 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application [None req-0533bf49-4aea-4b0e-be75-0d43b60bfd08 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 02 15:46:55.438691 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 15:46:55.438691 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 15:46:55.438691 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 15:46:55.438691 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 15:46:55.438691 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 15:46:55.438691 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 15:46:55.438691 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 15:46:55.438691 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 15:46:55.438691 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 15:46:55.438691 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 15:46:55.438691 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 15:46:55.438691 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 02 15:46:55.438691 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 02 15:46:55.438691 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 02 15:46:55.438691 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 02 15:46:55.439643 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 02 15:46:55.439643 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 02 15:46:55.439643 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 02 15:46:55.439643 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 02 15:46:55.439643 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 15:46:55.439643 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 15:46:55.439643 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 15:46:55.439643 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 15:46:55.439643 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 15:46:55.439643 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 15:46:55.439643 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 15:46:55.439643 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application with Lock( Jun 02 15:46:55.439643 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 15:46:55.439643 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self._enter() Jun 02 15:46:55.439643 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 15:46:55.439643 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 15:46:55.440485 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 15:46:55.440485 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self.creator() Jun 02 15:46:55.440485 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 15:46:55.440485 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application created_value = creator( Jun 02 15:46:55.440485 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 02 15:46:55.440485 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 02 15:46:55.440485 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 02 15:46:55.440485 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 02 15:46:55.440485 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 02 15:46:55.440485 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 02 15:46:55.440485 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 02 15:46:55.440485 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application Jun 02 15:46:55.444877 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 425/840] 10.222.0.59 () {56 vars in 1102 bytes} [Thu Jun 2 15:46:55 2022] GET /identity/v3/roles/service => generated 85 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 02 15:46:55.445847 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0533bf49-4aea-4b0e-be75-0d43b60bfd08 None admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:46:55.464028 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40bf26d0-2aa3-4675-9cf1-30b4b55a38bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:46:55.465033 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40bf26d0-2aa3-4675-9cf1-30b4b55a38bd None admin] REQUEST_METHOD: `GET` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:46:55.465533 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40bf26d0-2aa3-4675-9cf1-30b4b55a38bd None admin] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:46:55.466015 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40bf26d0-2aa3-4675-9cf1-30b4b55a38bd None admin] PATH_INFO: `/v3/domains` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:46:55.466992 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40bf26d0-2aa3-4675-9cf1-30b4b55a38bd None admin] RBAC: Adding query filter params (name=Default) {{(pid=80396) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 15:46:55.467519 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40bf26d0-2aa3-4675-9cf1-30b4b55a38bd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:46:55.469125 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40bf26d0-2aa3-4675-9cf1-30b4b55a38bd None admin] RBAC: Authorization granted {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:46:55.487849 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 416/841] 10.222.0.59 () {56 vars in 1109 bytes} [Thu Jun 2 15:46:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 15:46:55.489783 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40bf26d0-2aa3-4675-9cf1-30b4b55a38bd None admin] Authenticating user token {{(pid=80396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:46:55.522212 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writing DB stats keystone:SELECT=100 {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:46:55.560495 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0533bf49-4aea-4b0e-be75-0d43b60bfd08 None admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:46:55.588181 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG dbcounter [-] [80396] Writing DB stats keystone:SELECT=100 {{(pid=80396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:46:55.597859 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40bf26d0-2aa3-4675-9cf1-30b4b55a38bd None admin] Validating token access rules against request {{(pid=80396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:46:55.601882 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec214daf-60c9-49fd-b59e-de60d41dc02d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:46:55.602125 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec214daf-60c9-49fd-b59e-de60d41dc02d None admin] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:46:55.602348 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec214daf-60c9-49fd-b59e-de60d41dc02d None admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:46:55.602616 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec214daf-60c9-49fd-b59e-de60d41dc02d None admin] PATH_INFO: `/v3/roles` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:46:55.603361 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec214daf-60c9-49fd-b59e-de60d41dc02d None admin] RBAC: Adding query filter params (name=service) {{(pid=80395) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 15:46:55.603659 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec214daf-60c9-49fd-b59e-de60d41dc02d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:46:55.605034 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec214daf-60c9-49fd-b59e-de60d41dc02d None admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:46:55.619053 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 426/842] 10.222.0.59 () {56 vars in 1103 bytes} [Thu Jun 2 15:46:55 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 15:46:55.621271 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec214daf-60c9-49fd-b59e-de60d41dc02d None admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:46:55.638860 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-520d3599-aa8e-4ae2-bd51-890694bcf34c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:46:55.640005 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-520d3599-aa8e-4ae2-bd51-890694bcf34c None admin] REQUEST_METHOD: `GET` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:46:55.640509 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-520d3599-aa8e-4ae2-bd51-890694bcf34c None admin] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:46:55.640981 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-520d3599-aa8e-4ae2-bd51-890694bcf34c None admin] PATH_INFO: `/v3/users/swift` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:46:55.649221 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-520d3599-aa8e-4ae2-bd51-890694bcf34c None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:46:55.650979 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-520d3599-aa8e-4ae2-bd51-890694bcf34c None admin] RBAC: Authorization granted {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:46:55.665332 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application [None req-520d3599-aa8e-4ae2-bd51-890694bcf34c None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jun 02 15:46:55.665332 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 15:46:55.665332 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 15:46:55.665332 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 15:46:55.665332 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 15:46:55.665332 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 15:46:55.665332 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 15:46:55.665332 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 15:46:55.665332 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 15:46:55.665332 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 15:46:55.665332 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 15:46:55.665332 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 15:46:55.665332 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 02 15:46:55.665332 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 02 15:46:55.665332 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 02 15:46:55.665332 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 02 15:46:55.666365 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 15:46:55.666365 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 15:46:55.666365 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 02 15:46:55.666365 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 02 15:46:55.666365 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 02 15:46:55.666365 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 02 15:46:55.666365 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 15:46:55.666365 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 15:46:55.666365 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 15:46:55.666365 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 15:46:55.666365 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 15:46:55.666365 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application with Lock( Jun 02 15:46:55.666365 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 15:46:55.666365 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application return self._enter() Jun 02 15:46:55.666365 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 15:46:55.666365 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 15:46:55.666365 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 15:46:55.666365 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application return self.creator() Jun 02 15:46:55.667307 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 15:46:55.667307 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application created_value = creator( Jun 02 15:46:55.667307 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 02 15:46:55.667307 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 02 15:46:55.667307 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 02 15:46:55.667307 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 02 15:46:55.667307 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 02 15:46:55.667307 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 02 15:46:55.667307 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jun 02 15:46:55.667307 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application Jun 02 15:46:55.674265 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 417/843] 10.222.0.59 () {56 vars in 1096 bytes} [Thu Jun 2 15:46:55 2022] GET /identity/v3/users/swift => generated 83 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 15:46:55.675351 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-520d3599-aa8e-4ae2-bd51-890694bcf34c None admin] Authenticating user token {{(pid=80396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:46:55.729832 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec214daf-60c9-49fd-b59e-de60d41dc02d None admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:46:55.758751 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writing DB stats keystone:SELECT=100 {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:46:55.767835 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8a727f4-3ba6-4733-b677-0a89f7602e5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:46:55.768725 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a727f4-3ba6-4733-b677-0a89f7602e5f None admin] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:46:55.769006 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a727f4-3ba6-4733-b677-0a89f7602e5f None admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:46:55.769276 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a727f4-3ba6-4733-b677-0a89f7602e5f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:46:55.780831 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8a727f4-3ba6-4733-b677-0a89f7602e5f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:46:55.781818 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-520d3599-aa8e-4ae2-bd51-890694bcf34c None admin] Validating token access rules against request {{(pid=80396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:46:55.782295 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8a727f4-3ba6-4733-b677-0a89f7602e5f None admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:46:55.802505 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application [None req-a8a727f4-3ba6-4733-b677-0a89f7602e5f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 15:46:55.802505 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 15:46:55.802505 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 15:46:55.802505 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 15:46:55.802505 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 15:46:55.802505 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 15:46:55.802505 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 15:46:55.802505 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 15:46:55.802505 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 15:46:55.802505 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 15:46:55.802505 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 15:46:55.802505 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 15:46:55.802505 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 02 15:46:55.802505 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 02 15:46:55.802505 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 02 15:46:55.803447 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 02 15:46:55.803447 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 15:46:55.803447 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 15:46:55.803447 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 15:46:55.803447 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 15:46:55.803447 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 15:46:55.803447 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 15:46:55.803447 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 15:46:55.803447 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application with Lock( Jun 02 15:46:55.803447 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 15:46:55.803447 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self._enter() Jun 02 15:46:55.803447 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 15:46:55.803447 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 15:46:55.803447 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 15:46:55.803447 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self.creator() Jun 02 15:46:55.803447 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 15:46:55.803447 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application created_value = creator( Jun 02 15:46:55.804381 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 02 15:46:55.804381 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 02 15:46:55.804381 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 15:46:55.804381 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application Jun 02 15:46:55.808616 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 427/844] 10.222.0.59 () {56 vars in 1108 bytes} [Thu Jun 2 15:46:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 15:46:55.809400 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8a727f4-3ba6-4733-b677-0a89f7602e5f None admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:46:55.822318 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9718f5e6-8d9a-4e64-814a-1f52f43b1dec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:46:55.823299 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9718f5e6-8d9a-4e64-814a-1f52f43b1dec None admin] REQUEST_METHOD: `GET` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:46:55.823786 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9718f5e6-8d9a-4e64-814a-1f52f43b1dec None admin] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:46:55.824262 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9718f5e6-8d9a-4e64-814a-1f52f43b1dec None admin] PATH_INFO: `/v3/users` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:46:55.825333 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9718f5e6-8d9a-4e64-814a-1f52f43b1dec None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80396) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 15:46:55.825863 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9718f5e6-8d9a-4e64-814a-1f52f43b1dec None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:46:55.827519 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9718f5e6-8d9a-4e64-814a-1f52f43b1dec None admin] RBAC: Authorization granted {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:46:55.847238 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 418/845] 10.222.0.59 () {56 vars in 1135 bytes} [Thu Jun 2 15:46:55 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 15:46:55.849523 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-094a6e9e-1604-4072-bc59-52c9021859b2 None None] REQUEST_METHOD: `GET` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:46:55.850028 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-094a6e9e-1604-4072-bc59-52c9021859b2 None None] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:46:55.850554 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-094a6e9e-1604-4072-bc59-52c9021859b2 None None] PATH_INFO: `/` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:46:55.852324 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 419/846] 10.222.0.59 () {54 vars in 926 bytes} [Thu Jun 2 15:46:55 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 15:46:55.853592 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-094a6e9e-1604-4072-bc59-52c9021859b2 None None] Authenticating user token {{(pid=80396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:46:55.864001 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG dbcounter [-] [80396] Writing DB stats keystone:SELECT=100 {{(pid=80396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:46:55.926838 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8a727f4-3ba6-4733-b677-0a89f7602e5f None admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:46:55.964126 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84ae99cd-f94c-4314-a254-ec56108b357e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:46:55.964989 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ae99cd-f94c-4314-a254-ec56108b357e None admin] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:46:55.965182 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ae99cd-f94c-4314-a254-ec56108b357e None admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:46:55.965464 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ae99cd-f94c-4314-a254-ec56108b357e None admin] PATH_INFO: `/v3/domains` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:46:55.966333 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84ae99cd-f94c-4314-a254-ec56108b357e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80395) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 15:46:55.966643 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84ae99cd-f94c-4314-a254-ec56108b357e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:46:55.968013 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84ae99cd-f94c-4314-a254-ec56108b357e None admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:46:55.972551 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-094a6e9e-1604-4072-bc59-52c9021859b2 None None] Validating token access rules against request {{(pid=80396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:46:55.980669 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 428/847] 10.222.0.59 () {56 vars in 1109 bytes} [Thu Jun 2 15:46:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 15:46:55.981916 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd89a90-a2ca-4ecd-9074-8a10588bef5f None None] REQUEST_METHOD: `POST` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:46:55.982236 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd89a90-a2ca-4ecd-9074-8a10588bef5f None None] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:46:55.982515 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd89a90-a2ca-4ecd-9074-8a10588bef5f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:46:56.000059 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.auth.core [None req-bcd89a90-a2ca-4ecd-9074-8a10588bef5f None None] MFA Rules not processed for user `400d1f4db9de49638549e5db29a041e1`. Rule list: `[]` (Enabled: `True`). {{(pid=80395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 15:46:56.001255 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.fernet_utils [None req-bcd89a90-a2ca-4ecd-9074-8a10588bef5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 15:46:56.017250 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27f2f388-4678-469f-a79e-4f84b493096f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:46:56.017892 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f2f388-4678-469f-a79e-4f84b493096f None admin] REQUEST_METHOD: `GET` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:46:56.018205 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f2f388-4678-469f-a79e-4f84b493096f None admin] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:46:56.018481 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f2f388-4678-469f-a79e-4f84b493096f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:46:56.038277 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writing DB stats keystone:SELECT=100 {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:46:56.071162 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 429/848] 10.222.0.59 () {58 vars in 1023 bytes} [Thu Jun 2 15:46:55 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 02 15:46:56.072256 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcd89a90-a2ca-4ecd-9074-8a10588bef5f None None] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:46:56.099948 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27f2f388-4678-469f-a79e-4f84b493096f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:46:56.101350 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27f2f388-4678-469f-a79e-4f84b493096f None admin] RBAC: Authorization granted {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:46:56.111554 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG dbcounter [-] [80396] Writing DB stats keystone:SELECT=100 {{(pid=80396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:46:56.192675 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcd89a90-a2ca-4ecd-9074-8a10588bef5f None None] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:46:56.208329 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 420/849] 10.222.0.59 () {58 vars in 1282 bytes} [Thu Jun 2 15:46:55 2022] GET /identity/v3/auth/tokens => generated 1151 bytes in 355 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 02 15:46:56.210040 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27f2f388-4678-469f-a79e-4f84b493096f None admin] Authenticating user token {{(pid=80396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:46:56.232005 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-558c3492-0a91-496e-9dd7-1d5f55b22cdd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:46:56.233088 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558c3492-0a91-496e-9dd7-1d5f55b22cdd None admin] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:46:56.233564 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558c3492-0a91-496e-9dd7-1d5f55b22cdd None admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:46:56.234024 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558c3492-0a91-496e-9dd7-1d5f55b22cdd None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:46:56.241443 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-558c3492-0a91-496e-9dd7-1d5f55b22cdd None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:46:56.243112 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-558c3492-0a91-496e-9dd7-1d5f55b22cdd None admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:46:56.258257 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application [None req-558c3492-0a91-496e-9dd7-1d5f55b22cdd None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 02 15:46:56.258257 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 15:46:56.258257 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 15:46:56.258257 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 15:46:56.258257 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 15:46:56.258257 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 15:46:56.258257 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 15:46:56.258257 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 15:46:56.258257 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 15:46:56.258257 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 15:46:56.258257 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 15:46:56.258257 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 15:46:56.258257 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 02 15:46:56.258257 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 02 15:46:56.258257 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 02 15:46:56.258257 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 02 15:46:56.259217 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 15:46:56.259217 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 15:46:56.259217 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 02 15:46:56.259217 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 02 15:46:56.259217 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 02 15:46:56.259217 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 02 15:46:56.259217 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 15:46:56.259217 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 15:46:56.259217 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 15:46:56.259217 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 15:46:56.259217 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 15:46:56.259217 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application with Lock( Jun 02 15:46:56.259217 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 15:46:56.259217 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self._enter() Jun 02 15:46:56.259217 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 15:46:56.259217 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 15:46:56.259217 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 15:46:56.259217 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self.creator() Jun 02 15:46:56.260219 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 15:46:56.260219 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application created_value = creator( Jun 02 15:46:56.260219 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 02 15:46:56.260219 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 02 15:46:56.260219 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 02 15:46:56.260219 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 02 15:46:56.260219 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 02 15:46:56.260219 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 02 15:46:56.260219 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 02 15:46:56.260219 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application Jun 02 15:46:56.261746 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 430/850] 10.222.0.59 () {56 vars in 1117 bytes} [Thu Jun 2 15:46:56 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 15:46:56.266348 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-558c3492-0a91-496e-9dd7-1d5f55b22cdd None admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:46:56.294677 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writing DB stats keystone:SELECT=100 {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:46:56.320484 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27f2f388-4678-469f-a79e-4f84b493096f None admin] Validating token access rules against request {{(pid=80396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:46:56.330575 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG dbcounter [-] [80396] Writing DB stats keystone:SELECT=100 {{(pid=80396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:46:56.357542 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2051297f-ebd8-4aa1-920a-c6cffd8f9775 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:46:56.358278 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2051297f-ebd8-4aa1-920a-c6cffd8f9775 None admin] REQUEST_METHOD: `GET` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:46:56.358562 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2051297f-ebd8-4aa1-920a-c6cffd8f9775 None admin] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:46:56.358839 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2051297f-ebd8-4aa1-920a-c6cffd8f9775 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:46:56.359504 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2051297f-ebd8-4aa1-920a-c6cffd8f9775 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:46:56.360877 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2051297f-ebd8-4aa1-920a-c6cffd8f9775 None admin] RBAC: Authorization granted {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:46:56.369346 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-558c3492-0a91-496e-9dd7-1d5f55b22cdd None admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:46:56.373657 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application [None req-2051297f-ebd8-4aa1-920a-c6cffd8f9775 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 02 15:46:56.373657 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 15:46:56.373657 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 02 15:46:56.373657 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 02 15:46:56.373657 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 02 15:46:56.373657 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 02 15:46:56.373657 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 02 15:46:56.373657 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 02 15:46:56.373657 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 02 15:46:56.373657 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application Jun 02 15:46:56.373657 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 02 15:46:56.373657 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application Jun 02 15:46:56.373657 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 15:46:56.373657 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 15:46:56.373657 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 15:46:56.373657 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 15:46:56.373657 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 15:46:56.374890 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 15:46:56.374890 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 15:46:56.374890 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 15:46:56.374890 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 15:46:56.374890 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 15:46:56.374890 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 15:46:56.374890 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 02 15:46:56.374890 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 02 15:46:56.374890 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 02 15:46:56.374890 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 02 15:46:56.374890 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 15:46:56.374890 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 15:46:56.374890 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 15:46:56.374890 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 15:46:56.374890 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 15:46:56.374890 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 15:46:56.375916 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 15:46:56.375916 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application with Lock( Jun 02 15:46:56.375916 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 15:46:56.375916 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application return self._enter() Jun 02 15:46:56.375916 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 15:46:56.375916 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 15:46:56.375916 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 15:46:56.375916 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application return self.creator() Jun 02 15:46:56.375916 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 15:46:56.375916 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application created_value = creator( Jun 02 15:46:56.375916 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 02 15:46:56.375916 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 02 15:46:56.375916 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 02 15:46:56.375916 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application Jun 02 15:46:56.378729 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 421/851] 10.222.0.59 () {56 vars in 1114 bytes} [Thu Jun 2 15:46:56 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 15:46:56.379985 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2051297f-ebd8-4aa1-920a-c6cffd8f9775 None admin] Authenticating user token {{(pid=80396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:46:56.410299 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e74dddd0-0aac-46e1-9934-a0dc283fe038 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:46:56.411240 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74dddd0-0aac-46e1-9934-a0dc283fe038 None admin] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:46:56.411523 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74dddd0-0aac-46e1-9934-a0dc283fe038 None admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:46:56.411794 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74dddd0-0aac-46e1-9934-a0dc283fe038 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:46:56.421787 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e74dddd0-0aac-46e1-9934-a0dc283fe038 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:46:56.423275 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e74dddd0-0aac-46e1-9934-a0dc283fe038 None admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:46:56.442616 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application [None req-e74dddd0-0aac-46e1-9934-a0dc283fe038 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 15:46:56.442616 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 15:46:56.442616 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 15:46:56.442616 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 15:46:56.442616 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 15:46:56.442616 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 15:46:56.442616 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 15:46:56.442616 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 15:46:56.442616 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 15:46:56.442616 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 15:46:56.442616 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 15:46:56.442616 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 15:46:56.442616 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 02 15:46:56.442616 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 02 15:46:56.442616 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 02 15:46:56.443580 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 02 15:46:56.443580 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 15:46:56.443580 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 15:46:56.443580 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 15:46:56.443580 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 15:46:56.443580 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 15:46:56.443580 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 15:46:56.443580 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 15:46:56.443580 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application with Lock( Jun 02 15:46:56.443580 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 15:46:56.443580 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self._enter() Jun 02 15:46:56.443580 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 15:46:56.443580 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 15:46:56.443580 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 15:46:56.443580 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self.creator() Jun 02 15:46:56.443580 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 15:46:56.443580 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application created_value = creator( Jun 02 15:46:56.444483 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 02 15:46:56.444483 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 02 15:46:56.444483 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 15:46:56.444483 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application Jun 02 15:46:56.444483 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 431/852] 10.222.0.59 () {56 vars in 1108 bytes} [Thu Jun 2 15:46:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 15:46:56.445461 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e74dddd0-0aac-46e1-9934-a0dc283fe038 None admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:46:56.496856 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2051297f-ebd8-4aa1-920a-c6cffd8f9775 None admin] Validating token access rules against request {{(pid=80396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:46:56.531980 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writing DB stats keystone:SELECT=100 {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:46:56.532483 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df89fde0-fea4-4f20-ba50-d8b9c680ec07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:46:56.533154 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df89fde0-fea4-4f20-ba50-d8b9c680ec07 None admin] REQUEST_METHOD: `GET` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:46:56.533443 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df89fde0-fea4-4f20-ba50-d8b9c680ec07 None admin] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:46:56.533722 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df89fde0-fea4-4f20-ba50-d8b9c680ec07 None admin] PATH_INFO: `/v3/users` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:46:56.534589 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df89fde0-fea4-4f20-ba50-d8b9c680ec07 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80396) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 15:46:56.535045 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df89fde0-fea4-4f20-ba50-d8b9c680ec07 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:46:56.536359 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df89fde0-fea4-4f20-ba50-d8b9c680ec07 None admin] RBAC: Authorization granted {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:46:56.550430 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e74dddd0-0aac-46e1-9934-a0dc283fe038 None admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:46:56.559270 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 422/853] 10.222.0.59 () {56 vars in 1149 bytes} [Thu Jun 2 15:46:56 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 15:46:56.559270 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df89fde0-fea4-4f20-ba50-d8b9c680ec07 None admin] Authenticating user token {{(pid=80396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:46:56.589057 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG dbcounter [-] [80396] Writing DB stats keystone:SELECT=100 {{(pid=80396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:46:56.593463 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b06b5333-4f08-4a95-888a-473f971361c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:46:56.594180 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b06b5333-4f08-4a95-888a-473f971361c2 None admin] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:46:56.594838 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b06b5333-4f08-4a95-888a-473f971361c2 None admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:46:56.594838 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b06b5333-4f08-4a95-888a-473f971361c2 None admin] PATH_INFO: `/v3/services` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:46:56.595396 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b06b5333-4f08-4a95-888a-473f971361c2 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=80395) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 15:46:56.595696 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b06b5333-4f08-4a95-888a-473f971361c2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:46:56.597052 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b06b5333-4f08-4a95-888a-473f971361c2 None admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:46:56.606667 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 432/854] 10.222.0.59 () {56 vars in 1114 bytes} [Thu Jun 2 15:46:56 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 15:46:56.606667 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b06b5333-4f08-4a95-888a-473f971361c2 None admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:46:56.667355 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df89fde0-fea4-4f20-ba50-d8b9c680ec07 None admin] Validating token access rules against request {{(pid=80396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:46:56.705725 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0be18aa-d95a-4925-bf36-15c223c350d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:46:56.706426 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0be18aa-d95a-4925-bf36-15c223c350d0 None admin] REQUEST_METHOD: `GET` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:46:56.706716 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0be18aa-d95a-4925-bf36-15c223c350d0 None admin] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:46:56.707130 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0be18aa-d95a-4925-bf36-15c223c350d0 None admin] PATH_INFO: `/v3/domains` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:46:56.707908 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0be18aa-d95a-4925-bf36-15c223c350d0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80396) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 15:46:56.708219 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0be18aa-d95a-4925-bf36-15c223c350d0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:46:56.709768 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0be18aa-d95a-4925-bf36-15c223c350d0 None admin] RBAC: Authorization granted {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:46:56.716235 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b06b5333-4f08-4a95-888a-473f971361c2 None admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:46:56.727082 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 423/855] 10.222.0.59 () {56 vars in 1109 bytes} [Thu Jun 2 15:46:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 15:46:56.727082 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0be18aa-d95a-4925-bf36-15c223c350d0 None admin] Authenticating user token {{(pid=80396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:46:56.758253 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d9880c-1e43-4a7b-bbb2-8afe4034ee63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:46:56.758926 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d9880c-1e43-4a7b-bbb2-8afe4034ee63 None admin] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:46:56.759209 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d9880c-1e43-4a7b-bbb2-8afe4034ee63 None admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:46:56.759486 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d9880c-1e43-4a7b-bbb2-8afe4034ee63 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:46:56.777124 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writing DB stats keystone:SELECT=100 {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:46:56.823826 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG dbcounter [-] [80396] Writing DB stats keystone:SELECT=100 {{(pid=80396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:46:56.834804 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70d9880c-1e43-4a7b-bbb2-8afe4034ee63 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:46:56.835694 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0be18aa-d95a-4925-bf36-15c223c350d0 None admin] Validating token access rules against request {{(pid=80396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:46:56.836253 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70d9880c-1e43-4a7b-bbb2-8afe4034ee63 None admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:46:56.877859 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac620603-9f4f-4059-9e2b-9c402104815a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:46:56.878549 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac620603-9f4f-4059-9e2b-9c402104815a None admin] REQUEST_METHOD: `GET` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:46:56.878891 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac620603-9f4f-4059-9e2b-9c402104815a None admin] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:46:56.879164 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac620603-9f4f-4059-9e2b-9c402104815a None admin] PATH_INFO: `/v3/services` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:46:56.880521 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac620603-9f4f-4059-9e2b-9c402104815a None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=80396) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 15:46:56.880836 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac620603-9f4f-4059-9e2b-9c402104815a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:46:56.882471 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac620603-9f4f-4059-9e2b-9c402104815a None admin] RBAC: Authorization granted {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:46:56.887069 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 424/856] 10.222.0.59 () {56 vars in 1114 bytes} [Thu Jun 2 15:46:56 2022] GET /identity/v3/services?type=volumev3 => generated 125 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 15:46:56.887671 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac620603-9f4f-4059-9e2b-9c402104815a None admin] Authenticating user token {{(pid=80396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:46:56.983104 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 433/857] 10.222.0.59 () {58 vars in 1282 bytes} [Thu Jun 2 15:46:56 2022] GET /identity/v3/auth/tokens => generated 1151 bytes in 380 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 02 15:46:56.991182 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d9880c-1e43-4a7b-bbb2-8afe4034ee63 None admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:46:57.007173 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac620603-9f4f-4059-9e2b-9c402104815a None admin] Validating token access rules against request {{(pid=80396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:46:57.045776 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24c26de4-d41c-4eb4-8231-faae2844e54c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:46:57.046612 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c26de4-d41c-4eb4-8231-faae2844e54c None admin] REQUEST_METHOD: `GET` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:46:57.046894 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c26de4-d41c-4eb4-8231-faae2844e54c None admin] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:46:57.047172 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c26de4-d41c-4eb4-8231-faae2844e54c None admin] PATH_INFO: `/v3/projects/service` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:46:57.055684 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24c26de4-d41c-4eb4-8231-faae2844e54c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:46:57.055919 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writing DB stats keystone:SELECT=100 {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:46:57.057225 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24c26de4-d41c-4eb4-8231-faae2844e54c None admin] RBAC: Authorization granted {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:46:57.072513 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application [None req-24c26de4-d41c-4eb4-8231-faae2844e54c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 02 15:46:57.072513 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 15:46:57.072513 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 15:46:57.072513 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 15:46:57.072513 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 15:46:57.072513 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 15:46:57.072513 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 15:46:57.072513 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 15:46:57.072513 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 15:46:57.072513 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 15:46:57.072513 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 15:46:57.072513 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 15:46:57.072513 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 02 15:46:57.072513 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 02 15:46:57.072513 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 02 15:46:57.073470 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 02 15:46:57.073470 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 15:46:57.073470 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 15:46:57.073470 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 15:46:57.073470 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 15:46:57.073470 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 15:46:57.073470 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 15:46:57.073470 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 15:46:57.073470 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application with Lock( Jun 02 15:46:57.073470 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 15:46:57.073470 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application return self._enter() Jun 02 15:46:57.073470 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 15:46:57.073470 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 15:46:57.073470 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 15:46:57.073470 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application return self.creator() Jun 02 15:46:57.073470 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 15:46:57.073470 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application created_value = creator( Jun 02 15:46:57.074396 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 02 15:46:57.074396 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 02 15:46:57.074396 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 02 15:46:57.074396 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 02 15:46:57.074396 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 02 15:46:57.074396 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 02 15:46:57.074396 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 02 15:46:57.074396 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application Jun 02 15:46:57.074396 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 425/858] 10.222.0.59 () {56 vars in 1111 bytes} [Thu Jun 2 15:46:56 2022] GET /identity/v3/projects/service => generated 88 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 15:46:57.080686 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24c26de4-d41c-4eb4-8231-faae2844e54c None admin] Authenticating user token {{(pid=80396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:46:57.099982 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG dbcounter [-] [80396] Writing DB stats keystone:SELECT=100 {{(pid=80396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:46:57.123800 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d9880c-1e43-4a7b-bbb2-8afe4034ee63 None admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:46:57.164989 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-389afcef-1e10-4aa3-9a4a-3fb8bb678321 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:46:57.165782 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-389afcef-1e10-4aa3-9a4a-3fb8bb678321 None admin] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:46:57.166062 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-389afcef-1e10-4aa3-9a4a-3fb8bb678321 None admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:46:57.166366 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-389afcef-1e10-4aa3-9a4a-3fb8bb678321 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:46:57.178602 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-389afcef-1e10-4aa3-9a4a-3fb8bb678321 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:46:57.180378 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-389afcef-1e10-4aa3-9a4a-3fb8bb678321 None admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:46:57.199628 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24c26de4-d41c-4eb4-8231-faae2844e54c None admin] Validating token access rules against request {{(pid=80396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:46:57.199899 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application [None req-389afcef-1e10-4aa3-9a4a-3fb8bb678321 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 15:46:57.199899 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 15:46:57.199899 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 15:46:57.199899 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 15:46:57.199899 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 15:46:57.199899 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 15:46:57.199899 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 15:46:57.199899 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 15:46:57.199899 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 15:46:57.199899 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 15:46:57.199899 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 15:46:57.199899 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 15:46:57.199899 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 02 15:46:57.199899 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 02 15:46:57.199899 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 02 15:46:57.200751 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 02 15:46:57.200751 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 15:46:57.200751 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 15:46:57.200751 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 15:46:57.200751 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 15:46:57.200751 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 15:46:57.200751 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 15:46:57.200751 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 15:46:57.200751 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application with Lock( Jun 02 15:46:57.200751 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 15:46:57.200751 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self._enter() Jun 02 15:46:57.200751 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 15:46:57.200751 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 15:46:57.200751 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 15:46:57.200751 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self.creator() Jun 02 15:46:57.200751 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 15:46:57.200751 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application created_value = creator( Jun 02 15:46:57.202318 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 02 15:46:57.202318 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 02 15:46:57.202318 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 15:46:57.202318 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application Jun 02 15:46:57.202318 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 434/859] 10.222.0.59 () {56 vars in 1108 bytes} [Thu Jun 2 15:46:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 15:46:57.202706 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598be8b8-58f3-4461-bb0c-a8d3d8e4f2f2 None None] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:46:57.202973 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598be8b8-58f3-4461-bb0c-a8d3d8e4f2f2 None None] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:46:57.203240 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598be8b8-58f3-4461-bb0c-a8d3d8e4f2f2 None None] PATH_INFO: `/` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:46:57.204659 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 435/860] 10.222.0.59 () {54 vars in 926 bytes} [Thu Jun 2 15:46:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 15:46:57.209549 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-598be8b8-58f3-4461-bb0c-a8d3d8e4f2f2 None None] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:46:57.241145 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c056b5d-4cfa-4126-8aea-dcb437223f38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:46:57.241725 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c056b5d-4cfa-4126-8aea-dcb437223f38 None admin] REQUEST_METHOD: `GET` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:46:57.242008 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c056b5d-4cfa-4126-8aea-dcb437223f38 None admin] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:46:57.242581 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c056b5d-4cfa-4126-8aea-dcb437223f38 None admin] PATH_INFO: `/v3/projects` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:46:57.243107 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c056b5d-4cfa-4126-8aea-dcb437223f38 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80396) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 15:46:57.243428 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c056b5d-4cfa-4126-8aea-dcb437223f38 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:46:57.244831 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c056b5d-4cfa-4126-8aea-dcb437223f38 None admin] RBAC: Authorization granted {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:46:57.257255 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 426/861] 10.222.0.59 () {56 vars in 1148 bytes} [Thu Jun 2 15:46:57 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 15:46:57.258351 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba0e24d-0d08-4169-896c-f6964923f871 None None] REQUEST_METHOD: `POST` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:46:57.258644 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba0e24d-0d08-4169-896c-f6964923f871 None None] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:46:57.258921 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba0e24d-0d08-4169-896c-f6964923f871 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:46:57.276237 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.auth.core [None req-aba0e24d-0d08-4169-896c-f6964923f871 None None] MFA Rules not processed for user `400d1f4db9de49638549e5db29a041e1`. Rule list: `[]` (Enabled: `True`). {{(pid=80396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 15:46:57.277714 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.fernet_utils [None req-aba0e24d-0d08-4169-896c-f6964923f871 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 15:46:57.322701 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writing DB stats keystone:SELECT=100 {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:46:57.327769 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-598be8b8-58f3-4461-bb0c-a8d3d8e4f2f2 None None] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:46:57.352494 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 427/862] 10.222.0.59 () {58 vars in 1023 bytes} [Thu Jun 2 15:46:57 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 02 15:46:57.353419 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aba0e24d-0d08-4169-896c-f6964923f871 None None] Authenticating user token {{(pid=80396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:46:57.366424 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG dbcounter [-] [80396] Writing DB stats keystone:SELECT=100 {{(pid=80396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:46:57.372061 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-674699bb-0457-4e0a-80c6-0b8a298f6931 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:46:57.373223 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-674699bb-0457-4e0a-80c6-0b8a298f6931 None admin] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:46:57.373714 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-674699bb-0457-4e0a-80c6-0b8a298f6931 None admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:46:57.374198 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-674699bb-0457-4e0a-80c6-0b8a298f6931 None admin] PATH_INFO: `/v3/domains` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:46:57.375195 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-674699bb-0457-4e0a-80c6-0b8a298f6931 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80395) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 15:46:57.375683 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-674699bb-0457-4e0a-80c6-0b8a298f6931 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:46:57.377199 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-674699bb-0457-4e0a-80c6-0b8a298f6931 None admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:46:57.389706 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 436/863] 10.222.0.59 () {56 vars in 1109 bytes} [Thu Jun 2 15:46:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 15:46:57.390790 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-674699bb-0457-4e0a-80c6-0b8a298f6931 None admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:46:57.466335 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aba0e24d-0d08-4169-896c-f6964923f871 None None] Validating token access rules against request {{(pid=80396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:46:57.496409 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-674699bb-0457-4e0a-80c6-0b8a298f6931 None admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:46:57.501540 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95afe9ba-75a8-4370-85be-82bc62c60fe4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:46:57.502226 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95afe9ba-75a8-4370-85be-82bc62c60fe4 None admin] REQUEST_METHOD: `GET` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:46:57.502512 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95afe9ba-75a8-4370-85be-82bc62c60fe4 None admin] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:46:57.502786 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95afe9ba-75a8-4370-85be-82bc62c60fe4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:46:57.503636 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95afe9ba-75a8-4370-85be-82bc62c60fe4 None admin] RBAC: Adding query filter params (role.id=f1e0c25f6e9049e897cb7350c7e54ab3, scope.project.id=9c87c981909d4b8db02783421818c79b, user.id=31bd858bf7674f43a99b77d11bc3c1a3) {{(pid=80396) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 15:46:57.503925 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95afe9ba-75a8-4370-85be-82bc62c60fe4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:46:57.505921 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95afe9ba-75a8-4370-85be-82bc62c60fe4 None admin] RBAC: Authorization granted {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:46:57.513046 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 428/864] 10.222.0.59 () {56 vars in 1374 bytes} [Thu Jun 2 15:46:57 2022] GET /identity/v3/role_assignments?user.id=31bd858bf7674f43a99b77d11bc3c1a3&scope.project.id=9c87c981909d4b8db02783421818c79b&role.id=f1e0c25f6e9049e897cb7350c7e54ab3 => generated 608 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 15:46:57.513681 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95afe9ba-75a8-4370-85be-82bc62c60fe4 None admin] Authenticating user token {{(pid=80396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:46:57.551446 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2044f1df-6f61-4dbb-98f5-69b42fdc5eec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:46:57.552989 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2044f1df-6f61-4dbb-98f5-69b42fdc5eec None admin] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:46:57.553495 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2044f1df-6f61-4dbb-98f5-69b42fdc5eec None admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:46:57.554284 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2044f1df-6f61-4dbb-98f5-69b42fdc5eec None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:46:57.555805 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2044f1df-6f61-4dbb-98f5-69b42fdc5eec None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:46:57.557547 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2044f1df-6f61-4dbb-98f5-69b42fdc5eec None admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:46:57.574625 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application [None req-2044f1df-6f61-4dbb-98f5-69b42fdc5eec None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 02 15:46:57.574625 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 15:46:57.574625 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 02 15:46:57.574625 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 02 15:46:57.574625 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 02 15:46:57.574625 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 02 15:46:57.574625 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 02 15:46:57.574625 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 02 15:46:57.574625 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 02 15:46:57.574625 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application Jun 02 15:46:57.574625 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 02 15:46:57.574625 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application Jun 02 15:46:57.574625 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 15:46:57.574625 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 15:46:57.574625 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 15:46:57.574625 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 15:46:57.575674 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 15:46:57.575674 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 15:46:57.575674 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 15:46:57.575674 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 15:46:57.575674 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 15:46:57.575674 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 15:46:57.575674 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 15:46:57.575674 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 02 15:46:57.575674 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 02 15:46:57.575674 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 02 15:46:57.575674 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 02 15:46:57.575674 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 15:46:57.575674 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 15:46:57.575674 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 15:46:57.575674 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 15:46:57.575674 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 15:46:57.576539 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 15:46:57.576539 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 15:46:57.576539 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application with Lock( Jun 02 15:46:57.576539 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 15:46:57.576539 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self._enter() Jun 02 15:46:57.576539 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 15:46:57.576539 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 15:46:57.576539 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 15:46:57.576539 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self.creator() Jun 02 15:46:57.576539 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 15:46:57.576539 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application created_value = creator( Jun 02 15:46:57.576539 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 02 15:46:57.576539 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 02 15:46:57.576539 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 02 15:46:57.576539 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application Jun 02 15:46:57.581319 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 437/865] 10.222.0.59 () {56 vars in 1132 bytes} [Thu Jun 2 15:46:57 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 15:46:57.582497 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2044f1df-6f61-4dbb-98f5-69b42fdc5eec None admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:46:57.609019 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG dbcounter [-] [80396] Writing DB stats keystone:SELECT=100 {{(pid=80396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:46:57.611120 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writing DB stats keystone:SELECT=100 {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:46:57.652341 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95afe9ba-75a8-4370-85be-82bc62c60fe4 None admin] Validating token access rules against request {{(pid=80396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:46:57.693337 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb13b11f-8008-4466-a097-0f0f6dbf3be8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:46:57.694560 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb13b11f-8008-4466-a097-0f0f6dbf3be8 None admin] REQUEST_METHOD: `GET` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:46:57.695134 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb13b11f-8008-4466-a097-0f0f6dbf3be8 None admin] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:46:57.695528 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2044f1df-6f61-4dbb-98f5-69b42fdc5eec None admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:46:57.695841 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb13b11f-8008-4466-a097-0f0f6dbf3be8 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:46:57.704221 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb13b11f-8008-4466-a097-0f0f6dbf3be8 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:46:57.706299 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb13b11f-8008-4466-a097-0f0f6dbf3be8 None admin] RBAC: Authorization granted {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:46:57.724596 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application [None req-bb13b11f-8008-4466-a097-0f0f6dbf3be8 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 02 15:46:57.724596 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 15:46:57.724596 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 15:46:57.724596 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 15:46:57.724596 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 15:46:57.724596 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 15:46:57.724596 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 15:46:57.724596 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 15:46:57.724596 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 15:46:57.724596 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 15:46:57.724596 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 15:46:57.724596 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 15:46:57.724596 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 02 15:46:57.724596 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 02 15:46:57.724596 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 02 15:46:57.725541 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 02 15:46:57.725541 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 15:46:57.725541 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 15:46:57.725541 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 15:46:57.725541 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 15:46:57.725541 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 15:46:57.725541 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 15:46:57.725541 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 15:46:57.725541 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application with Lock( Jun 02 15:46:57.725541 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 15:46:57.725541 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application return self._enter() Jun 02 15:46:57.725541 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 15:46:57.725541 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 15:46:57.725541 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 15:46:57.725541 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application return self.creator() Jun 02 15:46:57.725541 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 15:46:57.725541 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application created_value = creator( Jun 02 15:46:57.726497 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 02 15:46:57.726497 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 02 15:46:57.726497 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 02 15:46:57.726497 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 02 15:46:57.726497 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 02 15:46:57.726497 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 02 15:46:57.726497 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 02 15:46:57.726497 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application Jun 02 15:46:57.729093 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 429/866] 10.222.0.59 () {56 vars in 1111 bytes} [Thu Jun 2 15:46:57 2022] GET /identity/v3/projects/service => generated 88 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 15:46:57.734699 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb13b11f-8008-4466-a097-0f0f6dbf3be8 None admin] Authenticating user token {{(pid=80396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:46:57.736063 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe1711c6-281c-4763-bf1d-33304b39989d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:46:57.736731 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1711c6-281c-4763-bf1d-33304b39989d None admin] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:46:57.737009 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1711c6-281c-4763-bf1d-33304b39989d None admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:46:57.737287 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1711c6-281c-4763-bf1d-33304b39989d None admin] PATH_INFO: `/v3/services` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:46:57.737999 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe1711c6-281c-4763-bf1d-33304b39989d None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=80395) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 15:46:57.738335 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe1711c6-281c-4763-bf1d-33304b39989d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:46:57.740864 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe1711c6-281c-4763-bf1d-33304b39989d None admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:46:57.746209 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 438/867] 10.222.0.59 () {56 vars in 1126 bytes} [Thu Jun 2 15:46:57 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 15:46:57.753114 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe1711c6-281c-4763-bf1d-33304b39989d None admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:46:57.851130 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writing DB stats keystone:SELECT=100 {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:46:57.871511 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe1711c6-281c-4763-bf1d-33304b39989d None admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:46:57.873271 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb13b11f-8008-4466-a097-0f0f6dbf3be8 None admin] Validating token access rules against request {{(pid=80396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:46:57.905316 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG dbcounter [-] [80396] Writing DB stats keystone:SELECT=100 {{(pid=80396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:46:57.911642 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2c0fc8a-63d1-4ab1-87f6-c9b850574ae6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:46:57.919243 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c0fc8a-63d1-4ab1-87f6-c9b850574ae6 None admin] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:46:57.919243 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c0fc8a-63d1-4ab1-87f6-c9b850574ae6 None admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:46:57.919243 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c0fc8a-63d1-4ab1-87f6-c9b850574ae6 None admin] PATH_INFO: `/v3/services` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:46:57.919243 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2c0fc8a-63d1-4ab1-87f6-c9b850574ae6 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=80395) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 15:46:57.919243 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2c0fc8a-63d1-4ab1-87f6-c9b850574ae6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:46:57.919850 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f07c875-c4ec-4c44-ad33-565563382cbc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:46:57.919953 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2c0fc8a-63d1-4ab1-87f6-c9b850574ae6 None admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:46:57.920051 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f07c875-c4ec-4c44-ad33-565563382cbc None admin] REQUEST_METHOD: `GET` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:46:57.920051 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f07c875-c4ec-4c44-ad33-565563382cbc None admin] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:46:57.920051 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f07c875-c4ec-4c44-ad33-565563382cbc None admin] PATH_INFO: `/v3/projects` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:46:57.920051 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f07c875-c4ec-4c44-ad33-565563382cbc None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80396) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 15:46:57.920051 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f07c875-c4ec-4c44-ad33-565563382cbc None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:46:57.920051 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f07c875-c4ec-4c44-ad33-565563382cbc None admin] RBAC: Authorization granted {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:46:57.920500 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 439/868] 10.222.0.59 () {56 vars in 1126 bytes} [Thu Jun 2 15:46:57 2022] GET /identity/v3/services?type=compute_legacy => generated 131 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 15:46:57.935907 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 430/869] 10.222.0.59 () {56 vars in 1148 bytes} [Thu Jun 2 15:46:57 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 15:46:57.941730 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2c0fc8a-63d1-4ab1-87f6-c9b850574ae6 None admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:46:58.064553 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2c0fc8a-63d1-4ab1-87f6-c9b850574ae6 None admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:46:58.105524 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e5dc8d7-a9f4-4e63-ad8b-a1fe303fbeb1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:46:58.106242 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e5dc8d7-a9f4-4e63-ad8b-a1fe303fbeb1 None admin] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:46:58.106525 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e5dc8d7-a9f4-4e63-ad8b-a1fe303fbeb1 None admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:46:58.106803 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e5dc8d7-a9f4-4e63-ad8b-a1fe303fbeb1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:46:58.107664 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e5dc8d7-a9f4-4e63-ad8b-a1fe303fbeb1 None admin] RBAC: Adding query filter params (role.id=36214aa6067e4493a555da410f965c5e, scope.project.id=9c87c981909d4b8db02783421818c79b, user.id=11b714eb2dda4460a8ff52215e671bfa) {{(pid=80395) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 15:46:58.107978 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e5dc8d7-a9f4-4e63-ad8b-a1fe303fbeb1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:46:58.109540 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e5dc8d7-a9f4-4e63-ad8b-a1fe303fbeb1 None admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:46:58.117708 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 440/870] 10.222.0.59 () {56 vars in 1374 bytes} [Thu Jun 2 15:46:57 2022] GET /identity/v3/role_assignments?user.id=11b714eb2dda4460a8ff52215e671bfa&scope.project.id=9c87c981909d4b8db02783421818c79b&role.id=36214aa6067e4493a555da410f965c5e => generated 608 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 15:46:59.214840 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c75d97c3-1835-4f87-956c-a5ac520902e6 None None] REQUEST_METHOD: `GET` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:46:59.215356 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c75d97c3-1835-4f87-956c-a5ac520902e6 None None] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:46:59.215434 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c75d97c3-1835-4f87-956c-a5ac520902e6 None None] PATH_INFO: `/` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:46:59.217035 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 431/871] 10.222.0.59 () {54 vars in 926 bytes} [Thu Jun 2 15:46:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 15:46:59.222362 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae488a9-f0d2-4a0a-9bc1-44d06e73a17c None None] REQUEST_METHOD: `POST` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:46:59.222772 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae488a9-f0d2-4a0a-9bc1-44d06e73a17c None None] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:46:59.223009 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae488a9-f0d2-4a0a-9bc1-44d06e73a17c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:46:59.240447 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.auth.core [None req-6ae488a9-f0d2-4a0a-9bc1-44d06e73a17c None None] MFA Rules not processed for user `400d1f4db9de49638549e5db29a041e1`. Rule list: `[]` (Enabled: `True`). {{(pid=80395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 15:46:59.241629 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.fernet_utils [None req-6ae488a9-f0d2-4a0a-9bc1-44d06e73a17c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 15:46:59.251534 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writing DB stats keystone:SELECT=100 {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:46:59.312269 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 441/872] 10.222.0.59 () {58 vars in 1023 bytes} [Thu Jun 2 15:46:59 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 02 15:46:59.334963 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c75d97c3-1835-4f87-956c-a5ac520902e6 None None] Authenticating user token {{(pid=80396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:46:59.442616 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c75d97c3-1835-4f87-956c-a5ac520902e6 None None] Validating token access rules against request {{(pid=80396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:46:59.477698 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9969223-4d3b-48f0-b4f5-921d95141506 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:46:59.478383 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9969223-4d3b-48f0-b4f5-921d95141506 None admin] REQUEST_METHOD: `POST` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:46:59.478661 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9969223-4d3b-48f0-b4f5-921d95141506 None admin] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:46:59.478932 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9969223-4d3b-48f0-b4f5-921d95141506 None admin] PATH_INFO: `/v3/services` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:46:59.479657 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9969223-4d3b-48f0-b4f5-921d95141506 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:46:59.481010 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9969223-4d3b-48f0-b4f5-921d95141506 None admin] RBAC: Authorization granted {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:46:59.536550 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 432/873] 10.222.0.59 () {60 vars in 1141 bytes} [Thu Jun 2 15:46:59 2022] POST /identity/v3/services => generated 251 bytes in 202 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 15:46:59.886890 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52e6987-277e-4e5b-b970-8b582abe2a2d None None] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:46:59.887191 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52e6987-277e-4e5b-b970-8b582abe2a2d None None] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:46:59.887359 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52e6987-277e-4e5b-b970-8b582abe2a2d None None] PATH_INFO: `/` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:46:59.888953 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 442/874] 10.222.0.59 () {54 vars in 926 bytes} [Thu Jun 2 15:46:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 15:46:59.894429 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b84c0f-7624-4082-aec6-a84d4aedf6fb None None] REQUEST_METHOD: `POST` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:46:59.895251 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b84c0f-7624-4082-aec6-a84d4aedf6fb None None] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:46:59.895546 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b84c0f-7624-4082-aec6-a84d4aedf6fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:46:59.913011 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.auth.core [None req-b3b84c0f-7624-4082-aec6-a84d4aedf6fb None None] MFA Rules not processed for user `400d1f4db9de49638549e5db29a041e1`. Rule list: `[]` (Enabled: `True`). {{(pid=80396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 15:46:59.914256 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.fernet_utils [None req-b3b84c0f-7624-4082-aec6-a84d4aedf6fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 15:46:59.965228 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG dbcounter [-] [80396] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:46:59.998140 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 433/875] 10.222.0.59 () {58 vars in 1023 bytes} [Thu Jun 2 15:46:59 2022] POST /identity/v3/auth/tokens => generated 1252 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 02 15:47:00.020527 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c52e6987-277e-4e5b-b970-8b582abe2a2d None None] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:47:00.130339 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c52e6987-277e-4e5b-b970-8b582abe2a2d None None] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:47:00.166333 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09307daa-b6a1-4233-9b6f-d2d0ae032c1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:47:00.169580 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09307daa-b6a1-4233-9b6f-d2d0ae032c1f None admin] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:47:00.169580 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09307daa-b6a1-4233-9b6f-d2d0ae032c1f None admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:47:00.169580 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09307daa-b6a1-4233-9b6f-d2d0ae032c1f None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:47:00.169580 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09307daa-b6a1-4233-9b6f-d2d0ae032c1f None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:47:00.170253 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09307daa-b6a1-4233-9b6f-d2d0ae032c1f None admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:47:00.185396 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application [None req-09307daa-b6a1-4233-9b6f-d2d0ae032c1f None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 02 15:47:00.185396 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 15:47:00.185396 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 02 15:47:00.185396 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 02 15:47:00.185396 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 02 15:47:00.185396 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 02 15:47:00.185396 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 02 15:47:00.185396 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 02 15:47:00.185396 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 02 15:47:00.185396 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application Jun 02 15:47:00.185396 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 02 15:47:00.185396 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application Jun 02 15:47:00.185396 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 15:47:00.185396 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 15:47:00.185396 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 15:47:00.185396 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 15:47:00.185396 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 15:47:00.186503 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 15:47:00.186503 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 15:47:00.186503 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 15:47:00.186503 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 15:47:00.186503 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 15:47:00.186503 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 15:47:00.186503 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 02 15:47:00.186503 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 02 15:47:00.186503 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 02 15:47:00.186503 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 02 15:47:00.186503 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 15:47:00.186503 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 15:47:00.186503 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 15:47:00.186503 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 15:47:00.186503 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 15:47:00.186503 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 15:47:00.187334 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 15:47:00.187334 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application with Lock( Jun 02 15:47:00.187334 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 15:47:00.187334 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self._enter() Jun 02 15:47:00.187334 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 15:47:00.187334 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 15:47:00.187334 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 15:47:00.187334 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self.creator() Jun 02 15:47:00.187334 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 15:47:00.187334 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application created_value = creator( Jun 02 15:47:00.187334 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 02 15:47:00.187334 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 02 15:47:00.187334 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 02 15:47:00.187334 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application Jun 02 15:47:00.190393 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 443/876] 10.222.0.59 () {56 vars in 1126 bytes} [Thu Jun 2 15:47:00 2022] GET /identity/v3/services/object-store => generated 93 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 15:47:00.198133 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3b84c0f-7624-4082-aec6-a84d4aedf6fb None None] Authenticating user token {{(pid=80396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:47:00.305895 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3b84c0f-7624-4082-aec6-a84d4aedf6fb None None] Validating token access rules against request {{(pid=80396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:47:00.334330 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b08cb8cc-a9e5-477c-aced-9d23d5dac65f None None] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:47:00.335276 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b08cb8cc-a9e5-477c-aced-9d23d5dac65f None None] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:47:00.335761 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b08cb8cc-a9e5-477c-aced-9d23d5dac65f None None] PATH_INFO: `/` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:47:00.337957 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 444/877] 10.222.0.59 () {54 vars in 926 bytes} [Thu Jun 2 15:47:00 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 15:47:00.343024 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f1d2b7-3979-46a5-b203-9593abefa210 None None] REQUEST_METHOD: `POST` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:47:00.343580 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f1d2b7-3979-46a5-b203-9593abefa210 None None] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:47:00.343803 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff8fe29c-0bf1-43ea-a1ad-8f4ff378ac7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:47:00.344288 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f1d2b7-3979-46a5-b203-9593abefa210 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:47:00.344482 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff8fe29c-0bf1-43ea-a1ad-8f4ff378ac7f None admin] REQUEST_METHOD: `GET` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:47:00.344744 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff8fe29c-0bf1-43ea-a1ad-8f4ff378ac7f None admin] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:47:00.345029 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff8fe29c-0bf1-43ea-a1ad-8f4ff378ac7f None admin] PATH_INFO: `/v3/services` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:47:00.345742 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff8fe29c-0bf1-43ea-a1ad-8f4ff378ac7f None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80396) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 15:47:00.346048 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff8fe29c-0bf1-43ea-a1ad-8f4ff378ac7f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:47:00.347596 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff8fe29c-0bf1-43ea-a1ad-8f4ff378ac7f None admin] RBAC: Authorization granted {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:47:00.353677 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 434/878] 10.222.0.59 () {56 vars in 1122 bytes} [Thu Jun 2 15:47:00 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 15:47:00.363083 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff8fe29c-0bf1-43ea-a1ad-8f4ff378ac7f None admin] Authenticating user token {{(pid=80396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:47:00.364821 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.auth.core [None req-01f1d2b7-3979-46a5-b203-9593abefa210 None None] MFA Rules not processed for user `400d1f4db9de49638549e5db29a041e1`. Rule list: `[]` (Enabled: `True`). {{(pid=80395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 15:47:00.366303 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.fernet_utils [None req-01f1d2b7-3979-46a5-b203-9593abefa210 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 15:47:00.368779 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writing DB stats keystone:SELECT=100 {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:47:00.414713 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG dbcounter [-] [80396] Writing DB stats keystone:SELECT=100 {{(pid=80396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:47:00.466094 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 445/879] 10.222.0.59 () {58 vars in 1023 bytes} [Thu Jun 2 15:47:00 2022] POST /identity/v3/auth/tokens => generated 1252 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 02 15:47:00.483611 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01f1d2b7-3979-46a5-b203-9593abefa210 None None] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:47:00.483982 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff8fe29c-0bf1-43ea-a1ad-8f4ff378ac7f None admin] Validating token access rules against request {{(pid=80396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:47:00.528113 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a49e30f5-a4a6-4faf-8d21-d0898758e1da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:47:00.528811 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49e30f5-a4a6-4faf-8d21-d0898758e1da None admin] REQUEST_METHOD: `GET` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:47:00.529330 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49e30f5-a4a6-4faf-8d21-d0898758e1da None admin] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:47:00.529618 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49e30f5-a4a6-4faf-8d21-d0898758e1da None admin] PATH_INFO: `/v3/services` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:47:00.530355 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a49e30f5-a4a6-4faf-8d21-d0898758e1da None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80396) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 15:47:00.530668 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a49e30f5-a4a6-4faf-8d21-d0898758e1da None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:47:00.532221 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a49e30f5-a4a6-4faf-8d21-d0898758e1da None admin] RBAC: Authorization granted {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:47:00.538784 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 435/880] 10.222.0.59 () {56 vars in 1122 bytes} [Thu Jun 2 15:47:00 2022] GET /identity/v3/services?type=object-store => generated 129 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 15:47:00.553707 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8523a2-6d8a-4b12-a468-9408cae2100f None None] REQUEST_METHOD: `GET` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:47:00.554048 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8523a2-6d8a-4b12-a468-9408cae2100f None None] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:47:00.554296 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8523a2-6d8a-4b12-a468-9408cae2100f None None] PATH_INFO: `/` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:47:00.556080 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 436/881] 10.222.0.59 () {54 vars in 926 bytes} [Thu Jun 2 15:47:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 02 15:47:00.561655 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d4afe6-5660-4085-af24-6214be999bd6 None None] REQUEST_METHOD: `POST` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:47:00.561949 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d4afe6-5660-4085-af24-6214be999bd6 None None] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:47:00.562311 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d4afe6-5660-4085-af24-6214be999bd6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:47:00.580456 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.auth.core [None req-c1d4afe6-5660-4085-af24-6214be999bd6 None None] MFA Rules not processed for user `400d1f4db9de49638549e5db29a041e1`. Rule list: `[]` (Enabled: `True`). {{(pid=80396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 15:47:00.581870 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.fernet_utils [None req-c1d4afe6-5660-4085-af24-6214be999bd6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 15:47:00.602943 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01f1d2b7-3979-46a5-b203-9593abefa210 None None] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:47:00.644642 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7187b9d1-6558-44ad-a4b2-b8b5d49343bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:47:00.645635 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7187b9d1-6558-44ad-a4b2-b8b5d49343bd None admin] REQUEST_METHOD: `POST` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:47:00.646007 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7187b9d1-6558-44ad-a4b2-b8b5d49343bd None admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:47:00.646309 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7187b9d1-6558-44ad-a4b2-b8b5d49343bd None admin] PATH_INFO: `/v3/services` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:47:00.647040 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7187b9d1-6558-44ad-a4b2-b8b5d49343bd None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:47:00.648465 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7187b9d1-6558-44ad-a4b2-b8b5d49343bd None admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:47:00.669386 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 437/882] 10.222.0.59 () {58 vars in 1023 bytes} [Thu Jun 2 15:47:00 2022] POST /identity/v3/auth/tokens => generated 1252 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 02 15:47:00.695396 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1d4afe6-5660-4085-af24-6214be999bd6 None None] Authenticating user token {{(pid=80396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:47:00.732307 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG dbcounter [-] [80396] Writing DB stats keystone:SELECT=100 {{(pid=80396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:47:00.746925 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:47:00.753552 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 446/883] 10.222.0.59 () {60 vars in 1141 bytes} [Thu Jun 2 15:47:00 2022] POST /identity/v3/services => generated 269 bytes in 270 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 02 15:47:00.839899 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1d4afe6-5660-4085-af24-6214be999bd6 None None] Validating token access rules against request {{(pid=80396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:47:00.886572 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a84f4ad1-f356-4a3a-8fd0-9544964b0261 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:47:00.887403 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a84f4ad1-f356-4a3a-8fd0-9544964b0261 None admin] REQUEST_METHOD: `GET` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:47:00.887686 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a84f4ad1-f356-4a3a-8fd0-9544964b0261 None admin] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:47:00.887965 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a84f4ad1-f356-4a3a-8fd0-9544964b0261 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:47:00.900556 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a84f4ad1-f356-4a3a-8fd0-9544964b0261 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 02 15:47:00.909044 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application [None req-a84f4ad1-f356-4a3a-8fd0-9544964b0261 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 02 15:47:00.909044 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 15:47:00.909044 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 15:47:00.909044 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 15:47:00.909044 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 15:47:00.909044 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 15:47:00.909044 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 15:47:00.909044 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 15:47:00.909044 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 15:47:00.909044 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 15:47:00.909044 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 15:47:00.909044 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 15:47:00.909044 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 02 15:47:00.909044 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 02 15:47:00.909044 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 02 15:47:00.909044 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 02 15:47:00.910064 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 02 15:47:00.910064 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 02 15:47:00.910064 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 02 15:47:00.910064 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 02 15:47:00.910064 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 15:47:00.910064 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 15:47:00.910064 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 15:47:00.910064 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 15:47:00.910064 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 15:47:00.910064 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 15:47:00.910064 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 15:47:00.910064 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application with Lock( Jun 02 15:47:00.910064 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 15:47:00.910064 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application return self._enter() Jun 02 15:47:00.910064 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 15:47:00.910064 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 15:47:00.911502 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 15:47:00.911502 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application return self.creator() Jun 02 15:47:00.911502 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 15:47:00.911502 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application created_value = creator( Jun 02 15:47:00.911502 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 02 15:47:00.911502 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 02 15:47:00.911502 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 02 15:47:00.911502 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 02 15:47:00.911502 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 02 15:47:00.911502 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 02 15:47:00.911502 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 02 15:47:00.911502 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application Jun 02 15:47:00.911502 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 438/884] 10.222.0.59 () {56 vars in 1120 bytes} [Thu Jun 2 15:47:00 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 02 15:47:00.917342 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7187b9d1-6558-44ad-a4b2-b8b5d49343bd None admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:47:01.029583 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7187b9d1-6558-44ad-a4b2-b8b5d49343bd None admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:47:01.063461 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ddf5f18-51ec-439f-9ad3-13669a848223 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:47:01.064129 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ddf5f18-51ec-439f-9ad3-13669a848223 None admin] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:47:01.064412 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ddf5f18-51ec-439f-9ad3-13669a848223 None admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:47:01.064685 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ddf5f18-51ec-439f-9ad3-13669a848223 None admin] PATH_INFO: `/v3/roles` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:47:01.065428 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ddf5f18-51ec-439f-9ad3-13669a848223 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80395) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 15:47:01.065734 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ddf5f18-51ec-439f-9ad3-13669a848223 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:47:01.067676 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ddf5f18-51ec-439f-9ad3-13669a848223 None admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:47:01.076597 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 447/885] 10.222.0.59 () {56 vars in 1115 bytes} [Thu Jun 2 15:47:00 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 15:47:01.081936 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a84f4ad1-f356-4a3a-8fd0-9544964b0261 None admin] Authenticating user token {{(pid=80396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:47:01.182580 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG dbcounter [-] [80396] Writing DB stats keystone:SELECT=100 {{(pid=80396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:47:01.191679 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a84f4ad1-f356-4a3a-8fd0-9544964b0261 None admin] Validating token access rules against request {{(pid=80396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:47:01.229059 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b637996-f648-41bf-9cde-3456713b85e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:47:01.229902 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b637996-f648-41bf-9cde-3456713b85e3 None admin] REQUEST_METHOD: `GET` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:47:01.230282 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b637996-f648-41bf-9cde-3456713b85e3 None admin] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:47:01.230792 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b637996-f648-41bf-9cde-3456713b85e3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:47:01.242997 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b637996-f648-41bf-9cde-3456713b85e3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:47:01.244471 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b637996-f648-41bf-9cde-3456713b85e3 None admin] RBAC: Authorization granted {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:47:01.262743 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application [None req-9b637996-f648-41bf-9cde-3456713b85e3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 15:47:01.262743 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 15:47:01.262743 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 15:47:01.262743 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 15:47:01.262743 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 15:47:01.262743 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 15:47:01.262743 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 15:47:01.262743 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 15:47:01.262743 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 15:47:01.262743 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 15:47:01.262743 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 15:47:01.262743 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 15:47:01.262743 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 02 15:47:01.262743 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 02 15:47:01.262743 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 02 15:47:01.263899 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 02 15:47:01.263899 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 15:47:01.263899 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 15:47:01.263899 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 15:47:01.263899 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 15:47:01.263899 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 15:47:01.263899 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 15:47:01.263899 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 15:47:01.263899 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application with Lock( Jun 02 15:47:01.263899 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 15:47:01.263899 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application return self._enter() Jun 02 15:47:01.263899 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 15:47:01.263899 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 15:47:01.263899 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 15:47:01.263899 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application return self.creator() Jun 02 15:47:01.263899 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 15:47:01.263899 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application created_value = creator( Jun 02 15:47:01.265084 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 02 15:47:01.265084 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 02 15:47:01.265084 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 15:47:01.265084 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application Jun 02 15:47:01.268673 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 439/886] 10.222.0.59 () {56 vars in 1108 bytes} [Thu Jun 2 15:47:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 15:47:01.270291 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ddf5f18-51ec-439f-9ad3-13669a848223 None admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:47:01.335965 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writing DB stats keystone:SELECT=100 {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:47:01.383037 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ddf5f18-51ec-439f-9ad3-13669a848223 None admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:47:01.418517 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39b51379-942b-4861-8da7-263ac2a330ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:47:01.419184 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b51379-942b-4861-8da7-263ac2a330ba None admin] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:47:01.419468 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b51379-942b-4861-8da7-263ac2a330ba None admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:47:01.419753 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b51379-942b-4861-8da7-263ac2a330ba None admin] PATH_INFO: `/v3/domains` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:47:01.420476 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39b51379-942b-4861-8da7-263ac2a330ba None admin] RBAC: Adding query filter params (name=Default) {{(pid=80395) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 15:47:01.420783 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39b51379-942b-4861-8da7-263ac2a330ba None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:47:01.422263 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39b51379-942b-4861-8da7-263ac2a330ba None admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:47:01.440190 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 448/887] 10.222.0.59 () {56 vars in 1109 bytes} [Thu Jun 2 15:47:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 15:47:01.442090 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b637996-f648-41bf-9cde-3456713b85e3 None admin] Authenticating user token {{(pid=80396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:47:01.553841 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b637996-f648-41bf-9cde-3456713b85e3 None admin] Validating token access rules against request {{(pid=80396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:47:01.594606 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0911127f-e744-407b-b910-ad4eca659b05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:47:01.595683 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0911127f-e744-407b-b910-ad4eca659b05 None admin] REQUEST_METHOD: `GET` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:47:01.596120 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0911127f-e744-407b-b910-ad4eca659b05 None admin] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:47:01.596571 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0911127f-e744-407b-b910-ad4eca659b05 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:47:01.606050 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0911127f-e744-407b-b910-ad4eca659b05 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:47:01.607798 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0911127f-e744-407b-b910-ad4eca659b05 None admin] RBAC: Authorization granted {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:47:01.611102 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG dbcounter [-] [80396] Writing DB stats keystone:SELECT=100 {{(pid=80396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:47:01.625727 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application [None req-0911127f-e744-407b-b910-ad4eca659b05 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 02 15:47:01.625727 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 15:47:01.625727 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 15:47:01.625727 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 15:47:01.625727 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 15:47:01.625727 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 15:47:01.625727 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 15:47:01.625727 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 15:47:01.625727 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 15:47:01.625727 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 15:47:01.625727 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 15:47:01.625727 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 15:47:01.625727 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 02 15:47:01.625727 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 02 15:47:01.625727 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 02 15:47:01.625727 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 02 15:47:01.626944 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 15:47:01.626944 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 15:47:01.626944 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 02 15:47:01.626944 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 02 15:47:01.626944 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 02 15:47:01.626944 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 02 15:47:01.626944 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 15:47:01.626944 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 15:47:01.626944 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 15:47:01.626944 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 15:47:01.626944 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 15:47:01.626944 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application with Lock( Jun 02 15:47:01.626944 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 15:47:01.626944 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application return self._enter() Jun 02 15:47:01.626944 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 15:47:01.626944 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 15:47:01.626944 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 15:47:01.626944 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application return self.creator() Jun 02 15:47:01.628097 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 15:47:01.628097 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application created_value = creator( Jun 02 15:47:01.628097 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 02 15:47:01.628097 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 02 15:47:01.628097 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 02 15:47:01.628097 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 02 15:47:01.628097 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 02 15:47:01.628097 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 02 15:47:01.628097 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 02 15:47:01.628097 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application Jun 02 15:47:01.630496 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 440/888] 10.222.0.59 () {56 vars in 1117 bytes} [Thu Jun 2 15:47:01 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 15:47:01.638109 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39b51379-942b-4861-8da7-263ac2a330ba None admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:47:01.742365 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39b51379-942b-4861-8da7-263ac2a330ba None admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:47:01.763578 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writing DB stats keystone:SELECT=100 {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:47:01.778716 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db4683d9-600d-4f0e-88eb-944ee381db68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:47:01.779508 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db4683d9-600d-4f0e-88eb-944ee381db68 None admin] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:47:01.779797 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db4683d9-600d-4f0e-88eb-944ee381db68 None admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:47:01.780074 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db4683d9-600d-4f0e-88eb-944ee381db68 None admin] PATH_INFO: `/v3/users` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:47:01.780912 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db4683d9-600d-4f0e-88eb-944ee381db68 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80395) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 15:47:01.781224 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db4683d9-600d-4f0e-88eb-944ee381db68 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:47:01.782769 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db4683d9-600d-4f0e-88eb-944ee381db68 None admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:47:01.804427 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 449/889] 10.222.0.59 () {56 vars in 1149 bytes} [Thu Jun 2 15:47:01 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 15:47:01.807057 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0911127f-e744-407b-b910-ad4eca659b05 None admin] Authenticating user token {{(pid=80396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:47:01.919829 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0911127f-e744-407b-b910-ad4eca659b05 None admin] Validating token access rules against request {{(pid=80396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:47:01.923744 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d917cc-057d-4611-841d-a915259ecf00 None None] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:47:01.924033 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d917cc-057d-4611-841d-a915259ecf00 None None] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:47:01.924306 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d917cc-057d-4611-841d-a915259ecf00 None None] PATH_INFO: `/` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:47:01.925829 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 450/890] 10.222.0.59 () {54 vars in 926 bytes} [Thu Jun 2 15:47:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 15:47:01.933845 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a549cf5a-ee1f-4c1b-8a0f-850ddb0a97d2 None None] REQUEST_METHOD: `POST` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:47:01.933845 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a549cf5a-ee1f-4c1b-8a0f-850ddb0a97d2 None None] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:47:01.933845 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a549cf5a-ee1f-4c1b-8a0f-850ddb0a97d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:47:01.950879 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.auth.core [None req-a549cf5a-ee1f-4c1b-8a0f-850ddb0a97d2 None None] MFA Rules not processed for user `400d1f4db9de49638549e5db29a041e1`. Rule list: `[]` (Enabled: `True`). {{(pid=80395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 15:47:01.952451 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.fernet_utils [None req-a549cf5a-ee1f-4c1b-8a0f-850ddb0a97d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 15:47:01.970759 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03930058-ef11-4fb2-8a28-f056dcc44992 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:47:01.971760 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03930058-ef11-4fb2-8a28-f056dcc44992 None admin] REQUEST_METHOD: `GET` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:47:01.972265 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03930058-ef11-4fb2-8a28-f056dcc44992 None admin] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:47:01.973301 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03930058-ef11-4fb2-8a28-f056dcc44992 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:47:02.033012 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 451/891] 10.222.0.59 () {58 vars in 1023 bytes} [Thu Jun 2 15:47:01 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 02 15:47:02.044485 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG dbcounter [-] [80396] Writing DB stats keystone:SELECT=100 {{(pid=80396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:47:02.047208 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03930058-ef11-4fb2-8a28-f056dcc44992 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:47:02.048674 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03930058-ef11-4fb2-8a28-f056dcc44992 None admin] RBAC: Authorization granted {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:47:02.057681 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a549cf5a-ee1f-4c1b-8a0f-850ddb0a97d2 None None] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:47:02.158300 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 441/892] 10.222.0.59 () {58 vars in 1282 bytes} [Thu Jun 2 15:47:01 2022] GET /identity/v3/auth/tokens => generated 1362 bytes in 347 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 02 15:47:02.159747 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03930058-ef11-4fb2-8a28-f056dcc44992 None admin] Authenticating user token {{(pid=80396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:47:02.164146 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a549cf5a-ee1f-4c1b-8a0f-850ddb0a97d2 None None] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:47:02.174373 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writing DB stats keystone:SELECT=100 {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:47:02.200813 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b18485b5-15de-4b48-8efa-6b50ede0bc9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:47:02.201677 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b18485b5-15de-4b48-8efa-6b50ede0bc9d None admin] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:47:02.201963 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b18485b5-15de-4b48-8efa-6b50ede0bc9d None admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:47:02.202389 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b18485b5-15de-4b48-8efa-6b50ede0bc9d None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:47:02.203229 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b18485b5-15de-4b48-8efa-6b50ede0bc9d None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:47:02.204663 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b18485b5-15de-4b48-8efa-6b50ede0bc9d None admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:47:02.217644 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application [None req-b18485b5-15de-4b48-8efa-6b50ede0bc9d None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 02 15:47:02.217644 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 15:47:02.217644 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 02 15:47:02.217644 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 02 15:47:02.217644 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 02 15:47:02.217644 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 02 15:47:02.217644 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 02 15:47:02.217644 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 02 15:47:02.217644 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 02 15:47:02.217644 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application Jun 02 15:47:02.217644 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 02 15:47:02.217644 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application Jun 02 15:47:02.217644 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 15:47:02.217644 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 15:47:02.217644 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 15:47:02.217644 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 15:47:02.217644 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 15:47:02.218670 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 15:47:02.218670 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 15:47:02.218670 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 15:47:02.218670 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 15:47:02.218670 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 15:47:02.218670 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 15:47:02.218670 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 02 15:47:02.218670 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 02 15:47:02.218670 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 02 15:47:02.218670 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 02 15:47:02.218670 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 15:47:02.218670 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 15:47:02.218670 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 15:47:02.218670 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 15:47:02.218670 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 15:47:02.218670 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 15:47:02.219485 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 15:47:02.219485 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application with Lock( Jun 02 15:47:02.219485 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 15:47:02.219485 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self._enter() Jun 02 15:47:02.219485 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 15:47:02.219485 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 15:47:02.219485 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 15:47:02.219485 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self.creator() Jun 02 15:47:02.219485 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 15:47:02.219485 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application created_value = creator( Jun 02 15:47:02.219485 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 02 15:47:02.219485 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 02 15:47:02.219485 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 02 15:47:02.219485 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application Jun 02 15:47:02.224641 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 452/893] 10.222.0.59 () {56 vars in 1114 bytes} [Thu Jun 2 15:47:02 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 02 15:47:02.225597 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b18485b5-15de-4b48-8efa-6b50ede0bc9d None admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:47:02.262296 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG dbcounter [-] [80396] Writing DB stats keystone:SELECT=100 {{(pid=80396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:47:02.265937 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03930058-ef11-4fb2-8a28-f056dcc44992 None admin] Validating token access rules against request {{(pid=80396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:47:02.301927 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbe59613-420d-494b-a945-ca2894be87ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:47:02.302968 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe59613-420d-494b-a945-ca2894be87ba None admin] REQUEST_METHOD: `GET` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:47:02.303425 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe59613-420d-494b-a945-ca2894be87ba None admin] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:47:02.303844 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe59613-420d-494b-a945-ca2894be87ba None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:47:02.315935 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbe59613-420d-494b-a945-ca2894be87ba None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:47:02.317846 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbe59613-420d-494b-a945-ca2894be87ba None admin] RBAC: Authorization granted {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:47:02.327457 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b18485b5-15de-4b48-8efa-6b50ede0bc9d None admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:47:02.337872 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application [None req-fbe59613-420d-494b-a945-ca2894be87ba None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 15:47:02.337872 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 15:47:02.337872 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 15:47:02.337872 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 15:47:02.337872 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 15:47:02.337872 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 15:47:02.337872 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 15:47:02.337872 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 15:47:02.337872 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 15:47:02.337872 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 15:47:02.337872 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 15:47:02.337872 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 15:47:02.337872 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 02 15:47:02.337872 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 02 15:47:02.337872 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 02 15:47:02.338967 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 02 15:47:02.338967 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 15:47:02.338967 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 15:47:02.338967 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 15:47:02.338967 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 15:47:02.338967 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 15:47:02.338967 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 15:47:02.338967 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 15:47:02.338967 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application with Lock( Jun 02 15:47:02.338967 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 15:47:02.338967 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application return self._enter() Jun 02 15:47:02.338967 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 15:47:02.338967 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 15:47:02.338967 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 15:47:02.338967 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application return self.creator() Jun 02 15:47:02.338967 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 15:47:02.338967 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application created_value = creator( Jun 02 15:47:02.339977 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 02 15:47:02.339977 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 02 15:47:02.339977 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 15:47:02.339977 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application Jun 02 15:47:02.346118 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 442/894] 10.222.0.59 () {56 vars in 1108 bytes} [Thu Jun 2 15:47:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 15:47:02.347455 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbe59613-420d-494b-a945-ca2894be87ba None admin] Authenticating user token {{(pid=80396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:47:02.362351 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-560e2272-ec1c-4b73-abf8-6b1cf966ee1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:47:02.363010 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560e2272-ec1c-4b73-abf8-6b1cf966ee1e None admin] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:47:02.363811 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560e2272-ec1c-4b73-abf8-6b1cf966ee1e None admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:47:02.364085 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560e2272-ec1c-4b73-abf8-6b1cf966ee1e None admin] PATH_INFO: `/v3/services` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:47:02.364841 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-560e2272-ec1c-4b73-abf8-6b1cf966ee1e None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=80395) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 15:47:02.365145 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-560e2272-ec1c-4b73-abf8-6b1cf966ee1e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:47:02.366799 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-560e2272-ec1c-4b73-abf8-6b1cf966ee1e None admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:47:02.376210 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 453/895] 10.222.0.59 () {56 vars in 1114 bytes} [Thu Jun 2 15:47:02 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 15:47:02.377133 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-560e2272-ec1c-4b73-abf8-6b1cf966ee1e None admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:47:02.413275 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writing DB stats keystone:SELECT=100 {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:47:02.459845 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbe59613-420d-494b-a945-ca2894be87ba None admin] Validating token access rules against request {{(pid=80396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:47:02.483182 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-560e2272-ec1c-4b73-abf8-6b1cf966ee1e None admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:47:02.499806 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65d9c836-7550-49dc-b82c-ee99900cf097 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:47:02.500903 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d9c836-7550-49dc-b82c-ee99900cf097 None admin] REQUEST_METHOD: `GET` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:47:02.501344 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d9c836-7550-49dc-b82c-ee99900cf097 None admin] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:47:02.501868 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d9c836-7550-49dc-b82c-ee99900cf097 None admin] PATH_INFO: `/v3/domains` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:47:02.502756 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65d9c836-7550-49dc-b82c-ee99900cf097 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80396) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 15:47:02.503210 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65d9c836-7550-49dc-b82c-ee99900cf097 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:47:02.504876 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65d9c836-7550-49dc-b82c-ee99900cf097 None admin] RBAC: Authorization granted {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:47:02.518190 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da6b75c9-1746-4d55-bb13-61fdff1f4323 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:47:02.519613 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6b75c9-1746-4d55-bb13-61fdff1f4323 None admin] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:47:02.519613 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6b75c9-1746-4d55-bb13-61fdff1f4323 None admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:47:02.519613 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6b75c9-1746-4d55-bb13-61fdff1f4323 None admin] PATH_INFO: `/v3/services` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:47:02.523754 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da6b75c9-1746-4d55-bb13-61fdff1f4323 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=80395) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 15:47:02.523754 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da6b75c9-1746-4d55-bb13-61fdff1f4323 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:47:02.523754 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da6b75c9-1746-4d55-bb13-61fdff1f4323 None admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:47:02.524139 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 443/896] 10.222.0.59 () {56 vars in 1109 bytes} [Thu Jun 2 15:47:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 15:47:02.525706 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65d9c836-7550-49dc-b82c-ee99900cf097 None admin] Authenticating user token {{(pid=80396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:47:02.527719 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 454/897] 10.222.0.59 () {56 vars in 1114 bytes} [Thu Jun 2 15:47:02 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 15:47:02.533295 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da6b75c9-1746-4d55-bb13-61fdff1f4323 None admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:47:02.543531 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG dbcounter [-] [80396] Writing DB stats keystone:SELECT=100 {{(pid=80396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:47:02.635343 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writing DB stats keystone:SELECT=100 {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:47:02.638120 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da6b75c9-1746-4d55-bb13-61fdff1f4323 None admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:47:02.640918 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65d9c836-7550-49dc-b82c-ee99900cf097 None admin] Validating token access rules against request {{(pid=80396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:47:02.674595 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb34739-12a0-4f56-858a-e1c651a47914 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:47:02.675248 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb34739-12a0-4f56-858a-e1c651a47914 None admin] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:47:02.675983 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb34739-12a0-4f56-858a-e1c651a47914 None admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:47:02.676578 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb34739-12a0-4f56-858a-e1c651a47914 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:47:02.677432 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fb34739-12a0-4f56-858a-e1c651a47914 None admin] RBAC: Adding query filter params (interface=public, service_id=8cae193e9c044da597e58bae1d4c5691, region_id=RegionOne) {{(pid=80395) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 15:47:02.678276 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fb34739-12a0-4f56-858a-e1c651a47914 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:47:02.679791 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fb34739-12a0-4f56-858a-e1c651a47914 None admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:47:02.680883 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3af929d-649f-4b1b-9f0b-8fc5a2199235 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:47:02.681933 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3af929d-649f-4b1b-9f0b-8fc5a2199235 None admin] REQUEST_METHOD: `GET` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:47:02.682471 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3af929d-649f-4b1b-9f0b-8fc5a2199235 None admin] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:47:02.682920 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3af929d-649f-4b1b-9f0b-8fc5a2199235 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:47:02.690441 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 455/898] 10.222.0.59 () {56 vars in 1251 bytes} [Thu Jun 2 15:47:02 2022] GET /identity/v3/endpoints?service_id=8cae193e9c044da597e58bae1d4c5691&interface=public®ion_id=RegionOne => generated 194 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 15:47:02.691976 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb34739-12a0-4f56-858a-e1c651a47914 None admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:47:02.692429 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3af929d-649f-4b1b-9f0b-8fc5a2199235 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:47:02.694135 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3af929d-649f-4b1b-9f0b-8fc5a2199235 None admin] RBAC: Authorization granted {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:47:02.710466 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application [None req-e3af929d-649f-4b1b-9f0b-8fc5a2199235 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 02 15:47:02.710466 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 15:47:02.710466 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 15:47:02.710466 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 15:47:02.710466 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 15:47:02.710466 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 15:47:02.710466 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 15:47:02.710466 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 15:47:02.710466 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 15:47:02.710466 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 15:47:02.710466 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 15:47:02.710466 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 15:47:02.710466 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 02 15:47:02.710466 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 02 15:47:02.710466 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 02 15:47:02.711604 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 02 15:47:02.711604 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 15:47:02.711604 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 15:47:02.711604 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 15:47:02.711604 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 15:47:02.711604 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 15:47:02.711604 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 15:47:02.711604 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 15:47:02.711604 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application with Lock( Jun 02 15:47:02.711604 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 15:47:02.711604 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application return self._enter() Jun 02 15:47:02.711604 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 15:47:02.711604 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 15:47:02.711604 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 15:47:02.711604 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application return self.creator() Jun 02 15:47:02.711604 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 15:47:02.711604 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application created_value = creator( Jun 02 15:47:02.712849 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 02 15:47:02.712849 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 02 15:47:02.712849 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 02 15:47:02.712849 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 02 15:47:02.712849 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 02 15:47:02.712849 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 02 15:47:02.712849 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 02 15:47:02.712849 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application Jun 02 15:47:02.719705 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 444/899] 10.222.0.59 () {56 vars in 1111 bytes} [Thu Jun 2 15:47:02 2022] GET /identity/v3/projects/service => generated 88 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 02 15:47:02.721487 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3af929d-649f-4b1b-9f0b-8fc5a2199235 None admin] Authenticating user token {{(pid=80396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:47:02.801545 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb34739-12a0-4f56-858a-e1c651a47914 None admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:47:02.802544 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG dbcounter [-] [80396] Writing DB stats keystone:SELECT=100 {{(pid=80396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:47:02.840483 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e33364db-37c4-4cc5-89b1-d760ff796405 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:47:02.840938 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3af929d-649f-4b1b-9f0b-8fc5a2199235 None admin] Validating token access rules against request {{(pid=80396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:47:02.841143 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33364db-37c4-4cc5-89b1-d760ff796405 None admin] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:47:02.841426 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33364db-37c4-4cc5-89b1-d760ff796405 None admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:47:02.841700 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33364db-37c4-4cc5-89b1-d760ff796405 None admin] PATH_INFO: `/v3/services` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:47:02.842404 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e33364db-37c4-4cc5-89b1-d760ff796405 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:47:02.843766 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e33364db-37c4-4cc5-89b1-d760ff796405 None admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:47:02.854357 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 456/900] 10.222.0.59 () {56 vars in 1087 bytes} [Thu Jun 2 15:47:02 2022] GET /identity/v3/services => generated 1268 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 15:47:02.882384 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7a3facb-0f0f-49be-b1b6-cc07d577bf2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:47:02.883338 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a3facb-0f0f-49be-b1b6-cc07d577bf2c None admin] REQUEST_METHOD: `GET` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:47:02.883772 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a3facb-0f0f-49be-b1b6-cc07d577bf2c None admin] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:47:02.884196 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a3facb-0f0f-49be-b1b6-cc07d577bf2c None admin] PATH_INFO: `/v3/projects` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:47:02.885161 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7a3facb-0f0f-49be-b1b6-cc07d577bf2c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80396) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 15:47:02.885654 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7a3facb-0f0f-49be-b1b6-cc07d577bf2c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:47:02.887312 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7a3facb-0f0f-49be-b1b6-cc07d577bf2c None admin] RBAC: Authorization granted {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:47:02.910254 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 445/901] 10.222.0.59 () {56 vars in 1148 bytes} [Thu Jun 2 15:47:02 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 15:47:02.912583 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e33364db-37c4-4cc5-89b1-d760ff796405 None admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:47:02.946103 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writing DB stats keystone:SELECT=100 {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:47:03.026520 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e33364db-37c4-4cc5-89b1-d760ff796405 None admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:47:03.047143 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff8e9fa-ede6-4fa0-be8f-f49023a00452 None None] REQUEST_METHOD: `GET` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:47:03.047436 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff8e9fa-ede6-4fa0-be8f-f49023a00452 None None] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:47:03.047721 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff8e9fa-ede6-4fa0-be8f-f49023a00452 None None] PATH_INFO: `/` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:47:03.049370 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 446/902] 10.222.0.59 () {54 vars in 926 bytes} [Thu Jun 2 15:47:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 15:47:03.055575 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb373a8f-721a-4508-aa70-e1e51f5af9b6 None None] REQUEST_METHOD: `POST` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:47:03.055864 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb373a8f-721a-4508-aa70-e1e51f5af9b6 None None] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:47:03.056153 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb373a8f-721a-4508-aa70-e1e51f5af9b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:47:03.071150 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88a4f5d7-6928-4f87-8645-8bfd49f902a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:47:03.071816 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a4f5d7-6928-4f87-8645-8bfd49f902a0 None admin] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:47:03.072094 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a4f5d7-6928-4f87-8645-8bfd49f902a0 None admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:47:03.072363 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a4f5d7-6928-4f87-8645-8bfd49f902a0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:47:03.073380 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88a4f5d7-6928-4f87-8645-8bfd49f902a0 None admin] RBAC: Adding query filter params (role.id=ce7c3f9097fa4b4aa3a7a1d7bef989be, scope.project.id=9c87c981909d4b8db02783421818c79b, user.id=11b714eb2dda4460a8ff52215e671bfa) {{(pid=80395) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 15:47:03.073693 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88a4f5d7-6928-4f87-8645-8bfd49f902a0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:47:03.074901 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.auth.core [None req-bb373a8f-721a-4508-aa70-e1e51f5af9b6 None None] MFA Rules not processed for user `400d1f4db9de49638549e5db29a041e1`. Rule list: `[]` (Enabled: `True`). {{(pid=80396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 15:47:03.075164 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88a4f5d7-6928-4f87-8645-8bfd49f902a0 None admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:47:03.077397 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.fernet_utils [None req-bb373a8f-721a-4508-aa70-e1e51f5af9b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 15:47:03.083492 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 457/903] 10.222.0.59 () {56 vars in 1374 bytes} [Thu Jun 2 15:47:02 2022] GET /identity/v3/role_assignments?user.id=11b714eb2dda4460a8ff52215e671bfa&scope.project.id=9c87c981909d4b8db02783421818c79b&role.id=ce7c3f9097fa4b4aa3a7a1d7bef989be => generated 259 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 15:47:03.142302 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0a63be-1caa-4e52-a1a8-a81cee23db9e None None] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:47:03.142769 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0a63be-1caa-4e52-a1a8-a81cee23db9e None None] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:47:03.143054 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0a63be-1caa-4e52-a1a8-a81cee23db9e None None] PATH_INFO: `/` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:47:03.145180 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 458/904] 10.222.0.59 () {54 vars in 926 bytes} [Thu Jun 2 15:47:03 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 15:47:03.151386 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ba4333-8871-4e11-b806-bba9f652e802 None None] REQUEST_METHOD: `POST` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:47:03.151947 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ba4333-8871-4e11-b806-bba9f652e802 None None] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:47:03.152233 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ba4333-8871-4e11-b806-bba9f652e802 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:47:03.166836 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 447/905] 10.222.0.59 () {58 vars in 1023 bytes} [Thu Jun 2 15:47:03 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 02 15:47:03.176768 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.auth.core [None req-95ba4333-8871-4e11-b806-bba9f652e802 None None] MFA Rules not processed for user `400d1f4db9de49638549e5db29a041e1`. Rule list: `[]` (Enabled: `True`). {{(pid=80395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 15:47:03.178119 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.fernet_utils [None req-95ba4333-8871-4e11-b806-bba9f652e802 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 15:47:03.190740 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb373a8f-721a-4508-aa70-e1e51f5af9b6 None None] Authenticating user token {{(pid=80396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:47:03.271408 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG dbcounter [-] [80396] Writing DB stats keystone:SELECT=100 {{(pid=80396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:47:03.277158 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 459/906] 10.222.0.59 () {58 vars in 1023 bytes} [Thu Jun 2 15:47:03 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 02 15:47:03.303327 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95ba4333-8871-4e11-b806-bba9f652e802 None None] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:47:03.321464 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb373a8f-721a-4508-aa70-e1e51f5af9b6 None None] Validating token access rules against request {{(pid=80396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:47:03.332843 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writing DB stats keystone:SELECT=100 {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:47:03.358545 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c709675-b47c-4dbe-90c5-8e18f838593c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:47:03.359356 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c709675-b47c-4dbe-90c5-8e18f838593c None admin] REQUEST_METHOD: `POST` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:47:03.359736 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c709675-b47c-4dbe-90c5-8e18f838593c None admin] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:47:03.360078 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c709675-b47c-4dbe-90c5-8e18f838593c None admin] PATH_INFO: `/v3/services` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:47:03.360887 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c709675-b47c-4dbe-90c5-8e18f838593c None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:47:03.362357 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c709675-b47c-4dbe-90c5-8e18f838593c None admin] RBAC: Authorization granted {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:47:03.421102 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95ba4333-8871-4e11-b806-bba9f652e802 None None] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:47:03.439278 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 448/907] 10.222.0.59 () {60 vars in 1141 bytes} [Thu Jun 2 15:47:03 2022] POST /identity/v3/services => generated 241 bytes in 249 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 02 15:47:03.480013 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-515288e1-0f80-4162-bdb6-606b72c9673e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:47:03.481426 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-515288e1-0f80-4162-bdb6-606b72c9673e None admin] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:47:03.481924 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-515288e1-0f80-4162-bdb6-606b72c9673e None admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:47:03.482439 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-515288e1-0f80-4162-bdb6-606b72c9673e None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:47:03.483459 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-515288e1-0f80-4162-bdb6-606b72c9673e None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:47:03.485147 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-515288e1-0f80-4162-bdb6-606b72c9673e None admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:47:03.500338 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application [None req-515288e1-0f80-4162-bdb6-606b72c9673e None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 02 15:47:03.500338 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 15:47:03.500338 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 02 15:47:03.500338 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 02 15:47:03.500338 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 02 15:47:03.500338 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 02 15:47:03.500338 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 02 15:47:03.500338 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 02 15:47:03.500338 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 02 15:47:03.500338 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application Jun 02 15:47:03.500338 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 02 15:47:03.500338 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application Jun 02 15:47:03.500338 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 15:47:03.500338 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 15:47:03.500338 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 15:47:03.500338 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 15:47:03.501354 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 15:47:03.501354 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 15:47:03.501354 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 15:47:03.501354 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 15:47:03.501354 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 15:47:03.501354 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 15:47:03.501354 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 15:47:03.501354 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 02 15:47:03.501354 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 02 15:47:03.501354 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 02 15:47:03.501354 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 02 15:47:03.501354 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 15:47:03.501354 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 15:47:03.501354 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 15:47:03.501354 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 15:47:03.501354 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 15:47:03.502209 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 15:47:03.502209 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 15:47:03.502209 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application with Lock( Jun 02 15:47:03.502209 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 15:47:03.502209 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self._enter() Jun 02 15:47:03.502209 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 15:47:03.502209 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 15:47:03.502209 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 15:47:03.502209 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self.creator() Jun 02 15:47:03.502209 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 15:47:03.502209 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application created_value = creator( Jun 02 15:47:03.502209 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 02 15:47:03.502209 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 02 15:47:03.502209 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 02 15:47:03.502209 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application Jun 02 15:47:03.506704 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 460/908] 10.222.0.59 () {56 vars in 1132 bytes} [Thu Jun 2 15:47:03 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 02 15:47:03.515658 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c709675-b47c-4dbe-90c5-8e18f838593c None admin] Authenticating user token {{(pid=80396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:47:03.622527 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c709675-b47c-4dbe-90c5-8e18f838593c None admin] Validating token access rules against request {{(pid=80396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:47:03.647479 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG dbcounter [-] [80396] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:47:03.659047 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9850c5c-2998-45fa-8022-da5f639fde79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:47:03.672534 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9850c5c-2998-45fa-8022-da5f639fde79 None admin] REQUEST_METHOD: `GET` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:47:03.672534 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9850c5c-2998-45fa-8022-da5f639fde79 None admin] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:47:03.672534 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9850c5c-2998-45fa-8022-da5f639fde79 None admin] PATH_INFO: `/v3/services` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:47:03.672534 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9850c5c-2998-45fa-8022-da5f639fde79 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=80396) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 15:47:03.672534 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9850c5c-2998-45fa-8022-da5f639fde79 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:47:03.672534 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9850c5c-2998-45fa-8022-da5f639fde79 None admin] RBAC: Authorization granted {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:47:03.673050 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 449/909] 10.222.0.59 () {56 vars in 1126 bytes} [Thu Jun 2 15:47:03 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 15:47:03.674447 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-515288e1-0f80-4162-bdb6-606b72c9673e None admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:47:03.772898 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writing DB stats keystone:SELECT=100 {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:47:03.791114 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-515288e1-0f80-4162-bdb6-606b72c9673e None admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:47:03.827636 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1bf1f4b-7105-4f05-9605-35f60851761b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:47:03.828313 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1bf1f4b-7105-4f05-9605-35f60851761b None admin] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:47:03.828595 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1bf1f4b-7105-4f05-9605-35f60851761b None admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:47:03.828869 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1bf1f4b-7105-4f05-9605-35f60851761b None admin] PATH_INFO: `/v3/services` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:47:03.829586 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1bf1f4b-7105-4f05-9605-35f60851761b None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=80395) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 15:47:03.829888 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1bf1f4b-7105-4f05-9605-35f60851761b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:47:03.831375 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1bf1f4b-7105-4f05-9605-35f60851761b None admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:47:03.837471 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 461/910] 10.222.0.59 () {56 vars in 1126 bytes} [Thu Jun 2 15:47:03 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 15:47:03.843101 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9850c5c-2998-45fa-8022-da5f639fde79 None admin] Authenticating user token {{(pid=80396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:47:03.951702 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9850c5c-2998-45fa-8022-da5f639fde79 None admin] Validating token access rules against request {{(pid=80396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:47:03.988547 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-174e055c-32fd-414c-9192-b814fc962ad0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:47:03.989811 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-174e055c-32fd-414c-9192-b814fc962ad0 None admin] REQUEST_METHOD: `GET` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:47:03.990319 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-174e055c-32fd-414c-9192-b814fc962ad0 None admin] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:47:03.990790 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-174e055c-32fd-414c-9192-b814fc962ad0 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:47:03.991795 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-174e055c-32fd-414c-9192-b814fc962ad0 None admin] RBAC: Adding query filter params (interface=public, service_id=b0dff8cb5bbb455394b8b457219d80ed, region_id=RegionOne) {{(pid=80396) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 15:47:03.992315 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-174e055c-32fd-414c-9192-b814fc962ad0 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:47:03.993885 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-174e055c-32fd-414c-9192-b814fc962ad0 None admin] RBAC: Authorization granted {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:47:03.999871 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 450/911] 10.222.0.59 () {56 vars in 1251 bytes} [Thu Jun 2 15:47:03 2022] GET /identity/v3/endpoints?service_id=b0dff8cb5bbb455394b8b457219d80ed&interface=public®ion_id=RegionOne => generated 194 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 15:47:04.007155 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1bf1f4b-7105-4f05-9605-35f60851761b None admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:47:04.116442 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1bf1f4b-7105-4f05-9605-35f60851761b None admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:47:04.159450 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cf35fb4-e371-481a-a8b9-c9f1df1354d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:47:04.161040 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf35fb4-e371-481a-a8b9-c9f1df1354d7 None admin] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:47:04.161624 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf35fb4-e371-481a-a8b9-c9f1df1354d7 None admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:47:04.162066 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf35fb4-e371-481a-a8b9-c9f1df1354d7 None admin] PATH_INFO: `/v3/services` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:47:04.162943 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cf35fb4-e371-481a-a8b9-c9f1df1354d7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:47:04.171131 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cf35fb4-e371-481a-a8b9-c9f1df1354d7 None admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:47:04.181728 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 462/912] 10.222.0.59 () {56 vars in 1087 bytes} [Thu Jun 2 15:47:04 2022] GET /identity/v3/services => generated 1497 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 15:47:05.274569 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e383c3-ff42-4992-b797-e201461772c7 None None] REQUEST_METHOD: `GET` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:47:05.275591 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e383c3-ff42-4992-b797-e201461772c7 None None] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:47:05.276160 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e383c3-ff42-4992-b797-e201461772c7 None None] PATH_INFO: `/` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:47:05.277989 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 451/913] 10.222.0.59 () {54 vars in 926 bytes} [Thu Jun 2 15:47:05 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 15:47:05.283199 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db71ff42-9ac3-4bc3-8689-da8c955fc964 None None] REQUEST_METHOD: `POST` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:47:05.283601 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db71ff42-9ac3-4bc3-8689-da8c955fc964 None None] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:47:05.283766 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db71ff42-9ac3-4bc3-8689-da8c955fc964 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:47:05.301388 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.auth.core [None req-db71ff42-9ac3-4bc3-8689-da8c955fc964 None None] MFA Rules not processed for user `400d1f4db9de49638549e5db29a041e1`. Rule list: `[]` (Enabled: `True`). {{(pid=80395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 15:47:05.302593 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.fernet_utils [None req-db71ff42-9ac3-4bc3-8689-da8c955fc964 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 15:47:05.305526 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writing DB stats keystone:SELECT=100 {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:47:05.379921 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 463/914] 10.222.0.59 () {58 vars in 1023 bytes} [Thu Jun 2 15:47:05 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 02 15:47:05.402318 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04e383c3-ff42-4992-b797-e201461772c7 None None] Authenticating user token {{(pid=80396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:47:05.456488 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG dbcounter [-] [80396] Writing DB stats keystone:SELECT=100 {{(pid=80396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:47:05.474942 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d889404-594b-44e7-92ea-baf756954011 None None] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:47:05.475240 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d889404-594b-44e7-92ea-baf756954011 None None] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:47:05.475520 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d889404-594b-44e7-92ea-baf756954011 None None] PATH_INFO: `/` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:47:05.477211 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 464/915] 10.222.0.59 () {54 vars in 926 bytes} [Thu Jun 2 15:47:05 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 02 15:47:05.482448 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5788c2e-0efd-4ccd-8112-12bb4c556787 None None] REQUEST_METHOD: `POST` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:47:05.482739 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5788c2e-0efd-4ccd-8112-12bb4c556787 None None] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:47:05.483024 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5788c2e-0efd-4ccd-8112-12bb4c556787 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:47:05.501115 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.auth.core [None req-d5788c2e-0efd-4ccd-8112-12bb4c556787 None None] MFA Rules not processed for user `400d1f4db9de49638549e5db29a041e1`. Rule list: `[]` (Enabled: `True`). {{(pid=80395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 15:47:05.502459 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.fernet_utils [None req-d5788c2e-0efd-4ccd-8112-12bb4c556787 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 15:47:05.514013 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04e383c3-ff42-4992-b797-e201461772c7 None None] Validating token access rules against request {{(pid=80396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:47:05.556905 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae939113-de03-4c48-9652-32bcf3b2de11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:47:05.557730 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae939113-de03-4c48-9652-32bcf3b2de11 None admin] REQUEST_METHOD: `GET` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:47:05.558014 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae939113-de03-4c48-9652-32bcf3b2de11 None admin] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:47:05.558368 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae939113-de03-4c48-9652-32bcf3b2de11 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:47:05.558995 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae939113-de03-4c48-9652-32bcf3b2de11 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:47:05.560437 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae939113-de03-4c48-9652-32bcf3b2de11 None admin] RBAC: Authorization granted {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:47:05.575024 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application [None req-ae939113-de03-4c48-9652-32bcf3b2de11 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 02 15:47:05.575024 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 15:47:05.575024 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 02 15:47:05.575024 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 02 15:47:05.575024 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 02 15:47:05.575024 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 02 15:47:05.575024 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 02 15:47:05.575024 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 02 15:47:05.575024 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 02 15:47:05.575024 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application Jun 02 15:47:05.575024 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 02 15:47:05.575024 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application Jun 02 15:47:05.575024 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 15:47:05.575024 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 15:47:05.575024 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 15:47:05.575024 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 15:47:05.575024 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 15:47:05.576093 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 15:47:05.576093 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 15:47:05.576093 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 15:47:05.576093 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 15:47:05.576093 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 15:47:05.576093 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 15:47:05.576093 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 02 15:47:05.576093 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 02 15:47:05.576093 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 02 15:47:05.576093 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 02 15:47:05.576093 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 15:47:05.576093 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 15:47:05.576093 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 15:47:05.576093 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 15:47:05.576093 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 15:47:05.576093 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 15:47:05.576932 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 15:47:05.576932 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application with Lock( Jun 02 15:47:05.576932 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 15:47:05.576932 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application return self._enter() Jun 02 15:47:05.576932 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 15:47:05.576932 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 15:47:05.576932 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 15:47:05.576932 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application return self.creator() Jun 02 15:47:05.576932 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 15:47:05.576932 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application created_value = creator( Jun 02 15:47:05.576932 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 02 15:47:05.576932 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 02 15:47:05.576932 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 02 15:47:05.576932 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application Jun 02 15:47:05.582533 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 452/916] 10.222.0.59 () {56 vars in 1114 bytes} [Thu Jun 2 15:47:05 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 15:47:05.586376 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae939113-de03-4c48-9652-32bcf3b2de11 None admin] Authenticating user token {{(pid=80396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:47:05.598108 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 465/917] 10.222.0.59 () {58 vars in 1023 bytes} [Thu Jun 2 15:47:05 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 02 15:47:05.616723 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5788c2e-0efd-4ccd-8112-12bb4c556787 None None] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:47:05.689953 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writing DB stats keystone:SELECT=100 {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:47:05.722783 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5788c2e-0efd-4ccd-8112-12bb4c556787 None None] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:47:05.726101 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae939113-de03-4c48-9652-32bcf3b2de11 None admin] Validating token access rules against request {{(pid=80396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:47:05.742669 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG dbcounter [-] [80396] Writing DB stats keystone:SELECT=100 {{(pid=80396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:47:05.764830 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eda64329-1761-489a-b6e1-3f799c9fd3fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:47:05.765361 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda64329-1761-489a-b6e1-3f799c9fd3fe None admin] REQUEST_METHOD: `GET` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:47:05.765649 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda64329-1761-489a-b6e1-3f799c9fd3fe None admin] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:47:05.765981 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda64329-1761-489a-b6e1-3f799c9fd3fe None admin] PATH_INFO: `/v3/services` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:47:05.766741 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eda64329-1761-489a-b6e1-3f799c9fd3fe None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=80396) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 15:47:05.767048 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eda64329-1761-489a-b6e1-3f799c9fd3fe None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:47:05.768425 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eda64329-1761-489a-b6e1-3f799c9fd3fe None admin] RBAC: Authorization granted {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:47:05.772418 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-091f4787-f128-428f-9be9-c22ca7028f10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:47:05.773584 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-091f4787-f128-428f-9be9-c22ca7028f10 None admin] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:47:05.774413 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-091f4787-f128-428f-9be9-c22ca7028f10 None admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:47:05.774917 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-091f4787-f128-428f-9be9-c22ca7028f10 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:47:05.779307 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 453/918] 10.222.0.59 () {56 vars in 1114 bytes} [Thu Jun 2 15:47:05 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 15:47:05.780233 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eda64329-1761-489a-b6e1-3f799c9fd3fe None admin] Authenticating user token {{(pid=80396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:47:05.789684 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-091f4787-f128-428f-9be9-c22ca7028f10 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 02 15:47:05.801182 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application [None req-091f4787-f128-428f-9be9-c22ca7028f10 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 02 15:47:05.801182 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 15:47:05.801182 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 15:47:05.801182 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 15:47:05.801182 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 15:47:05.801182 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 15:47:05.801182 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 15:47:05.801182 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 15:47:05.801182 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 15:47:05.801182 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 15:47:05.801182 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 15:47:05.801182 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 15:47:05.801182 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 02 15:47:05.801182 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 02 15:47:05.801182 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 02 15:47:05.801182 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 02 15:47:05.802398 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 02 15:47:05.802398 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 02 15:47:05.802398 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 02 15:47:05.802398 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 02 15:47:05.802398 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 15:47:05.802398 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 15:47:05.802398 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 15:47:05.802398 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 15:47:05.802398 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 15:47:05.802398 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 15:47:05.802398 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 15:47:05.802398 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application with Lock( Jun 02 15:47:05.802398 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 15:47:05.802398 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self._enter() Jun 02 15:47:05.802398 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 15:47:05.802398 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 15:47:05.803252 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 15:47:05.803252 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self.creator() Jun 02 15:47:05.803252 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 15:47:05.803252 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application created_value = creator( Jun 02 15:47:05.803252 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 02 15:47:05.803252 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 02 15:47:05.803252 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 02 15:47:05.803252 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 02 15:47:05.803252 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 02 15:47:05.803252 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 02 15:47:05.803252 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 02 15:47:05.803252 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application Jun 02 15:47:05.803252 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 466/919] 10.222.0.59 () {56 vars in 1120 bytes} [Thu Jun 2 15:47:05 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 02 15:47:05.810471 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-091f4787-f128-428f-9be9-c22ca7028f10 None admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:47:05.916790 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eda64329-1761-489a-b6e1-3f799c9fd3fe None admin] Validating token access rules against request {{(pid=80396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:47:05.922521 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-091f4787-f128-428f-9be9-c22ca7028f10 None admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:47:05.952978 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51406f79-96e9-4f96-99c0-ad35e87752d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:47:05.953898 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51406f79-96e9-4f96-99c0-ad35e87752d1 None admin] REQUEST_METHOD: `GET` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:47:05.954209 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51406f79-96e9-4f96-99c0-ad35e87752d1 None admin] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:47:05.954653 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51406f79-96e9-4f96-99c0-ad35e87752d1 None admin] PATH_INFO: `/v3/services` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:47:05.954793 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writing DB stats keystone:SELECT=100 {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:47:05.955367 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51406f79-96e9-4f96-99c0-ad35e87752d1 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=80396) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 15:47:05.955677 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51406f79-96e9-4f96-99c0-ad35e87752d1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:47:05.957559 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51406f79-96e9-4f96-99c0-ad35e87752d1 None admin] RBAC: Authorization granted {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:47:05.961355 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9972d1e5-c1c5-4912-a6a8-aaabd83402ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:47:05.962511 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9972d1e5-c1c5-4912-a6a8-aaabd83402ba None admin] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:47:05.966105 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 454/920] 10.222.0.59 () {56 vars in 1114 bytes} [Thu Jun 2 15:47:05 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 15:47:05.966105 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a66a48-b266-46b4-9339-db9d7ddefcc1 None None] REQUEST_METHOD: `GET` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:47:05.966105 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a66a48-b266-46b4-9339-db9d7ddefcc1 None None] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:47:05.966105 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a66a48-b266-46b4-9339-db9d7ddefcc1 None None] PATH_INFO: `/` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:47:05.966105 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 455/921] 10.222.0.59 () {54 vars in 926 bytes} [Thu Jun 2 15:47:05 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 15:47:05.967382 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9972d1e5-c1c5-4912-a6a8-aaabd83402ba None admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:47:05.967688 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9972d1e5-c1c5-4912-a6a8-aaabd83402ba None admin] PATH_INFO: `/v3/roles` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:47:05.968468 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9972d1e5-c1c5-4912-a6a8-aaabd83402ba None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80395) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 15:47:05.968782 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9972d1e5-c1c5-4912-a6a8-aaabd83402ba None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:47:05.970512 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9972d1e5-c1c5-4912-a6a8-aaabd83402ba None admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:47:05.971433 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ef3ca5-47d4-4495-a17d-8aa44a90b0c2 None None] REQUEST_METHOD: `POST` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:47:05.971725 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ef3ca5-47d4-4495-a17d-8aa44a90b0c2 None None] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:47:05.972007 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ef3ca5-47d4-4495-a17d-8aa44a90b0c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:47:05.980723 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 467/922] 10.222.0.59 () {56 vars in 1115 bytes} [Thu Jun 2 15:47:05 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 15:47:05.981861 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9972d1e5-c1c5-4912-a6a8-aaabd83402ba None admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:47:05.991326 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.auth.core [None req-c7ef3ca5-47d4-4495-a17d-8aa44a90b0c2 None None] MFA Rules not processed for user `400d1f4db9de49638549e5db29a041e1`. Rule list: `[]` (Enabled: `True`). {{(pid=80396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 15:47:05.992781 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.fernet_utils [None req-c7ef3ca5-47d4-4495-a17d-8aa44a90b0c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 15:47:06.031899 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG dbcounter [-] [80396] Writing DB stats keystone:SELECT=100 {{(pid=80396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:47:06.070909 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 456/923] 10.222.0.59 () {58 vars in 1023 bytes} [Thu Jun 2 15:47:05 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 02 15:47:06.070909 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7ef3ca5-47d4-4495-a17d-8aa44a90b0c2 None None] Authenticating user token {{(pid=80396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:47:06.107276 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9972d1e5-c1c5-4912-a6a8-aaabd83402ba None admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:47:06.146219 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3cb1e86-dcaa-44c1-aa1d-97a190500e01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:47:06.146898 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3cb1e86-dcaa-44c1-aa1d-97a190500e01 None admin] REQUEST_METHOD: `POST` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:47:06.147185 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3cb1e86-dcaa-44c1-aa1d-97a190500e01 None admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:47:06.147467 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3cb1e86-dcaa-44c1-aa1d-97a190500e01 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:47:06.148233 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3cb1e86-dcaa-44c1-aa1d-97a190500e01 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:47:06.149647 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3cb1e86-dcaa-44c1-aa1d-97a190500e01 None admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:47:06.180700 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7ef3ca5-47d4-4495-a17d-8aa44a90b0c2 None None] Validating token access rules against request {{(pid=80396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:47:06.217067 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91527616-5b07-48d6-b332-f4c3ebc2d079 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:47:06.217866 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91527616-5b07-48d6-b332-f4c3ebc2d079 None admin] REQUEST_METHOD: `GET` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:47:06.218182 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91527616-5b07-48d6-b332-f4c3ebc2d079 None admin] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:47:06.218500 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91527616-5b07-48d6-b332-f4c3ebc2d079 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:47:06.235305 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91527616-5b07-48d6-b332-f4c3ebc2d079 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:47:06.235305 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91527616-5b07-48d6-b332-f4c3ebc2d079 None admin] RBAC: Authorization granted {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:47:06.236168 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 468/924] 10.222.0.59 () {60 vars in 1144 bytes} [Thu Jun 2 15:47:05 2022] POST /identity/v3/endpoints => generated 346 bytes in 254 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 15:47:06.237385 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3cb1e86-dcaa-44c1-aa1d-97a190500e01 None admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:47:06.260300 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application [None req-91527616-5b07-48d6-b332-f4c3ebc2d079 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 15:47:06.260300 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 15:47:06.260300 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 15:47:06.260300 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 15:47:06.260300 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 15:47:06.260300 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 15:47:06.260300 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 15:47:06.260300 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 15:47:06.260300 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 15:47:06.260300 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 15:47:06.260300 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 15:47:06.260300 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 15:47:06.260300 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 02 15:47:06.260300 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 02 15:47:06.260300 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 02 15:47:06.265204 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 02 15:47:06.265204 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 15:47:06.265204 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 15:47:06.265204 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 15:47:06.265204 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 15:47:06.265204 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 15:47:06.265204 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 15:47:06.265204 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 15:47:06.265204 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application with Lock( Jun 02 15:47:06.265204 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 15:47:06.265204 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application return self._enter() Jun 02 15:47:06.265204 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 15:47:06.265204 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 15:47:06.265204 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 15:47:06.265204 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application return self.creator() Jun 02 15:47:06.265204 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 15:47:06.265204 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application created_value = creator( Jun 02 15:47:06.266375 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 02 15:47:06.266375 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 02 15:47:06.266375 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 15:47:06.266375 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application Jun 02 15:47:06.266375 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 457/925] 10.222.0.59 () {56 vars in 1108 bytes} [Thu Jun 2 15:47:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 15:47:06.268421 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91527616-5b07-48d6-b332-f4c3ebc2d079 None admin] Authenticating user token {{(pid=80396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:47:06.299012 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG dbcounter [-] [80396] Writing DB stats keystone:SELECT=100 {{(pid=80396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:47:06.322469 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:47:06.371608 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3cb1e86-dcaa-44c1-aa1d-97a190500e01 None admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:47:06.391464 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91527616-5b07-48d6-b332-f4c3ebc2d079 None admin] Validating token access rules against request {{(pid=80396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:47:06.412972 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aadbd56-22fc-4566-af70-0f40242ba72f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:47:06.413911 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aadbd56-22fc-4566-af70-0f40242ba72f None admin] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:47:06.414350 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aadbd56-22fc-4566-af70-0f40242ba72f None admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:47:06.414629 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aadbd56-22fc-4566-af70-0f40242ba72f None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:47:06.426119 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aadbd56-22fc-4566-af70-0f40242ba72f None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:47:06.426119 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aadbd56-22fc-4566-af70-0f40242ba72f None admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:47:06.431293 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application [None req-4aadbd56-22fc-4566-af70-0f40242ba72f None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 02 15:47:06.431293 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 15:47:06.431293 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 02 15:47:06.431293 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 02 15:47:06.431293 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 02 15:47:06.431293 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 02 15:47:06.431293 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 02 15:47:06.431293 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 02 15:47:06.431293 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 02 15:47:06.431293 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application Jun 02 15:47:06.431293 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 02 15:47:06.431293 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application Jun 02 15:47:06.431293 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 15:47:06.431293 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 15:47:06.431293 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 15:47:06.431293 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 15:47:06.431293 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 15:47:06.432329 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 15:47:06.432329 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 15:47:06.432329 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 15:47:06.432329 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 15:47:06.432329 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 15:47:06.432329 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 15:47:06.432329 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 02 15:47:06.432329 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 02 15:47:06.432329 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 02 15:47:06.432329 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 02 15:47:06.432329 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 15:47:06.432329 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 15:47:06.432329 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 15:47:06.432329 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 15:47:06.432329 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 15:47:06.432329 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 15:47:06.433473 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 15:47:06.433473 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application with Lock( Jun 02 15:47:06.433473 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 15:47:06.433473 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self._enter() Jun 02 15:47:06.433473 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 15:47:06.433473 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 15:47:06.433473 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 15:47:06.433473 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self.creator() Jun 02 15:47:06.433473 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 15:47:06.433473 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application created_value = creator( Jun 02 15:47:06.433473 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 02 15:47:06.433473 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 02 15:47:06.433473 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 02 15:47:06.433473 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application Jun 02 15:47:06.433473 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 469/926] 10.222.0.59 () {56 vars in 1126 bytes} [Thu Jun 2 15:47:06 2022] GET /identity/v3/services/object-store => generated 93 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 15:47:06.438579 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aadbd56-22fc-4566-af70-0f40242ba72f None admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:47:06.438795 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca07b61d-121a-41c4-87ee-db63d440899f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:47:06.440779 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca07b61d-121a-41c4-87ee-db63d440899f None admin] REQUEST_METHOD: `GET` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:47:06.440779 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca07b61d-121a-41c4-87ee-db63d440899f None admin] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:47:06.440779 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca07b61d-121a-41c4-87ee-db63d440899f None admin] PATH_INFO: `/v3/domains` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:47:06.440779 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca07b61d-121a-41c4-87ee-db63d440899f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80396) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 15:47:06.441426 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca07b61d-121a-41c4-87ee-db63d440899f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:47:06.443891 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca07b61d-121a-41c4-87ee-db63d440899f None admin] RBAC: Authorization granted {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:47:06.462471 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 458/927] 10.222.0.59 () {56 vars in 1109 bytes} [Thu Jun 2 15:47:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 15:47:06.467907 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca07b61d-121a-41c4-87ee-db63d440899f None admin] Authenticating user token {{(pid=80396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:47:06.565928 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aadbd56-22fc-4566-af70-0f40242ba72f None admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:47:06.574004 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG dbcounter [-] [80396] Writing DB stats keystone:SELECT=100 {{(pid=80396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:47:06.575851 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writing DB stats keystone:SELECT=100 {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:47:06.592031 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca07b61d-121a-41c4-87ee-db63d440899f None admin] Validating token access rules against request {{(pid=80396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:47:06.600895 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bff5d76c-1084-4caa-abcb-576e90aa7ebf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:47:06.601669 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff5d76c-1084-4caa-abcb-576e90aa7ebf None admin] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:47:06.601880 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff5d76c-1084-4caa-abcb-576e90aa7ebf None admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:47:06.602160 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff5d76c-1084-4caa-abcb-576e90aa7ebf None admin] PATH_INFO: `/v3/services` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:47:06.602865 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bff5d76c-1084-4caa-abcb-576e90aa7ebf None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80395) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 15:47:06.603168 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bff5d76c-1084-4caa-abcb-576e90aa7ebf None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:47:06.604531 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bff5d76c-1084-4caa-abcb-576e90aa7ebf None admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:47:06.614245 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 470/928] 10.222.0.59 () {56 vars in 1122 bytes} [Thu Jun 2 15:47:06 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 15:47:06.614245 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0bc5533-b701-43b4-82bc-4b85f1cacac6 None None] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:47:06.614245 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0bc5533-b701-43b4-82bc-4b85f1cacac6 None None] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:47:06.614245 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0bc5533-b701-43b4-82bc-4b85f1cacac6 None None] PATH_INFO: `/` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:47:06.614245 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 471/929] 10.222.0.59 () {54 vars in 926 bytes} [Thu Jun 2 15:47:06 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 15:47:06.617076 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0bc5533-b701-43b4-82bc-4b85f1cacac6 None None] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:47:06.642414 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b6108b1-d372-435f-829c-b9c8d9ddfe30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:47:06.643215 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b6108b1-d372-435f-829c-b9c8d9ddfe30 None admin] REQUEST_METHOD: `GET` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:47:06.643497 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b6108b1-d372-435f-829c-b9c8d9ddfe30 None admin] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:47:06.643774 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b6108b1-d372-435f-829c-b9c8d9ddfe30 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:47:06.651556 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b6108b1-d372-435f-829c-b9c8d9ddfe30 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:47:06.652982 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b6108b1-d372-435f-829c-b9c8d9ddfe30 None admin] RBAC: Authorization granted {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:47:06.668141 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application [None req-4b6108b1-d372-435f-829c-b9c8d9ddfe30 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 02 15:47:06.668141 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 15:47:06.668141 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 15:47:06.668141 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 15:47:06.668141 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 15:47:06.668141 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 15:47:06.668141 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 15:47:06.668141 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 15:47:06.668141 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 15:47:06.668141 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 15:47:06.668141 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 15:47:06.668141 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 15:47:06.668141 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 02 15:47:06.668141 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 02 15:47:06.668141 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 02 15:47:06.668141 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 02 15:47:06.669325 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 15:47:06.669325 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 15:47:06.669325 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 02 15:47:06.669325 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 02 15:47:06.669325 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 02 15:47:06.669325 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 02 15:47:06.669325 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 15:47:06.669325 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 15:47:06.669325 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 15:47:06.669325 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 15:47:06.669325 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 15:47:06.669325 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application with Lock( Jun 02 15:47:06.669325 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 15:47:06.669325 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application return self._enter() Jun 02 15:47:06.669325 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 15:47:06.669325 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 15:47:06.669325 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 15:47:06.669325 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application return self.creator() Jun 02 15:47:06.670513 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 15:47:06.670513 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application created_value = creator( Jun 02 15:47:06.670513 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 02 15:47:06.670513 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 02 15:47:06.670513 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 02 15:47:06.670513 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 02 15:47:06.670513 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 02 15:47:06.670513 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 02 15:47:06.670513 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 02 15:47:06.670513 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application Jun 02 15:47:06.670513 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 459/930] 10.222.0.59 () {56 vars in 1117 bytes} [Thu Jun 2 15:47:06 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 15:47:06.671130 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6a7193-2452-4fe6-84aa-068bfa14a546 None None] REQUEST_METHOD: `POST` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:47:06.671130 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6a7193-2452-4fe6-84aa-068bfa14a546 None None] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:47:06.671387 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6a7193-2452-4fe6-84aa-068bfa14a546 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:47:06.688300 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.auth.core [None req-0d6a7193-2452-4fe6-84aa-068bfa14a546 None None] MFA Rules not processed for user `400d1f4db9de49638549e5db29a041e1`. Rule list: `[]` (Enabled: `True`). {{(pid=80396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 15:47:06.689475 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.fernet_utils [None req-0d6a7193-2452-4fe6-84aa-068bfa14a546 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 15:47:06.735604 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0bc5533-b701-43b4-82bc-4b85f1cacac6 None None] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:47:06.754536 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 460/931] 10.222.0.59 () {58 vars in 1023 bytes} [Thu Jun 2 15:47:06 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 02 15:47:06.755377 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d6a7193-2452-4fe6-84aa-068bfa14a546 None None] Authenticating user token {{(pid=80396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:47:06.781956 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df565a26-68e6-41c6-95b2-9199065fb8e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:47:06.783025 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df565a26-68e6-41c6-95b2-9199065fb8e7 None admin] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:47:06.783460 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df565a26-68e6-41c6-95b2-9199065fb8e7 None admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:47:06.783929 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df565a26-68e6-41c6-95b2-9199065fb8e7 None admin] PATH_INFO: `/v3/services` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:47:06.784843 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df565a26-68e6-41c6-95b2-9199065fb8e7 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80395) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 15:47:06.785943 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df565a26-68e6-41c6-95b2-9199065fb8e7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:47:06.787758 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df565a26-68e6-41c6-95b2-9199065fb8e7 None admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:47:06.798349 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 472/932] 10.222.0.59 () {56 vars in 1122 bytes} [Thu Jun 2 15:47:06 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 15:47:06.800618 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df565a26-68e6-41c6-95b2-9199065fb8e7 None admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:47:06.838210 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG dbcounter [-] [80396] Writing DB stats keystone:SELECT=100 {{(pid=80396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:47:06.841742 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writing DB stats keystone:SELECT=100 {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:47:06.867695 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d6a7193-2452-4fe6-84aa-068bfa14a546 None None] Validating token access rules against request {{(pid=80396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:47:06.903237 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df565a26-68e6-41c6-95b2-9199065fb8e7 None admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:47:06.905544 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be040b99-0358-460f-b59b-7cf70bd64d8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:47:06.906251 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be040b99-0358-460f-b59b-7cf70bd64d8a None admin] REQUEST_METHOD: `GET` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:47:06.906548 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be040b99-0358-460f-b59b-7cf70bd64d8a None admin] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:47:06.906834 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be040b99-0358-460f-b59b-7cf70bd64d8a None admin] PATH_INFO: `/v3/users` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:47:06.907672 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be040b99-0358-460f-b59b-7cf70bd64d8a None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80396) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 15:47:06.907986 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be040b99-0358-460f-b59b-7cf70bd64d8a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:47:06.909412 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be040b99-0358-460f-b59b-7cf70bd64d8a None admin] RBAC: Authorization granted {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:47:06.927127 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 461/933] 10.222.0.59 () {56 vars in 1149 bytes} [Thu Jun 2 15:47:06 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 15:47:06.927741 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be040b99-0358-460f-b59b-7cf70bd64d8a None admin] Authenticating user token {{(pid=80396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:47:06.945308 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-636f855c-26f2-4cbd-a62e-a08f862ea9c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:47:06.946144 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-636f855c-26f2-4cbd-a62e-a08f862ea9c3 None admin] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:47:06.946433 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-636f855c-26f2-4cbd-a62e-a08f862ea9c3 None admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:47:06.946717 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-636f855c-26f2-4cbd-a62e-a08f862ea9c3 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:47:06.947377 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-636f855c-26f2-4cbd-a62e-a08f862ea9c3 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:47:06.948760 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-636f855c-26f2-4cbd-a62e-a08f862ea9c3 None admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:47:06.961670 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application [None req-636f855c-26f2-4cbd-a62e-a08f862ea9c3 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 02 15:47:06.961670 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 15:47:06.961670 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 02 15:47:06.961670 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 02 15:47:06.961670 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 02 15:47:06.961670 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 02 15:47:06.961670 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 02 15:47:06.961670 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 02 15:47:06.961670 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 02 15:47:06.961670 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application Jun 02 15:47:06.961670 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 02 15:47:06.961670 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application Jun 02 15:47:06.961670 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 15:47:06.961670 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 15:47:06.961670 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 15:47:06.961670 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 15:47:06.962994 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 15:47:06.962994 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 15:47:06.962994 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 15:47:06.962994 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 15:47:06.962994 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 15:47:06.962994 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 15:47:06.962994 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 15:47:06.962994 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 02 15:47:06.962994 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 02 15:47:06.962994 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 02 15:47:06.962994 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 02 15:47:06.962994 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 15:47:06.962994 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 15:47:06.962994 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 15:47:06.962994 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 15:47:06.962994 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 15:47:06.964346 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 15:47:06.964346 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 15:47:06.964346 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application with Lock( Jun 02 15:47:06.964346 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 15:47:06.964346 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self._enter() Jun 02 15:47:06.964346 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 15:47:06.964346 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 15:47:06.964346 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 15:47:06.964346 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self.creator() Jun 02 15:47:06.964346 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 15:47:06.964346 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application created_value = creator( Jun 02 15:47:06.964346 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 02 15:47:06.964346 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 02 15:47:06.964346 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 02 15:47:06.964346 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application Jun 02 15:47:06.964346 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 473/934] 10.222.0.59 () {56 vars in 1132 bytes} [Thu Jun 2 15:47:06 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 15:47:06.965173 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-636f855c-26f2-4cbd-a62e-a08f862ea9c3 None admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:47:07.040842 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be040b99-0358-460f-b59b-7cf70bd64d8a None admin] Validating token access rules against request {{(pid=80396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:47:07.069871 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writing DB stats keystone:SELECT=100 {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:47:07.070063 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG dbcounter [-] [80396] Writing DB stats keystone:SELECT=100 {{(pid=80396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:47:07.073677 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-636f855c-26f2-4cbd-a62e-a08f862ea9c3 None admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:47:07.075944 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-773148b9-f84b-454f-b5f3-40e5613dedb9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:47:07.076600 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-773148b9-f84b-454f-b5f3-40e5613dedb9 None admin] REQUEST_METHOD: `GET` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:47:07.076883 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-773148b9-f84b-454f-b5f3-40e5613dedb9 None admin] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:47:07.077156 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-773148b9-f84b-454f-b5f3-40e5613dedb9 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:47:07.077947 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-773148b9-f84b-454f-b5f3-40e5613dedb9 None admin] RBAC: Adding query filter params (interface=public, service_id=889c6d18ca4347f2aa84e1f500919f19, region_id=RegionOne) {{(pid=80396) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 15:47:07.078285 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-773148b9-f84b-454f-b5f3-40e5613dedb9 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:47:07.079644 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-773148b9-f84b-454f-b5f3-40e5613dedb9 None admin] RBAC: Authorization granted {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:47:07.085998 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 462/935] 10.222.0.59 () {56 vars in 1251 bytes} [Thu Jun 2 15:47:06 2022] GET /identity/v3/endpoints?service_id=889c6d18ca4347f2aa84e1f500919f19&interface=public®ion_id=RegionOne => generated 194 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 15:47:07.087132 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-773148b9-f84b-454f-b5f3-40e5613dedb9 None admin] Authenticating user token {{(pid=80396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:47:07.115497 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-574bdf7b-a5f2-4391-a017-b4ab17901d59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:47:07.115497 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574bdf7b-a5f2-4391-a017-b4ab17901d59 None admin] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:47:07.115497 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574bdf7b-a5f2-4391-a017-b4ab17901d59 None admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:47:07.115497 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574bdf7b-a5f2-4391-a017-b4ab17901d59 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:47:07.126195 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-574bdf7b-a5f2-4391-a017-b4ab17901d59 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:47:07.127671 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-574bdf7b-a5f2-4391-a017-b4ab17901d59 None admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:47:07.147740 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application [None req-574bdf7b-a5f2-4391-a017-b4ab17901d59 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 15:47:07.147740 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 15:47:07.147740 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 15:47:07.147740 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 15:47:07.147740 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 15:47:07.147740 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 15:47:07.147740 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 15:47:07.147740 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 15:47:07.147740 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 15:47:07.147740 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 15:47:07.147740 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 15:47:07.147740 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 15:47:07.147740 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 02 15:47:07.147740 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 02 15:47:07.147740 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 02 15:47:07.148670 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 02 15:47:07.148670 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 15:47:07.148670 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 15:47:07.148670 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 15:47:07.148670 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 15:47:07.148670 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 15:47:07.148670 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 15:47:07.148670 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 15:47:07.148670 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application with Lock( Jun 02 15:47:07.148670 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 15:47:07.148670 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self._enter() Jun 02 15:47:07.148670 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 15:47:07.148670 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 15:47:07.148670 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 15:47:07.148670 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self.creator() Jun 02 15:47:07.148670 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 15:47:07.148670 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application created_value = creator( Jun 02 15:47:07.149559 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 02 15:47:07.149559 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 02 15:47:07.149559 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 15:47:07.149559 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application Jun 02 15:47:07.149559 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 474/936] 10.222.0.59 () {56 vars in 1108 bytes} [Thu Jun 2 15:47:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 15:47:07.149839 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-574bdf7b-a5f2-4391-a017-b4ab17901d59 None admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:47:07.204989 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-773148b9-f84b-454f-b5f3-40e5613dedb9 None admin] Validating token access rules against request {{(pid=80396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:47:07.239446 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-569d5725-5077-4115-9514-aa83ab4978ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:47:07.240113 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569d5725-5077-4115-9514-aa83ab4978ec None admin] REQUEST_METHOD: `GET` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:47:07.240398 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569d5725-5077-4115-9514-aa83ab4978ec None admin] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:47:07.240677 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569d5725-5077-4115-9514-aa83ab4978ec None admin] PATH_INFO: `/v3/services` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:47:07.241382 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-569d5725-5077-4115-9514-aa83ab4978ec None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=80396) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 15:47:07.241695 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-569d5725-5077-4115-9514-aa83ab4978ec None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:47:07.243110 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-569d5725-5077-4115-9514-aa83ab4978ec None admin] RBAC: Authorization granted {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:47:07.248114 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 463/937] 10.222.0.59 () {56 vars in 1126 bytes} [Thu Jun 2 15:47:07 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 15:47:07.248700 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-569d5725-5077-4115-9514-aa83ab4978ec None admin] Authenticating user token {{(pid=80396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:47:07.265083 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-574bdf7b-a5f2-4391-a017-b4ab17901d59 None admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:47:07.299461 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd5b59f1-26e5-4890-bf0e-641cd6ae6fce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:47:07.300116 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd5b59f1-26e5-4890-bf0e-641cd6ae6fce None admin] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:47:07.300431 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd5b59f1-26e5-4890-bf0e-641cd6ae6fce None admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:47:07.300713 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd5b59f1-26e5-4890-bf0e-641cd6ae6fce None admin] PATH_INFO: `/v3/services` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:47:07.301476 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd5b59f1-26e5-4890-bf0e-641cd6ae6fce None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:47:07.302908 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd5b59f1-26e5-4890-bf0e-641cd6ae6fce None admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:47:07.308939 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 475/938] 10.222.0.59 () {56 vars in 1087 bytes} [Thu Jun 2 15:47:07 2022] GET /identity/v3/services => generated 1497 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 15:47:07.309723 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd5b59f1-26e5-4890-bf0e-641cd6ae6fce None admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:47:07.324293 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG dbcounter [-] [80396] Writing DB stats keystone:SELECT=100 {{(pid=80396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:47:07.338924 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writing DB stats keystone:SELECT=100 {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:47:07.391065 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-569d5725-5077-4115-9514-aa83ab4978ec None admin] Validating token access rules against request {{(pid=80396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:47:07.452789 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd5b59f1-26e5-4890-bf0e-641cd6ae6fce None admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:47:07.454949 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-311117d1-753e-4eaa-97e8-6d7e853bc560 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:47:07.455717 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-311117d1-753e-4eaa-97e8-6d7e853bc560 None admin] REQUEST_METHOD: `GET` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:47:07.457035 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-311117d1-753e-4eaa-97e8-6d7e853bc560 None admin] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:47:07.457399 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-311117d1-753e-4eaa-97e8-6d7e853bc560 None admin] PATH_INFO: `/v3/domains` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:47:07.458255 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-311117d1-753e-4eaa-97e8-6d7e853bc560 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80396) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 15:47:07.458643 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-311117d1-753e-4eaa-97e8-6d7e853bc560 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:47:07.460127 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-311117d1-753e-4eaa-97e8-6d7e853bc560 None admin] RBAC: Authorization granted {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:47:07.481681 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 464/939] 10.222.0.59 () {56 vars in 1109 bytes} [Thu Jun 2 15:47:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 15:47:07.482650 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-311117d1-753e-4eaa-97e8-6d7e853bc560 None admin] Authenticating user token {{(pid=80396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:47:07.501734 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eff14af5-5982-4236-8559-3dde6b125577 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:47:07.502643 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff14af5-5982-4236-8559-3dde6b125577 None admin] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:47:07.503058 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff14af5-5982-4236-8559-3dde6b125577 None admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:47:07.503344 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff14af5-5982-4236-8559-3dde6b125577 None admin] PATH_INFO: `/v3/services` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:47:07.504725 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eff14af5-5982-4236-8559-3dde6b125577 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=80395) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 15:47:07.505015 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eff14af5-5982-4236-8559-3dde6b125577 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:47:07.506755 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eff14af5-5982-4236-8559-3dde6b125577 None admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:47:07.518184 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 476/940] 10.222.0.59 () {56 vars in 1126 bytes} [Thu Jun 2 15:47:07 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 15:47:07.520604 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eff14af5-5982-4236-8559-3dde6b125577 None admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:47:07.616743 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-311117d1-753e-4eaa-97e8-6d7e853bc560 None admin] Validating token access rules against request {{(pid=80396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:47:07.639205 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writing DB stats keystone:SELECT=100 {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:47:07.645284 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG dbcounter [-] [80396] Writing DB stats keystone:SELECT=100 {{(pid=80396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:47:07.659826 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eff14af5-5982-4236-8559-3dde6b125577 None admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:47:07.663562 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77dd28e7-e22e-444e-8821-d83a28b3ed16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:47:07.664441 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77dd28e7-e22e-444e-8821-d83a28b3ed16 None admin] REQUEST_METHOD: `GET` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:47:07.664793 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77dd28e7-e22e-444e-8821-d83a28b3ed16 None admin] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:47:07.665135 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77dd28e7-e22e-444e-8821-d83a28b3ed16 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:47:07.673992 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77dd28e7-e22e-444e-8821-d83a28b3ed16 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:47:07.677020 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77dd28e7-e22e-444e-8821-d83a28b3ed16 None admin] RBAC: Authorization granted {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:47:07.695099 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application [None req-77dd28e7-e22e-444e-8821-d83a28b3ed16 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 02 15:47:07.695099 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 15:47:07.695099 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 15:47:07.695099 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 15:47:07.695099 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 15:47:07.695099 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 15:47:07.695099 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 15:47:07.695099 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 15:47:07.695099 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 15:47:07.695099 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 15:47:07.695099 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 15:47:07.695099 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 15:47:07.695099 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 02 15:47:07.695099 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 02 15:47:07.695099 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 02 15:47:07.696184 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 02 15:47:07.696184 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 15:47:07.696184 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 15:47:07.696184 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 15:47:07.696184 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 15:47:07.696184 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 15:47:07.696184 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 15:47:07.696184 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 15:47:07.696184 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application with Lock( Jun 02 15:47:07.696184 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 15:47:07.696184 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application return self._enter() Jun 02 15:47:07.696184 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 15:47:07.696184 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 15:47:07.696184 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 15:47:07.696184 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application return self.creator() Jun 02 15:47:07.696184 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 15:47:07.696184 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application created_value = creator( Jun 02 15:47:07.697256 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 02 15:47:07.697256 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 02 15:47:07.697256 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 02 15:47:07.697256 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 02 15:47:07.697256 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 02 15:47:07.697256 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 02 15:47:07.697256 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 02 15:47:07.697256 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application Jun 02 15:47:07.697256 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 465/941] 10.222.0.59 () {56 vars in 1111 bytes} [Thu Jun 2 15:47:07 2022] GET /identity/v3/projects/service => generated 88 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 15:47:07.702856 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b804497-c9f3-4752-bd1f-6aebac966e7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:47:07.703068 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77dd28e7-e22e-444e-8821-d83a28b3ed16 None admin] Authenticating user token {{(pid=80396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:47:07.703511 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b804497-c9f3-4752-bd1f-6aebac966e7a None admin] REQUEST_METHOD: `POST` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:47:07.703802 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b804497-c9f3-4752-bd1f-6aebac966e7a None admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:47:07.704079 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b804497-c9f3-4752-bd1f-6aebac966e7a None admin] PATH_INFO: `/v3/endpoints` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:47:07.704861 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b804497-c9f3-4752-bd1f-6aebac966e7a None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:47:07.707118 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b804497-c9f3-4752-bd1f-6aebac966e7a None admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:47:07.813218 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77dd28e7-e22e-444e-8821-d83a28b3ed16 None admin] Validating token access rules against request {{(pid=80396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:47:07.818219 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 477/942] 10.222.0.59 () {60 vars in 1144 bytes} [Thu Jun 2 15:47:07 2022] POST /identity/v3/endpoints => generated 347 bytes in 292 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 15:47:07.865392 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e95811-86ae-4c30-9ba9-9696249da09d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:47:07.866198 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e95811-86ae-4c30-9ba9-9696249da09d None admin] REQUEST_METHOD: `GET` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:47:07.866553 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e95811-86ae-4c30-9ba9-9696249da09d None admin] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:47:07.866895 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e95811-86ae-4c30-9ba9-9696249da09d None admin] PATH_INFO: `/v3/projects` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:47:07.867873 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49e95811-86ae-4c30-9ba9-9696249da09d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80396) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 15:47:07.868254 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49e95811-86ae-4c30-9ba9-9696249da09d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:47:07.869858 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49e95811-86ae-4c30-9ba9-9696249da09d None admin] RBAC: Authorization granted {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:47:07.884865 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 466/943] 10.222.0.59 () {56 vars in 1148 bytes} [Thu Jun 2 15:47:07 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 15:47:07.891113 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b804497-c9f3-4752-bd1f-6aebac966e7a None admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:47:08.007039 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b804497-c9f3-4752-bd1f-6aebac966e7a None admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:47:08.044348 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bdcd07e-0277-4f48-955b-f8a361cd37cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:47:08.045381 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bdcd07e-0277-4f48-955b-f8a361cd37cc None admin] REQUEST_METHOD: `PUT` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:47:08.045759 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bdcd07e-0277-4f48-955b-f8a361cd37cc None admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:47:08.046158 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bdcd07e-0277-4f48-955b-f8a361cd37cc None admin] PATH_INFO: `/v3/projects/9c87c981909d4b8db02783421818c79b/users/11b714eb2dda4460a8ff52215e671bfa/roles/ce7c3f9097fa4b4aa3a7a1d7bef989be` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:47:08.048457 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bdcd07e-0277-4f48-955b-f8a361cd37cc None admin] RBAC: Authorizing `identity:create_grant(project_id=9c87c981909d4b8db02783421818c79b, user_id=11b714eb2dda4460a8ff52215e671bfa, role_id=ce7c3f9097fa4b4aa3a7a1d7bef989be)` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:47:08.049991 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bdcd07e-0277-4f48-955b-f8a361cd37cc None admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:47:08.053696 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:47:08.164276 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 478/944] 10.222.0.59 () {58 vars in 1439 bytes} [Thu Jun 2 15:47:07 2022] PUT /identity/v3/projects/9c87c981909d4b8db02783421818c79b/users/11b714eb2dda4460a8ff52215e671bfa/roles/ce7c3f9097fa4b4aa3a7a1d7bef989be => generated 0 bytes in 273 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 15:47:08.629197 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f372c1d-e137-4e1f-8649-529cc654cc1a None None] REQUEST_METHOD: `GET` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:47:08.629803 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f372c1d-e137-4e1f-8649-529cc654cc1a None None] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:47:08.629911 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f372c1d-e137-4e1f-8649-529cc654cc1a None None] PATH_INFO: `/` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:47:08.631541 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 467/945] 10.222.0.59 () {54 vars in 926 bytes} [Thu Jun 2 15:47:08 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 15:47:08.637155 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab5b8fc-b7a9-40f0-b21a-cb8c9b0798af None None] REQUEST_METHOD: `POST` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:47:08.637574 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab5b8fc-b7a9-40f0-b21a-cb8c9b0798af None None] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:47:08.637717 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab5b8fc-b7a9-40f0-b21a-cb8c9b0798af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:47:08.655509 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.auth.core [None req-0ab5b8fc-b7a9-40f0-b21a-cb8c9b0798af None None] MFA Rules not processed for user `400d1f4db9de49638549e5db29a041e1`. Rule list: `[]` (Enabled: `True`). {{(pid=80395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 15:47:08.656697 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.fernet_utils [None req-0ab5b8fc-b7a9-40f0-b21a-cb8c9b0798af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 15:47:08.734184 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 479/946] 10.222.0.59 () {58 vars in 1023 bytes} [Thu Jun 2 15:47:08 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 02 15:47:08.753280 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f372c1d-e137-4e1f-8649-529cc654cc1a None None] Authenticating user token {{(pid=80396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:47:08.790189 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG dbcounter [-] [80396] Writing DB stats keystone:SELECT=100 {{(pid=80396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:47:08.859981 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f372c1d-e137-4e1f-8649-529cc654cc1a None None] Validating token access rules against request {{(pid=80396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:47:08.896318 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-175e24d7-1b6d-449b-bad3-5a1f35855c01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:47:08.896898 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175e24d7-1b6d-449b-bad3-5a1f35855c01 None admin] REQUEST_METHOD: `POST` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:47:08.897182 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175e24d7-1b6d-449b-bad3-5a1f35855c01 None admin] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:47:08.897454 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175e24d7-1b6d-449b-bad3-5a1f35855c01 None admin] PATH_INFO: `/v3/projects` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:47:08.898192 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-175e24d7-1b6d-449b-bad3-5a1f35855c01 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:47:08.899618 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-175e24d7-1b6d-449b-bad3-5a1f35855c01 None admin] RBAC: Authorization granted {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:47:08.900976 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: WARNING keystone.server.flask.common [None req-175e24d7-1b6d-449b-bad3-5a1f35855c01 None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Jun 02 15:47:08.948814 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.sql.core [None req-175e24d7-1b6d-449b-bad3-5a1f35855c01 None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Jun 02 15:47:08.948814 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Jun 02 15:47:08.948814 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [parameters: {'id': 'd898c475695e49809f1f2e2324ceaffd', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Jun 02 15:47:08.948814 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=80396) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Jun 02 15:47:08.966714 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application [None req-175e24d7-1b6d-449b-bad3-5a1f35855c01 None admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id d898c475695e49809f1f2e2324ceaffd.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id d898c475695e49809f1f2e2324ceaffd. Jun 02 15:47:08.966714 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 15:47:08.966714 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jun 02 15:47:08.966714 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application self.dialect.do_execute( Jun 02 15:47:08.966714 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jun 02 15:47:08.966714 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jun 02 15:47:08.966714 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jun 02 15:47:08.966714 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application result = self._query(query) Jun 02 15:47:08.966714 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jun 02 15:47:08.966714 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application conn.query(q) Jun 02 15:47:08.966714 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jun 02 15:47:08.966714 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jun 02 15:47:08.966714 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jun 02 15:47:08.968039 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application result.read() Jun 02 15:47:08.968039 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jun 02 15:47:08.968039 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jun 02 15:47:08.968039 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jun 02 15:47:08.968039 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application packet.raise_for_error() Jun 02 15:47:08.968039 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jun 02 15:47:08.968039 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jun 02 15:47:08.968039 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jun 02 15:47:08.968039 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jun 02 15:47:08.968039 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Jun 02 15:47:08.968039 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application Jun 02 15:47:08.968039 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Jun 02 15:47:08.968039 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application Jun 02 15:47:08.968039 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 15:47:08.968039 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Jun 02 15:47:08.968039 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application return method(*args, **kwargs) Jun 02 15:47:08.968039 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project Jun 02 15:47:08.968039 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application return project_ref.to_dict() Jun 02 15:47:08.969487 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jun 02 15:47:08.969487 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application next(self.gen) Jun 02 15:47:08.969487 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Jun 02 15:47:08.969487 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application yield resource Jun 02 15:47:08.969487 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jun 02 15:47:08.969487 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application next(self.gen) Jun 02 15:47:08.969487 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Jun 02 15:47:08.969487 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application self.session.rollback() Jun 02 15:47:08.969487 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jun 02 15:47:08.969487 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application self.force_reraise() Jun 02 15:47:08.969487 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jun 02 15:47:08.969487 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application raise self.value Jun 02 15:47:08.969487 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Jun 02 15:47:08.969487 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Jun 02 15:47:08.969487 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Jun 02 15:47:08.969487 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application session.commit() Jun 02 15:47:08.969487 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1435, in commit Jun 02 15:47:08.972182 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Jun 02 15:47:08.972182 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Jun 02 15:47:08.972182 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application self._prepare_impl() Jun 02 15:47:08.972182 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Jun 02 15:47:08.972182 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application self.session.flush() Jun 02 15:47:08.972182 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3367, in flush Jun 02 15:47:08.972182 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application self._flush(objects) Jun 02 15:47:08.972182 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3507, in _flush Jun 02 15:47:08.972182 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Jun 02 15:47:08.972182 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Jun 02 15:47:08.972182 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application compat.raise_( Jun 02 15:47:08.972182 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ Jun 02 15:47:08.972182 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application raise exception Jun 02 15:47:08.972182 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3467, in _flush Jun 02 15:47:08.972182 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application flush_context.execute() Jun 02 15:47:08.972182 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Jun 02 15:47:08.972182 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application rec.execute(self) Jun 02 15:47:08.978566 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Jun 02 15:47:08.978566 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Jun 02 15:47:08.978566 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Jun 02 15:47:08.978566 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application _emit_insert_statements( Jun 02 15:47:08.978566 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Jun 02 15:47:08.978566 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application c = connection._execute_20( Jun 02 15:47:08.978566 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Jun 02 15:47:08.978566 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Jun 02 15:47:08.978566 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 325, in _execute_on_connection Jun 02 15:47:08.978566 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Jun 02 15:47:08.978566 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Jun 02 15:47:08.978566 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application ret = self._execute_context( Jun 02 15:47:08.978566 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Jun 02 15:47:08.978566 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Jun 02 15:47:08.978566 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Jun 02 15:47:08.979418 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Jun 02 15:47:08.979418 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ Jun 02 15:47:08.979418 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application raise exception Jun 02 15:47:08.979418 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jun 02 15:47:08.979418 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application self.dialect.do_execute( Jun 02 15:47:08.979418 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jun 02 15:47:08.979418 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jun 02 15:47:08.979418 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jun 02 15:47:08.979418 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application result = self._query(query) Jun 02 15:47:08.979418 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jun 02 15:47:08.979418 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application conn.query(q) Jun 02 15:47:08.979418 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jun 02 15:47:08.979418 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jun 02 15:47:08.979418 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jun 02 15:47:08.979418 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application result.read() Jun 02 15:47:08.979418 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jun 02 15:47:08.979418 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jun 02 15:47:08.980321 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jun 02 15:47:08.980321 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application packet.raise_for_error() Jun 02 15:47:08.980321 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jun 02 15:47:08.980321 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jun 02 15:47:08.980321 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jun 02 15:47:08.980321 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jun 02 15:47:08.980321 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Jun 02 15:47:08.980321 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Jun 02 15:47:08.980321 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application [parameters: {'id': 'd898c475695e49809f1f2e2324ceaffd', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Jun 02 15:47:08.980321 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Jun 02 15:47:08.980321 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application Jun 02 15:47:08.980321 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 02 15:47:08.980321 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application Jun 02 15:47:08.980321 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 15:47:08.980321 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project Jun 02 15:47:08.981137 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) Jun 02 15:47:08.981137 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Jun 02 15:47:08.981137 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Jun 02 15:47:08.981137 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name service at domain ID default. Jun 02 15:47:08.981137 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application Jun 02 15:47:08.981137 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 02 15:47:08.981137 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application Jun 02 15:47:08.981137 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 15:47:08.981137 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 15:47:08.981137 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 15:47:08.981137 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 15:47:08.981137 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 15:47:08.981137 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 15:47:08.981137 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 15:47:08.981137 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 15:47:08.981137 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 15:47:08.981137 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 15:47:08.982039 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 15:47:08.982039 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 176, in post Jun 02 15:47:08.982039 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_project( Jun 02 15:47:08.982039 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 15:47:08.982039 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 15:47:08.982039 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project Jun 02 15:47:08.982039 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application raise exception.Conflict( Jun 02 15:47:08.982039 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id d898c475695e49809f1f2e2324ceaffd. Jun 02 15:47:08.982039 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application Jun 02 15:47:08.982039 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 468/947] 10.222.0.59 () {60 vars in 1140 bytes} [Thu Jun 2 15:47:08 2022] POST /identity/v3/projects => generated 262 bytes in 216 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Jun 02 15:47:08.982633 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ab5b8fc-b7a9-40f0-b21a-cb8c9b0798af None None] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:47:09.087583 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ab5b8fc-b7a9-40f0-b21a-cb8c9b0798af None None] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:47:09.115679 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writing DB stats keystone:SELECT=100 {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:47:09.125041 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa788daa-b74e-4c74-8d0d-470d77d815a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:47:09.128531 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa788daa-b74e-4c74-8d0d-470d77d815a5 None admin] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:47:09.128531 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa788daa-b74e-4c74-8d0d-470d77d815a5 None admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:47:09.128531 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa788daa-b74e-4c74-8d0d-470d77d815a5 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:47:09.133584 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa788daa-b74e-4c74-8d0d-470d77d815a5 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:47:09.135080 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa788daa-b74e-4c74-8d0d-470d77d815a5 None admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:47:09.150456 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application [None req-fa788daa-b74e-4c74-8d0d-470d77d815a5 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 02 15:47:09.150456 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 15:47:09.150456 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 15:47:09.150456 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 15:47:09.150456 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 15:47:09.150456 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 15:47:09.150456 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 15:47:09.150456 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 15:47:09.150456 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 15:47:09.150456 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 15:47:09.150456 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 15:47:09.150456 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 15:47:09.150456 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 02 15:47:09.150456 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 02 15:47:09.150456 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 02 15:47:09.151567 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 02 15:47:09.151567 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 15:47:09.151567 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 15:47:09.151567 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 15:47:09.151567 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 15:47:09.151567 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 15:47:09.151567 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 15:47:09.151567 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 15:47:09.151567 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application with Lock( Jun 02 15:47:09.151567 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 15:47:09.151567 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self._enter() Jun 02 15:47:09.151567 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 15:47:09.151567 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 15:47:09.151567 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 15:47:09.151567 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self.creator() Jun 02 15:47:09.151567 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 15:47:09.151567 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application created_value = creator( Jun 02 15:47:09.152651 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 02 15:47:09.152651 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 02 15:47:09.152651 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 02 15:47:09.152651 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 02 15:47:09.152651 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 02 15:47:09.152651 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 02 15:47:09.152651 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 02 15:47:09.152651 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application Jun 02 15:47:09.156376 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 480/948] 10.222.0.59 () {56 vars in 1111 bytes} [Thu Jun 2 15:47:08 2022] GET /identity/v3/projects/service => generated 88 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 15:47:09.158141 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-175e24d7-1b6d-449b-bad3-5a1f35855c01 None admin] Authenticating user token {{(pid=80396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:47:09.263897 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG dbcounter [-] [80396] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:47:09.276211 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-175e24d7-1b6d-449b-bad3-5a1f35855c01 None admin] Validating token access rules against request {{(pid=80396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:47:09.313680 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea61a2b3-1a5f-4c27-81ee-b7a3a48e41be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:47:09.314379 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea61a2b3-1a5f-4c27-81ee-b7a3a48e41be None admin] REQUEST_METHOD: `GET` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:47:09.314665 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea61a2b3-1a5f-4c27-81ee-b7a3a48e41be None admin] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:47:09.314946 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea61a2b3-1a5f-4c27-81ee-b7a3a48e41be None admin] PATH_INFO: `/v3/projects` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:47:09.315755 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea61a2b3-1a5f-4c27-81ee-b7a3a48e41be None admin] RBAC: Adding query filter params (name=service) {{(pid=80396) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 15:47:09.316161 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea61a2b3-1a5f-4c27-81ee-b7a3a48e41be None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:47:09.318340 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea61a2b3-1a5f-4c27-81ee-b7a3a48e41be None admin] RBAC: Authorization granted {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:47:09.347586 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 469/949] 10.222.0.59 () {56 vars in 1112 bytes} [Thu Jun 2 15:47:09 2022] GET /identity/v3/projects?name=service => generated 411 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 15:47:09.724267 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb2671d6-2c14-4055-90eb-38069ed934ac None None] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:47:09.724955 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb2671d6-2c14-4055-90eb-38069ed934ac None None] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:47:09.724955 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb2671d6-2c14-4055-90eb-38069ed934ac None None] PATH_INFO: `/` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:47:09.726503 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 481/950] 10.222.0.59 () {54 vars in 926 bytes} [Thu Jun 2 15:47:09 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 15:47:09.731927 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167d4384-4189-4f19-9e70-1cd3b49d7894 None None] REQUEST_METHOD: `POST` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:47:09.732353 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167d4384-4189-4f19-9e70-1cd3b49d7894 None None] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:47:09.732527 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167d4384-4189-4f19-9e70-1cd3b49d7894 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:47:09.750419 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.auth.core [None req-167d4384-4189-4f19-9e70-1cd3b49d7894 None None] MFA Rules not processed for user `400d1f4db9de49638549e5db29a041e1`. Rule list: `[]` (Enabled: `True`). {{(pid=80396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 15:47:09.751937 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.fernet_utils [None req-167d4384-4189-4f19-9e70-1cd3b49d7894 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 15:47:09.823562 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 470/951] 10.222.0.59 () {58 vars in 1023 bytes} [Thu Jun 2 15:47:09 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 02 15:47:09.846683 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb2671d6-2c14-4055-90eb-38069ed934ac None None] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:47:09.960669 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb2671d6-2c14-4055-90eb-38069ed934ac None None] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:47:09.995988 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4b2d61c-119f-4d92-ab4d-239529ef10e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:47:09.997192 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b2d61c-119f-4d92-ab4d-239529ef10e1 None admin] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:47:09.997693 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b2d61c-119f-4d92-ab4d-239529ef10e1 None admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:47:09.998193 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b2d61c-119f-4d92-ab4d-239529ef10e1 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:47:09.999039 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4b2d61c-119f-4d92-ab4d-239529ef10e1 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:47:10.000661 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4b2d61c-119f-4d92-ab4d-239529ef10e1 None admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:47:10.013686 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application [None req-a4b2d61c-119f-4d92-ab4d-239529ef10e1 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 02 15:47:10.013686 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 15:47:10.013686 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 02 15:47:10.013686 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 02 15:47:10.013686 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 02 15:47:10.013686 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 02 15:47:10.013686 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 02 15:47:10.013686 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 02 15:47:10.013686 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 02 15:47:10.013686 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application Jun 02 15:47:10.013686 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 02 15:47:10.013686 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application Jun 02 15:47:10.013686 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 15:47:10.013686 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 15:47:10.013686 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 15:47:10.013686 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 15:47:10.013686 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 15:47:10.014814 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 15:47:10.014814 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 15:47:10.014814 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 15:47:10.014814 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 15:47:10.014814 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 15:47:10.014814 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 15:47:10.014814 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 02 15:47:10.014814 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 02 15:47:10.014814 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 02 15:47:10.014814 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 02 15:47:10.014814 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 15:47:10.014814 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 15:47:10.014814 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 15:47:10.014814 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 15:47:10.014814 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 15:47:10.014814 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 15:47:10.015859 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 15:47:10.015859 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application with Lock( Jun 02 15:47:10.015859 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 15:47:10.015859 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self._enter() Jun 02 15:47:10.015859 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 15:47:10.015859 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 15:47:10.015859 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 15:47:10.015859 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self.creator() Jun 02 15:47:10.015859 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 15:47:10.015859 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application created_value = creator( Jun 02 15:47:10.015859 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 02 15:47:10.015859 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 02 15:47:10.015859 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 02 15:47:10.015859 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application Jun 02 15:47:10.024169 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 482/952] 10.222.0.59 () {56 vars in 1126 bytes} [Thu Jun 2 15:47:09 2022] GET /identity/v3/services/object-store => generated 93 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 15:47:10.025793 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-167d4384-4189-4f19-9e70-1cd3b49d7894 None None] Authenticating user token {{(pid=80396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:47:10.111904 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG dbcounter [-] [80396] Writing DB stats keystone:SELECT=100 {{(pid=80396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:47:10.130368 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-167d4384-4189-4f19-9e70-1cd3b49d7894 None None] Validating token access rules against request {{(pid=80396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:47:10.169437 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7aa2f9f-4e87-43a0-9a9e-33fa12c6e63b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:47:10.169437 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7aa2f9f-4e87-43a0-9a9e-33fa12c6e63b None admin] REQUEST_METHOD: `GET` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:47:10.169437 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7aa2f9f-4e87-43a0-9a9e-33fa12c6e63b None admin] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:47:10.169437 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7aa2f9f-4e87-43a0-9a9e-33fa12c6e63b None admin] PATH_INFO: `/v3/services` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:47:10.169864 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7aa2f9f-4e87-43a0-9a9e-33fa12c6e63b None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80396) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 15:47:10.169864 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7aa2f9f-4e87-43a0-9a9e-33fa12c6e63b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:47:10.170289 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7aa2f9f-4e87-43a0-9a9e-33fa12c6e63b None admin] RBAC: Authorization granted {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:47:10.180456 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 471/953] 10.222.0.59 () {56 vars in 1122 bytes} [Thu Jun 2 15:47:10 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 15:47:10.182137 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4b2d61c-119f-4d92-ab4d-239529ef10e1 None admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:47:10.240348 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writing DB stats keystone:SELECT=100 {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:47:10.275491 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0148937-ca53-41a5-8d33-10e3e04cde3f None None] REQUEST_METHOD: `GET` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:47:10.275827 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0148937-ca53-41a5-8d33-10e3e04cde3f None None] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:47:10.276340 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0148937-ca53-41a5-8d33-10e3e04cde3f None None] PATH_INFO: `/` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:47:10.279550 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 472/954] 10.222.0.59 () {54 vars in 926 bytes} [Thu Jun 2 15:47:10 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 15:47:10.287756 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ab0d3e-df91-4ef4-a088-6a495bc9b644 None None] REQUEST_METHOD: `POST` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:47:10.288057 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ab0d3e-df91-4ef4-a088-6a495bc9b644 None None] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:47:10.288323 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ab0d3e-df91-4ef4-a088-6a495bc9b644 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:47:10.303807 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4b2d61c-119f-4d92-ab4d-239529ef10e1 None admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:47:10.310729 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.auth.core [None req-a4ab0d3e-df91-4ef4-a088-6a495bc9b644 None None] MFA Rules not processed for user `400d1f4db9de49638549e5db29a041e1`. Rule list: `[]` (Enabled: `True`). {{(pid=80396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 15:47:10.311924 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.fernet_utils [None req-a4ab0d3e-df91-4ef4-a088-6a495bc9b644 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 15:47:10.346295 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ed605be-c274-4660-a735-c1013d7efb48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:47:10.347289 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed605be-c274-4660-a735-c1013d7efb48 None admin] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:47:10.347599 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed605be-c274-4660-a735-c1013d7efb48 None admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:47:10.347892 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed605be-c274-4660-a735-c1013d7efb48 None admin] PATH_INFO: `/v3/services` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:47:10.348718 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ed605be-c274-4660-a735-c1013d7efb48 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80395) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 15:47:10.349109 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ed605be-c274-4660-a735-c1013d7efb48 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:47:10.350589 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ed605be-c274-4660-a735-c1013d7efb48 None admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:47:10.362460 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 483/955] 10.222.0.59 () {56 vars in 1122 bytes} [Thu Jun 2 15:47:10 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 15:47:10.364406 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ed605be-c274-4660-a735-c1013d7efb48 None admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:47:10.401400 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 473/956] 10.222.0.59 () {58 vars in 1023 bytes} [Thu Jun 2 15:47:10 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 02 15:47:10.423547 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4ab0d3e-df91-4ef4-a088-6a495bc9b644 None None] Authenticating user token {{(pid=80396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:47:10.470728 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ed605be-c274-4660-a735-c1013d7efb48 None admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:47:10.486203 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writing DB stats keystone:SELECT=100 {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:47:10.512353 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d1cd28e-f4b2-48d4-9eee-f6a04d4d71a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:47:10.513176 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1cd28e-f4b2-48d4-9eee-f6a04d4d71a7 None admin] REQUEST_METHOD: `POST` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:47:10.513562 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1cd28e-f4b2-48d4-9eee-f6a04d4d71a7 None admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:47:10.513941 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1cd28e-f4b2-48d4-9eee-f6a04d4d71a7 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:47:10.514822 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d1cd28e-f4b2-48d4-9eee-f6a04d4d71a7 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:47:10.516482 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d1cd28e-f4b2-48d4-9eee-f6a04d4d71a7 None admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:47:10.526169 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG dbcounter [-] [80396] Writing DB stats keystone:SELECT=100 {{(pid=80396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:47:10.549610 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4ab0d3e-df91-4ef4-a088-6a495bc9b644 None None] Validating token access rules against request {{(pid=80396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:47:10.589409 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b542c7d-fc0a-438d-b03e-e6e17f01db39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:47:10.590252 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b542c7d-fc0a-438d-b03e-e6e17f01db39 None admin] REQUEST_METHOD: `GET` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:47:10.590539 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b542c7d-fc0a-438d-b03e-e6e17f01db39 None admin] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:47:10.590817 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b542c7d-fc0a-438d-b03e-e6e17f01db39 None admin] PATH_INFO: `/v3/services/compute` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:47:10.591475 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b542c7d-fc0a-438d-b03e-e6e17f01db39 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:47:10.592969 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b542c7d-fc0a-438d-b03e-e6e17f01db39 None admin] RBAC: Authorization granted {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:47:10.604854 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 484/957] 10.222.0.59 () {60 vars in 1144 bytes} [Thu Jun 2 15:47:10 2022] POST /identity/v3/endpoints => generated 349 bytes in 241 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 15:47:10.612207 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application [None req-6b542c7d-fc0a-438d-b03e-e6e17f01db39 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Jun 02 15:47:10.612207 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 15:47:10.612207 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 02 15:47:10.612207 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 02 15:47:10.612207 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 02 15:47:10.612207 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 02 15:47:10.612207 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 02 15:47:10.612207 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 02 15:47:10.612207 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jun 02 15:47:10.612207 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application Jun 02 15:47:10.612207 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 02 15:47:10.612207 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application Jun 02 15:47:10.612207 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 15:47:10.612207 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 15:47:10.612207 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 15:47:10.612207 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 15:47:10.612207 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 15:47:10.613768 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 15:47:10.613768 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 15:47:10.613768 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 15:47:10.613768 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 15:47:10.613768 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 15:47:10.613768 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 15:47:10.613768 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 02 15:47:10.613768 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 02 15:47:10.613768 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 02 15:47:10.613768 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 02 15:47:10.613768 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 15:47:10.613768 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 15:47:10.613768 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 15:47:10.613768 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 15:47:10.613768 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 15:47:10.613768 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 15:47:10.614739 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 15:47:10.614739 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application with Lock( Jun 02 15:47:10.614739 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 15:47:10.614739 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application return self._enter() Jun 02 15:47:10.614739 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 15:47:10.614739 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 15:47:10.614739 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 15:47:10.614739 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application return self.creator() Jun 02 15:47:10.614739 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 15:47:10.614739 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application created_value = creator( Jun 02 15:47:10.614739 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 02 15:47:10.614739 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 02 15:47:10.614739 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jun 02 15:47:10.614739 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application Jun 02 15:47:10.614739 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 474/958] 10.222.0.59 () {56 vars in 1111 bytes} [Thu Jun 2 15:47:10 2022] GET /identity/v3/services/compute => generated 88 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 02 15:47:10.618395 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d1cd28e-f4b2-48d4-9eee-f6a04d4d71a7 None admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:47:10.624351 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f90d19a0-be63-4f1f-b566-637ca3be876f None None] REQUEST_METHOD: `GET` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:47:10.624704 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f90d19a0-be63-4f1f-b566-637ca3be876f None None] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:47:10.625048 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f90d19a0-be63-4f1f-b566-637ca3be876f None None] PATH_INFO: `/` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:47:10.626593 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 475/959] 10.222.0.59 () {54 vars in 926 bytes} [Thu Jun 2 15:47:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 02 15:47:10.633362 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd56094a-bf43-44ef-81db-e37ee0a4a2a0 None None] REQUEST_METHOD: `POST` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:47:10.633692 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd56094a-bf43-44ef-81db-e37ee0a4a2a0 None None] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:47:10.633933 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd56094a-bf43-44ef-81db-e37ee0a4a2a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:47:10.653014 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.auth.core [None req-fd56094a-bf43-44ef-81db-e37ee0a4a2a0 None None] MFA Rules not processed for user `400d1f4db9de49638549e5db29a041e1`. Rule list: `[]` (Enabled: `True`). {{(pid=80396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 15:47:10.654344 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.fernet_utils [None req-fd56094a-bf43-44ef-81db-e37ee0a4a2a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 15:47:10.752970 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 476/960] 10.222.0.59 () {58 vars in 1023 bytes} [Thu Jun 2 15:47:10 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 02 15:47:10.767963 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d1cd28e-f4b2-48d4-9eee-f6a04d4d71a7 None admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:47:10.779518 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd56094a-bf43-44ef-81db-e37ee0a4a2a0 None None] Authenticating user token {{(pid=80396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:47:10.814106 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04ab9389-d21d-42a6-9df1-e655c421c6c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:47:10.815038 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ab9389-d21d-42a6-9df1-e655c421c6c7 None admin] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:47:10.815349 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ab9389-d21d-42a6-9df1-e655c421c6c7 None admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:47:10.815633 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ab9389-d21d-42a6-9df1-e655c421c6c7 None admin] PATH_INFO: `/v3/services` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:47:10.816896 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04ab9389-d21d-42a6-9df1-e655c421c6c7 None admin] RBAC: Adding query filter params (name=compute) {{(pid=80395) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 15:47:10.817351 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04ab9389-d21d-42a6-9df1-e655c421c6c7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:47:10.819685 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04ab9389-d21d-42a6-9df1-e655c421c6c7 None admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:47:10.825102 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 485/961] 10.222.0.59 () {56 vars in 1112 bytes} [Thu Jun 2 15:47:10 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 15:47:10.832275 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04ab9389-d21d-42a6-9df1-e655c421c6c7 None admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:47:10.870115 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG dbcounter [-] [80396] Writing DB stats keystone:SELECT=100 {{(pid=80396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:47:10.875688 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:47:10.912269 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd56094a-bf43-44ef-81db-e37ee0a4a2a0 None None] Validating token access rules against request {{(pid=80396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:47:10.955965 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d896db49-b067-4e61-97b7-acb99e7f1bc9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:47:10.957730 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d896db49-b067-4e61-97b7-acb99e7f1bc9 None admin] REQUEST_METHOD: `GET` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:47:10.958308 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d896db49-b067-4e61-97b7-acb99e7f1bc9 None admin] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:47:10.958597 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d896db49-b067-4e61-97b7-acb99e7f1bc9 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:47:10.959972 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04ab9389-d21d-42a6-9df1-e655c421c6c7 None admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:47:10.971560 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d896db49-b067-4e61-97b7-acb99e7f1bc9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 02 15:47:10.982830 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application [None req-d896db49-b067-4e61-97b7-acb99e7f1bc9 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 02 15:47:10.982830 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 15:47:10.982830 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 15:47:10.982830 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 15:47:10.982830 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 15:47:10.982830 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 15:47:10.982830 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 15:47:10.982830 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 15:47:10.982830 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 15:47:10.982830 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 15:47:10.982830 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 15:47:10.982830 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 15:47:10.982830 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 02 15:47:10.982830 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 02 15:47:10.982830 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 02 15:47:10.982830 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 02 15:47:10.983739 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 02 15:47:10.983739 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 02 15:47:10.983739 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 02 15:47:10.983739 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 02 15:47:10.983739 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 15:47:10.983739 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 15:47:10.983739 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 15:47:10.983739 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 15:47:10.983739 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 15:47:10.983739 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 15:47:10.983739 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 15:47:10.983739 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application with Lock( Jun 02 15:47:10.983739 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 15:47:10.983739 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application return self._enter() Jun 02 15:47:10.983739 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 15:47:10.983739 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 15:47:10.985019 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 15:47:10.985019 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application return self.creator() Jun 02 15:47:10.985019 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 15:47:10.985019 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application created_value = creator( Jun 02 15:47:10.985019 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 02 15:47:10.985019 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 02 15:47:10.985019 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 02 15:47:10.985019 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 02 15:47:10.985019 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 02 15:47:10.985019 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 02 15:47:10.985019 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 02 15:47:10.985019 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application Jun 02 15:47:10.985019 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 477/962] 10.222.0.59 () {56 vars in 1120 bytes} [Thu Jun 2 15:47:10 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 15:47:10.995047 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d896db49-b067-4e61-97b7-acb99e7f1bc9 None admin] Authenticating user token {{(pid=80396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:47:11.001230 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82a61b7d-538e-49e0-9e35-06cfcb506577 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:47:11.001903 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a61b7d-538e-49e0-9e35-06cfcb506577 None admin] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:47:11.002231 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a61b7d-538e-49e0-9e35-06cfcb506577 None admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:47:11.002507 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a61b7d-538e-49e0-9e35-06cfcb506577 None admin] PATH_INFO: `/v3/services` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:47:11.003755 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82a61b7d-538e-49e0-9e35-06cfcb506577 None admin] RBAC: Adding query filter params (type=compute) {{(pid=80395) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 15:47:11.004274 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82a61b7d-538e-49e0-9e35-06cfcb506577 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:47:11.005679 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82a61b7d-538e-49e0-9e35-06cfcb506577 None admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:47:11.018119 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 486/963] 10.222.0.59 () {56 vars in 1112 bytes} [Thu Jun 2 15:47:10 2022] GET /identity/v3/services?type=compute => generated 124 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 15:47:11.116651 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d896db49-b067-4e61-97b7-acb99e7f1bc9 None admin] Validating token access rules against request {{(pid=80396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:47:11.145899 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG dbcounter [-] [80396] Writing DB stats keystone:SELECT=100 {{(pid=80396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:47:11.155046 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13b4f485-6027-4538-a832-0fd42dfe42c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:47:11.155730 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b4f485-6027-4538-a832-0fd42dfe42c0 None admin] REQUEST_METHOD: `GET` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:47:11.156325 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b4f485-6027-4538-a832-0fd42dfe42c0 None admin] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:47:11.156612 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b4f485-6027-4538-a832-0fd42dfe42c0 None admin] PATH_INFO: `/v3/roles` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:47:11.157373 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13b4f485-6027-4538-a832-0fd42dfe42c0 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80396) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 15:47:11.157687 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13b4f485-6027-4538-a832-0fd42dfe42c0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:47:11.159166 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13b4f485-6027-4538-a832-0fd42dfe42c0 None admin] RBAC: Authorization granted {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:47:11.170797 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 478/964] 10.222.0.59 () {56 vars in 1115 bytes} [Thu Jun 2 15:47:10 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 15:47:11.179278 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82a61b7d-538e-49e0-9e35-06cfcb506577 None admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:47:11.294683 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writing DB stats keystone:SELECT=100 {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:47:11.299091 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82a61b7d-538e-49e0-9e35-06cfcb506577 None admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:47:11.339391 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f0493f7-352a-4ba9-97d4-48df9e3eaf90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:47:11.340552 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f0493f7-352a-4ba9-97d4-48df9e3eaf90 None admin] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:47:11.341028 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f0493f7-352a-4ba9-97d4-48df9e3eaf90 None admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:47:11.341494 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f0493f7-352a-4ba9-97d4-48df9e3eaf90 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:47:11.353124 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f0493f7-352a-4ba9-97d4-48df9e3eaf90 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:47:11.354924 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f0493f7-352a-4ba9-97d4-48df9e3eaf90 None admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:47:11.373588 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application [None req-3f0493f7-352a-4ba9-97d4-48df9e3eaf90 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 15:47:11.373588 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 15:47:11.373588 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 15:47:11.373588 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 15:47:11.373588 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 15:47:11.373588 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 15:47:11.373588 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 15:47:11.373588 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 15:47:11.373588 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 15:47:11.373588 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 15:47:11.373588 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 15:47:11.373588 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 15:47:11.373588 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 02 15:47:11.373588 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 02 15:47:11.373588 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 02 15:47:11.374529 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 02 15:47:11.374529 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 15:47:11.374529 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 15:47:11.374529 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 15:47:11.374529 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 15:47:11.374529 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 15:47:11.374529 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 15:47:11.374529 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 15:47:11.374529 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application with Lock( Jun 02 15:47:11.374529 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 15:47:11.374529 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self._enter() Jun 02 15:47:11.374529 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 15:47:11.374529 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 15:47:11.374529 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 15:47:11.374529 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self.creator() Jun 02 15:47:11.374529 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 15:47:11.374529 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application created_value = creator( Jun 02 15:47:11.375427 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 02 15:47:11.375427 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 02 15:47:11.375427 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 15:47:11.375427 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application Jun 02 15:47:11.377362 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 487/965] 10.222.0.59 () {56 vars in 1108 bytes} [Thu Jun 2 15:47:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 15:47:11.387188 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13b4f485-6027-4538-a832-0fd42dfe42c0 None admin] Authenticating user token {{(pid=80396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:47:11.498321 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13b4f485-6027-4538-a832-0fd42dfe42c0 None admin] Validating token access rules against request {{(pid=80396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:47:11.534219 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21bd9c98-04d9-48c2-8359-50f66e71d844 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:47:11.535419 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21bd9c98-04d9-48c2-8359-50f66e71d844 None admin] REQUEST_METHOD: `GET` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:47:11.535697 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21bd9c98-04d9-48c2-8359-50f66e71d844 None admin] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:47:11.536141 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21bd9c98-04d9-48c2-8359-50f66e71d844 None admin] PATH_INFO: `/v3/domains` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:47:11.536851 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21bd9c98-04d9-48c2-8359-50f66e71d844 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80396) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 15:47:11.537156 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21bd9c98-04d9-48c2-8359-50f66e71d844 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:47:11.538548 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21bd9c98-04d9-48c2-8359-50f66e71d844 None admin] RBAC: Authorization granted {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:47:11.550673 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 479/966] 10.222.0.59 () {56 vars in 1109 bytes} [Thu Jun 2 15:47:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 15:47:11.556279 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f0493f7-352a-4ba9-97d4-48df9e3eaf90 None admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:47:11.665872 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f0493f7-352a-4ba9-97d4-48df9e3eaf90 None admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:47:11.700513 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0778eb85-8e85-4770-a8ce-9a9036a704ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:47:11.701327 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0778eb85-8e85-4770-a8ce-9a9036a704ba None admin] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:47:11.701609 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0778eb85-8e85-4770-a8ce-9a9036a704ba None admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:47:11.701885 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0778eb85-8e85-4770-a8ce-9a9036a704ba None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:47:11.709911 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0778eb85-8e85-4770-a8ce-9a9036a704ba None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:47:11.711387 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0778eb85-8e85-4770-a8ce-9a9036a704ba None admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:47:11.726892 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application [None req-0778eb85-8e85-4770-a8ce-9a9036a704ba None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 02 15:47:11.726892 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 15:47:11.726892 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 15:47:11.726892 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 15:47:11.726892 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 15:47:11.726892 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 15:47:11.726892 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 15:47:11.726892 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 15:47:11.726892 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 15:47:11.726892 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 15:47:11.726892 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 15:47:11.726892 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 15:47:11.726892 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 02 15:47:11.726892 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 02 15:47:11.726892 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 02 15:47:11.726892 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 02 15:47:11.727918 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 15:47:11.727918 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 15:47:11.727918 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 02 15:47:11.727918 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 02 15:47:11.727918 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 02 15:47:11.727918 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 02 15:47:11.727918 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 15:47:11.727918 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 15:47:11.727918 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 15:47:11.727918 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 15:47:11.727918 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 15:47:11.727918 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application with Lock( Jun 02 15:47:11.727918 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 15:47:11.727918 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self._enter() Jun 02 15:47:11.727918 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 15:47:11.727918 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 15:47:11.727918 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 15:47:11.727918 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self.creator() Jun 02 15:47:11.729267 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 15:47:11.729267 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application created_value = creator( Jun 02 15:47:11.729267 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 02 15:47:11.729267 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 02 15:47:11.729267 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 02 15:47:11.729267 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 02 15:47:11.729267 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 02 15:47:11.729267 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 02 15:47:11.729267 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 02 15:47:11.729267 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application Jun 02 15:47:11.729267 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 488/967] 10.222.0.59 () {56 vars in 1117 bytes} [Thu Jun 2 15:47:11 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 15:47:11.735951 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21bd9c98-04d9-48c2-8359-50f66e71d844 None admin] Authenticating user token {{(pid=80396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:47:11.772811 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-042d5028-7a86-4fa8-a44a-a23686cac21e None None] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:47:11.773328 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-042d5028-7a86-4fa8-a44a-a23686cac21e None None] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:47:11.773407 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-042d5028-7a86-4fa8-a44a-a23686cac21e None None] PATH_INFO: `/` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:47:11.775029 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 489/968] 10.222.0.59 () {54 vars in 926 bytes} [Thu Jun 2 15:47:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 15:47:11.780152 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21817221-80f3-44f7-8901-102558e450c1 None None] REQUEST_METHOD: `POST` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:47:11.780447 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21817221-80f3-44f7-8901-102558e450c1 None None] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:47:11.780727 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21817221-80f3-44f7-8901-102558e450c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:47:11.793159 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG dbcounter [-] [80396] Writing DB stats keystone:SELECT=100 {{(pid=80396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:47:11.803627 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.auth.core [None req-21817221-80f3-44f7-8901-102558e450c1 None None] MFA Rules not processed for user `400d1f4db9de49638549e5db29a041e1`. Rule list: `[]` (Enabled: `True`). {{(pid=80395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 15:47:11.811277 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.fernet_utils [None req-21817221-80f3-44f7-8901-102558e450c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 15:47:11.811277 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writing DB stats keystone:SELECT=100 {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:47:11.848528 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21bd9c98-04d9-48c2-8359-50f66e71d844 None admin] Validating token access rules against request {{(pid=80396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:47:11.890992 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4efae521-5bc1-4d17-af03-99e4a39040c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:47:11.891765 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4efae521-5bc1-4d17-af03-99e4a39040c8 None admin] REQUEST_METHOD: `GET` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:47:11.892156 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4efae521-5bc1-4d17-af03-99e4a39040c8 None admin] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:47:11.892439 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4efae521-5bc1-4d17-af03-99e4a39040c8 None admin] PATH_INFO: `/v3/users` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:47:11.893283 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4efae521-5bc1-4d17-af03-99e4a39040c8 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80396) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 15:47:11.893590 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4efae521-5bc1-4d17-af03-99e4a39040c8 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:47:11.895906 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4efae521-5bc1-4d17-af03-99e4a39040c8 None admin] RBAC: Authorization granted {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:47:11.906166 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 490/969] 10.222.0.59 () {58 vars in 1023 bytes} [Thu Jun 2 15:47:11 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 02 15:47:11.921799 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 480/970] 10.222.0.59 () {56 vars in 1149 bytes} [Thu Jun 2 15:47:11 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 15:47:11.927957 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21817221-80f3-44f7-8901-102558e450c1 None None] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:47:11.932750 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4efae521-5bc1-4d17-af03-99e4a39040c8 None admin] Authenticating user token {{(pid=80396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:47:12.043671 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4efae521-5bc1-4d17-af03-99e4a39040c8 None admin] Validating token access rules against request {{(pid=80396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:47:12.051692 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21817221-80f3-44f7-8901-102558e450c1 None None] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:47:12.052384 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG dbcounter [-] [80396] Writing DB stats keystone:SELECT=100 {{(pid=80396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:47:12.083033 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fd73d32-5645-4c21-a0f5-8a9934506b47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:47:12.083804 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd73d32-5645-4c21-a0f5-8a9934506b47 None admin] REQUEST_METHOD: `POST` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:47:12.084222 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd73d32-5645-4c21-a0f5-8a9934506b47 None admin] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:47:12.084516 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd73d32-5645-4c21-a0f5-8a9934506b47 None admin] PATH_INFO: `/v3/users` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:47:12.085502 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fd73d32-5645-4c21-a0f5-8a9934506b47 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:47:12.087145 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fd73d32-5645-4c21-a0f5-8a9934506b47 None admin] RBAC: Authorization granted {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:47:12.093935 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-929d33f9-ed60-4039-b9f4-717027fbabb6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:47:12.094865 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929d33f9-ed60-4039-b9f4-717027fbabb6 None admin] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:47:12.095348 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929d33f9-ed60-4039-b9f4-717027fbabb6 None admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:47:12.096001 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929d33f9-ed60-4039-b9f4-717027fbabb6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:47:12.108749 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writing DB stats keystone:SELECT=100 {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:47:12.131767 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.sql.core [None req-3fd73d32-5645-4c21-a0f5-8a9934506b47 None admin] Conflict user: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Jun 02 15:47:12.131767 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Jun 02 15:47:12.131767 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [parameters: {'user_id': 'f008f5c5b87742709cd604fd6b4b5cf4', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Jun 02 15:47:12.131767 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=80396) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Jun 02 15:47:12.142409 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application [None req-3fd73d32-5645-4c21-a0f5-8a9934506b47 None admin] Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default.: keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Jun 02 15:47:12.142409 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 15:47:12.142409 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jun 02 15:47:12.142409 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application self.dialect.do_execute( Jun 02 15:47:12.142409 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jun 02 15:47:12.142409 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jun 02 15:47:12.142409 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jun 02 15:47:12.142409 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application result = self._query(query) Jun 02 15:47:12.142409 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jun 02 15:47:12.142409 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application conn.query(q) Jun 02 15:47:12.142409 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jun 02 15:47:12.142409 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jun 02 15:47:12.142409 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jun 02 15:47:12.142409 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application result.read() Jun 02 15:47:12.142409 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jun 02 15:47:12.144429 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jun 02 15:47:12.144429 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jun 02 15:47:12.144429 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application packet.raise_for_error() Jun 02 15:47:12.144429 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jun 02 15:47:12.144429 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jun 02 15:47:12.144429 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jun 02 15:47:12.144429 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jun 02 15:47:12.144429 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Jun 02 15:47:12.144429 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application Jun 02 15:47:12.144429 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Jun 02 15:47:12.144429 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application Jun 02 15:47:12.144429 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 15:47:12.144429 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Jun 02 15:47:12.144429 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application return method(*args, **kwargs) Jun 02 15:47:12.144429 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 141, in create_user Jun 02 15:47:12.144429 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application return base.filter_user(user_ref.to_dict()) Jun 02 15:47:12.144429 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jun 02 15:47:12.144429 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application next(self.gen) Jun 02 15:47:12.145395 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Jun 02 15:47:12.145395 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application yield resource Jun 02 15:47:12.145395 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jun 02 15:47:12.145395 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application next(self.gen) Jun 02 15:47:12.145395 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Jun 02 15:47:12.145395 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application self.session.rollback() Jun 02 15:47:12.145395 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jun 02 15:47:12.145395 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application self.force_reraise() Jun 02 15:47:12.145395 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jun 02 15:47:12.145395 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application raise self.value Jun 02 15:47:12.145395 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Jun 02 15:47:12.145395 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Jun 02 15:47:12.145395 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Jun 02 15:47:12.145395 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application session.commit() Jun 02 15:47:12.145395 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1435, in commit Jun 02 15:47:12.145395 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Jun 02 15:47:12.145395 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Jun 02 15:47:12.146366 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application self._prepare_impl() Jun 02 15:47:12.146366 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Jun 02 15:47:12.146366 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application self.session.flush() Jun 02 15:47:12.146366 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3367, in flush Jun 02 15:47:12.146366 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application self._flush(objects) Jun 02 15:47:12.146366 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3507, in _flush Jun 02 15:47:12.146366 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Jun 02 15:47:12.146366 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Jun 02 15:47:12.146366 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application compat.raise_( Jun 02 15:47:12.146366 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ Jun 02 15:47:12.146366 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application raise exception Jun 02 15:47:12.146366 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3467, in _flush Jun 02 15:47:12.146366 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application flush_context.execute() Jun 02 15:47:12.146366 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Jun 02 15:47:12.146366 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application rec.execute(self) Jun 02 15:47:12.146366 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Jun 02 15:47:12.146366 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Jun 02 15:47:12.147300 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Jun 02 15:47:12.147300 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application _emit_insert_statements( Jun 02 15:47:12.147300 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Jun 02 15:47:12.147300 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application result = connection._execute_20( Jun 02 15:47:12.147300 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Jun 02 15:47:12.147300 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Jun 02 15:47:12.147300 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 325, in _execute_on_connection Jun 02 15:47:12.147300 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Jun 02 15:47:12.147300 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Jun 02 15:47:12.147300 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application ret = self._execute_context( Jun 02 15:47:12.147300 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Jun 02 15:47:12.147300 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Jun 02 15:47:12.147300 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Jun 02 15:47:12.147300 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Jun 02 15:47:12.147300 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ Jun 02 15:47:12.147300 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application raise exception Jun 02 15:47:12.148184 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jun 02 15:47:12.148184 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application self.dialect.do_execute( Jun 02 15:47:12.148184 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jun 02 15:47:12.148184 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jun 02 15:47:12.148184 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jun 02 15:47:12.148184 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application result = self._query(query) Jun 02 15:47:12.148184 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jun 02 15:47:12.148184 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application conn.query(q) Jun 02 15:47:12.148184 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jun 02 15:47:12.148184 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jun 02 15:47:12.148184 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jun 02 15:47:12.148184 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application result.read() Jun 02 15:47:12.148184 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jun 02 15:47:12.148184 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jun 02 15:47:12.148184 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jun 02 15:47:12.148184 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application packet.raise_for_error() Jun 02 15:47:12.149084 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jun 02 15:47:12.149084 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jun 02 15:47:12.149084 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jun 02 15:47:12.149084 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jun 02 15:47:12.149084 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Jun 02 15:47:12.149084 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Jun 02 15:47:12.149084 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application [parameters: {'user_id': 'f008f5c5b87742709cd604fd6b4b5cf4', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Jun 02 15:47:12.149084 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Jun 02 15:47:12.149084 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application Jun 02 15:47:12.149084 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 02 15:47:12.149084 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application Jun 02 15:47:12.149084 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 15:47:12.149084 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 15:47:12.149084 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 15:47:12.149084 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 15:47:12.149907 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 15:47:12.149907 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 15:47:12.149907 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 15:47:12.149907 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 15:47:12.149907 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 15:47:12.149907 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 15:47:12.149907 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 15:47:12.149907 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 244, in post Jun 02 15:47:12.149907 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.create_user( Jun 02 15:47:12.149907 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 15:47:12.149907 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 15:47:12.149907 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 02 15:47:12.149907 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 02 15:47:12.149907 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 02 15:47:12.149907 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 02 15:47:12.149907 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1000, in create_user Jun 02 15:47:12.149907 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application ref = self._create_user_with_federated_objects(user, driver) Jun 02 15:47:12.150861 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 966, in _create_user_with_federated_objects Jun 02 15:47:12.150861 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application user = driver.create_user(user['id'], user) Jun 02 15:47:12.150861 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Jun 02 15:47:12.150861 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Jun 02 15:47:12.150861 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Jun 02 15:47:12.150861 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application Jun 02 15:47:12.150861 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 481/971] 10.222.0.59 () {60 vars in 1131 bytes} [Thu Jun 2 15:47:11 2022] POST /identity/v3/users => generated 160 bytes in 215 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) Jun 02 15:47:12.158208 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fd73d32-5645-4c21-a0f5-8a9934506b47 None admin] Authenticating user token {{(pid=80396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:47:12.182899 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-929d33f9-ed60-4039-b9f4-717027fbabb6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:47:12.185158 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-929d33f9-ed60-4039-b9f4-717027fbabb6 None admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:47:12.278997 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fd73d32-5645-4c21-a0f5-8a9934506b47 None admin] Validating token access rules against request {{(pid=80396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:47:12.314173 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 491/972] 10.222.0.59 () {58 vars in 1282 bytes} [Thu Jun 2 15:47:11 2022] GET /identity/v3/auth/tokens => generated 1464 bytes in 384 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 02 15:47:12.317195 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-929d33f9-ed60-4039-b9f4-717027fbabb6 None admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:47:12.325502 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-412a1843-8ff0-48dc-b82e-0345a91d2b37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:47:12.326595 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-412a1843-8ff0-48dc-b82e-0345a91d2b37 None admin] REQUEST_METHOD: `GET` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:47:12.327080 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-412a1843-8ff0-48dc-b82e-0345a91d2b37 None admin] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:47:12.327620 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-412a1843-8ff0-48dc-b82e-0345a91d2b37 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:47:12.337059 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-412a1843-8ff0-48dc-b82e-0345a91d2b37 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:47:12.339075 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-412a1843-8ff0-48dc-b82e-0345a91d2b37 None admin] RBAC: Authorization granted {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:47:12.355544 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application [None req-412a1843-8ff0-48dc-b82e-0345a91d2b37 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jun 02 15:47:12.355544 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 15:47:12.355544 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 15:47:12.355544 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 15:47:12.355544 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 15:47:12.355544 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 15:47:12.355544 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 15:47:12.355544 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 15:47:12.355544 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 15:47:12.355544 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 15:47:12.355544 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 15:47:12.355544 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 15:47:12.355544 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 02 15:47:12.355544 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 02 15:47:12.355544 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 02 15:47:12.355544 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 02 15:47:12.356517 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 15:47:12.356517 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 15:47:12.356517 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 02 15:47:12.356517 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 02 15:47:12.356517 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 02 15:47:12.356517 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 02 15:47:12.356517 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 15:47:12.356517 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 15:47:12.356517 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 15:47:12.356517 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 15:47:12.356517 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 15:47:12.356517 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application with Lock( Jun 02 15:47:12.356517 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 15:47:12.356517 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application return self._enter() Jun 02 15:47:12.356517 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 15:47:12.356517 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 15:47:12.356517 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 15:47:12.356517 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application return self.creator() Jun 02 15:47:12.357434 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 15:47:12.357434 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application created_value = creator( Jun 02 15:47:12.357434 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 02 15:47:12.357434 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 02 15:47:12.357434 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 02 15:47:12.357434 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 02 15:47:12.357434 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 02 15:47:12.357434 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 02 15:47:12.357434 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jun 02 15:47:12.357434 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application Jun 02 15:47:12.364626 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 482/973] 10.222.0.59 () {56 vars in 1099 bytes} [Thu Jun 2 15:47:12 2022] GET /identity/v3/users/cinder => generated 84 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 15:47:12.365742 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writing DB stats keystone:SELECT=100 {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:47:12.367440 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-412a1843-8ff0-48dc-b82e-0345a91d2b37 None admin] Authenticating user token {{(pid=80396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:47:12.398362 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG dbcounter [-] [80396] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:47:12.424377 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-929d33f9-ed60-4039-b9f4-717027fbabb6 None admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:47:12.462454 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edb068bb-c1c0-4989-a82a-131f84bb22cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:47:12.463196 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb068bb-c1c0-4989-a82a-131f84bb22cd None admin] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:47:12.463480 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb068bb-c1c0-4989-a82a-131f84bb22cd None admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:47:12.463756 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb068bb-c1c0-4989-a82a-131f84bb22cd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:47:12.476457 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edb068bb-c1c0-4989-a82a-131f84bb22cd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:47:12.477940 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edb068bb-c1c0-4989-a82a-131f84bb22cd None admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:47:12.479528 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-412a1843-8ff0-48dc-b82e-0345a91d2b37 None admin] Validating token access rules against request {{(pid=80396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:47:12.497564 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application [None req-edb068bb-c1c0-4989-a82a-131f84bb22cd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 15:47:12.497564 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 15:47:12.497564 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 15:47:12.497564 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 15:47:12.497564 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 15:47:12.497564 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 15:47:12.497564 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 15:47:12.497564 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 15:47:12.497564 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 15:47:12.497564 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 15:47:12.497564 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 15:47:12.497564 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 15:47:12.497564 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 02 15:47:12.497564 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 02 15:47:12.497564 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 02 15:47:12.498522 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 02 15:47:12.498522 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 15:47:12.498522 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 15:47:12.498522 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 15:47:12.498522 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 15:47:12.498522 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 15:47:12.498522 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 15:47:12.498522 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 15:47:12.498522 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application with Lock( Jun 02 15:47:12.498522 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 15:47:12.498522 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self._enter() Jun 02 15:47:12.498522 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 15:47:12.498522 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 15:47:12.498522 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 15:47:12.498522 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self.creator() Jun 02 15:47:12.498522 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 15:47:12.498522 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application created_value = creator( Jun 02 15:47:12.499503 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 02 15:47:12.499503 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 02 15:47:12.499503 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 15:47:12.499503 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application Jun 02 15:47:12.503909 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 492/974] 10.222.0.59 () {56 vars in 1108 bytes} [Thu Jun 2 15:47:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 15:47:12.504862 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edb068bb-c1c0-4989-a82a-131f84bb22cd None admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:47:12.521360 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b00a4b3-7f70-4e3e-be9d-c51c8c29308f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:47:12.522466 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b00a4b3-7f70-4e3e-be9d-c51c8c29308f None admin] REQUEST_METHOD: `GET` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:47:12.522950 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b00a4b3-7f70-4e3e-be9d-c51c8c29308f None admin] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:47:12.523439 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b00a4b3-7f70-4e3e-be9d-c51c8c29308f None admin] PATH_INFO: `/v3/users` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:47:12.524551 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b00a4b3-7f70-4e3e-be9d-c51c8c29308f None admin] RBAC: Adding query filter params (name=cinder) {{(pid=80396) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 15:47:12.525146 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b00a4b3-7f70-4e3e-be9d-c51c8c29308f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:47:12.526791 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b00a4b3-7f70-4e3e-be9d-c51c8c29308f None admin] RBAC: Authorization granted {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:47:12.574220 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 483/975] 10.222.0.59 () {56 vars in 1101 bytes} [Thu Jun 2 15:47:12 2022] GET /identity/v3/users?name=cinder => generated 354 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 15:47:12.602875 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writing DB stats keystone:SELECT=100 {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:47:12.613073 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edb068bb-c1c0-4989-a82a-131f84bb22cd None admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:47:12.655669 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-832fb0c7-2efa-4096-b46b-011b519841dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:47:12.656363 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832fb0c7-2efa-4096-b46b-011b519841dd None admin] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:47:12.656643 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832fb0c7-2efa-4096-b46b-011b519841dd None admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:47:12.656917 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832fb0c7-2efa-4096-b46b-011b519841dd None admin] PATH_INFO: `/v3/domains` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:47:12.657669 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-832fb0c7-2efa-4096-b46b-011b519841dd None admin] RBAC: Adding query filter params (name=Default) {{(pid=80395) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 15:47:12.657975 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-832fb0c7-2efa-4096-b46b-011b519841dd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:47:12.660201 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-832fb0c7-2efa-4096-b46b-011b519841dd None admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:47:12.673835 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 493/976] 10.222.0.59 () {56 vars in 1109 bytes} [Thu Jun 2 15:47:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 15:47:12.679575 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b00a4b3-7f70-4e3e-be9d-c51c8c29308f None admin] Authenticating user token {{(pid=80396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:47:12.776958 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG dbcounter [-] [80396] Writing DB stats keystone:SELECT=100 {{(pid=80396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:47:12.792370 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b00a4b3-7f70-4e3e-be9d-c51c8c29308f None admin] Validating token access rules against request {{(pid=80396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:47:12.828145 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4152b704-3007-4f02-9e49-f070a782aec3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:47:12.828930 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4152b704-3007-4f02-9e49-f070a782aec3 None admin] REQUEST_METHOD: `GET` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:47:12.829209 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4152b704-3007-4f02-9e49-f070a782aec3 None admin] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:47:12.829481 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4152b704-3007-4f02-9e49-f070a782aec3 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:47:12.837625 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4152b704-3007-4f02-9e49-f070a782aec3 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:47:12.839133 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4152b704-3007-4f02-9e49-f070a782aec3 None admin] RBAC: Authorization granted {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:47:12.853930 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application [None req-4152b704-3007-4f02-9e49-f070a782aec3 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 02 15:47:12.853930 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 15:47:12.853930 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 15:47:12.853930 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 15:47:12.853930 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 15:47:12.853930 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 15:47:12.853930 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 15:47:12.853930 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 15:47:12.853930 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 15:47:12.853930 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 15:47:12.853930 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 15:47:12.853930 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 15:47:12.853930 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 02 15:47:12.853930 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 02 15:47:12.853930 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 02 15:47:12.854936 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 02 15:47:12.854936 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 15:47:12.854936 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 15:47:12.854936 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 15:47:12.854936 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 15:47:12.854936 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 15:47:12.854936 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 15:47:12.854936 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 15:47:12.854936 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application with Lock( Jun 02 15:47:12.854936 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 15:47:12.854936 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application return self._enter() Jun 02 15:47:12.854936 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 15:47:12.854936 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 15:47:12.854936 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 15:47:12.854936 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application return self.creator() Jun 02 15:47:12.854936 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 15:47:12.854936 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application created_value = creator( Jun 02 15:47:12.855809 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 02 15:47:12.855809 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 02 15:47:12.855809 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 02 15:47:12.855809 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 02 15:47:12.855809 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 02 15:47:12.855809 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 02 15:47:12.855809 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 02 15:47:12.855809 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application Jun 02 15:47:12.855809 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 484/977] 10.222.0.59 () {56 vars in 1111 bytes} [Thu Jun 2 15:47:12 2022] GET /identity/v3/projects/service => generated 88 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 15:47:12.863139 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-832fb0c7-2efa-4096-b46b-011b519841dd None admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:47:12.972751 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-832fb0c7-2efa-4096-b46b-011b519841dd None admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:47:12.976107 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b15616-a123-4d64-a338-21bea3c68e81 None None] REQUEST_METHOD: `GET` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:47:12.976394 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b15616-a123-4d64-a338-21bea3c68e81 None None] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:47:12.976671 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b15616-a123-4d64-a338-21bea3c68e81 None None] PATH_INFO: `/` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:47:12.978245 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 485/978] 10.222.0.59 () {54 vars in 926 bytes} [Thu Jun 2 15:47:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 15:47:12.983170 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf7e06a-d526-4bfe-9e10-fb2032dc39f7 None None] REQUEST_METHOD: `POST` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:47:12.983460 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf7e06a-d526-4bfe-9e10-fb2032dc39f7 None None] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:47:12.983732 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf7e06a-d526-4bfe-9e10-fb2032dc39f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:47:13.003848 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.auth.core [None req-dbf7e06a-d526-4bfe-9e10-fb2032dc39f7 None None] MFA Rules not processed for user `400d1f4db9de49638549e5db29a041e1`. Rule list: `[]` (Enabled: `True`). {{(pid=80396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 15:47:13.005651 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.fernet_utils [None req-dbf7e06a-d526-4bfe-9e10-fb2032dc39f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 15:47:13.007956 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b512d3d7-4a58-407f-8caa-b2ac893262bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:47:13.008621 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b512d3d7-4a58-407f-8caa-b2ac893262bb None admin] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:47:13.008904 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b512d3d7-4a58-407f-8caa-b2ac893262bb None admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:47:13.009180 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b512d3d7-4a58-407f-8caa-b2ac893262bb None admin] PATH_INFO: `/v3/projects` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:47:13.009962 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b512d3d7-4a58-407f-8caa-b2ac893262bb None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80395) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 15:47:13.010295 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b512d3d7-4a58-407f-8caa-b2ac893262bb None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:47:13.011717 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b512d3d7-4a58-407f-8caa-b2ac893262bb None admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:47:13.023934 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 494/979] 10.222.0.59 () {56 vars in 1148 bytes} [Thu Jun 2 15:47:12 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 15:47:13.029638 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b512d3d7-4a58-407f-8caa-b2ac893262bb None admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:47:13.044945 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writing DB stats keystone:SELECT=100 {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:47:13.083160 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 486/980] 10.222.0.59 () {58 vars in 1023 bytes} [Thu Jun 2 15:47:12 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 02 15:47:13.107160 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbf7e06a-d526-4bfe-9e10-fb2032dc39f7 None None] Authenticating user token {{(pid=80396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:47:13.141468 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b512d3d7-4a58-407f-8caa-b2ac893262bb None admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:47:13.183132 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42ec2777-079d-46ec-a947-8855d2c2a489 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:47:13.183799 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ec2777-079d-46ec-a947-8855d2c2a489 None admin] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:47:13.184084 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ec2777-079d-46ec-a947-8855d2c2a489 None admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:47:13.184361 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ec2777-079d-46ec-a947-8855d2c2a489 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:47:13.185481 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42ec2777-079d-46ec-a947-8855d2c2a489 None admin] RBAC: Adding query filter params (role.id=ce7c3f9097fa4b4aa3a7a1d7bef989be, scope.project.id=9c87c981909d4b8db02783421818c79b, user.id=11b714eb2dda4460a8ff52215e671bfa) {{(pid=80395) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 15:47:13.185796 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42ec2777-079d-46ec-a947-8855d2c2a489 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:47:13.189425 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42ec2777-079d-46ec-a947-8855d2c2a489 None admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:47:13.206102 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 495/981] 10.222.0.59 () {56 vars in 1374 bytes} [Thu Jun 2 15:47:13 2022] GET /identity/v3/role_assignments?user.id=11b714eb2dda4460a8ff52215e671bfa&scope.project.id=9c87c981909d4b8db02783421818c79b&role.id=ce7c3f9097fa4b4aa3a7a1d7bef989be => generated 608 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 15:47:13.206596 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG dbcounter [-] [80396] Writing DB stats keystone:SELECT=100 {{(pid=80396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:47:13.224495 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbf7e06a-d526-4bfe-9e10-fb2032dc39f7 None None] Validating token access rules against request {{(pid=80396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:47:13.265287 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9777e675-cfb6-4637-ae8e-478ed531cea2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:47:13.266166 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9777e675-cfb6-4637-ae8e-478ed531cea2 None admin] REQUEST_METHOD: `GET` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:47:13.266456 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9777e675-cfb6-4637-ae8e-478ed531cea2 None admin] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:47:13.266735 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9777e675-cfb6-4637-ae8e-478ed531cea2 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:47:13.267409 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9777e675-cfb6-4637-ae8e-478ed531cea2 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:47:13.269563 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9777e675-cfb6-4637-ae8e-478ed531cea2 None admin] RBAC: Authorization granted {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:47:13.283062 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application [None req-9777e675-cfb6-4637-ae8e-478ed531cea2 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 02 15:47:13.283062 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 15:47:13.283062 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 02 15:47:13.283062 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 02 15:47:13.283062 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 02 15:47:13.283062 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 02 15:47:13.283062 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 02 15:47:13.283062 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 02 15:47:13.283062 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 02 15:47:13.283062 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application Jun 02 15:47:13.283062 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 02 15:47:13.283062 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application Jun 02 15:47:13.283062 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 15:47:13.283062 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 15:47:13.283062 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 15:47:13.283062 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 15:47:13.283062 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 15:47:13.284086 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 15:47:13.284086 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 15:47:13.284086 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 15:47:13.284086 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 15:47:13.284086 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 15:47:13.284086 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 15:47:13.284086 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 02 15:47:13.284086 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 02 15:47:13.284086 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 02 15:47:13.284086 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 02 15:47:13.284086 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 15:47:13.284086 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 15:47:13.284086 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 15:47:13.284086 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 15:47:13.284086 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 15:47:13.284086 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 15:47:13.285062 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 15:47:13.285062 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application with Lock( Jun 02 15:47:13.285062 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 15:47:13.285062 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application return self._enter() Jun 02 15:47:13.285062 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 15:47:13.285062 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 15:47:13.285062 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 15:47:13.285062 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application return self.creator() Jun 02 15:47:13.285062 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 15:47:13.285062 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application created_value = creator( Jun 02 15:47:13.285062 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 02 15:47:13.285062 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 02 15:47:13.285062 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 02 15:47:13.285062 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application Jun 02 15:47:13.291098 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 487/982] 10.222.0.59 () {56 vars in 1126 bytes} [Thu Jun 2 15:47:13 2022] GET /identity/v3/services/object-store => generated 93 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 02 15:47:13.291261 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42ec2777-079d-46ec-a947-8855d2c2a489 None admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:47:13.377714 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writing DB stats keystone:SELECT=100 {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:47:13.402834 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42ec2777-079d-46ec-a947-8855d2c2a489 None admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:47:13.437757 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af877bb-ca04-44fa-882a-2b9a2309b0a7 None None] REQUEST_METHOD: `GET` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:47:13.438044 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af877bb-ca04-44fa-882a-2b9a2309b0a7 None None] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:47:13.438372 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af877bb-ca04-44fa-882a-2b9a2309b0a7 None None] PATH_INFO: `/` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:47:13.438630 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbfe2f7f-2405-47e3-aa38-9b0827b69601 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:47:13.439291 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbfe2f7f-2405-47e3-aa38-9b0827b69601 None admin] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:47:13.439577 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbfe2f7f-2405-47e3-aa38-9b0827b69601 None admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:47:13.439974 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbfe2f7f-2405-47e3-aa38-9b0827b69601 None admin] PATH_INFO: `/v3/services` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:47:13.440076 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 488/983] 10.222.0.59 () {54 vars in 926 bytes} [Thu Jun 2 15:47:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 15:47:13.441262 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbfe2f7f-2405-47e3-aa38-9b0827b69601 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80395) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 15:47:13.441778 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbfe2f7f-2405-47e3-aa38-9b0827b69601 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:47:13.443190 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbfe2f7f-2405-47e3-aa38-9b0827b69601 None admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:47:13.445378 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f4d663c-3902-4432-87dc-5ffeb9c8ded0 None None] REQUEST_METHOD: `POST` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:47:13.445664 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f4d663c-3902-4432-87dc-5ffeb9c8ded0 None None] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:47:13.445940 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f4d663c-3902-4432-87dc-5ffeb9c8ded0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:47:13.448670 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 496/984] 10.222.0.59 () {56 vars in 1122 bytes} [Thu Jun 2 15:47:13 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 15:47:13.454013 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbfe2f7f-2405-47e3-aa38-9b0827b69601 None admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:47:13.467596 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.auth.core [None req-5f4d663c-3902-4432-87dc-5ffeb9c8ded0 None None] MFA Rules not processed for user `400d1f4db9de49638549e5db29a041e1`. Rule list: `[]` (Enabled: `True`). {{(pid=80396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 15:47:13.468785 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.fernet_utils [None req-5f4d663c-3902-4432-87dc-5ffeb9c8ded0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 15:47:13.542817 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 489/985] 10.222.0.59 () {58 vars in 1023 bytes} [Thu Jun 2 15:47:13 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 02 15:47:13.560211 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f4d663c-3902-4432-87dc-5ffeb9c8ded0 None None] Authenticating user token {{(pid=80396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:47:13.567327 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbfe2f7f-2405-47e3-aa38-9b0827b69601 None admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:47:13.603440 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db35891-7389-458d-8893-1d2c146ef6d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:47:13.604112 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db35891-7389-458d-8893-1d2c146ef6d4 None admin] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:47:13.604400 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db35891-7389-458d-8893-1d2c146ef6d4 None admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:47:13.604676 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db35891-7389-458d-8893-1d2c146ef6d4 None admin] PATH_INFO: `/v3/services` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:47:13.605385 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2db35891-7389-458d-8893-1d2c146ef6d4 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80395) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 15:47:13.605858 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2db35891-7389-458d-8893-1d2c146ef6d4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:47:13.607361 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2db35891-7389-458d-8893-1d2c146ef6d4 None admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:47:13.618446 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 497/986] 10.222.0.59 () {56 vars in 1122 bytes} [Thu Jun 2 15:47:13 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 15:47:13.620741 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db35891-7389-458d-8893-1d2c146ef6d4 None admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:47:13.625371 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writing DB stats keystone:SELECT=100 {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:47:13.638673 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG dbcounter [-] [80396] Writing DB stats keystone:SELECT=100 {{(pid=80396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:47:13.672755 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f4d663c-3902-4432-87dc-5ffeb9c8ded0 None None] Validating token access rules against request {{(pid=80396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:47:13.710540 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39e3529c-ec2c-4341-8cea-fda1e06b18d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:47:13.711210 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e3529c-ec2c-4341-8cea-fda1e06b18d3 None admin] REQUEST_METHOD: `POST` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:47:13.711492 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e3529c-ec2c-4341-8cea-fda1e06b18d3 None admin] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:47:13.712137 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e3529c-ec2c-4341-8cea-fda1e06b18d3 None admin] PATH_INFO: `/v3/services` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:47:13.712755 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39e3529c-ec2c-4341-8cea-fda1e06b18d3 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:47:13.714149 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39e3529c-ec2c-4341-8cea-fda1e06b18d3 None admin] RBAC: Authorization granted {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:47:13.728410 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db35891-7389-458d-8893-1d2c146ef6d4 None admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:47:13.762902 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b078c5db-6d24-4e76-b5f1-2b59d1740988 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:47:13.763558 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b078c5db-6d24-4e76-b5f1-2b59d1740988 None admin] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:47:13.763842 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b078c5db-6d24-4e76-b5f1-2b59d1740988 None admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:47:13.764118 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b078c5db-6d24-4e76-b5f1-2b59d1740988 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:47:13.764912 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b078c5db-6d24-4e76-b5f1-2b59d1740988 None admin] RBAC: Adding query filter params (interface=admin, service_id=889c6d18ca4347f2aa84e1f500919f19, region_id=RegionOne) {{(pid=80395) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 15:47:13.765231 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b078c5db-6d24-4e76-b5f1-2b59d1740988 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:47:13.766683 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b078c5db-6d24-4e76-b5f1-2b59d1740988 None admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:47:13.772480 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 498/987] 10.222.0.59 () {56 vars in 1249 bytes} [Thu Jun 2 15:47:13 2022] GET /identity/v3/endpoints?service_id=889c6d18ca4347f2aa84e1f500919f19&interface=admin®ion_id=RegionOne => generated 193 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 15:47:13.777778 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b078c5db-6d24-4e76-b5f1-2b59d1740988 None admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:47:13.782442 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 490/988] 10.222.0.59 () {60 vars in 1141 bytes} [Thu Jun 2 15:47:13 2022] POST /identity/v3/services => generated 242 bytes in 223 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 02 15:47:13.857634 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writing DB stats keystone:SELECT=100 {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:47:13.895198 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b078c5db-6d24-4e76-b5f1-2b59d1740988 None admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:47:13.939203 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd6598ba-987e-41cd-9fbe-26607a69d1d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:47:13.939876 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd6598ba-987e-41cd-9fbe-26607a69d1d2 None admin] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:47:13.940162 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd6598ba-987e-41cd-9fbe-26607a69d1d2 None admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:47:13.940440 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd6598ba-987e-41cd-9fbe-26607a69d1d2 None admin] PATH_INFO: `/v3/services` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:47:13.942697 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd6598ba-987e-41cd-9fbe-26607a69d1d2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:47:13.952306 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd6598ba-987e-41cd-9fbe-26607a69d1d2 None admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:47:13.963208 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 499/989] 10.222.0.59 () {56 vars in 1087 bytes} [Thu Jun 2 15:47:13 2022] GET /identity/v3/services => generated 1727 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 02 15:47:15.483637 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf030885-0480-42b6-96eb-2698f7343046 None None] REQUEST_METHOD: `GET` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:47:15.484178 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf030885-0480-42b6-96eb-2698f7343046 None None] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:47:15.484178 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf030885-0480-42b6-96eb-2698f7343046 None None] PATH_INFO: `/` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:47:15.485613 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 491/990] 10.222.0.59 () {54 vars in 926 bytes} [Thu Jun 2 15:47:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 15:47:15.490849 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71feb442-5e7e-4ac7-8fde-2c475e97878c None None] REQUEST_METHOD: `POST` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:47:15.491240 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71feb442-5e7e-4ac7-8fde-2c475e97878c None None] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:47:15.491438 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71feb442-5e7e-4ac7-8fde-2c475e97878c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:47:15.508396 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.auth.core [None req-71feb442-5e7e-4ac7-8fde-2c475e97878c None None] MFA Rules not processed for user `400d1f4db9de49638549e5db29a041e1`. Rule list: `[]` (Enabled: `True`). {{(pid=80395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 15:47:15.509572 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.fernet_utils [None req-71feb442-5e7e-4ac7-8fde-2c475e97878c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 15:47:15.576444 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 500/991] 10.222.0.59 () {58 vars in 1023 bytes} [Thu Jun 2 15:47:15 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 02 15:47:15.598317 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf030885-0480-42b6-96eb-2698f7343046 None None] Authenticating user token {{(pid=80396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:47:15.699599 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf030885-0480-42b6-96eb-2698f7343046 None None] Validating token access rules against request {{(pid=80396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:47:15.728921 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG dbcounter [-] [80396] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:47:15.735318 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7512f390-908c-4227-b8c1-d4997f136818 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:47:15.736046 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7512f390-908c-4227-b8c1-d4997f136818 None admin] REQUEST_METHOD: `GET` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:47:15.736322 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7512f390-908c-4227-b8c1-d4997f136818 None admin] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:47:15.736591 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7512f390-908c-4227-b8c1-d4997f136818 None admin] PATH_INFO: `/v3/services/image` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:47:15.737861 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7512f390-908c-4227-b8c1-d4997f136818 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:47:15.739426 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7512f390-908c-4227-b8c1-d4997f136818 None admin] RBAC: Authorization granted {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:47:15.752234 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application [None req-7512f390-908c-4227-b8c1-d4997f136818 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Jun 02 15:47:15.752234 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 15:47:15.752234 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 02 15:47:15.752234 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 02 15:47:15.752234 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 02 15:47:15.752234 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 02 15:47:15.752234 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 02 15:47:15.752234 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 02 15:47:15.752234 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jun 02 15:47:15.752234 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application Jun 02 15:47:15.752234 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 02 15:47:15.752234 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application Jun 02 15:47:15.752234 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 15:47:15.752234 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 15:47:15.752234 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 15:47:15.752234 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 15:47:15.752234 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 15:47:15.753591 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 15:47:15.753591 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 15:47:15.753591 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 15:47:15.753591 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 15:47:15.753591 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 15:47:15.753591 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 15:47:15.753591 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 02 15:47:15.753591 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 02 15:47:15.753591 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 02 15:47:15.753591 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 02 15:47:15.753591 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 15:47:15.753591 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 15:47:15.753591 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 15:47:15.753591 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 15:47:15.753591 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 15:47:15.753591 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 15:47:15.754856 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 15:47:15.754856 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application with Lock( Jun 02 15:47:15.754856 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 15:47:15.754856 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application return self._enter() Jun 02 15:47:15.754856 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 15:47:15.754856 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 15:47:15.754856 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 15:47:15.754856 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application return self.creator() Jun 02 15:47:15.754856 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 15:47:15.754856 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application created_value = creator( Jun 02 15:47:15.754856 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 02 15:47:15.754856 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 02 15:47:15.754856 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jun 02 15:47:15.754856 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application Jun 02 15:47:15.758511 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 492/992] 10.222.0.59 () {56 vars in 1105 bytes} [Thu Jun 2 15:47:15 2022] GET /identity/v3/services/image => generated 86 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 15:47:15.760220 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71feb442-5e7e-4ac7-8fde-2c475e97878c None None] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:47:15.819497 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writing DB stats keystone:SELECT=100 {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:47:15.862828 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71feb442-5e7e-4ac7-8fde-2c475e97878c None None] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:47:15.896762 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5843c8d2-afd4-41d3-b2e4-6498407a0f49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:47:15.897452 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5843c8d2-afd4-41d3-b2e4-6498407a0f49 None admin] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:47:15.897732 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5843c8d2-afd4-41d3-b2e4-6498407a0f49 None admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:47:15.898006 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5843c8d2-afd4-41d3-b2e4-6498407a0f49 None admin] PATH_INFO: `/v3/services` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:47:15.898766 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5843c8d2-afd4-41d3-b2e4-6498407a0f49 None admin] RBAC: Adding query filter params (name=image) {{(pid=80395) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 15:47:15.899072 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5843c8d2-afd4-41d3-b2e4-6498407a0f49 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:47:15.900487 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5843c8d2-afd4-41d3-b2e4-6498407a0f49 None admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:47:15.910524 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 501/993] 10.222.0.59 () {56 vars in 1108 bytes} [Thu Jun 2 15:47:15 2022] GET /identity/v3/services?name=image => generated 122 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 15:47:15.912367 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7512f390-908c-4227-b8c1-d4997f136818 None admin] Authenticating user token {{(pid=80396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:47:16.015947 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7512f390-908c-4227-b8c1-d4997f136818 None admin] Validating token access rules against request {{(pid=80396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:47:16.049666 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a269fe5d-af6a-4086-a5d9-95bed1a3d667 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:47:16.050794 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a269fe5d-af6a-4086-a5d9-95bed1a3d667 None admin] REQUEST_METHOD: `GET` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:47:16.051298 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a269fe5d-af6a-4086-a5d9-95bed1a3d667 None admin] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:47:16.051747 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a269fe5d-af6a-4086-a5d9-95bed1a3d667 None admin] PATH_INFO: `/v3/services` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:47:16.052620 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a269fe5d-af6a-4086-a5d9-95bed1a3d667 None admin] RBAC: Adding query filter params (type=image) {{(pid=80396) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 15:47:16.053115 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a269fe5d-af6a-4086-a5d9-95bed1a3d667 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:47:16.054666 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a269fe5d-af6a-4086-a5d9-95bed1a3d667 None admin] RBAC: Authorization granted {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:47:16.066104 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 493/994] 10.222.0.59 () {56 vars in 1108 bytes} [Thu Jun 2 15:47:15 2022] GET /identity/v3/services?type=image => generated 122 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 15:47:16.092039 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1319bcf6-5162-4b09-8bfc-e3b2f04ead93 None None] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:47:16.092401 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1319bcf6-5162-4b09-8bfc-e3b2f04ead93 None None] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:47:16.092592 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1319bcf6-5162-4b09-8bfc-e3b2f04ead93 None None] PATH_INFO: `/` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:47:16.094022 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 502/995] 10.222.0.59 () {54 vars in 926 bytes} [Thu Jun 2 15:47:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 15:47:16.100722 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f48d426-892d-4e26-9ecf-eb62033cc5ea None None] REQUEST_METHOD: `POST` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:47:16.101025 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f48d426-892d-4e26-9ecf-eb62033cc5ea None None] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:47:16.101290 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f48d426-892d-4e26-9ecf-eb62033cc5ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:47:16.119473 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.auth.core [None req-6f48d426-892d-4e26-9ecf-eb62033cc5ea None None] MFA Rules not processed for user `400d1f4db9de49638549e5db29a041e1`. Rule list: `[]` (Enabled: `True`). {{(pid=80396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 15:47:16.120694 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.fernet_utils [None req-6f48d426-892d-4e26-9ecf-eb62033cc5ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 15:47:16.183139 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG dbcounter [-] [80396] Writing DB stats keystone:SELECT=100 {{(pid=80396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:47:16.203046 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 494/996] 10.222.0.59 () {58 vars in 1023 bytes} [Thu Jun 2 15:47:16 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 02 15:47:16.226464 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1319bcf6-5162-4b09-8bfc-e3b2f04ead93 None None] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:47:16.249816 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e64ce2-47e6-4e49-bb6d-c615701bc314 None None] REQUEST_METHOD: `GET` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:47:16.250133 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e64ce2-47e6-4e49-bb6d-c615701bc314 None None] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:47:16.250420 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e64ce2-47e6-4e49-bb6d-c615701bc314 None None] PATH_INFO: `/` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:47:16.251992 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 495/997] 10.222.0.59 () {54 vars in 926 bytes} [Thu Jun 2 15:47:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 15:47:16.257364 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a1fe34-8221-4398-a5ba-50c3ddb0c29d None None] REQUEST_METHOD: `POST` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:47:16.257656 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a1fe34-8221-4398-a5ba-50c3ddb0c29d None None] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:47:16.263366 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a1fe34-8221-4398-a5ba-50c3ddb0c29d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:47:16.275634 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.auth.core [None req-e0a1fe34-8221-4398-a5ba-50c3ddb0c29d None None] MFA Rules not processed for user `400d1f4db9de49638549e5db29a041e1`. Rule list: `[]` (Enabled: `True`). {{(pid=80396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 15:47:16.276797 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.fernet_utils [None req-e0a1fe34-8221-4398-a5ba-50c3ddb0c29d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 15:47:16.345092 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1319bcf6-5162-4b09-8bfc-e3b2f04ead93 None None] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:47:16.351673 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 496/998] 10.222.0.59 () {58 vars in 1023 bytes} [Thu Jun 2 15:47:16 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 02 15:47:16.374304 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0a1fe34-8221-4398-a5ba-50c3ddb0c29d None None] Authenticating user token {{(pid=80396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:47:16.376852 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writing DB stats keystone:SELECT=100 {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:47:16.389700 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db18ee00-b12e-4464-8b84-0eb65af4fb1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:47:16.391089 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db18ee00-b12e-4464-8b84-0eb65af4fb1f None admin] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:47:16.391089 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db18ee00-b12e-4464-8b84-0eb65af4fb1f None admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:47:16.391273 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db18ee00-b12e-4464-8b84-0eb65af4fb1f None admin] PATH_INFO: `/v3/services/compute` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:47:16.391842 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db18ee00-b12e-4464-8b84-0eb65af4fb1f None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:47:16.393245 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db18ee00-b12e-4464-8b84-0eb65af4fb1f None admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:47:16.405928 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application [None req-db18ee00-b12e-4464-8b84-0eb65af4fb1f None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Jun 02 15:47:16.405928 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 15:47:16.405928 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 02 15:47:16.405928 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 02 15:47:16.405928 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 02 15:47:16.405928 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 02 15:47:16.405928 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 02 15:47:16.405928 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 02 15:47:16.405928 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jun 02 15:47:16.405928 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application Jun 02 15:47:16.405928 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 02 15:47:16.405928 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application Jun 02 15:47:16.405928 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 15:47:16.405928 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 15:47:16.405928 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 15:47:16.405928 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 15:47:16.405928 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 15:47:16.407074 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 15:47:16.407074 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 15:47:16.407074 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 15:47:16.407074 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 15:47:16.407074 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 15:47:16.407074 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 15:47:16.407074 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 02 15:47:16.407074 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 02 15:47:16.407074 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 02 15:47:16.407074 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 02 15:47:16.407074 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 15:47:16.407074 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 15:47:16.407074 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 15:47:16.407074 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 15:47:16.407074 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 15:47:16.407074 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 15:47:16.408492 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 15:47:16.408492 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application with Lock( Jun 02 15:47:16.408492 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 15:47:16.408492 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self._enter() Jun 02 15:47:16.408492 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 15:47:16.408492 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 15:47:16.408492 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 15:47:16.408492 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self.creator() Jun 02 15:47:16.408492 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 15:47:16.408492 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application created_value = creator( Jun 02 15:47:16.408492 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 02 15:47:16.408492 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 02 15:47:16.408492 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jun 02 15:47:16.408492 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application Jun 02 15:47:16.408492 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 503/999] 10.222.0.59 () {56 vars in 1111 bytes} [Thu Jun 2 15:47:16 2022] GET /identity/v3/services/compute => generated 88 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 15:47:16.413573 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db18ee00-b12e-4464-8b84-0eb65af4fb1f None admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:47:16.488849 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0a1fe34-8221-4398-a5ba-50c3ddb0c29d None None] Validating token access rules against request {{(pid=80396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:47:16.507672 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG dbcounter [-] [80396] Writing DB stats keystone:SELECT=100 {{(pid=80396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:47:16.525912 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-face55d5-2e93-4bbc-bdbe-a7fb56d5f26a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:47:16.526673 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-face55d5-2e93-4bbc-bdbe-a7fb56d5f26a None admin] REQUEST_METHOD: `GET` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:47:16.526952 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-face55d5-2e93-4bbc-bdbe-a7fb56d5f26a None admin] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:47:16.527224 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-face55d5-2e93-4bbc-bdbe-a7fb56d5f26a None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:47:16.527880 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-face55d5-2e93-4bbc-bdbe-a7fb56d5f26a None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:47:16.528301 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db18ee00-b12e-4464-8b84-0eb65af4fb1f None admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:47:16.529241 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-face55d5-2e93-4bbc-bdbe-a7fb56d5f26a None admin] RBAC: Authorization granted {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:47:16.542443 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application [None req-face55d5-2e93-4bbc-bdbe-a7fb56d5f26a None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 02 15:47:16.542443 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 15:47:16.542443 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 02 15:47:16.542443 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 02 15:47:16.542443 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 02 15:47:16.542443 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 02 15:47:16.542443 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 02 15:47:16.542443 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 02 15:47:16.542443 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 02 15:47:16.542443 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application Jun 02 15:47:16.542443 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 02 15:47:16.542443 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application Jun 02 15:47:16.542443 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 15:47:16.542443 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 15:47:16.542443 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 15:47:16.542443 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 15:47:16.542443 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 15:47:16.543758 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 15:47:16.543758 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 15:47:16.543758 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 15:47:16.543758 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 15:47:16.543758 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 15:47:16.543758 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 15:47:16.543758 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 02 15:47:16.543758 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 02 15:47:16.543758 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 02 15:47:16.543758 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 02 15:47:16.543758 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 15:47:16.543758 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 15:47:16.543758 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 15:47:16.543758 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 15:47:16.543758 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 15:47:16.543758 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 15:47:16.544784 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 15:47:16.544784 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application with Lock( Jun 02 15:47:16.544784 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 15:47:16.544784 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application return self._enter() Jun 02 15:47:16.544784 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 15:47:16.544784 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 15:47:16.544784 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 15:47:16.544784 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application return self.creator() Jun 02 15:47:16.544784 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 15:47:16.544784 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application created_value = creator( Jun 02 15:47:16.544784 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 02 15:47:16.544784 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 02 15:47:16.544784 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 02 15:47:16.544784 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application Jun 02 15:47:16.548597 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 497/1000] 10.222.0.59 () {56 vars in 1126 bytes} [Thu Jun 2 15:47:16 2022] GET /identity/v3/services/object-store => generated 93 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 02 15:47:16.549447 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-face55d5-2e93-4bbc-bdbe-a7fb56d5f26a None admin] Authenticating user token {{(pid=80396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:47:16.569455 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-509e6a8e-1051-456c-8b6a-e0dccf578532 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:47:16.570782 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-509e6a8e-1051-456c-8b6a-e0dccf578532 None admin] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:47:16.571247 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-509e6a8e-1051-456c-8b6a-e0dccf578532 None admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:47:16.571678 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-509e6a8e-1051-456c-8b6a-e0dccf578532 None admin] PATH_INFO: `/v3/services` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:47:16.572536 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-509e6a8e-1051-456c-8b6a-e0dccf578532 None admin] RBAC: Adding query filter params (name=compute) {{(pid=80395) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 15:47:16.572993 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-509e6a8e-1051-456c-8b6a-e0dccf578532 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:47:16.575364 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-509e6a8e-1051-456c-8b6a-e0dccf578532 None admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:47:16.582569 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 504/1001] 10.222.0.59 () {56 vars in 1112 bytes} [Thu Jun 2 15:47:16 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 15:47:16.588266 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-509e6a8e-1051-456c-8b6a-e0dccf578532 None admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:47:16.641232 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writing DB stats keystone:SELECT=100 {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:47:16.662814 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-face55d5-2e93-4bbc-bdbe-a7fb56d5f26a None admin] Validating token access rules against request {{(pid=80396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:47:16.695237 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-509e6a8e-1051-456c-8b6a-e0dccf578532 None admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:47:16.697983 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a447a9d9-fdd0-4ed7-950f-90b5fb11308f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:47:16.698671 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a447a9d9-fdd0-4ed7-950f-90b5fb11308f None admin] REQUEST_METHOD: `GET` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:47:16.698952 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a447a9d9-fdd0-4ed7-950f-90b5fb11308f None admin] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:47:16.699226 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a447a9d9-fdd0-4ed7-950f-90b5fb11308f None admin] PATH_INFO: `/v3/services` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:47:16.699930 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a447a9d9-fdd0-4ed7-950f-90b5fb11308f None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80396) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 15:47:16.700235 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a447a9d9-fdd0-4ed7-950f-90b5fb11308f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:47:16.701609 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a447a9d9-fdd0-4ed7-950f-90b5fb11308f None admin] RBAC: Authorization granted {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:47:16.707174 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 498/1002] 10.222.0.59 () {56 vars in 1122 bytes} [Thu Jun 2 15:47:16 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 15:47:16.712980 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a447a9d9-fdd0-4ed7-950f-90b5fb11308f None admin] Authenticating user token {{(pid=80396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:47:16.738207 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16251527-372a-4ae6-9ced-eb7148684fb5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:47:16.738877 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16251527-372a-4ae6-9ced-eb7148684fb5 None admin] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:47:16.739162 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16251527-372a-4ae6-9ced-eb7148684fb5 None admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:47:16.739474 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16251527-372a-4ae6-9ced-eb7148684fb5 None admin] PATH_INFO: `/v3/services` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:47:16.740182 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16251527-372a-4ae6-9ced-eb7148684fb5 None admin] RBAC: Adding query filter params (type=compute) {{(pid=80395) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 15:47:16.740487 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16251527-372a-4ae6-9ced-eb7148684fb5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:47:16.741890 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16251527-372a-4ae6-9ced-eb7148684fb5 None admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:47:16.752105 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 505/1003] 10.222.0.59 () {56 vars in 1112 bytes} [Thu Jun 2 15:47:16 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 15:47:16.753506 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16251527-372a-4ae6-9ced-eb7148684fb5 None admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:47:16.761472 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG dbcounter [-] [80396] Writing DB stats keystone:SELECT=100 {{(pid=80396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:47:16.818730 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a447a9d9-fdd0-4ed7-950f-90b5fb11308f None admin] Validating token access rules against request {{(pid=80396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:47:16.854461 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-393a9e12-57fa-4961-a8ba-076062df0309 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:47:16.855058 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16251527-372a-4ae6-9ced-eb7148684fb5 None admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:47:16.855181 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393a9e12-57fa-4961-a8ba-076062df0309 None admin] REQUEST_METHOD: `GET` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:47:16.855389 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393a9e12-57fa-4961-a8ba-076062df0309 None admin] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:47:16.855660 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393a9e12-57fa-4961-a8ba-076062df0309 None admin] PATH_INFO: `/v3/services` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:47:16.856418 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-393a9e12-57fa-4961-a8ba-076062df0309 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80396) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 15:47:16.856666 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-393a9e12-57fa-4961-a8ba-076062df0309 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:47:16.858038 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-393a9e12-57fa-4961-a8ba-076062df0309 None admin] RBAC: Authorization granted {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:47:16.863075 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 499/1004] 10.222.0.59 () {56 vars in 1122 bytes} [Thu Jun 2 15:47:16 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 15:47:16.868621 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-393a9e12-57fa-4961-a8ba-076062df0309 None admin] Authenticating user token {{(pid=80396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:47:16.873782 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writing DB stats keystone:SELECT=100 {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:47:16.895897 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f9a3c30-f97a-41b7-9242-e27b407bb815 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:47:16.896559 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f9a3c30-f97a-41b7-9242-e27b407bb815 None admin] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:47:16.896842 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f9a3c30-f97a-41b7-9242-e27b407bb815 None admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:47:16.897115 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f9a3c30-f97a-41b7-9242-e27b407bb815 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:47:16.900344 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f9a3c30-f97a-41b7-9242-e27b407bb815 None admin] RBAC: Adding query filter params (interface=public, service_id=83656b97bfb146d99a73c63145bab0ff, region_id=RegionOne) {{(pid=80395) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 15:47:16.900344 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f9a3c30-f97a-41b7-9242-e27b407bb815 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:47:16.900344 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f9a3c30-f97a-41b7-9242-e27b407bb815 None admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:47:16.904769 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 506/1005] 10.222.0.59 () {56 vars in 1251 bytes} [Thu Jun 2 15:47:16 2022] GET /identity/v3/endpoints?service_id=83656b97bfb146d99a73c63145bab0ff&interface=public®ion_id=RegionOne => generated 194 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 15:47:16.910610 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f9a3c30-f97a-41b7-9242-e27b407bb815 None admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:47:16.977169 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-393a9e12-57fa-4961-a8ba-076062df0309 None admin] Validating token access rules against request {{(pid=80396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:47:16.987833 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG dbcounter [-] [80396] Writing DB stats keystone:SELECT=100 {{(pid=80396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:47:17.011892 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60c25210-4bbe-45c3-a34a-cde96e6fba40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:47:17.012350 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f9a3c30-f97a-41b7-9242-e27b407bb815 None admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:47:17.012724 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c25210-4bbe-45c3-a34a-cde96e6fba40 None admin] REQUEST_METHOD: `POST` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:47:17.013013 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c25210-4bbe-45c3-a34a-cde96e6fba40 None admin] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:47:17.013289 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c25210-4bbe-45c3-a34a-cde96e6fba40 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:47:17.014022 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60c25210-4bbe-45c3-a34a-cde96e6fba40 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:47:17.015527 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60c25210-4bbe-45c3-a34a-cde96e6fba40 None admin] RBAC: Authorization granted {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:47:17.047294 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca424077-9d81-4fff-b39d-286f82b85d6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:47:17.047945 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca424077-9d81-4fff-b39d-286f82b85d6c None admin] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:47:17.048230 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca424077-9d81-4fff-b39d-286f82b85d6c None admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:47:17.048506 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca424077-9d81-4fff-b39d-286f82b85d6c None admin] PATH_INFO: `/v3/services` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:47:17.049183 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca424077-9d81-4fff-b39d-286f82b85d6c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:47:17.050758 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca424077-9d81-4fff-b39d-286f82b85d6c None admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:47:17.056993 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 507/1006] 10.222.0.59 () {56 vars in 1087 bytes} [Thu Jun 2 15:47:16 2022] GET /identity/v3/services => generated 1727 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 02 15:47:17.090120 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 500/1007] 10.222.0.59 () {60 vars in 1144 bytes} [Thu Jun 2 15:47:16 2022] POST /identity/v3/endpoints => generated 325 bytes in 222 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 02 15:47:18.339971 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6417ee96-b5f6-4d29-a938-e997b1871f4a None None] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:47:18.340492 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6417ee96-b5f6-4d29-a938-e997b1871f4a None None] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:47:18.340570 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6417ee96-b5f6-4d29-a938-e997b1871f4a None None] PATH_INFO: `/` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:47:18.342026 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 508/1008] 10.222.0.59 () {54 vars in 926 bytes} [Thu Jun 2 15:47:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 15:47:18.347712 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59297b1a-42e8-4115-8b83-df589d99b86f None None] REQUEST_METHOD: `POST` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:47:18.348110 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59297b1a-42e8-4115-8b83-df589d99b86f None None] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:47:18.348275 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59297b1a-42e8-4115-8b83-df589d99b86f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:47:18.365558 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.auth.core [None req-59297b1a-42e8-4115-8b83-df589d99b86f None None] MFA Rules not processed for user `400d1f4db9de49638549e5db29a041e1`. Rule list: `[]` (Enabled: `True`). {{(pid=80396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 15:47:18.366773 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.fernet_utils [None req-59297b1a-42e8-4115-8b83-df589d99b86f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 15:47:18.442166 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 501/1009] 10.222.0.59 () {58 vars in 1023 bytes} [Thu Jun 2 15:47:18 2022] POST /identity/v3/auth/tokens => generated 1707 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 02 15:47:18.464197 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6417ee96-b5f6-4d29-a938-e997b1871f4a None None] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:47:18.508966 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writing DB stats keystone:SELECT=100 {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:47:18.567052 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6417ee96-b5f6-4d29-a938-e997b1871f4a None None] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:47:18.600907 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56c0c4a3-bc04-47a5-ac38-b1ea0187c8a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:47:18.601562 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c0c4a3-bc04-47a5-ac38-b1ea0187c8a3 None admin] REQUEST_METHOD: `POST` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:47:18.601846 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c0c4a3-bc04-47a5-ac38-b1ea0187c8a3 None admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:47:18.602156 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c0c4a3-bc04-47a5-ac38-b1ea0187c8a3 None admin] PATH_INFO: `/v3/services` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:47:18.602889 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56c0c4a3-bc04-47a5-ac38-b1ea0187c8a3 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:47:18.604267 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56c0c4a3-bc04-47a5-ac38-b1ea0187c8a3 None admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:47:18.699306 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 509/1010] 10.222.0.59 () {60 vars in 1141 bytes} [Thu Jun 2 15:47:18 2022] POST /identity/v3/services => generated 242 bytes in 235 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 15:47:19.344176 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50355f23-edcc-4b47-bac6-f9fd986051fa None None] REQUEST_METHOD: `GET` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:47:19.344527 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50355f23-edcc-4b47-bac6-f9fd986051fa None None] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:47:19.344744 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50355f23-edcc-4b47-bac6-f9fd986051fa None None] PATH_INFO: `/` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:47:19.348076 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 502/1011] 10.222.0.59 () {54 vars in 926 bytes} [Thu Jun 2 15:47:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 15:47:19.354002 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f690eb14-5461-487d-8c39-e6696fcef8bc None None] REQUEST_METHOD: `POST` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:47:19.354433 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f690eb14-5461-487d-8c39-e6696fcef8bc None None] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:47:19.354604 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f690eb14-5461-487d-8c39-e6696fcef8bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:47:19.371963 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.auth.core [None req-f690eb14-5461-487d-8c39-e6696fcef8bc None None] MFA Rules not processed for user `400d1f4db9de49638549e5db29a041e1`. Rule list: `[]` (Enabled: `True`). {{(pid=80395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 15:47:19.373141 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.fernet_utils [None req-f690eb14-5461-487d-8c39-e6696fcef8bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 15:47:19.390721 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b38d35b9-1a56-46ca-ac4c-bd0770803beb None None] REQUEST_METHOD: `GET` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:47:19.391022 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b38d35b9-1a56-46ca-ac4c-bd0770803beb None None] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:47:19.391282 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b38d35b9-1a56-46ca-ac4c-bd0770803beb None None] PATH_INFO: `/` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:47:19.392658 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 503/1012] 10.222.0.59 () {54 vars in 926 bytes} [Thu Jun 2 15:47:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 02 15:47:19.397690 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fae58d2-19c6-44c5-a648-627396a149ef None None] REQUEST_METHOD: `POST` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:47:19.397974 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fae58d2-19c6-44c5-a648-627396a149ef None None] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:47:19.398282 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fae58d2-19c6-44c5-a648-627396a149ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:47:19.414921 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.auth.core [None req-0fae58d2-19c6-44c5-a648-627396a149ef None None] MFA Rules not processed for user `400d1f4db9de49638549e5db29a041e1`. Rule list: `[]` (Enabled: `True`). {{(pid=80396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 15:47:19.416080 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.fernet_utils [None req-0fae58d2-19c6-44c5-a648-627396a149ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 15:47:19.454229 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 510/1013] 10.222.0.59 () {58 vars in 1023 bytes} [Thu Jun 2 15:47:19 2022] POST /identity/v3/auth/tokens => generated 1803 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 02 15:47:19.476913 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f690eb14-5461-487d-8c39-e6696fcef8bc None None] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:47:19.492730 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 504/1014] 10.222.0.59 () {58 vars in 1023 bytes} [Thu Jun 2 15:47:19 2022] POST /identity/v3/auth/tokens => generated 1803 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 02 15:47:19.505907 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:47:19.517262 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fae58d2-19c6-44c5-a648-627396a149ef None None] Authenticating user token {{(pid=80396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:47:19.545801 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG dbcounter [-] [80396] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:47:19.583538 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f690eb14-5461-487d-8c39-e6696fcef8bc None None] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:47:19.618044 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e721af0-6fa4-478e-93f3-36743aa91d8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:47:19.618855 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e721af0-6fa4-478e-93f3-36743aa91d8a None admin] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:47:19.619132 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e721af0-6fa4-478e-93f3-36743aa91d8a None admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:47:19.619405 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e721af0-6fa4-478e-93f3-36743aa91d8a None admin] PATH_INFO: `/v3/services/compute` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:47:19.620053 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e721af0-6fa4-478e-93f3-36743aa91d8a None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:47:19.621429 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e721af0-6fa4-478e-93f3-36743aa91d8a None admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:47:19.623482 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fae58d2-19c6-44c5-a648-627396a149ef None None] Validating token access rules against request {{(pid=80396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:47:19.633088 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application [None req-3e721af0-6fa4-478e-93f3-36743aa91d8a None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Jun 02 15:47:19.633088 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 15:47:19.633088 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 02 15:47:19.633088 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 02 15:47:19.633088 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 02 15:47:19.633088 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 02 15:47:19.633088 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 02 15:47:19.633088 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 02 15:47:19.633088 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jun 02 15:47:19.633088 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application Jun 02 15:47:19.633088 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 02 15:47:19.633088 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application Jun 02 15:47:19.633088 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 15:47:19.633088 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 15:47:19.633088 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 15:47:19.633088 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 15:47:19.633088 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 15:47:19.638191 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 15:47:19.638191 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 15:47:19.638191 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 15:47:19.638191 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 15:47:19.638191 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 15:47:19.638191 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 15:47:19.638191 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 02 15:47:19.638191 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 02 15:47:19.638191 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 02 15:47:19.638191 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 02 15:47:19.638191 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 15:47:19.638191 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 15:47:19.638191 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 15:47:19.638191 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 15:47:19.638191 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 15:47:19.638191 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 15:47:19.639083 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 15:47:19.639083 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application with Lock( Jun 02 15:47:19.639083 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 15:47:19.639083 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self._enter() Jun 02 15:47:19.639083 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 15:47:19.639083 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 15:47:19.639083 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 15:47:19.639083 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self.creator() Jun 02 15:47:19.639083 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 15:47:19.639083 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application created_value = creator( Jun 02 15:47:19.639083 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 02 15:47:19.639083 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 02 15:47:19.639083 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jun 02 15:47:19.639083 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application Jun 02 15:47:19.639083 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 511/1015] 10.222.0.59 () {56 vars in 1111 bytes} [Thu Jun 2 15:47:19 2022] GET /identity/v3/services/compute => generated 88 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 02 15:47:19.640376 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e721af0-6fa4-478e-93f3-36743aa91d8a None admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:47:19.667882 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32e99633-c4a5-4743-ae7c-b066710bf4b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:47:19.668716 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e99633-c4a5-4743-ae7c-b066710bf4b5 None admin] REQUEST_METHOD: `GET` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:47:19.669005 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e99633-c4a5-4743-ae7c-b066710bf4b5 None admin] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:47:19.669280 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e99633-c4a5-4743-ae7c-b066710bf4b5 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:47:19.670675 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32e99633-c4a5-4743-ae7c-b066710bf4b5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:47:19.672263 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32e99633-c4a5-4743-ae7c-b066710bf4b5 None admin] RBAC: Authorization granted {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:47:19.678109 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 505/1016] 10.222.0.59 () {56 vars in 1108 bytes} [Thu Jun 2 15:47:19 2022] GET /identity/v3/domains/default => generated 199 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 15:47:19.679952 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32e99633-c4a5-4743-ae7c-b066710bf4b5 None admin] Authenticating user token {{(pid=80396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:47:19.739186 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writing DB stats keystone:SELECT=100 {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:47:19.748218 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e721af0-6fa4-478e-93f3-36743aa91d8a None admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:47:19.780482 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG dbcounter [-] [80396] Writing DB stats keystone:SELECT=100 {{(pid=80396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:47:19.785066 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf18c605-66e5-4612-8151-dac68a84f8de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:47:19.785742 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf18c605-66e5-4612-8151-dac68a84f8de None admin] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:47:19.786027 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf18c605-66e5-4612-8151-dac68a84f8de None admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:47:19.786353 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf18c605-66e5-4612-8151-dac68a84f8de None admin] PATH_INFO: `/v3/services` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:47:19.786894 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32e99633-c4a5-4743-ae7c-b066710bf4b5 None admin] Validating token access rules against request {{(pid=80396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:47:19.787063 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf18c605-66e5-4612-8151-dac68a84f8de None admin] RBAC: Adding query filter params (name=compute) {{(pid=80395) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 15:47:19.790432 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf18c605-66e5-4612-8151-dac68a84f8de None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:47:19.790432 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf18c605-66e5-4612-8151-dac68a84f8de None admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:47:19.794358 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 512/1017] 10.222.0.59 () {56 vars in 1112 bytes} [Thu Jun 2 15:47:19 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 15:47:19.799704 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf18c605-66e5-4612-8151-dac68a84f8de None admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:47:19.822735 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb4eaf7b-73f2-4646-aaab-155c58f862ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:47:19.823510 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4eaf7b-73f2-4646-aaab-155c58f862ec None admin] REQUEST_METHOD: `POST` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:47:19.823800 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4eaf7b-73f2-4646-aaab-155c58f862ec None admin] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:47:19.824075 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4eaf7b-73f2-4646-aaab-155c58f862ec None admin] PATH_INFO: `/v3/projects` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:47:19.824781 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb4eaf7b-73f2-4646-aaab-155c58f862ec None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:47:19.826230 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb4eaf7b-73f2-4646-aaab-155c58f862ec None admin] RBAC: Authorization granted {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:47:19.907107 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf18c605-66e5-4612-8151-dac68a84f8de None admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:47:19.924416 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 506/1018] 10.222.0.59 () {60 vars in 1141 bytes} [Thu Jun 2 15:47:19 2022] POST /identity/v3/projects => generated 311 bytes in 245 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 02 15:47:19.972179 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d0e8c50-9a0f-4ea2-865e-2fb78084124a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:47:19.972179 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0e8c50-9a0f-4ea2-865e-2fb78084124a None admin] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:47:19.972179 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0e8c50-9a0f-4ea2-865e-2fb78084124a None admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:47:19.972179 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0e8c50-9a0f-4ea2-865e-2fb78084124a None admin] PATH_INFO: `/v3/services` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:47:19.973221 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d0e8c50-9a0f-4ea2-865e-2fb78084124a None admin] RBAC: Adding query filter params (type=compute) {{(pid=80395) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 15:47:19.973221 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d0e8c50-9a0f-4ea2-865e-2fb78084124a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:47:19.973221 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d0e8c50-9a0f-4ea2-865e-2fb78084124a None admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:47:19.973221 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 513/1019] 10.222.0.59 () {56 vars in 1112 bytes} [Thu Jun 2 15:47:19 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 15:47:19.973478 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb4eaf7b-73f2-4646-aaab-155c58f862ec None admin] Authenticating user token {{(pid=80396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:47:20.091588 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb4eaf7b-73f2-4646-aaab-155c58f862ec None admin] Validating token access rules against request {{(pid=80396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:47:20.128280 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df7046de-ed78-43d1-bcc6-f8315780b4d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:47:20.129102 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df7046de-ed78-43d1-bcc6-f8315780b4d9 None admin] REQUEST_METHOD: `POST` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:47:20.129821 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df7046de-ed78-43d1-bcc6-f8315780b4d9 None admin] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:47:20.129821 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df7046de-ed78-43d1-bcc6-f8315780b4d9 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:47:20.131116 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df7046de-ed78-43d1-bcc6-f8315780b4d9 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:47:20.132315 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df7046de-ed78-43d1-bcc6-f8315780b4d9 None admin] RBAC: Authorization granted {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:47:20.209779 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 507/1020] 10.222.0.59 () {60 vars in 1144 bytes} [Thu Jun 2 15:47:19 2022] POST /identity/v3/endpoints => generated 334 bytes in 245 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 15:47:21.002002 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c05e6b-5409-4fa6-be42-94ef5ca240a9 None None] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:47:21.002595 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c05e6b-5409-4fa6-be42-94ef5ca240a9 None None] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:47:21.002979 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c05e6b-5409-4fa6-be42-94ef5ca240a9 None None] PATH_INFO: `/` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:47:21.004395 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 514/1021] 10.222.0.59 () {54 vars in 926 bytes} [Thu Jun 2 15:47:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 15:47:21.009572 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d218ae5-6d65-431d-8b58-5b1e9ef7bfc7 None None] REQUEST_METHOD: `POST` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:47:21.009990 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d218ae5-6d65-431d-8b58-5b1e9ef7bfc7 None None] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:47:21.010194 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d218ae5-6d65-431d-8b58-5b1e9ef7bfc7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:47:21.015138 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG dbcounter [-] [80396] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:47:21.029052 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.auth.core [None req-5d218ae5-6d65-431d-8b58-5b1e9ef7bfc7 None None] MFA Rules not processed for user `400d1f4db9de49638549e5db29a041e1`. Rule list: `[]` (Enabled: `True`). {{(pid=80396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 15:47:21.030283 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.fernet_utils [None req-5d218ae5-6d65-431d-8b58-5b1e9ef7bfc7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 15:47:21.110205 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 508/1022] 10.222.0.59 () {58 vars in 1023 bytes} [Thu Jun 2 15:47:21 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 02 15:47:21.133688 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52c05e6b-5409-4fa6-be42-94ef5ca240a9 None None] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:47:21.158102 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writing DB stats keystone:SELECT=100 {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:47:21.251188 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52c05e6b-5409-4fa6-be42-94ef5ca240a9 None None] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:47:21.284999 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c08e32d-ed3e-4853-b50b-895d826929b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:47:21.285691 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c08e32d-ed3e-4853-b50b-895d826929b3 None admin] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:47:21.285974 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c08e32d-ed3e-4853-b50b-895d826929b3 None admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:47:21.286281 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c08e32d-ed3e-4853-b50b-895d826929b3 None admin] PATH_INFO: `/v3/services/image` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:47:21.286928 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c08e32d-ed3e-4853-b50b-895d826929b3 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:47:21.288288 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c08e32d-ed3e-4853-b50b-895d826929b3 None admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:47:21.301178 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application [None req-5c08e32d-ed3e-4853-b50b-895d826929b3 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Jun 02 15:47:21.301178 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 15:47:21.301178 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 02 15:47:21.301178 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 02 15:47:21.301178 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 02 15:47:21.301178 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 02 15:47:21.301178 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 02 15:47:21.301178 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 02 15:47:21.301178 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jun 02 15:47:21.301178 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application Jun 02 15:47:21.301178 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 02 15:47:21.301178 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application Jun 02 15:47:21.301178 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 15:47:21.301178 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 15:47:21.301178 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 15:47:21.301178 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 15:47:21.301178 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 15:47:21.302184 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 15:47:21.302184 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 15:47:21.302184 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 15:47:21.302184 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 15:47:21.302184 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 15:47:21.302184 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 15:47:21.302184 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 02 15:47:21.302184 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 02 15:47:21.302184 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 02 15:47:21.302184 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 02 15:47:21.302184 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 15:47:21.302184 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 15:47:21.302184 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 15:47:21.302184 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 15:47:21.302184 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 15:47:21.302184 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 15:47:21.303055 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 15:47:21.303055 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application with Lock( Jun 02 15:47:21.303055 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 15:47:21.303055 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self._enter() Jun 02 15:47:21.303055 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 15:47:21.303055 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 15:47:21.303055 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 15:47:21.303055 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self.creator() Jun 02 15:47:21.303055 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 15:47:21.303055 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application created_value = creator( Jun 02 15:47:21.303055 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 02 15:47:21.303055 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 02 15:47:21.303055 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jun 02 15:47:21.303055 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application Jun 02 15:47:21.303055 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 515/1023] 10.222.0.59 () {56 vars in 1105 bytes} [Thu Jun 2 15:47:21 2022] GET /identity/v3/services/image => generated 86 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 15:47:21.310123 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d218ae5-6d65-431d-8b58-5b1e9ef7bfc7 None None] Authenticating user token {{(pid=80396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:47:21.439658 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d218ae5-6d65-431d-8b58-5b1e9ef7bfc7 None None] Validating token access rules against request {{(pid=80396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:47:21.483629 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG dbcounter [-] [80396] Writing DB stats keystone:SELECT=100 {{(pid=80396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:47:21.496070 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60f3a9a7-cb41-43cd-853c-c571c0baaf98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:47:21.497087 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f3a9a7-cb41-43cd-853c-c571c0baaf98 None admin] REQUEST_METHOD: `GET` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:47:21.497524 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f3a9a7-cb41-43cd-853c-c571c0baaf98 None admin] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:47:21.497954 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f3a9a7-cb41-43cd-853c-c571c0baaf98 None admin] PATH_INFO: `/v3/services` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:47:21.499290 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60f3a9a7-cb41-43cd-853c-c571c0baaf98 None admin] RBAC: Adding query filter params (name=image) {{(pid=80396) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 15:47:21.499768 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60f3a9a7-cb41-43cd-853c-c571c0baaf98 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:47:21.502046 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60f3a9a7-cb41-43cd-853c-c571c0baaf98 None admin] RBAC: Authorization granted {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:47:21.511398 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 509/1024] 10.222.0.59 () {56 vars in 1108 bytes} [Thu Jun 2 15:47:21 2022] GET /identity/v3/services?name=image => generated 122 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 15:47:21.520159 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c08e32d-ed3e-4853-b50b-895d826929b3 None admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:47:21.663879 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writing DB stats keystone:SELECT=100 {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:47:21.689483 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c08e32d-ed3e-4853-b50b-895d826929b3 None admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:47:21.745182 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f460aab7-0c9b-4e16-b331-e64dd9b1e4cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:47:21.746336 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f460aab7-0c9b-4e16-b331-e64dd9b1e4cd None admin] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:47:21.746851 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f460aab7-0c9b-4e16-b331-e64dd9b1e4cd None admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:47:21.747351 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f460aab7-0c9b-4e16-b331-e64dd9b1e4cd None admin] PATH_INFO: `/v3/services` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:47:21.748644 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f460aab7-0c9b-4e16-b331-e64dd9b1e4cd None admin] RBAC: Adding query filter params (type=image) {{(pid=80395) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 15:47:21.749197 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f460aab7-0c9b-4e16-b331-e64dd9b1e4cd None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:47:21.751764 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f460aab7-0c9b-4e16-b331-e64dd9b1e4cd None admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:47:21.760657 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 516/1025] 10.222.0.59 () {56 vars in 1108 bytes} [Thu Jun 2 15:47:21 2022] GET /identity/v3/services?type=image => generated 350 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 15:47:21.770393 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60f3a9a7-cb41-43cd-853c-c571c0baaf98 None admin] Authenticating user token {{(pid=80396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:47:21.889289 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60f3a9a7-cb41-43cd-853c-c571c0baaf98 None admin] Validating token access rules against request {{(pid=80396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:47:21.922595 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb012741-f5b1-4315-a363-f0503adfc90a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:47:21.923254 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb012741-f5b1-4315-a363-f0503adfc90a None admin] REQUEST_METHOD: `GET` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:47:21.923535 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb012741-f5b1-4315-a363-f0503adfc90a None admin] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:47:21.923811 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb012741-f5b1-4315-a363-f0503adfc90a None admin] PATH_INFO: `/v3/endpoints` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:47:21.925307 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb012741-f5b1-4315-a363-f0503adfc90a None admin] RBAC: Adding query filter params (interface=public, service_id=2a0107334f32428ebffbe53a3b0c5801, region_id=RegionOne) {{(pid=80396) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 15:47:21.925621 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb012741-f5b1-4315-a363-f0503adfc90a None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:47:21.927003 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb012741-f5b1-4315-a363-f0503adfc90a None admin] RBAC: Authorization granted {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:47:21.936977 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 510/1026] 10.222.0.59 () {56 vars in 1251 bytes} [Thu Jun 2 15:47:21 2022] GET /identity/v3/endpoints?service_id=2a0107334f32428ebffbe53a3b0c5801&interface=public®ion_id=RegionOne => generated 194 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 15:47:21.938577 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f460aab7-0c9b-4e16-b331-e64dd9b1e4cd None admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:47:22.045119 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f460aab7-0c9b-4e16-b331-e64dd9b1e4cd None admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:47:22.078248 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bce9ade7-e3d7-40c8-a414-60e385a37e91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:47:22.078903 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce9ade7-e3d7-40c8-a414-60e385a37e91 None admin] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:47:22.079180 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce9ade7-e3d7-40c8-a414-60e385a37e91 None admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:47:22.079450 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce9ade7-e3d7-40c8-a414-60e385a37e91 None admin] PATH_INFO: `/v3/services` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:47:22.080123 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bce9ade7-e3d7-40c8-a414-60e385a37e91 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:47:22.081935 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bce9ade7-e3d7-40c8-a414-60e385a37e91 None admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:47:22.089773 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 517/1027] 10.222.0.59 () {56 vars in 1087 bytes} [Thu Jun 2 15:47:21 2022] GET /identity/v3/services => generated 1957 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 15:47:22.285159 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2882025-fa27-4ecf-a410-a9aa0cf1c839 None None] REQUEST_METHOD: `GET` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:47:22.285658 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2882025-fa27-4ecf-a410-a9aa0cf1c839 None None] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:47:22.285658 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2882025-fa27-4ecf-a410-a9aa0cf1c839 None None] PATH_INFO: `/` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:47:22.287181 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 511/1028] 10.222.0.59 () {54 vars in 926 bytes} [Thu Jun 2 15:47:22 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 15:47:22.292353 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551d3513-7e28-4e63-8115-4e1859aedd01 None None] REQUEST_METHOD: `POST` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:47:22.292734 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551d3513-7e28-4e63-8115-4e1859aedd01 None None] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:47:22.293083 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551d3513-7e28-4e63-8115-4e1859aedd01 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:47:22.311621 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.auth.core [None req-551d3513-7e28-4e63-8115-4e1859aedd01 None None] MFA Rules not processed for user `400d1f4db9de49638549e5db29a041e1`. Rule list: `[]` (Enabled: `True`). {{(pid=80395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 15:47:22.312979 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.fernet_utils [None req-551d3513-7e28-4e63-8115-4e1859aedd01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 15:47:22.320868 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writing DB stats keystone:SELECT=100 {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:47:22.380892 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 518/1029] 10.222.0.59 () {58 vars in 1023 bytes} [Thu Jun 2 15:47:22 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 02 15:47:22.405246 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2882025-fa27-4ecf-a410-a9aa0cf1c839 None None] Authenticating user token {{(pid=80396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:47:22.463797 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG dbcounter [-] [80396] Writing DB stats keystone:SELECT=100 {{(pid=80396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:47:22.514124 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2882025-fa27-4ecf-a410-a9aa0cf1c839 None None] Validating token access rules against request {{(pid=80396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:47:22.548402 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dbafff1-d969-42ef-b3b5-5c4f31e53095 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:47:22.549107 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dbafff1-d969-42ef-b3b5-5c4f31e53095 None admin] REQUEST_METHOD: `GET` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:47:22.550045 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dbafff1-d969-42ef-b3b5-5c4f31e53095 None admin] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:47:22.550349 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dbafff1-d969-42ef-b3b5-5c4f31e53095 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:47:22.551527 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dbafff1-d969-42ef-b3b5-5c4f31e53095 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:47:22.552947 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dbafff1-d969-42ef-b3b5-5c4f31e53095 None admin] RBAC: Authorization granted {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:47:22.554755 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 512/1030] 10.222.0.59 () {56 vars in 1108 bytes} [Thu Jun 2 15:47:22 2022] GET /identity/v3/domains/default => generated 199 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 15:47:22.560265 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-551d3513-7e28-4e63-8115-4e1859aedd01 None None] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:47:22.661490 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-551d3513-7e28-4e63-8115-4e1859aedd01 None None] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:47:22.695871 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fccda1e2-7056-4802-834d-a41f0f7ddd8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:47:22.696540 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fccda1e2-7056-4802-834d-a41f0f7ddd8e None admin] REQUEST_METHOD: `POST` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:47:22.696822 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fccda1e2-7056-4802-834d-a41f0f7ddd8e None admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:47:22.697088 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fccda1e2-7056-4802-834d-a41f0f7ddd8e None admin] PATH_INFO: `/v3/users` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:47:22.697813 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fccda1e2-7056-4802-834d-a41f0f7ddd8e None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:47:22.699273 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fccda1e2-7056-4802-834d-a41f0f7ddd8e None admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:47:22.768579 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:47:22.782105 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 519/1031] 10.222.0.59 () {60 vars in 1132 bytes} [Thu Jun 2 15:47:22 2022] POST /identity/v3/users => generated 285 bytes in 215 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 02 15:47:22.834382 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c88a120-ef95-452f-8dd3-c06023981e04 None None] REQUEST_METHOD: `GET` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:47:22.834591 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c88a120-ef95-452f-8dd3-c06023981e04 None None] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:47:22.835034 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c88a120-ef95-452f-8dd3-c06023981e04 None None] PATH_INFO: `/` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:47:22.837027 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 513/1032] 10.222.0.59 () {54 vars in 926 bytes} [Thu Jun 2 15:47:22 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 15:47:22.842879 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21716b65-7f0e-4d77-9f27-19b7d237da44 None None] REQUEST_METHOD: `POST` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:47:22.843081 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21716b65-7f0e-4d77-9f27-19b7d237da44 None None] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:47:22.847945 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21716b65-7f0e-4d77-9f27-19b7d237da44 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:47:22.863932 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.auth.core [None req-21716b65-7f0e-4d77-9f27-19b7d237da44 None None] MFA Rules not processed for user `400d1f4db9de49638549e5db29a041e1`. Rule list: `[]` (Enabled: `True`). {{(pid=80395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 15:47:22.865157 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.fernet_utils [None req-21716b65-7f0e-4d77-9f27-19b7d237da44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 15:47:22.940970 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 520/1033] 10.222.0.59 () {58 vars in 1023 bytes} [Thu Jun 2 15:47:22 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 02 15:47:22.965559 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c88a120-ef95-452f-8dd3-c06023981e04 None None] Authenticating user token {{(pid=80396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:47:23.077464 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c88a120-ef95-452f-8dd3-c06023981e04 None None] Validating token access rules against request {{(pid=80396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:47:23.103437 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG dbcounter [-] [80396] Writing DB stats keystone:SELECT=100 {{(pid=80396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:47:23.114669 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1f2b44a-52b5-45b4-8735-57cce2ee4c65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:47:23.115607 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f2b44a-52b5-45b4-8735-57cce2ee4c65 None admin] REQUEST_METHOD: `GET` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:47:23.127961 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f2b44a-52b5-45b4-8735-57cce2ee4c65 None admin] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:47:23.127961 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f2b44a-52b5-45b4-8735-57cce2ee4c65 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:47:23.127961 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1f2b44a-52b5-45b4-8735-57cce2ee4c65 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 02 15:47:23.135259 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application [None req-c1f2b44a-52b5-45b4-8735-57cce2ee4c65 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 02 15:47:23.135259 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 15:47:23.135259 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 15:47:23.135259 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 15:47:23.135259 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 15:47:23.135259 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 15:47:23.135259 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 15:47:23.135259 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 15:47:23.135259 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 15:47:23.135259 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 15:47:23.135259 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 15:47:23.135259 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 15:47:23.135259 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 02 15:47:23.135259 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 02 15:47:23.135259 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 02 15:47:23.135259 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 02 15:47:23.136212 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 02 15:47:23.136212 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 02 15:47:23.136212 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 02 15:47:23.136212 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 02 15:47:23.136212 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 15:47:23.136212 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 15:47:23.136212 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 15:47:23.136212 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 15:47:23.136212 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 15:47:23.136212 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 15:47:23.136212 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 15:47:23.136212 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application with Lock( Jun 02 15:47:23.136212 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 15:47:23.136212 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application return self._enter() Jun 02 15:47:23.136212 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 15:47:23.136212 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 15:47:23.137173 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 15:47:23.137173 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application return self.creator() Jun 02 15:47:23.137173 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 15:47:23.137173 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application created_value = creator( Jun 02 15:47:23.137173 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 02 15:47:23.137173 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 02 15:47:23.137173 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 02 15:47:23.137173 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 02 15:47:23.137173 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 02 15:47:23.137173 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 02 15:47:23.137173 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 02 15:47:23.137173 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application Jun 02 15:47:23.137173 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 514/1034] 10.222.0.59 () {56 vars in 1120 bytes} [Thu Jun 2 15:47:22 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 15:47:23.142741 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21716b65-7f0e-4d77-9f27-19b7d237da44 None None] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:47:23.254804 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21716b65-7f0e-4d77-9f27-19b7d237da44 None None] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:47:23.282870 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writing DB stats keystone:SELECT=100 {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:47:23.291859 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a784343b-502f-40ce-9550-02921ba3218d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:47:23.292620 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a784343b-502f-40ce-9550-02921ba3218d None admin] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:47:23.292899 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a784343b-502f-40ce-9550-02921ba3218d None admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:47:23.293174 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a784343b-502f-40ce-9550-02921ba3218d None admin] PATH_INFO: `/v3/roles` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:47:23.293919 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a784343b-502f-40ce-9550-02921ba3218d None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80395) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 15:47:23.294274 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a784343b-502f-40ce-9550-02921ba3218d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:47:23.295682 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a784343b-502f-40ce-9550-02921ba3218d None admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:47:23.308997 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 521/1035] 10.222.0.59 () {56 vars in 1115 bytes} [Thu Jun 2 15:47:23 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 15:47:23.310317 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1f2b44a-52b5-45b4-8735-57cce2ee4c65 None admin] Authenticating user token {{(pid=80396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:47:23.416645 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1f2b44a-52b5-45b4-8735-57cce2ee4c65 None admin] Validating token access rules against request {{(pid=80396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:47:23.449741 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efb13bd9-65a2-4a83-9119-e012be04b5fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:47:23.450548 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb13bd9-65a2-4a83-9119-e012be04b5fe None admin] REQUEST_METHOD: `GET` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:47:23.450832 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb13bd9-65a2-4a83-9119-e012be04b5fe None admin] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:47:23.451106 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb13bd9-65a2-4a83-9119-e012be04b5fe None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:47:23.462435 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efb13bd9-65a2-4a83-9119-e012be04b5fe None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:47:23.463869 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efb13bd9-65a2-4a83-9119-e012be04b5fe None admin] RBAC: Authorization granted {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:47:23.480771 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application [None req-efb13bd9-65a2-4a83-9119-e012be04b5fe None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 15:47:23.480771 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 15:47:23.480771 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 15:47:23.480771 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 15:47:23.480771 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 15:47:23.480771 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 15:47:23.480771 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 15:47:23.480771 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 15:47:23.480771 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 15:47:23.480771 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 15:47:23.480771 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 15:47:23.480771 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 15:47:23.480771 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 02 15:47:23.480771 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 02 15:47:23.480771 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 02 15:47:23.481756 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 02 15:47:23.481756 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 15:47:23.481756 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 15:47:23.481756 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 15:47:23.481756 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 15:47:23.481756 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 15:47:23.481756 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 15:47:23.481756 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 15:47:23.481756 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application with Lock( Jun 02 15:47:23.481756 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 15:47:23.481756 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application return self._enter() Jun 02 15:47:23.481756 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 15:47:23.481756 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 15:47:23.481756 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 15:47:23.481756 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application return self.creator() Jun 02 15:47:23.481756 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 15:47:23.481756 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application created_value = creator( Jun 02 15:47:23.482726 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 02 15:47:23.482726 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 02 15:47:23.482726 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 15:47:23.482726 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application Jun 02 15:47:23.482726 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 515/1036] 10.222.0.59 () {56 vars in 1108 bytes} [Thu Jun 2 15:47:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 15:47:23.487686 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a784343b-502f-40ce-9550-02921ba3218d None admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:47:23.589658 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a784343b-502f-40ce-9550-02921ba3218d None admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:47:23.623009 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-300dc5f3-359d-4ca2-992b-a6f67b35e094 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:47:23.623668 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-300dc5f3-359d-4ca2-992b-a6f67b35e094 None admin] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:47:23.623931 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-300dc5f3-359d-4ca2-992b-a6f67b35e094 None admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:47:23.624208 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-300dc5f3-359d-4ca2-992b-a6f67b35e094 None admin] PATH_INFO: `/v3/domains` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:47:23.624926 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-300dc5f3-359d-4ca2-992b-a6f67b35e094 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80395) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 15:47:23.625230 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-300dc5f3-359d-4ca2-992b-a6f67b35e094 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:47:23.626626 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-300dc5f3-359d-4ca2-992b-a6f67b35e094 None admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:47:23.643497 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 522/1037] 10.222.0.59 () {56 vars in 1109 bytes} [Thu Jun 2 15:47:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 15:47:23.644878 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efb13bd9-65a2-4a83-9119-e012be04b5fe None admin] Authenticating user token {{(pid=80396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:47:23.687479 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG dbcounter [-] [80396] Writing DB stats keystone:SELECT=100 {{(pid=80396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:47:23.752075 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efb13bd9-65a2-4a83-9119-e012be04b5fe None admin] Validating token access rules against request {{(pid=80396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:47:23.786510 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d3a85d1-cf6d-4875-8ad1-de92fb3ec00d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:47:23.787287 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3a85d1-cf6d-4875-8ad1-de92fb3ec00d None admin] REQUEST_METHOD: `GET` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:47:23.787565 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3a85d1-cf6d-4875-8ad1-de92fb3ec00d None admin] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:47:23.787836 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3a85d1-cf6d-4875-8ad1-de92fb3ec00d None admin] PATH_INFO: `/v3/users/nova` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:47:23.794958 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d3a85d1-cf6d-4875-8ad1-de92fb3ec00d None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:47:23.796378 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d3a85d1-cf6d-4875-8ad1-de92fb3ec00d None admin] RBAC: Authorization granted {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:47:23.810698 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application [None req-1d3a85d1-cf6d-4875-8ad1-de92fb3ec00d None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 02 15:47:23.810698 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 15:47:23.810698 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 15:47:23.810698 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 15:47:23.810698 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 15:47:23.810698 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 15:47:23.810698 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 15:47:23.810698 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 15:47:23.810698 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 15:47:23.810698 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 15:47:23.810698 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 15:47:23.810698 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 15:47:23.810698 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 02 15:47:23.810698 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 02 15:47:23.810698 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 02 15:47:23.810698 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 02 15:47:23.811713 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 15:47:23.811713 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 15:47:23.811713 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 02 15:47:23.811713 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 02 15:47:23.811713 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 02 15:47:23.811713 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 02 15:47:23.811713 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 15:47:23.811713 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 15:47:23.811713 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 15:47:23.811713 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 15:47:23.811713 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 15:47:23.811713 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application with Lock( Jun 02 15:47:23.811713 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 15:47:23.811713 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application return self._enter() Jun 02 15:47:23.811713 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 15:47:23.811713 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 15:47:23.811713 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 15:47:23.811713 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application return self.creator() Jun 02 15:47:23.812642 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 15:47:23.812642 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application created_value = creator( Jun 02 15:47:23.812642 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 02 15:47:23.812642 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 02 15:47:23.812642 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 02 15:47:23.812642 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 02 15:47:23.812642 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 02 15:47:23.812642 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 02 15:47:23.812642 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 02 15:47:23.812642 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application Jun 02 15:47:23.817147 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 516/1038] 10.222.0.59 () {56 vars in 1093 bytes} [Thu Jun 2 15:47:23 2022] GET /identity/v3/users/nova => generated 82 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 15:47:23.818161 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-300dc5f3-359d-4ca2-992b-a6f67b35e094 None admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:47:23.872142 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writing DB stats keystone:SELECT=100 {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:47:23.921739 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-300dc5f3-359d-4ca2-992b-a6f67b35e094 None admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:47:23.957578 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0764047d-7ab1-4b7d-a382-08df94c9c3d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:47:23.958198 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0764047d-7ab1-4b7d-a382-08df94c9c3d9 None admin] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:47:23.958480 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0764047d-7ab1-4b7d-a382-08df94c9c3d9 None admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:47:23.958751 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0764047d-7ab1-4b7d-a382-08df94c9c3d9 None admin] PATH_INFO: `/v3/users` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:47:23.959578 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0764047d-7ab1-4b7d-a382-08df94c9c3d9 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80395) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 15:47:23.959876 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0764047d-7ab1-4b7d-a382-08df94c9c3d9 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:47:23.961312 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0764047d-7ab1-4b7d-a382-08df94c9c3d9 None admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:47:23.980552 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 523/1039] 10.222.0.59 () {56 vars in 1133 bytes} [Thu Jun 2 15:47:23 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 15:47:23.986036 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d3a85d1-cf6d-4875-8ad1-de92fb3ec00d None admin] Authenticating user token {{(pid=80396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:47:24.094188 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG dbcounter [-] [80396] Writing DB stats keystone:SELECT=100 {{(pid=80396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:47:24.101750 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d3a85d1-cf6d-4875-8ad1-de92fb3ec00d None admin] Validating token access rules against request {{(pid=80396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:47:24.136084 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05d52da3-9b2c-4f4e-915e-45b66b3ef8af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:47:24.136733 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d52da3-9b2c-4f4e-915e-45b66b3ef8af None admin] REQUEST_METHOD: `GET` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:47:24.137020 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d52da3-9b2c-4f4e-915e-45b66b3ef8af None admin] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:47:24.137295 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d52da3-9b2c-4f4e-915e-45b66b3ef8af None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:47:24.216561 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05d52da3-9b2c-4f4e-915e-45b66b3ef8af None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:47:24.218318 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05d52da3-9b2c-4f4e-915e-45b66b3ef8af None admin] RBAC: Authorization granted {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:47:24.311997 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG dbcounter [-] [80396] Writing DB stats keystone:SELECT=100 {{(pid=80396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:47:24.325255 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 517/1040] 10.222.0.59 () {58 vars in 1282 bytes} [Thu Jun 2 15:47:23 2022] GET /identity/v3/auth/tokens => generated 1959 bytes in 336 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 02 15:47:24.326921 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0764047d-7ab1-4b7d-a382-08df94c9c3d9 None admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:47:24.410544 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c9fb16-6cc4-42b2-a1e6-23122933f545 None None] REQUEST_METHOD: `GET` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:47:24.410831 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c9fb16-6cc4-42b2-a1e6-23122933f545 None None] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:47:24.411113 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c9fb16-6cc4-42b2-a1e6-23122933f545 None None] PATH_INFO: `/` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:47:24.412496 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 518/1041] 10.222.0.59 () {54 vars in 926 bytes} [Thu Jun 2 15:47:24 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 15:47:24.417606 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d419289-afb2-4ac7-83f3-445972111b03 None None] REQUEST_METHOD: `POST` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:47:24.417754 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d419289-afb2-4ac7-83f3-445972111b03 None None] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:47:24.417959 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d419289-afb2-4ac7-83f3-445972111b03 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:47:24.435928 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0764047d-7ab1-4b7d-a382-08df94c9c3d9 None admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:47:24.436392 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.auth.core [None req-0d419289-afb2-4ac7-83f3-445972111b03 None None] MFA Rules not processed for user `400d1f4db9de49638549e5db29a041e1`. Rule list: `[]` (Enabled: `True`). {{(pid=80396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 15:47:24.438125 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.fernet_utils [None req-0d419289-afb2-4ac7-83f3-445972111b03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 15:47:24.447556 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writing DB stats keystone:SELECT=100 {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:47:24.478975 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3df80fc3-b753-4161-9147-102e0b2677c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:47:24.480083 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df80fc3-b753-4161-9147-102e0b2677c9 None admin] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:47:24.480527 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df80fc3-b753-4161-9147-102e0b2677c9 None admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:47:24.480961 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df80fc3-b753-4161-9147-102e0b2677c9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:47:24.494484 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3df80fc3-b753-4161-9147-102e0b2677c9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:47:24.496166 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3df80fc3-b753-4161-9147-102e0b2677c9 None admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:47:24.512987 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 519/1042] 10.222.0.59 () {58 vars in 1023 bytes} [Thu Jun 2 15:47:24 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 02 15:47:24.519630 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application [None req-3df80fc3-b753-4161-9147-102e0b2677c9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 15:47:24.519630 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 15:47:24.519630 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 15:47:24.519630 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 15:47:24.519630 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 15:47:24.519630 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 15:47:24.519630 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 15:47:24.519630 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 15:47:24.519630 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 15:47:24.519630 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 15:47:24.519630 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 15:47:24.519630 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 15:47:24.519630 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 02 15:47:24.519630 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 02 15:47:24.519630 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 02 15:47:24.520754 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 02 15:47:24.520754 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 15:47:24.520754 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 15:47:24.520754 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 15:47:24.520754 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 15:47:24.520754 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 15:47:24.520754 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 15:47:24.520754 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 15:47:24.520754 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application with Lock( Jun 02 15:47:24.520754 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 15:47:24.520754 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self._enter() Jun 02 15:47:24.520754 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 15:47:24.520754 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 15:47:24.520754 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 15:47:24.520754 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self.creator() Jun 02 15:47:24.520754 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 15:47:24.520754 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application created_value = creator( Jun 02 15:47:24.521891 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 02 15:47:24.521891 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 02 15:47:24.521891 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 15:47:24.521891 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application Jun 02 15:47:24.530609 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 524/1043] 10.222.0.59 () {56 vars in 1108 bytes} [Thu Jun 2 15:47:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 15:47:24.531500 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d419289-afb2-4ac7-83f3-445972111b03 None None] Authenticating user token {{(pid=80396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:47:24.536564 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3df80fc3-b753-4161-9147-102e0b2677c9 None admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:47:24.650404 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d419289-afb2-4ac7-83f3-445972111b03 None None] Validating token access rules against request {{(pid=80396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:47:24.655477 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3df80fc3-b753-4161-9147-102e0b2677c9 None admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:47:24.678679 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG dbcounter [-] [80396] Writing DB stats keystone:SELECT=100 {{(pid=80396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:47:24.687341 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef34d0fa-7484-4bef-a429-f6e04222c9db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:47:24.688121 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef34d0fa-7484-4bef-a429-f6e04222c9db None admin] REQUEST_METHOD: `GET` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:47:24.688401 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef34d0fa-7484-4bef-a429-f6e04222c9db None admin] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:47:24.688675 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef34d0fa-7484-4bef-a429-f6e04222c9db None admin] PATH_INFO: `/v3/domains` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:47:24.689437 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef34d0fa-7484-4bef-a429-f6e04222c9db None admin] RBAC: Adding query filter params (name=Default) {{(pid=80396) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 15:47:24.689756 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef34d0fa-7484-4bef-a429-f6e04222c9db None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:47:24.691220 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef34d0fa-7484-4bef-a429-f6e04222c9db None admin] RBAC: Authorization granted {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:47:24.706872 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 520/1044] 10.222.0.59 () {56 vars in 1109 bytes} [Thu Jun 2 15:47:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 15:47:24.707871 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a41a63a5-c085-484c-bbf7-088402efa9e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:47:24.708895 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a41a63a5-c085-484c-bbf7-088402efa9e6 None admin] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:47:24.709368 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a41a63a5-c085-484c-bbf7-088402efa9e6 None admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:47:24.709825 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a41a63a5-c085-484c-bbf7-088402efa9e6 None admin] PATH_INFO: `/v3/services/image` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:47:24.710864 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a41a63a5-c085-484c-bbf7-088402efa9e6 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:47:24.712740 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef34d0fa-7484-4bef-a429-f6e04222c9db None admin] Authenticating user token {{(pid=80396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:47:24.713411 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a41a63a5-c085-484c-bbf7-088402efa9e6 None admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:47:24.729407 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application [None req-a41a63a5-c085-484c-bbf7-088402efa9e6 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Jun 02 15:47:24.729407 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 15:47:24.729407 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 02 15:47:24.729407 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 02 15:47:24.729407 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 02 15:47:24.729407 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 02 15:47:24.729407 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 02 15:47:24.729407 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 02 15:47:24.729407 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jun 02 15:47:24.729407 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application Jun 02 15:47:24.729407 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 02 15:47:24.729407 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application Jun 02 15:47:24.729407 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 15:47:24.729407 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 15:47:24.729407 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 15:47:24.729407 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 15:47:24.729407 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 15:47:24.730730 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 15:47:24.730730 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 15:47:24.730730 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 15:47:24.730730 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 15:47:24.730730 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 15:47:24.730730 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 15:47:24.730730 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 02 15:47:24.730730 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 02 15:47:24.730730 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 02 15:47:24.730730 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 02 15:47:24.730730 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 15:47:24.730730 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 15:47:24.730730 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 15:47:24.730730 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 15:47:24.730730 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 15:47:24.730730 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 15:47:24.731749 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 15:47:24.731749 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application with Lock( Jun 02 15:47:24.731749 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 15:47:24.731749 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self._enter() Jun 02 15:47:24.731749 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 15:47:24.731749 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 15:47:24.731749 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 15:47:24.731749 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self.creator() Jun 02 15:47:24.731749 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 15:47:24.731749 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application created_value = creator( Jun 02 15:47:24.731749 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 02 15:47:24.731749 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 02 15:47:24.731749 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jun 02 15:47:24.731749 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application Jun 02 15:47:24.731749 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 525/1045] 10.222.0.59 () {56 vars in 1105 bytes} [Thu Jun 2 15:47:24 2022] GET /identity/v3/services/image => generated 86 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 02 15:47:24.737876 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a41a63a5-c085-484c-bbf7-088402efa9e6 None admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:47:24.767705 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writing DB stats keystone:SELECT=100 {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:47:24.841973 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef34d0fa-7484-4bef-a429-f6e04222c9db None admin] Validating token access rules against request {{(pid=80396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:47:24.858734 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a41a63a5-c085-484c-bbf7-088402efa9e6 None admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:47:24.891728 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59834097-9e36-43fb-a5d3-d24834f52d09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:47:24.893515 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59834097-9e36-43fb-a5d3-d24834f52d09 None admin] REQUEST_METHOD: `GET` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:47:24.893983 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59834097-9e36-43fb-a5d3-d24834f52d09 None admin] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:47:24.894458 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59834097-9e36-43fb-a5d3-d24834f52d09 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:47:24.894850 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eb4c6cc-662e-49b0-b580-e45a3cd1d27f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:47:24.895555 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb4c6cc-662e-49b0-b580-e45a3cd1d27f None admin] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:47:24.895799 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb4c6cc-662e-49b0-b580-e45a3cd1d27f None admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:47:24.896111 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb4c6cc-662e-49b0-b580-e45a3cd1d27f None admin] PATH_INFO: `/v3/services` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:47:24.896819 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eb4c6cc-662e-49b0-b580-e45a3cd1d27f None admin] RBAC: Adding query filter params (name=image) {{(pid=80395) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 15:47:24.897195 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eb4c6cc-662e-49b0-b580-e45a3cd1d27f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:47:24.898571 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eb4c6cc-662e-49b0-b580-e45a3cd1d27f None admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:47:24.903878 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 526/1046] 10.222.0.59 () {56 vars in 1108 bytes} [Thu Jun 2 15:47:24 2022] GET /identity/v3/services?name=image => generated 122 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 15:47:24.906033 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59834097-9e36-43fb-a5d3-d24834f52d09 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:47:24.909213 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59834097-9e36-43fb-a5d3-d24834f52d09 None admin] RBAC: Authorization granted {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:47:24.909791 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eb4c6cc-662e-49b0-b580-e45a3cd1d27f None admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:47:24.927704 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application [None req-59834097-9e36-43fb-a5d3-d24834f52d09 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 02 15:47:24.927704 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 15:47:24.927704 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 15:47:24.927704 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 15:47:24.927704 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 15:47:24.927704 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 15:47:24.927704 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 15:47:24.927704 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 15:47:24.927704 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 15:47:24.927704 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 15:47:24.927704 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 15:47:24.927704 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 15:47:24.927704 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 02 15:47:24.927704 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 02 15:47:24.927704 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 02 15:47:24.928645 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 02 15:47:24.928645 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 15:47:24.928645 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 15:47:24.928645 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 15:47:24.928645 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 15:47:24.928645 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 15:47:24.928645 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 15:47:24.928645 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 15:47:24.928645 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application with Lock( Jun 02 15:47:24.928645 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 15:47:24.928645 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application return self._enter() Jun 02 15:47:24.928645 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 15:47:24.928645 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 15:47:24.928645 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 15:47:24.928645 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application return self.creator() Jun 02 15:47:24.928645 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 15:47:24.928645 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application created_value = creator( Jun 02 15:47:24.929859 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 02 15:47:24.929859 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 02 15:47:24.929859 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 02 15:47:24.929859 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 02 15:47:24.929859 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 02 15:47:24.929859 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 02 15:47:24.929859 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 02 15:47:24.929859 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application Jun 02 15:47:24.929859 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 521/1047] 10.222.0.59 () {56 vars in 1111 bytes} [Thu Jun 2 15:47:24 2022] GET /identity/v3/projects/service => generated 88 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 15:47:24.934770 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59834097-9e36-43fb-a5d3-d24834f52d09 None admin] Authenticating user token {{(pid=80396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:47:24.988296 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG dbcounter [-] [80396] Writing DB stats keystone:SELECT=100 {{(pid=80396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:47:25.011660 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writing DB stats keystone:SELECT=100 {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:47:25.026724 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eb4c6cc-662e-49b0-b580-e45a3cd1d27f None admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:47:25.054123 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59834097-9e36-43fb-a5d3-d24834f52d09 None admin] Validating token access rules against request {{(pid=80396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:47:25.067074 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83045bd5-bc38-40a8-80e1-cf2fcd8e3322 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:47:25.068807 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83045bd5-bc38-40a8-80e1-cf2fcd8e3322 None admin] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:47:25.069276 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83045bd5-bc38-40a8-80e1-cf2fcd8e3322 None admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:47:25.069743 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83045bd5-bc38-40a8-80e1-cf2fcd8e3322 None admin] PATH_INFO: `/v3/services` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:47:25.071194 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83045bd5-bc38-40a8-80e1-cf2fcd8e3322 None admin] RBAC: Adding query filter params (type=image) {{(pid=80395) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 15:47:25.071529 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83045bd5-bc38-40a8-80e1-cf2fcd8e3322 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:47:25.073046 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83045bd5-bc38-40a8-80e1-cf2fcd8e3322 None admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:47:25.083754 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 527/1048] 10.222.0.59 () {56 vars in 1108 bytes} [Thu Jun 2 15:47:24 2022] GET /identity/v3/services?type=image => generated 350 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 15:47:25.085563 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83045bd5-bc38-40a8-80e1-cf2fcd8e3322 None admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:47:25.099001 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b368353-6820-44c5-9227-e951d30860ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:47:25.099662 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b368353-6820-44c5-9227-e951d30860ef None admin] REQUEST_METHOD: `GET` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:47:25.099943 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b368353-6820-44c5-9227-e951d30860ef None admin] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:47:25.100214 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b368353-6820-44c5-9227-e951d30860ef None admin] PATH_INFO: `/v3/projects` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:47:25.101002 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b368353-6820-44c5-9227-e951d30860ef None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80396) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 15:47:25.101305 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b368353-6820-44c5-9227-e951d30860ef None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:47:25.102753 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b368353-6820-44c5-9227-e951d30860ef None admin] RBAC: Authorization granted {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:47:25.115045 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 522/1049] 10.222.0.59 () {56 vars in 1148 bytes} [Thu Jun 2 15:47:24 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 15:47:25.122322 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b368353-6820-44c5-9227-e951d30860ef None admin] Authenticating user token {{(pid=80396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:47:25.201830 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83045bd5-bc38-40a8-80e1-cf2fcd8e3322 None admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:47:25.236036 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b368353-6820-44c5-9227-e951d30860ef None admin] Validating token access rules against request {{(pid=80396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:47:25.237965 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b09052c0-5044-4a65-a5e2-abdcdb695bef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:47:25.238714 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09052c0-5044-4a65-a5e2-abdcdb695bef None admin] REQUEST_METHOD: `POST` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:47:25.238936 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09052c0-5044-4a65-a5e2-abdcdb695bef None admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:47:25.239238 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09052c0-5044-4a65-a5e2-abdcdb695bef None admin] PATH_INFO: `/v3/endpoints` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:47:25.239967 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b09052c0-5044-4a65-a5e2-abdcdb695bef None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:47:25.241333 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b09052c0-5044-4a65-a5e2-abdcdb695bef None admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:47:25.243835 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG dbcounter [-] [80396] Writing DB stats keystone:SELECT=100 {{(pid=80396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:47:25.273364 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a4879c1-a5a2-4a9d-b618-12e1c7f6d625 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:47:25.274019 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4879c1-a5a2-4a9d-b618-12e1c7f6d625 None admin] REQUEST_METHOD: `GET` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:47:25.274331 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4879c1-a5a2-4a9d-b618-12e1c7f6d625 None admin] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:47:25.274609 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4879c1-a5a2-4a9d-b618-12e1c7f6d625 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:47:25.275600 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a4879c1-a5a2-4a9d-b618-12e1c7f6d625 None admin] RBAC: Adding query filter params (role.id=ce7c3f9097fa4b4aa3a7a1d7bef989be, scope.project.id=9c87c981909d4b8db02783421818c79b, user.id=52f9fe4b13574516bb0a8e2aa11a61e8) {{(pid=80396) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 15:47:25.275914 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a4879c1-a5a2-4a9d-b618-12e1c7f6d625 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:47:25.277340 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a4879c1-a5a2-4a9d-b618-12e1c7f6d625 None admin] RBAC: Authorization granted {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:47:25.283975 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 523/1050] 10.222.0.59 () {56 vars in 1374 bytes} [Thu Jun 2 15:47:25 2022] GET /identity/v3/role_assignments?user.id=52f9fe4b13574516bb0a8e2aa11a61e8&scope.project.id=9c87c981909d4b8db02783421818c79b&role.id=ce7c3f9097fa4b4aa3a7a1d7bef989be => generated 259 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 15:47:25.285255 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17520f01-55ef-4395-b9f7-da7d6aa6bc26 None None] REQUEST_METHOD: `GET` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:47:25.285548 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17520f01-55ef-4395-b9f7-da7d6aa6bc26 None None] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:47:25.285833 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17520f01-55ef-4395-b9f7-da7d6aa6bc26 None None] PATH_INFO: `/` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:47:25.287122 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 524/1051] 10.222.0.59 () {54 vars in 926 bytes} [Thu Jun 2 15:47:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 15:47:25.295068 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533ac889-b1fa-4357-b5c6-14b7004263b3 None None] REQUEST_METHOD: `POST` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:47:25.298172 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533ac889-b1fa-4357-b5c6-14b7004263b3 None None] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:47:25.298172 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533ac889-b1fa-4357-b5c6-14b7004263b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:47:25.315384 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.auth.core [None req-533ac889-b1fa-4357-b5c6-14b7004263b3 None None] MFA Rules not processed for user `400d1f4db9de49638549e5db29a041e1`. Rule list: `[]` (Enabled: `True`). {{(pid=80396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 15:47:25.316600 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.fernet_utils [None req-533ac889-b1fa-4357-b5c6-14b7004263b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 15:47:25.369046 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 528/1052] 10.222.0.59 () {60 vars in 1144 bytes} [Thu Jun 2 15:47:25 2022] POST /identity/v3/endpoints => generated 327 bytes in 284 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 02 15:47:25.405362 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 525/1053] 10.222.0.59 () {58 vars in 1023 bytes} [Thu Jun 2 15:47:25 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 02 15:47:25.429312 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b09052c0-5044-4a65-a5e2-abdcdb695bef None admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:47:25.443118 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:47:25.547292 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b09052c0-5044-4a65-a5e2-abdcdb695bef None admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:47:25.587592 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89b9786d-ff32-4afd-b0f2-3979641ac1d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:47:25.588387 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b9786d-ff32-4afd-b0f2-3979641ac1d8 None admin] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:47:25.588667 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b9786d-ff32-4afd-b0f2-3979641ac1d8 None admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:47:25.588938 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b9786d-ff32-4afd-b0f2-3979641ac1d8 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:47:25.600518 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89b9786d-ff32-4afd-b0f2-3979641ac1d8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 02 15:47:25.608211 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application [None req-89b9786d-ff32-4afd-b0f2-3979641ac1d8 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 02 15:47:25.608211 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 15:47:25.608211 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 15:47:25.608211 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 15:47:25.608211 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 15:47:25.608211 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 15:47:25.608211 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 15:47:25.608211 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 15:47:25.608211 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 15:47:25.608211 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 15:47:25.608211 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 15:47:25.608211 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 15:47:25.608211 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 02 15:47:25.608211 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 02 15:47:25.608211 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 02 15:47:25.608211 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 02 15:47:25.609195 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 02 15:47:25.609195 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 02 15:47:25.609195 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 02 15:47:25.609195 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 02 15:47:25.609195 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 15:47:25.609195 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 15:47:25.609195 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 15:47:25.609195 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 15:47:25.609195 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 15:47:25.609195 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 15:47:25.609195 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 15:47:25.609195 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application with Lock( Jun 02 15:47:25.609195 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 15:47:25.609195 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self._enter() Jun 02 15:47:25.609195 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 15:47:25.609195 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 15:47:25.610061 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 15:47:25.610061 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self.creator() Jun 02 15:47:25.610061 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 15:47:25.610061 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application created_value = creator( Jun 02 15:47:25.610061 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 02 15:47:25.610061 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 02 15:47:25.610061 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 02 15:47:25.610061 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 02 15:47:25.610061 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 02 15:47:25.610061 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 02 15:47:25.610061 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 02 15:47:25.610061 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application Jun 02 15:47:25.610061 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 529/1054] 10.222.0.59 () {56 vars in 1096 bytes} [Thu Jun 2 15:47:25 2022] GET /identity/v3/roles/admin => generated 83 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 15:47:25.615879 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-533ac889-b1fa-4357-b5c6-14b7004263b3 None None] Authenticating user token {{(pid=80396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:47:25.716147 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG dbcounter [-] [80396] Writing DB stats keystone:SELECT=100 {{(pid=80396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:47:25.722412 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-533ac889-b1fa-4357-b5c6-14b7004263b3 None None] Validating token access rules against request {{(pid=80396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:47:25.756378 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c28d6ae0-34a3-4e06-adbd-feaddc54f9fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:47:25.757043 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28d6ae0-34a3-4e06-adbd-feaddc54f9fa None admin] REQUEST_METHOD: `GET` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:47:25.757320 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28d6ae0-34a3-4e06-adbd-feaddc54f9fa None admin] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:47:25.757603 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28d6ae0-34a3-4e06-adbd-feaddc54f9fa None admin] PATH_INFO: `/v3/roles` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:47:25.758368 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c28d6ae0-34a3-4e06-adbd-feaddc54f9fa None admin] RBAC: Adding query filter params (name=admin) {{(pid=80396) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 15:47:25.758671 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c28d6ae0-34a3-4e06-adbd-feaddc54f9fa None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:47:25.760032 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c28d6ae0-34a3-4e06-adbd-feaddc54f9fa None admin] RBAC: Authorization granted {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:47:25.774027 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 526/1055] 10.222.0.59 () {56 vars in 1099 bytes} [Thu Jun 2 15:47:25 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 15:47:25.775396 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89b9786d-ff32-4afd-b0f2-3979641ac1d8 None admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:47:25.845013 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writing DB stats keystone:SELECT=100 {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:47:25.877649 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89b9786d-ff32-4afd-b0f2-3979641ac1d8 None admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:47:25.912758 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fa94722-ca75-4b82-9674-d46dd81b4133 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:47:25.913619 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa94722-ca75-4b82-9674-d46dd81b4133 None admin] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:47:25.913899 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa94722-ca75-4b82-9674-d46dd81b4133 None admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:47:25.914196 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa94722-ca75-4b82-9674-d46dd81b4133 None admin] PATH_INFO: `/v3/users/fd79eab3f3284ce1852411d8103c8e7f` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:47:25.927612 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fa94722-ca75-4b82-9674-d46dd81b4133 None admin] RBAC: Authorizing `identity:get_user(user_id=fd79eab3f3284ce1852411d8103c8e7f)` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:47:25.929054 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fa94722-ca75-4b82-9674-d46dd81b4133 None admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:47:25.931036 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 530/1056] 10.222.0.59 () {56 vars in 1177 bytes} [Thu Jun 2 15:47:25 2022] GET /identity/v3/users/fd79eab3f3284ce1852411d8103c8e7f => generated 285 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 15:47:25.936433 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c28d6ae0-34a3-4e06-adbd-feaddc54f9fa None admin] Authenticating user token {{(pid=80396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:47:26.037854 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c28d6ae0-34a3-4e06-adbd-feaddc54f9fa None admin] Validating token access rules against request {{(pid=80396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:47:26.070835 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50bf450c-8722-4ca1-ad95-305b334815ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:47:26.071481 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50bf450c-8722-4ca1-ad95-305b334815ea None admin] REQUEST_METHOD: `GET` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:47:26.071761 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50bf450c-8722-4ca1-ad95-305b334815ea None admin] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:47:26.072033 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50bf450c-8722-4ca1-ad95-305b334815ea None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:47:26.099610 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG dbcounter [-] [80396] Writing DB stats keystone:SELECT=100 {{(pid=80396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:47:26.141192 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50bf450c-8722-4ca1-ad95-305b334815ea None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:47:26.142662 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50bf450c-8722-4ca1-ad95-305b334815ea None admin] RBAC: Authorization granted {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:47:26.250576 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 527/1057] 10.222.0.59 () {58 vars in 1282 bytes} [Thu Jun 2 15:47:25 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 02 15:47:26.257318 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fa94722-ca75-4b82-9674-d46dd81b4133 None admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:47:26.362420 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fa94722-ca75-4b82-9674-d46dd81b4133 None admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:47:26.387858 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writing DB stats keystone:SELECT=100 {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:47:26.397348 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-420e2ab7-1e16-4b44-943a-540d1fa0a770 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:47:26.398229 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-420e2ab7-1e16-4b44-943a-540d1fa0a770 None admin] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:47:26.398511 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-420e2ab7-1e16-4b44-943a-540d1fa0a770 None admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:47:26.403778 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-420e2ab7-1e16-4b44-943a-540d1fa0a770 None admin] PATH_INFO: `/v3/projects/b493ca0feff84e37813d3a36919b8b4f` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:47:26.403778 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-420e2ab7-1e16-4b44-943a-540d1fa0a770 None admin] RBAC: Authorizing `identity:get_project(project_id=b493ca0feff84e37813d3a36919b8b4f)` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:47:26.403778 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-420e2ab7-1e16-4b44-943a-540d1fa0a770 None admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:47:26.408030 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 531/1058] 10.222.0.59 () {56 vars in 1186 bytes} [Thu Jun 2 15:47:26 2022] GET /identity/v3/projects/b493ca0feff84e37813d3a36919b8b4f => generated 311 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 15:47:26.409453 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50bf450c-8722-4ca1-ad95-305b334815ea None admin] Authenticating user token {{(pid=80396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:47:26.473491 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG dbcounter [-] [80396] Writing DB stats keystone:SELECT=100 {{(pid=80396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:47:26.517344 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50bf450c-8722-4ca1-ad95-305b334815ea None admin] Validating token access rules against request {{(pid=80396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:47:26.551997 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d692be3d-ab0a-402d-956e-987a6f883ce4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:47:26.552678 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d692be3d-ab0a-402d-956e-987a6f883ce4 None admin] REQUEST_METHOD: `GET` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:47:26.552964 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d692be3d-ab0a-402d-956e-987a6f883ce4 None admin] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:47:26.553246 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d692be3d-ab0a-402d-956e-987a6f883ce4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:47:26.554126 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d692be3d-ab0a-402d-956e-987a6f883ce4 None admin] RBAC: Adding query filter params (role.id=f1e0c25f6e9049e897cb7350c7e54ab3, scope.project.id=b493ca0feff84e37813d3a36919b8b4f, user.id=fd79eab3f3284ce1852411d8103c8e7f) {{(pid=80396) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 15:47:26.554446 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d692be3d-ab0a-402d-956e-987a6f883ce4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:47:26.555909 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d692be3d-ab0a-402d-956e-987a6f883ce4 None admin] RBAC: Authorization granted {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:47:26.570118 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 528/1059] 10.222.0.59 () {56 vars in 1374 bytes} [Thu Jun 2 15:47:26 2022] GET /identity/v3/role_assignments?user.id=fd79eab3f3284ce1852411d8103c8e7f&scope.project.id=b493ca0feff84e37813d3a36919b8b4f&role.id=f1e0c25f6e9049e897cb7350c7e54ab3 => generated 259 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 15:47:27.562092 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b85ff5f-c1f9-48a4-b8eb-736dc94aa91c None None] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:47:27.562616 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b85ff5f-c1f9-48a4-b8eb-736dc94aa91c None None] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:47:27.562616 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b85ff5f-c1f9-48a4-b8eb-736dc94aa91c None None] PATH_INFO: `/` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:47:27.563966 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 532/1060] 10.222.0.59 () {54 vars in 926 bytes} [Thu Jun 2 15:47:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 15:47:27.569630 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d9cb7cf-7dc4-4626-8077-2af581639b40 None None] REQUEST_METHOD: `POST` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:47:27.570052 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d9cb7cf-7dc4-4626-8077-2af581639b40 None None] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:47:27.570252 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d9cb7cf-7dc4-4626-8077-2af581639b40 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:47:27.587164 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.auth.core [None req-1d9cb7cf-7dc4-4626-8077-2af581639b40 None None] MFA Rules not processed for user `400d1f4db9de49638549e5db29a041e1`. Rule list: `[]` (Enabled: `True`). {{(pid=80396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 15:47:27.588346 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.fernet_utils [None req-1d9cb7cf-7dc4-4626-8077-2af581639b40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 15:47:27.655340 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 529/1061] 10.222.0.59 () {58 vars in 1023 bytes} [Thu Jun 2 15:47:27 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 02 15:47:27.678390 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b85ff5f-c1f9-48a4-b8eb-736dc94aa91c None None] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:47:27.693196 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f4b9a59-2211-4b27-8594-c146faa3cc12 None None] REQUEST_METHOD: `GET` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:47:27.693493 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f4b9a59-2211-4b27-8594-c146faa3cc12 None None] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:47:27.693769 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f4b9a59-2211-4b27-8594-c146faa3cc12 None None] PATH_INFO: `/` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:47:27.695201 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 530/1062] 10.222.0.59 () {54 vars in 926 bytes} [Thu Jun 2 15:47:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 15:47:27.700029 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cce5c20-c225-4c22-a3e0-d2fc6169f6c7 None None] REQUEST_METHOD: `POST` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:47:27.700315 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cce5c20-c225-4c22-a3e0-d2fc6169f6c7 None None] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:47:27.700592 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cce5c20-c225-4c22-a3e0-d2fc6169f6c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:47:27.718767 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.auth.core [None req-5cce5c20-c225-4c22-a3e0-d2fc6169f6c7 None None] MFA Rules not processed for user `400d1f4db9de49638549e5db29a041e1`. Rule list: `[]` (Enabled: `True`). {{(pid=80396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 15:47:27.719939 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.fernet_utils [None req-5cce5c20-c225-4c22-a3e0-d2fc6169f6c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 15:47:27.775379 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG dbcounter [-] [80396] Writing DB stats keystone:SELECT=100 {{(pid=80396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:47:27.790529 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b85ff5f-c1f9-48a4-b8eb-736dc94aa91c None None] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:47:27.796069 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 531/1063] 10.222.0.59 () {58 vars in 1023 bytes} [Thu Jun 2 15:47:27 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 02 15:47:27.818881 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cce5c20-c225-4c22-a3e0-d2fc6169f6c7 None None] Authenticating user token {{(pid=80396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:47:27.827078 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a56bb72-a2ad-4a27-84b3-3a95328a408e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:47:27.827893 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a56bb72-a2ad-4a27-84b3-3a95328a408e None admin] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:47:27.828175 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a56bb72-a2ad-4a27-84b3-3a95328a408e None admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:47:27.828444 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a56bb72-a2ad-4a27-84b3-3a95328a408e None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:47:27.839980 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a56bb72-a2ad-4a27-84b3-3a95328a408e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 02 15:47:27.848462 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application [None req-2a56bb72-a2ad-4a27-84b3-3a95328a408e None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 02 15:47:27.848462 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 15:47:27.848462 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 15:47:27.848462 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 15:47:27.848462 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 15:47:27.848462 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 15:47:27.848462 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 15:47:27.848462 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 15:47:27.848462 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 15:47:27.848462 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 15:47:27.848462 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 15:47:27.848462 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 15:47:27.848462 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 02 15:47:27.848462 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 02 15:47:27.848462 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 02 15:47:27.848462 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 02 15:47:27.849498 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 02 15:47:27.849498 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 02 15:47:27.849498 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 02 15:47:27.849498 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 02 15:47:27.849498 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 15:47:27.849498 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 15:47:27.849498 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 15:47:27.849498 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 15:47:27.849498 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 15:47:27.849498 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 15:47:27.849498 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 15:47:27.849498 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application with Lock( Jun 02 15:47:27.849498 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 15:47:27.849498 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self._enter() Jun 02 15:47:27.849498 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 15:47:27.849498 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 15:47:27.850382 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 15:47:27.850382 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self.creator() Jun 02 15:47:27.850382 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 15:47:27.850382 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application created_value = creator( Jun 02 15:47:27.850382 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 02 15:47:27.850382 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 02 15:47:27.850382 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 02 15:47:27.850382 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 02 15:47:27.850382 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 02 15:47:27.850382 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 02 15:47:27.850382 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 02 15:47:27.850382 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application Jun 02 15:47:27.850382 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 533/1064] 10.222.0.59 () {56 vars in 1120 bytes} [Thu Jun 2 15:47:27 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 15:47:27.855490 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a56bb72-a2ad-4a27-84b3-3a95328a408e None admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:47:27.912510 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writing DB stats keystone:SELECT=100 {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:47:27.928950 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cce5c20-c225-4c22-a3e0-d2fc6169f6c7 None None] Validating token access rules against request {{(pid=80396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:47:27.961136 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a56bb72-a2ad-4a27-84b3-3a95328a408e None admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:47:27.965683 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c966f66e-b9da-40ae-b7a7-eed12a7862ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:47:27.966366 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c966f66e-b9da-40ae-b7a7-eed12a7862ac None admin] REQUEST_METHOD: `GET` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:47:27.966652 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c966f66e-b9da-40ae-b7a7-eed12a7862ac None admin] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:47:27.966929 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c966f66e-b9da-40ae-b7a7-eed12a7862ac None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:47:28.005154 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-118e9b1d-1731-4ca3-95b2-cb310ad6ef3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:47:28.005822 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-118e9b1d-1731-4ca3-95b2-cb310ad6ef3a None admin] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:47:28.006134 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-118e9b1d-1731-4ca3-95b2-cb310ad6ef3a None admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:47:28.006428 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-118e9b1d-1731-4ca3-95b2-cb310ad6ef3a None admin] PATH_INFO: `/v3/roles` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:47:28.007754 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-118e9b1d-1731-4ca3-95b2-cb310ad6ef3a None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80395) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 15:47:28.007754 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-118e9b1d-1731-4ca3-95b2-cb310ad6ef3a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:47:28.008805 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-118e9b1d-1731-4ca3-95b2-cb310ad6ef3a None admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:47:28.017797 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 534/1065] 10.222.0.59 () {56 vars in 1115 bytes} [Thu Jun 2 15:47:27 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 15:47:28.023060 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG dbcounter [-] [80396] Writing DB stats keystone:SELECT=100 {{(pid=80396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:47:28.023529 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-118e9b1d-1731-4ca3-95b2-cb310ad6ef3a None admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:47:28.042582 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c966f66e-b9da-40ae-b7a7-eed12a7862ac None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:47:28.044048 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c966f66e-b9da-40ae-b7a7-eed12a7862ac None admin] RBAC: Authorization granted {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:47:28.136415 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-118e9b1d-1731-4ca3-95b2-cb310ad6ef3a None admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:47:28.149172 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 532/1066] 10.222.0.59 () {58 vars in 1282 bytes} [Thu Jun 2 15:47:27 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 331 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 02 15:47:28.155011 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c966f66e-b9da-40ae-b7a7-eed12a7862ac None admin] Authenticating user token {{(pid=80396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:47:28.157762 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writing DB stats keystone:SELECT=100 {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:47:28.181364 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70b7aa14-7286-4fa2-8959-8b6ba7f5caa5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:47:28.182189 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b7aa14-7286-4fa2-8959-8b6ba7f5caa5 None admin] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:47:28.182474 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b7aa14-7286-4fa2-8959-8b6ba7f5caa5 None admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:47:28.182895 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b7aa14-7286-4fa2-8959-8b6ba7f5caa5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:47:28.197765 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70b7aa14-7286-4fa2-8959-8b6ba7f5caa5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:47:28.199261 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70b7aa14-7286-4fa2-8959-8b6ba7f5caa5 None admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:47:28.218139 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application [None req-70b7aa14-7286-4fa2-8959-8b6ba7f5caa5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 15:47:28.218139 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 15:47:28.218139 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 15:47:28.218139 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 15:47:28.218139 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 15:47:28.218139 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 15:47:28.218139 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 15:47:28.218139 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 15:47:28.218139 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 15:47:28.218139 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 15:47:28.218139 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 15:47:28.218139 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 15:47:28.218139 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 02 15:47:28.218139 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 02 15:47:28.218139 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 02 15:47:28.219082 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 02 15:47:28.219082 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 15:47:28.219082 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 15:47:28.219082 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 15:47:28.219082 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 15:47:28.219082 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 15:47:28.219082 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 15:47:28.219082 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 15:47:28.219082 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application with Lock( Jun 02 15:47:28.219082 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 15:47:28.219082 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self._enter() Jun 02 15:47:28.219082 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 15:47:28.219082 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 15:47:28.219082 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 15:47:28.219082 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self.creator() Jun 02 15:47:28.219082 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 15:47:28.219082 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application created_value = creator( Jun 02 15:47:28.219971 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 02 15:47:28.219971 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 02 15:47:28.219971 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 15:47:28.219971 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application Jun 02 15:47:28.219971 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 535/1067] 10.222.0.59 () {56 vars in 1108 bytes} [Thu Jun 2 15:47:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 02 15:47:28.225715 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70b7aa14-7286-4fa2-8959-8b6ba7f5caa5 None admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:47:28.249286 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG dbcounter [-] [80396] Writing DB stats keystone:SELECT=100 {{(pid=80396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:47:28.267301 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c966f66e-b9da-40ae-b7a7-eed12a7862ac None admin] Validating token access rules against request {{(pid=80396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:47:28.307014 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-987bffa4-b038-444a-b417-80b97d9d5a77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:47:28.307801 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-987bffa4-b038-444a-b417-80b97d9d5a77 None admin] REQUEST_METHOD: `GET` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:47:28.308082 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-987bffa4-b038-444a-b417-80b97d9d5a77 None admin] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:47:28.308358 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-987bffa4-b038-444a-b417-80b97d9d5a77 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:47:28.319431 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-987bffa4-b038-444a-b417-80b97d9d5a77 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:47:28.320870 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-987bffa4-b038-444a-b417-80b97d9d5a77 None admin] RBAC: Authorization granted {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:47:28.333295 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70b7aa14-7286-4fa2-8959-8b6ba7f5caa5 None admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:47:28.339732 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application [None req-987bffa4-b038-444a-b417-80b97d9d5a77 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 15:47:28.339732 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 15:47:28.339732 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 15:47:28.339732 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 15:47:28.339732 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 15:47:28.339732 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 15:47:28.339732 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 15:47:28.339732 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 15:47:28.339732 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 15:47:28.339732 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 15:47:28.339732 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 15:47:28.339732 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 15:47:28.339732 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 02 15:47:28.339732 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 02 15:47:28.339732 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 02 15:47:28.340624 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 02 15:47:28.340624 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 15:47:28.340624 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 15:47:28.340624 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 15:47:28.340624 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 15:47:28.340624 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 15:47:28.340624 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 15:47:28.340624 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 15:47:28.340624 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application with Lock( Jun 02 15:47:28.340624 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 15:47:28.340624 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application return self._enter() Jun 02 15:47:28.340624 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 15:47:28.340624 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 15:47:28.340624 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 15:47:28.340624 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application return self.creator() Jun 02 15:47:28.340624 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 15:47:28.340624 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application created_value = creator( Jun 02 15:47:28.341522 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 02 15:47:28.341522 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 02 15:47:28.341522 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 15:47:28.341522 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application Jun 02 15:47:28.341522 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 533/1068] 10.222.0.59 () {56 vars in 1108 bytes} [Thu Jun 2 15:47:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 02 15:47:28.347680 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-987bffa4-b038-444a-b417-80b97d9d5a77 None admin] Authenticating user token {{(pid=80396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:47:28.372081 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72de89bd-bffd-4573-a686-a80844ff9cd6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:47:28.372746 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72de89bd-bffd-4573-a686-a80844ff9cd6 None admin] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:47:28.373047 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72de89bd-bffd-4573-a686-a80844ff9cd6 None admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:47:28.373541 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72de89bd-bffd-4573-a686-a80844ff9cd6 None admin] PATH_INFO: `/v3/domains` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:47:28.374192 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72de89bd-bffd-4573-a686-a80844ff9cd6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80395) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 15:47:28.374500 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72de89bd-bffd-4573-a686-a80844ff9cd6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:47:28.375966 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72de89bd-bffd-4573-a686-a80844ff9cd6 None admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:47:28.389269 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 536/1069] 10.222.0.59 () {56 vars in 1109 bytes} [Thu Jun 2 15:47:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 15:47:28.395102 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72de89bd-bffd-4573-a686-a80844ff9cd6 None admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:47:28.426490 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writing DB stats keystone:SELECT=100 {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:47:28.456748 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-987bffa4-b038-444a-b417-80b97d9d5a77 None admin] Validating token access rules against request {{(pid=80396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:47:28.496208 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49617739-cd5a-4f7e-b854-fdfe68e851c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:47:28.496877 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49617739-cd5a-4f7e-b854-fdfe68e851c8 None admin] REQUEST_METHOD: `GET` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:47:28.497161 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49617739-cd5a-4f7e-b854-fdfe68e851c8 None admin] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:47:28.497434 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49617739-cd5a-4f7e-b854-fdfe68e851c8 None admin] PATH_INFO: `/v3/domains` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:47:28.498195 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49617739-cd5a-4f7e-b854-fdfe68e851c8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80396) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 15:47:28.498506 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49617739-cd5a-4f7e-b854-fdfe68e851c8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:47:28.499886 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49617739-cd5a-4f7e-b854-fdfe68e851c8 None admin] RBAC: Authorization granted {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:47:28.501404 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG dbcounter [-] [80396] Writing DB stats keystone:SELECT=100 {{(pid=80396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:47:28.509535 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72de89bd-bffd-4573-a686-a80844ff9cd6 None admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:47:28.513585 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 534/1070] 10.222.0.59 () {56 vars in 1109 bytes} [Thu Jun 2 15:47:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 15:47:28.550461 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98600b44-f37f-4ddc-9874-1ab4b11604ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:47:28.551282 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98600b44-f37f-4ddc-9874-1ab4b11604ef None admin] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:47:28.551565 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98600b44-f37f-4ddc-9874-1ab4b11604ef None admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:47:28.551839 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98600b44-f37f-4ddc-9874-1ab4b11604ef None admin] PATH_INFO: `/v3/users/nova` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:47:28.560360 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98600b44-f37f-4ddc-9874-1ab4b11604ef None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:47:28.561844 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98600b44-f37f-4ddc-9874-1ab4b11604ef None admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:47:28.578600 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application [None req-98600b44-f37f-4ddc-9874-1ab4b11604ef None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 02 15:47:28.578600 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 15:47:28.578600 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 15:47:28.578600 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 15:47:28.578600 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 15:47:28.578600 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 15:47:28.578600 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 15:47:28.578600 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 15:47:28.578600 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 15:47:28.578600 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 15:47:28.578600 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 15:47:28.578600 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 15:47:28.578600 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 02 15:47:28.578600 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 02 15:47:28.578600 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 02 15:47:28.578600 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 02 15:47:28.580588 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 15:47:28.580588 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 15:47:28.580588 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 02 15:47:28.580588 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 02 15:47:28.580588 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 02 15:47:28.580588 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 02 15:47:28.580588 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 15:47:28.580588 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 15:47:28.580588 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 15:47:28.580588 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 15:47:28.580588 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 15:47:28.580588 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application with Lock( Jun 02 15:47:28.580588 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 15:47:28.580588 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self._enter() Jun 02 15:47:28.580588 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 15:47:28.580588 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 15:47:28.580588 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 15:47:28.580588 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self.creator() Jun 02 15:47:28.582946 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 15:47:28.582946 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application created_value = creator( Jun 02 15:47:28.582946 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 02 15:47:28.582946 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 02 15:47:28.582946 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 02 15:47:28.582946 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 02 15:47:28.582946 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 02 15:47:28.582946 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 02 15:47:28.582946 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 02 15:47:28.582946 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application Jun 02 15:47:28.585553 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 537/1071] 10.222.0.59 () {56 vars in 1093 bytes} [Thu Jun 2 15:47:28 2022] GET /identity/v3/users/nova => generated 82 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 02 15:47:28.587172 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49617739-cd5a-4f7e-b854-fdfe68e851c8 None admin] Authenticating user token {{(pid=80396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:47:28.701702 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49617739-cd5a-4f7e-b854-fdfe68e851c8 None admin] Validating token access rules against request {{(pid=80396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:47:28.742665 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fafb025-703c-4196-b06d-b35b08298945 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:47:28.743335 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fafb025-703c-4196-b06d-b35b08298945 None admin] REQUEST_METHOD: `GET` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:47:28.743617 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fafb025-703c-4196-b06d-b35b08298945 None admin] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:47:28.743890 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fafb025-703c-4196-b06d-b35b08298945 None admin] PATH_INFO: `/v3/users` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:47:28.744730 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fafb025-703c-4196-b06d-b35b08298945 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80396) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 15:47:28.745036 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fafb025-703c-4196-b06d-b35b08298945 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:47:28.746536 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fafb025-703c-4196-b06d-b35b08298945 None admin] RBAC: Authorization granted {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:47:28.765218 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 535/1072] 10.222.0.59 () {56 vars in 1133 bytes} [Thu Jun 2 15:47:28 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 15:47:28.770572 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98600b44-f37f-4ddc-9874-1ab4b11604ef None admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:47:28.802432 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d0d900-9aa6-484e-94be-09ef49ec2b95 None None] REQUEST_METHOD: `GET` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:47:28.802730 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d0d900-9aa6-484e-94be-09ef49ec2b95 None None] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:47:28.802985 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d0d900-9aa6-484e-94be-09ef49ec2b95 None None] PATH_INFO: `/` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:47:28.804472 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 536/1073] 10.222.0.59 () {54 vars in 926 bytes} [Thu Jun 2 15:47:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 02 15:47:28.809466 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05738f59-b27e-49c3-9e6e-67e995d6855d None None] REQUEST_METHOD: `POST` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:47:28.809748 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05738f59-b27e-49c3-9e6e-67e995d6855d None None] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:47:28.810013 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05738f59-b27e-49c3-9e6e-67e995d6855d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:47:28.827386 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.auth.core [None req-05738f59-b27e-49c3-9e6e-67e995d6855d None None] MFA Rules not processed for user `400d1f4db9de49638549e5db29a041e1`. Rule list: `[]` (Enabled: `True`). {{(pid=80396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 15:47:28.828565 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.fernet_utils [None req-05738f59-b27e-49c3-9e6e-67e995d6855d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 15:47:28.872922 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writing DB stats keystone:SELECT=100 {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:47:28.879923 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG dbcounter [-] [80396] Writing DB stats keystone:SELECT=100 {{(pid=80396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:47:28.885028 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98600b44-f37f-4ddc-9874-1ab4b11604ef None admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:47:28.899391 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 537/1074] 10.222.0.59 () {58 vars in 1023 bytes} [Thu Jun 2 15:47:28 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 02 15:47:28.919799 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84035b50-32cb-4730-9e99-20a7e30ee5da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:47:28.920593 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84035b50-32cb-4730-9e99-20a7e30ee5da None admin] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:47:28.920882 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84035b50-32cb-4730-9e99-20a7e30ee5da None admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:47:28.921183 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84035b50-32cb-4730-9e99-20a7e30ee5da None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:47:28.922376 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05738f59-b27e-49c3-9e6e-67e995d6855d None None] Authenticating user token {{(pid=80396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:47:28.932800 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84035b50-32cb-4730-9e99-20a7e30ee5da None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:47:28.934281 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84035b50-32cb-4730-9e99-20a7e30ee5da None admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:47:28.951838 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application [None req-84035b50-32cb-4730-9e99-20a7e30ee5da None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 15:47:28.951838 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 15:47:28.951838 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 15:47:28.951838 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 15:47:28.951838 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 15:47:28.951838 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 15:47:28.951838 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 15:47:28.951838 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 15:47:28.951838 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 15:47:28.951838 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 15:47:28.951838 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 15:47:28.951838 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 15:47:28.951838 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 02 15:47:28.951838 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 02 15:47:28.951838 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 02 15:47:28.952818 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 02 15:47:28.952818 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 15:47:28.952818 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 15:47:28.952818 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 15:47:28.952818 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 15:47:28.952818 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 15:47:28.952818 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 15:47:28.952818 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 15:47:28.952818 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application with Lock( Jun 02 15:47:28.952818 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 15:47:28.952818 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self._enter() Jun 02 15:47:28.952818 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 15:47:28.952818 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 15:47:28.952818 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 15:47:28.952818 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self.creator() Jun 02 15:47:28.952818 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 15:47:28.952818 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application created_value = creator( Jun 02 15:47:28.953707 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 02 15:47:28.953707 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 02 15:47:28.953707 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 15:47:28.953707 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application Jun 02 15:47:28.953707 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 538/1075] 10.222.0.59 () {56 vars in 1108 bytes} [Thu Jun 2 15:47:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 15:47:28.958736 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84035b50-32cb-4730-9e99-20a7e30ee5da None admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:47:29.022830 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05738f59-b27e-49c3-9e6e-67e995d6855d None None] Validating token access rules against request {{(pid=80396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:47:29.055587 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbec3a71-5a37-4ceb-982e-368a4a9a95c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:47:29.056365 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbec3a71-5a37-4ceb-982e-368a4a9a95c0 None admin] REQUEST_METHOD: `GET` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:47:29.056648 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbec3a71-5a37-4ceb-982e-368a4a9a95c0 None admin] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:47:29.056921 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbec3a71-5a37-4ceb-982e-368a4a9a95c0 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:47:29.058203 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84035b50-32cb-4730-9e99-20a7e30ee5da None admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:47:29.067695 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbec3a71-5a37-4ceb-982e-368a4a9a95c0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 02 15:47:29.075303 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application [None req-cbec3a71-5a37-4ceb-982e-368a4a9a95c0 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 02 15:47:29.075303 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 15:47:29.075303 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 15:47:29.075303 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 15:47:29.075303 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 15:47:29.075303 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 15:47:29.075303 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 15:47:29.075303 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 15:47:29.075303 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 15:47:29.075303 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 15:47:29.075303 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 15:47:29.075303 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 15:47:29.075303 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 02 15:47:29.075303 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 02 15:47:29.075303 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 02 15:47:29.075303 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 02 15:47:29.076247 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 02 15:47:29.076247 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 02 15:47:29.076247 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 02 15:47:29.076247 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 02 15:47:29.076247 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 15:47:29.076247 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 15:47:29.076247 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 15:47:29.076247 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 15:47:29.076247 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 15:47:29.076247 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 15:47:29.076247 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 15:47:29.076247 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application with Lock( Jun 02 15:47:29.076247 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 15:47:29.076247 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application return self._enter() Jun 02 15:47:29.076247 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 15:47:29.076247 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 15:47:29.077095 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 15:47:29.077095 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application return self.creator() Jun 02 15:47:29.077095 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 15:47:29.077095 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application created_value = creator( Jun 02 15:47:29.077095 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 02 15:47:29.077095 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 02 15:47:29.077095 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 02 15:47:29.077095 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 02 15:47:29.077095 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 02 15:47:29.077095 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 02 15:47:29.077095 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 02 15:47:29.077095 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application Jun 02 15:47:29.077095 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 538/1076] 10.222.0.59 () {56 vars in 1096 bytes} [Thu Jun 2 15:47:28 2022] GET /identity/v3/roles/admin => generated 83 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 02 15:47:29.083019 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbec3a71-5a37-4ceb-982e-368a4a9a95c0 None admin] Authenticating user token {{(pid=80396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:47:29.099590 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-067eb0b6-1e04-40e3-a88c-8f90c0d8aae8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:47:29.100252 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-067eb0b6-1e04-40e3-a88c-8f90c0d8aae8 None admin] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:47:29.100533 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-067eb0b6-1e04-40e3-a88c-8f90c0d8aae8 None admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:47:29.100807 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-067eb0b6-1e04-40e3-a88c-8f90c0d8aae8 None admin] PATH_INFO: `/v3/domains` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:47:29.101528 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-067eb0b6-1e04-40e3-a88c-8f90c0d8aae8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80395) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 15:47:29.101822 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-067eb0b6-1e04-40e3-a88c-8f90c0d8aae8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:47:29.103227 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-067eb0b6-1e04-40e3-a88c-8f90c0d8aae8 None admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:47:29.111820 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writing DB stats keystone:SELECT=100 {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:47:29.115492 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 539/1077] 10.222.0.59 () {56 vars in 1109 bytes} [Thu Jun 2 15:47:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 15:47:29.120910 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-067eb0b6-1e04-40e3-a88c-8f90c0d8aae8 None admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:47:29.127745 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG dbcounter [-] [80396] Writing DB stats keystone:SELECT=100 {{(pid=80396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:47:29.183812 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbec3a71-5a37-4ceb-982e-368a4a9a95c0 None admin] Validating token access rules against request {{(pid=80396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:47:29.218024 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f81a40f2-3949-436d-9666-0c68cb8edaa5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:47:29.218649 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81a40f2-3949-436d-9666-0c68cb8edaa5 None admin] REQUEST_METHOD: `GET` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:47:29.218935 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81a40f2-3949-436d-9666-0c68cb8edaa5 None admin] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:47:29.219213 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81a40f2-3949-436d-9666-0c68cb8edaa5 None admin] PATH_INFO: `/v3/roles` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:47:29.219957 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f81a40f2-3949-436d-9666-0c68cb8edaa5 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80396) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 15:47:29.220265 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f81a40f2-3949-436d-9666-0c68cb8edaa5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:47:29.222327 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f81a40f2-3949-436d-9666-0c68cb8edaa5 None admin] RBAC: Authorization granted {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:47:29.225255 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-067eb0b6-1e04-40e3-a88c-8f90c0d8aae8 None admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:47:29.230337 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 539/1078] 10.222.0.59 () {56 vars in 1099 bytes} [Thu Jun 2 15:47:29 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 15:47:29.236171 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f81a40f2-3949-436d-9666-0c68cb8edaa5 None admin] Authenticating user token {{(pid=80396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:47:29.258608 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fe064f9-9f0a-4eee-90d9-529555850aa2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:47:29.259402 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe064f9-9f0a-4eee-90d9-529555850aa2 None admin] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:47:29.259691 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe064f9-9f0a-4eee-90d9-529555850aa2 None admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:47:29.259972 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe064f9-9f0a-4eee-90d9-529555850aa2 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:47:29.266546 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fe064f9-9f0a-4eee-90d9-529555850aa2 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:47:29.268536 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fe064f9-9f0a-4eee-90d9-529555850aa2 None admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:47:29.282416 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application [None req-0fe064f9-9f0a-4eee-90d9-529555850aa2 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 02 15:47:29.282416 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 15:47:29.282416 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 15:47:29.282416 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 15:47:29.282416 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 15:47:29.282416 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 15:47:29.282416 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 15:47:29.282416 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 15:47:29.282416 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 15:47:29.282416 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 15:47:29.282416 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 15:47:29.282416 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 15:47:29.282416 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 02 15:47:29.282416 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 02 15:47:29.282416 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 02 15:47:29.283581 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 02 15:47:29.283581 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 15:47:29.283581 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 15:47:29.283581 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 15:47:29.283581 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 15:47:29.283581 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 15:47:29.283581 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 15:47:29.283581 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 15:47:29.283581 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application with Lock( Jun 02 15:47:29.283581 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 15:47:29.283581 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self._enter() Jun 02 15:47:29.283581 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 15:47:29.283581 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 15:47:29.283581 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 15:47:29.283581 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self.creator() Jun 02 15:47:29.283581 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 15:47:29.283581 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application created_value = creator( Jun 02 15:47:29.284485 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 02 15:47:29.284485 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 02 15:47:29.284485 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 02 15:47:29.284485 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 02 15:47:29.284485 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 02 15:47:29.284485 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 02 15:47:29.284485 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 02 15:47:29.284485 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application Jun 02 15:47:29.284485 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 540/1079] 10.222.0.59 () {56 vars in 1111 bytes} [Thu Jun 2 15:47:29 2022] GET /identity/v3/projects/service => generated 88 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 02 15:47:29.289370 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fe064f9-9f0a-4eee-90d9-529555850aa2 None admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:47:29.334520 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f81a40f2-3949-436d-9666-0c68cb8edaa5 None admin] Validating token access rules against request {{(pid=80396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:47:29.337110 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG dbcounter [-] [80396] Writing DB stats keystone:SELECT=100 {{(pid=80396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:47:29.349187 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writing DB stats keystone:SELECT=100 {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:47:29.368686 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2ab4263-222b-46f5-8947-4e3c03c66be4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:47:29.369545 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ab4263-222b-46f5-8947-4e3c03c66be4 None admin] REQUEST_METHOD: `GET` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:47:29.369823 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ab4263-222b-46f5-8947-4e3c03c66be4 None admin] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:47:29.370122 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ab4263-222b-46f5-8947-4e3c03c66be4 None admin] PATH_INFO: `/v3/users/fd79eab3f3284ce1852411d8103c8e7f` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:47:29.371316 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2ab4263-222b-46f5-8947-4e3c03c66be4 None admin] RBAC: Authorizing `identity:get_user(user_id=fd79eab3f3284ce1852411d8103c8e7f)` {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:47:29.372743 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2ab4263-222b-46f5-8947-4e3c03c66be4 None admin] RBAC: Authorization granted {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:47:29.374586 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 540/1080] 10.222.0.59 () {56 vars in 1177 bytes} [Thu Jun 2 15:47:29 2022] GET /identity/v3/users/fd79eab3f3284ce1852411d8103c8e7f => generated 285 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 15:47:29.380123 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2ab4263-222b-46f5-8947-4e3c03c66be4 None admin] Authenticating user token {{(pid=80396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:47:29.389041 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fe064f9-9f0a-4eee-90d9-529555850aa2 None admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:47:29.425548 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f8f64b8-9f77-441a-bfbc-9e13dc1e215a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:47:29.427156 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8f64b8-9f77-441a-bfbc-9e13dc1e215a None admin] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:47:29.428069 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8f64b8-9f77-441a-bfbc-9e13dc1e215a None admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:47:29.428069 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8f64b8-9f77-441a-bfbc-9e13dc1e215a None admin] PATH_INFO: `/v3/projects` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:47:29.428602 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f8f64b8-9f77-441a-bfbc-9e13dc1e215a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80395) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 15:47:29.428922 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f8f64b8-9f77-441a-bfbc-9e13dc1e215a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:47:29.430388 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f8f64b8-9f77-441a-bfbc-9e13dc1e215a None admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:47:29.448019 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 541/1081] 10.222.0.59 () {56 vars in 1148 bytes} [Thu Jun 2 15:47:29 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 15:47:29.448941 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f8f64b8-9f77-441a-bfbc-9e13dc1e215a None admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:47:29.482507 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2ab4263-222b-46f5-8947-4e3c03c66be4 None admin] Validating token access rules against request {{(pid=80396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:47:29.515599 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ea399cb-8bf8-4844-936f-7970074970cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:47:29.516445 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea399cb-8bf8-4844-936f-7970074970cc None admin] REQUEST_METHOD: `GET` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:47:29.516720 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea399cb-8bf8-4844-936f-7970074970cc None admin] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:47:29.516987 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea399cb-8bf8-4844-936f-7970074970cc None admin] PATH_INFO: `/v3/projects/b493ca0feff84e37813d3a36919b8b4f` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:47:29.518788 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ea399cb-8bf8-4844-936f-7970074970cc None admin] RBAC: Authorizing `identity:get_project(project_id=b493ca0feff84e37813d3a36919b8b4f)` {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:47:29.520199 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ea399cb-8bf8-4844-936f-7970074970cc None admin] RBAC: Authorization granted {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:47:29.521874 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 541/1082] 10.222.0.59 () {56 vars in 1186 bytes} [Thu Jun 2 15:47:29 2022] GET /identity/v3/projects/b493ca0feff84e37813d3a36919b8b4f => generated 311 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 15:47:29.527567 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ea399cb-8bf8-4844-936f-7970074970cc None admin] Authenticating user token {{(pid=80396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:47:29.548017 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f8f64b8-9f77-441a-bfbc-9e13dc1e215a None admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:47:29.566933 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG dbcounter [-] [80396] Writing DB stats keystone:SELECT=100 {{(pid=80396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:47:29.567474 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writing DB stats keystone:SELECT=100 {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:47:29.581514 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17890377-99f2-4ba2-9957-6940b3a1e558 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:47:29.582478 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17890377-99f2-4ba2-9957-6940b3a1e558 None admin] REQUEST_METHOD: `PUT` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:47:29.582764 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17890377-99f2-4ba2-9957-6940b3a1e558 None admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:47:29.583045 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17890377-99f2-4ba2-9957-6940b3a1e558 None admin] PATH_INFO: `/v3/projects/9c87c981909d4b8db02783421818c79b/users/52f9fe4b13574516bb0a8e2aa11a61e8/roles/ce7c3f9097fa4b4aa3a7a1d7bef989be` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:47:29.585256 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17890377-99f2-4ba2-9957-6940b3a1e558 None admin] RBAC: Authorizing `identity:create_grant(project_id=9c87c981909d4b8db02783421818c79b, user_id=52f9fe4b13574516bb0a8e2aa11a61e8, role_id=ce7c3f9097fa4b4aa3a7a1d7bef989be)` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:47:29.587076 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17890377-99f2-4ba2-9957-6940b3a1e558 None admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:47:29.623038 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ea399cb-8bf8-4844-936f-7970074970cc None admin] Validating token access rules against request {{(pid=80396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:47:29.655655 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-768f483a-1381-43d9-8525-ae91f536e65a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:47:29.656526 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768f483a-1381-43d9-8525-ae91f536e65a None admin] REQUEST_METHOD: `PUT` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:47:29.656801 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768f483a-1381-43d9-8525-ae91f536e65a None admin] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:47:29.657065 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768f483a-1381-43d9-8525-ae91f536e65a None admin] PATH_INFO: `/v3/projects/b493ca0feff84e37813d3a36919b8b4f/users/fd79eab3f3284ce1852411d8103c8e7f/roles/f1e0c25f6e9049e897cb7350c7e54ab3` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:47:29.659552 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-768f483a-1381-43d9-8525-ae91f536e65a None admin] RBAC: Authorizing `identity:create_grant(project_id=b493ca0feff84e37813d3a36919b8b4f, user_id=fd79eab3f3284ce1852411d8103c8e7f, role_id=f1e0c25f6e9049e897cb7350c7e54ab3)` {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:47:29.660962 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-768f483a-1381-43d9-8525-ae91f536e65a None admin] RBAC: Authorization granted {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:47:29.665181 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 542/1083] 10.222.0.59 () {58 vars in 1439 bytes} [Thu Jun 2 15:47:29 2022] PUT /identity/v3/projects/9c87c981909d4b8db02783421818c79b/users/52f9fe4b13574516bb0a8e2aa11a61e8/roles/ce7c3f9097fa4b4aa3a7a1d7bef989be => generated 0 bytes in 216 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 02 15:47:29.777476 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 542/1084] 10.222.0.59 () {58 vars in 1439 bytes} [Thu Jun 2 15:47:29 2022] PUT /identity/v3/projects/b493ca0feff84e37813d3a36919b8b4f/users/fd79eab3f3284ce1852411d8103c8e7f/roles/f1e0c25f6e9049e897cb7350c7e54ab3 => generated 0 bytes in 250 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 02 15:47:31.913156 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f8eb65-f032-4bd6-a6da-71e9d7b31d25 None None] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:47:31.913714 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f8eb65-f032-4bd6-a6da-71e9d7b31d25 None None] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:47:31.913714 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f8eb65-f032-4bd6-a6da-71e9d7b31d25 None None] PATH_INFO: `/` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:47:31.915127 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 543/1085] 10.222.0.59 () {54 vars in 926 bytes} [Thu Jun 2 15:47:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 15:47:31.920268 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762331a8-7b5e-4fec-b721-53e3f7cc7586 None None] REQUEST_METHOD: `POST` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:47:31.920657 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762331a8-7b5e-4fec-b721-53e3f7cc7586 None None] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:47:31.920825 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762331a8-7b5e-4fec-b721-53e3f7cc7586 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:47:31.937895 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.auth.core [None req-762331a8-7b5e-4fec-b721-53e3f7cc7586 None None] MFA Rules not processed for user `400d1f4db9de49638549e5db29a041e1`. Rule list: `[]` (Enabled: `True`). {{(pid=80396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 15:47:31.939089 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.fernet_utils [None req-762331a8-7b5e-4fec-b721-53e3f7cc7586 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 15:47:32.004431 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 543/1086] 10.222.0.59 () {58 vars in 1023 bytes} [Thu Jun 2 15:47:31 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 02 15:47:32.027605 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29f8eb65-f032-4bd6-a6da-71e9d7b31d25 None None] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:47:32.042933 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdcfc147-8e8d-441e-87ad-056c1e88df48 None None] REQUEST_METHOD: `GET` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:47:32.043228 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdcfc147-8e8d-441e-87ad-056c1e88df48 None None] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:47:32.043507 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdcfc147-8e8d-441e-87ad-056c1e88df48 None None] PATH_INFO: `/` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:47:32.044880 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 544/1087] 10.222.0.59 () {54 vars in 926 bytes} [Thu Jun 2 15:47:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 02 15:47:32.050481 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb02053-c57f-4c1c-b26d-8309cae9f872 None None] REQUEST_METHOD: `POST` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:47:32.050767 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb02053-c57f-4c1c-b26d-8309cae9f872 None None] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:47:32.051042 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb02053-c57f-4c1c-b26d-8309cae9f872 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:47:32.067112 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.auth.core [None req-7fb02053-c57f-4c1c-b26d-8309cae9f872 None None] MFA Rules not processed for user `400d1f4db9de49638549e5db29a041e1`. Rule list: `[]` (Enabled: `True`). {{(pid=80396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 15:47:32.068279 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.fernet_utils [None req-7fb02053-c57f-4c1c-b26d-8309cae9f872 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 15:47:32.092215 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG dbcounter [-] [80396] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:47:32.129775 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29f8eb65-f032-4bd6-a6da-71e9d7b31d25 None None] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:47:32.134863 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 545/1088] 10.222.0.59 () {58 vars in 1023 bytes} [Thu Jun 2 15:47:32 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 02 15:47:32.158952 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fb02053-c57f-4c1c-b26d-8309cae9f872 None None] Authenticating user token {{(pid=80396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:47:32.163782 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7773e777-6e61-4cd6-a304-49d7e99c8785 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:47:32.164533 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7773e777-6e61-4cd6-a304-49d7e99c8785 None admin] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:47:32.164811 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7773e777-6e61-4cd6-a304-49d7e99c8785 None admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:47:32.165083 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7773e777-6e61-4cd6-a304-49d7e99c8785 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:47:32.180189 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7773e777-6e61-4cd6-a304-49d7e99c8785 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 02 15:47:32.193623 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application [None req-7773e777-6e61-4cd6-a304-49d7e99c8785 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 02 15:47:32.193623 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 15:47:32.193623 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 15:47:32.193623 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 15:47:32.193623 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 15:47:32.193623 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 15:47:32.193623 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 15:47:32.193623 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 15:47:32.193623 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 15:47:32.193623 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 15:47:32.193623 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 15:47:32.193623 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 15:47:32.193623 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 02 15:47:32.193623 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 02 15:47:32.193623 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 02 15:47:32.193623 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 02 15:47:32.194822 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 02 15:47:32.194822 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 02 15:47:32.194822 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 02 15:47:32.194822 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 02 15:47:32.194822 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 15:47:32.194822 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 15:47:32.194822 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 15:47:32.194822 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 15:47:32.194822 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 15:47:32.194822 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 15:47:32.194822 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 15:47:32.194822 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application with Lock( Jun 02 15:47:32.194822 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 15:47:32.194822 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self._enter() Jun 02 15:47:32.194822 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 15:47:32.194822 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 15:47:32.195879 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 15:47:32.195879 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self.creator() Jun 02 15:47:32.195879 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 15:47:32.195879 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application created_value = creator( Jun 02 15:47:32.195879 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 02 15:47:32.195879 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 02 15:47:32.195879 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 02 15:47:32.195879 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 02 15:47:32.195879 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 02 15:47:32.195879 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 02 15:47:32.195879 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 02 15:47:32.195879 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application Jun 02 15:47:32.195879 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 544/1089] 10.222.0.59 () {56 vars in 1120 bytes} [Thu Jun 2 15:47:32 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 15:47:32.200719 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7773e777-6e61-4cd6-a304-49d7e99c8785 None admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:47:32.243114 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:47:32.266162 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fb02053-c57f-4c1c-b26d-8309cae9f872 None None] Validating token access rules against request {{(pid=80396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:47:32.300826 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-518d7bca-9360-44d0-9bef-66eb80e4aea5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:47:32.301018 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7773e777-6e61-4cd6-a304-49d7e99c8785 None admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:47:32.301970 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-518d7bca-9360-44d0-9bef-66eb80e4aea5 None admin] REQUEST_METHOD: `GET` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:47:32.302288 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-518d7bca-9360-44d0-9bef-66eb80e4aea5 None admin] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:47:32.302571 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-518d7bca-9360-44d0-9bef-66eb80e4aea5 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:47:32.312643 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-518d7bca-9360-44d0-9bef-66eb80e4aea5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 02 15:47:32.320622 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application [None req-518d7bca-9360-44d0-9bef-66eb80e4aea5 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 02 15:47:32.320622 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 15:47:32.320622 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 15:47:32.320622 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 15:47:32.320622 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 15:47:32.320622 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 15:47:32.320622 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 15:47:32.320622 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 15:47:32.320622 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 15:47:32.320622 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 15:47:32.320622 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 15:47:32.320622 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 15:47:32.320622 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 02 15:47:32.320622 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 02 15:47:32.320622 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 02 15:47:32.320622 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 02 15:47:32.324001 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 02 15:47:32.324001 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 02 15:47:32.324001 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 02 15:47:32.324001 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 02 15:47:32.324001 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 15:47:32.324001 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 15:47:32.324001 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 15:47:32.324001 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 15:47:32.324001 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 15:47:32.324001 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 15:47:32.324001 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 15:47:32.324001 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application with Lock( Jun 02 15:47:32.324001 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 15:47:32.324001 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application return self._enter() Jun 02 15:47:32.324001 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 15:47:32.324001 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 15:47:32.325026 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 15:47:32.325026 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application return self.creator() Jun 02 15:47:32.325026 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 15:47:32.325026 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application created_value = creator( Jun 02 15:47:32.325026 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 02 15:47:32.325026 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 02 15:47:32.325026 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 02 15:47:32.325026 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 02 15:47:32.325026 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 02 15:47:32.325026 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 02 15:47:32.325026 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 02 15:47:32.325026 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application Jun 02 15:47:32.325026 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 546/1090] 10.222.0.59 () {56 vars in 1096 bytes} [Thu Jun 2 15:47:32 2022] GET /identity/v3/roles/admin => generated 83 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 02 15:47:32.327669 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-518d7bca-9360-44d0-9bef-66eb80e4aea5 None admin] Authenticating user token {{(pid=80396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:47:32.404902 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG dbcounter [-] [80396] Writing DB stats keystone:SELECT=100 {{(pid=80396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:47:32.419898 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b80e6a3-4d72-45ca-a279-25dd61645c29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:47:32.420612 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b80e6a3-4d72-45ca-a279-25dd61645c29 None admin] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:47:32.420883 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b80e6a3-4d72-45ca-a279-25dd61645c29 None admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:47:32.421160 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b80e6a3-4d72-45ca-a279-25dd61645c29 None admin] PATH_INFO: `/v3/roles` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:47:32.421908 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b80e6a3-4d72-45ca-a279-25dd61645c29 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80395) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 15:47:32.422251 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b80e6a3-4d72-45ca-a279-25dd61645c29 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:47:32.423634 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b80e6a3-4d72-45ca-a279-25dd61645c29 None admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:47:32.432499 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 545/1091] 10.222.0.59 () {56 vars in 1115 bytes} [Thu Jun 2 15:47:32 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 15:47:32.438063 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b80e6a3-4d72-45ca-a279-25dd61645c29 None admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:47:32.483761 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-518d7bca-9360-44d0-9bef-66eb80e4aea5 None admin] Validating token access rules against request {{(pid=80396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:47:32.518369 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2633007d-b02a-4979-9cd2-3b5d42a738cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:47:32.519017 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2633007d-b02a-4979-9cd2-3b5d42a738cf None admin] REQUEST_METHOD: `GET` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:47:32.519303 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2633007d-b02a-4979-9cd2-3b5d42a738cf None admin] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:47:32.519573 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2633007d-b02a-4979-9cd2-3b5d42a738cf None admin] PATH_INFO: `/v3/roles` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:47:32.520302 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2633007d-b02a-4979-9cd2-3b5d42a738cf None admin] RBAC: Adding query filter params (name=admin) {{(pid=80396) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 15:47:32.520601 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2633007d-b02a-4979-9cd2-3b5d42a738cf None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:47:32.521953 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2633007d-b02a-4979-9cd2-3b5d42a738cf None admin] RBAC: Authorization granted {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:47:32.529847 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 547/1092] 10.222.0.59 () {56 vars in 1099 bytes} [Thu Jun 2 15:47:32 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 15:47:32.536014 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2633007d-b02a-4979-9cd2-3b5d42a738cf None admin] Authenticating user token {{(pid=80396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:47:32.540865 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b80e6a3-4d72-45ca-a279-25dd61645c29 None admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:47:32.542420 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writing DB stats keystone:SELECT=100 {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:47:32.574401 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a71010c-0283-451f-bab7-fa722e2905a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:47:32.575282 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a71010c-0283-451f-bab7-fa722e2905a4 None admin] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:47:32.575561 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a71010c-0283-451f-bab7-fa722e2905a4 None admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:47:32.575828 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a71010c-0283-451f-bab7-fa722e2905a4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:47:32.586851 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a71010c-0283-451f-bab7-fa722e2905a4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:47:32.588272 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a71010c-0283-451f-bab7-fa722e2905a4 None admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:47:32.605373 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application [None req-0a71010c-0283-451f-bab7-fa722e2905a4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 15:47:32.605373 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 15:47:32.605373 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 15:47:32.605373 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 15:47:32.605373 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 15:47:32.605373 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 15:47:32.605373 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 15:47:32.605373 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 15:47:32.605373 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 15:47:32.605373 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 15:47:32.605373 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 15:47:32.605373 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 15:47:32.605373 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 02 15:47:32.605373 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 02 15:47:32.605373 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 02 15:47:32.606355 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 02 15:47:32.606355 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 15:47:32.606355 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 15:47:32.606355 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 15:47:32.606355 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 15:47:32.606355 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 15:47:32.606355 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 15:47:32.606355 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 15:47:32.606355 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application with Lock( Jun 02 15:47:32.606355 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 15:47:32.606355 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self._enter() Jun 02 15:47:32.606355 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 15:47:32.606355 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 15:47:32.606355 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 15:47:32.606355 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self.creator() Jun 02 15:47:32.606355 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 15:47:32.606355 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application created_value = creator( Jun 02 15:47:32.607277 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 02 15:47:32.607277 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 02 15:47:32.607277 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 15:47:32.607277 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application Jun 02 15:47:32.607277 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 546/1093] 10.222.0.59 () {56 vars in 1108 bytes} [Thu Jun 2 15:47:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 15:47:32.612853 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a71010c-0283-451f-bab7-fa722e2905a4 None admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:47:32.616903 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG dbcounter [-] [80396] Writing DB stats keystone:SELECT=100 {{(pid=80396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:47:32.635028 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2633007d-b02a-4979-9cd2-3b5d42a738cf None admin] Validating token access rules against request {{(pid=80396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:47:32.670340 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-935e23e7-2c91-4f95-bcdc-6d59aa1cfc2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:47:32.671128 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-935e23e7-2c91-4f95-bcdc-6d59aa1cfc2c None admin] REQUEST_METHOD: `GET` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:47:32.671413 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-935e23e7-2c91-4f95-bcdc-6d59aa1cfc2c None admin] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:47:32.671685 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-935e23e7-2c91-4f95-bcdc-6d59aa1cfc2c None admin] PATH_INFO: `/v3/users/fd79eab3f3284ce1852411d8103c8e7f` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:47:32.672861 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-935e23e7-2c91-4f95-bcdc-6d59aa1cfc2c None admin] RBAC: Authorizing `identity:get_user(user_id=fd79eab3f3284ce1852411d8103c8e7f)` {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:47:32.674856 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-935e23e7-2c91-4f95-bcdc-6d59aa1cfc2c None admin] RBAC: Authorization granted {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:47:32.676477 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 548/1094] 10.222.0.59 () {56 vars in 1177 bytes} [Thu Jun 2 15:47:32 2022] GET /identity/v3/users/fd79eab3f3284ce1852411d8103c8e7f => generated 285 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 15:47:32.682056 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-935e23e7-2c91-4f95-bcdc-6d59aa1cfc2c None admin] Authenticating user token {{(pid=80396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:47:32.713152 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a71010c-0283-451f-bab7-fa722e2905a4 None admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:47:32.749051 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77373318-15ae-4fb8-a9eb-593b29027ba4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:47:32.749706 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77373318-15ae-4fb8-a9eb-593b29027ba4 None admin] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:47:32.749994 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77373318-15ae-4fb8-a9eb-593b29027ba4 None admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:47:32.750306 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77373318-15ae-4fb8-a9eb-593b29027ba4 None admin] PATH_INFO: `/v3/domains` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:47:32.751029 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77373318-15ae-4fb8-a9eb-593b29027ba4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80395) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 15:47:32.751332 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77373318-15ae-4fb8-a9eb-593b29027ba4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:47:32.752874 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77373318-15ae-4fb8-a9eb-593b29027ba4 None admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:47:32.764363 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 547/1095] 10.222.0.59 () {56 vars in 1109 bytes} [Thu Jun 2 15:47:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 15:47:32.770238 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77373318-15ae-4fb8-a9eb-593b29027ba4 None admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:47:32.780267 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-935e23e7-2c91-4f95-bcdc-6d59aa1cfc2c None admin] Validating token access rules against request {{(pid=80396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:47:32.785650 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writing DB stats keystone:SELECT=100 {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:47:32.815880 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4a77ca2-bdf2-4f63-bcef-d5eb5bcd25e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:47:32.816525 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a77ca2-bdf2-4f63-bcef-d5eb5bcd25e8 None admin] REQUEST_METHOD: `GET` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:47:32.816842 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a77ca2-bdf2-4f63-bcef-d5eb5bcd25e8 None admin] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:47:32.817093 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a77ca2-bdf2-4f63-bcef-d5eb5bcd25e8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:47:32.835940 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG dbcounter [-] [80396] Writing DB stats keystone:SELECT=100 {{(pid=80396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:47:32.870310 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77373318-15ae-4fb8-a9eb-593b29027ba4 None admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:47:32.884003 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4a77ca2-bdf2-4f63-bcef-d5eb5bcd25e8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:47:32.885451 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4a77ca2-bdf2-4f63-bcef-d5eb5bcd25e8 None admin] RBAC: Authorization granted {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:47:32.903680 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82e4f24a-e287-4424-8ea1-b11ae5ca5908 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:47:32.904456 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e4f24a-e287-4424-8ea1-b11ae5ca5908 None admin] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:47:32.904739 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e4f24a-e287-4424-8ea1-b11ae5ca5908 None admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:47:32.905020 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e4f24a-e287-4424-8ea1-b11ae5ca5908 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:47:32.912679 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82e4f24a-e287-4424-8ea1-b11ae5ca5908 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:47:32.914150 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82e4f24a-e287-4424-8ea1-b11ae5ca5908 None admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:47:32.928489 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application [None req-82e4f24a-e287-4424-8ea1-b11ae5ca5908 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 02 15:47:32.928489 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 15:47:32.928489 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 15:47:32.928489 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 15:47:32.928489 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 15:47:32.928489 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 15:47:32.928489 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 15:47:32.928489 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 15:47:32.928489 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 15:47:32.928489 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 15:47:32.928489 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 15:47:32.928489 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 15:47:32.928489 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 02 15:47:32.928489 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 02 15:47:32.928489 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 02 15:47:32.928489 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 02 15:47:32.929414 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 15:47:32.929414 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 15:47:32.929414 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 02 15:47:32.929414 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 02 15:47:32.929414 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 02 15:47:32.929414 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 02 15:47:32.929414 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 15:47:32.929414 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 15:47:32.929414 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 15:47:32.929414 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 15:47:32.929414 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 15:47:32.929414 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application with Lock( Jun 02 15:47:32.929414 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 15:47:32.929414 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self._enter() Jun 02 15:47:32.929414 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 15:47:32.929414 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 15:47:32.929414 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 15:47:32.929414 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self.creator() Jun 02 15:47:32.930406 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 15:47:32.930406 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application created_value = creator( Jun 02 15:47:32.930406 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 02 15:47:32.930406 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 02 15:47:32.930406 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 02 15:47:32.930406 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 02 15:47:32.930406 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 02 15:47:32.930406 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 02 15:47:32.930406 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 02 15:47:32.930406 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application Jun 02 15:47:32.930406 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 548/1096] 10.222.0.59 () {56 vars in 1093 bytes} [Thu Jun 2 15:47:32 2022] GET /identity/v3/users/nova => generated 82 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 02 15:47:32.935296 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82e4f24a-e287-4424-8ea1-b11ae5ca5908 None admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:47:32.982247 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 549/1097] 10.222.0.59 () {58 vars in 1282 bytes} [Thu Jun 2 15:47:32 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 300 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jun 02 15:47:32.988068 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4a77ca2-bdf2-4f63-bcef-d5eb5bcd25e8 None admin] Authenticating user token {{(pid=80396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:47:33.011150 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writing DB stats keystone:SELECT=100 {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:47:33.036448 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82e4f24a-e287-4424-8ea1-b11ae5ca5908 None admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:47:33.037420 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG dbcounter [-] [80396] Writing DB stats keystone:SELECT=100 {{(pid=80396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:47:33.070934 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f75fb3a5-888d-4875-93a1-7ad081aab9e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:47:33.071601 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75fb3a5-888d-4875-93a1-7ad081aab9e3 None admin] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:47:33.071886 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75fb3a5-888d-4875-93a1-7ad081aab9e3 None admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:47:33.072162 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75fb3a5-888d-4875-93a1-7ad081aab9e3 None admin] PATH_INFO: `/v3/users` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:47:33.072990 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f75fb3a5-888d-4875-93a1-7ad081aab9e3 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80395) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 15:47:33.073337 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f75fb3a5-888d-4875-93a1-7ad081aab9e3 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:47:33.074799 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f75fb3a5-888d-4875-93a1-7ad081aab9e3 None admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:47:33.087020 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4a77ca2-bdf2-4f63-bcef-d5eb5bcd25e8 None admin] Validating token access rules against request {{(pid=80396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:47:33.093423 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 549/1098] 10.222.0.59 () {56 vars in 1133 bytes} [Thu Jun 2 15:47:32 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 15:47:33.099748 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f75fb3a5-888d-4875-93a1-7ad081aab9e3 None admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:47:33.121106 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-166b036e-9f2a-482d-b5d5-5a4a5bf2bd0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:47:33.121894 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166b036e-9f2a-482d-b5d5-5a4a5bf2bd0c None admin] REQUEST_METHOD: `GET` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:47:33.131793 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166b036e-9f2a-482d-b5d5-5a4a5bf2bd0c None admin] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:47:33.131793 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166b036e-9f2a-482d-b5d5-5a4a5bf2bd0c None admin] PATH_INFO: `/v3/projects/b493ca0feff84e37813d3a36919b8b4f` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:47:33.131793 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-166b036e-9f2a-482d-b5d5-5a4a5bf2bd0c None admin] RBAC: Authorizing `identity:get_project(project_id=b493ca0feff84e37813d3a36919b8b4f)` {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:47:33.131793 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-166b036e-9f2a-482d-b5d5-5a4a5bf2bd0c None admin] RBAC: Authorization granted {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:47:33.131793 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 550/1099] 10.222.0.59 () {56 vars in 1186 bytes} [Thu Jun 2 15:47:32 2022] GET /identity/v3/projects/b493ca0feff84e37813d3a36919b8b4f => generated 311 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 15:47:33.133196 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-166b036e-9f2a-482d-b5d5-5a4a5bf2bd0c None admin] Authenticating user token {{(pid=80396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:47:33.198634 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f75fb3a5-888d-4875-93a1-7ad081aab9e3 None admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:47:33.229076 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writing DB stats keystone:SELECT=100 {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:47:33.233995 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28ce6891-1903-4707-aa07-791af7edb35f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:47:33.234669 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ce6891-1903-4707-aa07-791af7edb35f None admin] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:47:33.234954 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ce6891-1903-4707-aa07-791af7edb35f None admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:47:33.235230 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ce6891-1903-4707-aa07-791af7edb35f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:47:33.237900 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-166b036e-9f2a-482d-b5d5-5a4a5bf2bd0c None admin] Validating token access rules against request {{(pid=80396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:47:33.254813 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG dbcounter [-] [80396] Writing DB stats keystone:SELECT=100 {{(pid=80396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:47:33.270680 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5defcca8-f4b8-4f44-b5bf-826528ccfeab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:47:33.271327 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5defcca8-f4b8-4f44-b5bf-826528ccfeab None admin] REQUEST_METHOD: `GET` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:47:33.271606 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5defcca8-f4b8-4f44-b5bf-826528ccfeab None admin] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:47:33.271879 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5defcca8-f4b8-4f44-b5bf-826528ccfeab None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:47:33.272693 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5defcca8-f4b8-4f44-b5bf-826528ccfeab None admin] RBAC: Adding query filter params (role.id=f1e0c25f6e9049e897cb7350c7e54ab3, scope.project.id=b493ca0feff84e37813d3a36919b8b4f, user.id=fd79eab3f3284ce1852411d8103c8e7f) {{(pid=80396) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 15:47:33.272999 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5defcca8-f4b8-4f44-b5bf-826528ccfeab None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:47:33.274450 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5defcca8-f4b8-4f44-b5bf-826528ccfeab None admin] RBAC: Authorization granted {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:47:33.280202 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 551/1100] 10.222.0.59 () {56 vars in 1374 bytes} [Thu Jun 2 15:47:33 2022] GET /identity/v3/role_assignments?user.id=fd79eab3f3284ce1852411d8103c8e7f&scope.project.id=b493ca0feff84e37813d3a36919b8b4f&role.id=f1e0c25f6e9049e897cb7350c7e54ab3 => generated 608 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 15:47:33.308100 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28ce6891-1903-4707-aa07-791af7edb35f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:47:33.309600 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28ce6891-1903-4707-aa07-791af7edb35f None admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:47:33.414991 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 550/1101] 10.222.0.59 () {58 vars in 1282 bytes} [Thu Jun 2 15:47:33 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jun 02 15:47:33.420971 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5defcca8-f4b8-4f44-b5bf-826528ccfeab None admin] Authenticating user token {{(pid=80396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:47:33.524323 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5defcca8-f4b8-4f44-b5bf-826528ccfeab None admin] Validating token access rules against request {{(pid=80396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:47:33.557393 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7aba310-c1e5-4a37-b670-ad1bb9a14a0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:47:33.558197 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7aba310-c1e5-4a37-b670-ad1bb9a14a0b None admin] REQUEST_METHOD: `GET` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:47:33.558476 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7aba310-c1e5-4a37-b670-ad1bb9a14a0b None admin] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:47:33.558743 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7aba310-c1e5-4a37-b670-ad1bb9a14a0b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:47:33.569125 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7aba310-c1e5-4a37-b670-ad1bb9a14a0b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:47:33.570580 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7aba310-c1e5-4a37-b670-ad1bb9a14a0b None admin] RBAC: Authorization granted {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:47:33.587753 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application [None req-e7aba310-c1e5-4a37-b670-ad1bb9a14a0b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 15:47:33.587753 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 15:47:33.587753 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 15:47:33.587753 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 15:47:33.587753 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 15:47:33.587753 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 15:47:33.587753 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 15:47:33.587753 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 15:47:33.587753 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 15:47:33.587753 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 15:47:33.587753 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 15:47:33.587753 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 15:47:33.587753 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 02 15:47:33.587753 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 02 15:47:33.587753 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 02 15:47:33.588648 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 02 15:47:33.588648 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 15:47:33.588648 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 15:47:33.588648 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 15:47:33.588648 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 15:47:33.588648 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 15:47:33.588648 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 15:47:33.588648 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 15:47:33.588648 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application with Lock( Jun 02 15:47:33.588648 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 15:47:33.588648 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application return self._enter() Jun 02 15:47:33.588648 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 15:47:33.588648 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 15:47:33.588648 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 15:47:33.588648 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application return self.creator() Jun 02 15:47:33.588648 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 15:47:33.588648 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application created_value = creator( Jun 02 15:47:33.589528 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 02 15:47:33.589528 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 02 15:47:33.589528 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 15:47:33.589528 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application Jun 02 15:47:33.589528 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 552/1102] 10.222.0.59 () {56 vars in 1108 bytes} [Thu Jun 2 15:47:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 15:47:33.594560 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28ce6891-1903-4707-aa07-791af7edb35f None admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:47:33.624719 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writing DB stats keystone:SELECT=100 {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:47:33.693696 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28ce6891-1903-4707-aa07-791af7edb35f None admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:47:33.728138 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e182507-790f-47e1-87f5-adf88bd817ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:47:33.728796 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e182507-790f-47e1-87f5-adf88bd817ca None admin] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:47:33.729079 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e182507-790f-47e1-87f5-adf88bd817ca None admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:47:33.729355 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e182507-790f-47e1-87f5-adf88bd817ca None admin] PATH_INFO: `/v3/domains` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:47:33.730140 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e182507-790f-47e1-87f5-adf88bd817ca None admin] RBAC: Adding query filter params (name=Default) {{(pid=80395) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 15:47:33.730447 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e182507-790f-47e1-87f5-adf88bd817ca None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:47:33.731809 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e182507-790f-47e1-87f5-adf88bd817ca None admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:47:33.742946 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 551/1103] 10.222.0.59 () {56 vars in 1109 bytes} [Thu Jun 2 15:47:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 15:47:33.748284 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7aba310-c1e5-4a37-b670-ad1bb9a14a0b None admin] Authenticating user token {{(pid=80396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:47:33.782016 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG dbcounter [-] [80396] Writing DB stats keystone:SELECT=100 {{(pid=80396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:47:33.849113 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7aba310-c1e5-4a37-b670-ad1bb9a14a0b None admin] Validating token access rules against request {{(pid=80396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:47:33.882240 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f72426f8-c195-45f4-a660-422a7fdcb280 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:47:33.883022 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f72426f8-c195-45f4-a660-422a7fdcb280 None admin] REQUEST_METHOD: `GET` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:47:33.883303 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f72426f8-c195-45f4-a660-422a7fdcb280 None admin] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:47:33.883578 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f72426f8-c195-45f4-a660-422a7fdcb280 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:47:33.890154 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f72426f8-c195-45f4-a660-422a7fdcb280 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:47:33.891582 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f72426f8-c195-45f4-a660-422a7fdcb280 None admin] RBAC: Authorization granted {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:47:33.905607 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application [None req-f72426f8-c195-45f4-a660-422a7fdcb280 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 02 15:47:33.905607 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 15:47:33.905607 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 15:47:33.905607 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 15:47:33.905607 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 15:47:33.905607 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 15:47:33.905607 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 15:47:33.905607 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 15:47:33.905607 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 15:47:33.905607 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 15:47:33.905607 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 15:47:33.905607 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 15:47:33.905607 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 02 15:47:33.905607 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 02 15:47:33.905607 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 02 15:47:33.906534 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 02 15:47:33.906534 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 15:47:33.906534 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 15:47:33.906534 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 15:47:33.906534 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 15:47:33.906534 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 15:47:33.906534 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 15:47:33.906534 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 15:47:33.906534 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application with Lock( Jun 02 15:47:33.906534 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 15:47:33.906534 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application return self._enter() Jun 02 15:47:33.906534 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 15:47:33.906534 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 15:47:33.906534 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 15:47:33.906534 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application return self.creator() Jun 02 15:47:33.906534 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 15:47:33.906534 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application created_value = creator( Jun 02 15:47:33.907454 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 02 15:47:33.907454 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 02 15:47:33.907454 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 02 15:47:33.907454 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 02 15:47:33.907454 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 02 15:47:33.907454 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 02 15:47:33.907454 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 02 15:47:33.907454 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application Jun 02 15:47:33.907454 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 553/1104] 10.222.0.59 () {56 vars in 1111 bytes} [Thu Jun 2 15:47:33 2022] GET /identity/v3/projects/service => generated 88 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 15:47:33.913069 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e182507-790f-47e1-87f5-adf88bd817ca None admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:47:34.002644 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writing DB stats keystone:SELECT=100 {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:47:34.011308 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e182507-790f-47e1-87f5-adf88bd817ca None admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:47:34.044639 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4554537d-2f51-42f9-babe-7e57d0f0fe8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:47:34.045221 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4554537d-2f51-42f9-babe-7e57d0f0fe8a None admin] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:47:34.045506 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4554537d-2f51-42f9-babe-7e57d0f0fe8a None admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:47:34.045780 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4554537d-2f51-42f9-babe-7e57d0f0fe8a None admin] PATH_INFO: `/v3/projects` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:47:34.046605 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4554537d-2f51-42f9-babe-7e57d0f0fe8a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80395) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 15:47:34.046914 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4554537d-2f51-42f9-babe-7e57d0f0fe8a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:47:34.048375 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4554537d-2f51-42f9-babe-7e57d0f0fe8a None admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:47:34.060444 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 552/1105] 10.222.0.59 () {56 vars in 1148 bytes} [Thu Jun 2 15:47:33 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 15:47:34.066888 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f72426f8-c195-45f4-a660-422a7fdcb280 None admin] Authenticating user token {{(pid=80396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:47:34.159754 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG dbcounter [-] [80396] Writing DB stats keystone:SELECT=100 {{(pid=80396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:47:34.166509 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f72426f8-c195-45f4-a660-422a7fdcb280 None admin] Validating token access rules against request {{(pid=80396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:47:34.199843 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c6570c4-6c7d-4552-80d3-fa8d56dfe9fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:47:34.200496 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c6570c4-6c7d-4552-80d3-fa8d56dfe9fb None admin] REQUEST_METHOD: `GET` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:47:34.200777 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c6570c4-6c7d-4552-80d3-fa8d56dfe9fb None admin] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:47:34.201051 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c6570c4-6c7d-4552-80d3-fa8d56dfe9fb None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:47:34.201876 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c6570c4-6c7d-4552-80d3-fa8d56dfe9fb None admin] RBAC: Adding query filter params (role.id=ce7c3f9097fa4b4aa3a7a1d7bef989be, scope.project.id=9c87c981909d4b8db02783421818c79b, user.id=52f9fe4b13574516bb0a8e2aa11a61e8) {{(pid=80396) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 15:47:34.202343 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c6570c4-6c7d-4552-80d3-fa8d56dfe9fb None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:47:34.203762 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c6570c4-6c7d-4552-80d3-fa8d56dfe9fb None admin] RBAC: Authorization granted {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:47:34.210463 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 554/1106] 10.222.0.59 () {56 vars in 1374 bytes} [Thu Jun 2 15:47:34 2022] GET /identity/v3/role_assignments?user.id=52f9fe4b13574516bb0a8e2aa11a61e8&scope.project.id=9c87c981909d4b8db02783421818c79b&role.id=ce7c3f9097fa4b4aa3a7a1d7bef989be => generated 608 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 15:47:35.604574 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdcd855e-d506-4f17-92ac-54ba26bf714a None None] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:47:35.605079 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdcd855e-d506-4f17-92ac-54ba26bf714a None None] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:47:35.605079 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdcd855e-d506-4f17-92ac-54ba26bf714a None None] PATH_INFO: `/` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:47:35.606425 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 553/1107] 10.222.0.59 () {54 vars in 926 bytes} [Thu Jun 2 15:47:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 15:47:35.611821 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e323f637-362a-4632-9a8d-6345da74e20b None None] REQUEST_METHOD: `POST` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:47:35.612252 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e323f637-362a-4632-9a8d-6345da74e20b None None] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:47:35.612355 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e323f637-362a-4632-9a8d-6345da74e20b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:47:35.628909 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.auth.core [None req-e323f637-362a-4632-9a8d-6345da74e20b None None] MFA Rules not processed for user `400d1f4db9de49638549e5db29a041e1`. Rule list: `[]` (Enabled: `True`). {{(pid=80396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 15:47:35.630099 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.fernet_utils [None req-e323f637-362a-4632-9a8d-6345da74e20b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 15:47:35.693586 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 555/1108] 10.222.0.59 () {58 vars in 1023 bytes} [Thu Jun 2 15:47:35 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 02 15:47:35.717749 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdcd855e-d506-4f17-92ac-54ba26bf714a None None] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:47:35.816208 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdcd855e-d506-4f17-92ac-54ba26bf714a None None] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:47:35.849186 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d34fe375-c8da-4b54-9cc2-58048149fbfd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:47:35.849950 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34fe375-c8da-4b54-9cc2-58048149fbfd None admin] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:47:35.850261 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34fe375-c8da-4b54-9cc2-58048149fbfd None admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:47:35.850533 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34fe375-c8da-4b54-9cc2-58048149fbfd None admin] PATH_INFO: `/v3/domains/default` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:47:35.851674 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d34fe375-c8da-4b54-9cc2-58048149fbfd None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:47:35.853107 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d34fe375-c8da-4b54-9cc2-58048149fbfd None admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:47:35.854763 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 554/1109] 10.222.0.59 () {56 vars in 1108 bytes} [Thu Jun 2 15:47:35 2022] GET /identity/v3/domains/default => generated 199 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 15:47:35.860628 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e323f637-362a-4632-9a8d-6345da74e20b None None] Authenticating user token {{(pid=80396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:47:35.946596 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG dbcounter [-] [80396] Writing DB stats keystone:SELECT=100 {{(pid=80396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:47:35.958940 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e323f637-362a-4632-9a8d-6345da74e20b None None] Validating token access rules against request {{(pid=80396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:47:35.992581 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c91df70-32cc-4339-9182-1273d3e03b97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:47:35.993233 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c91df70-32cc-4339-9182-1273d3e03b97 None admin] REQUEST_METHOD: `POST` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:47:35.993518 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c91df70-32cc-4339-9182-1273d3e03b97 None admin] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:47:35.993796 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c91df70-32cc-4339-9182-1273d3e03b97 None admin] PATH_INFO: `/v3/users` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:47:35.994533 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c91df70-32cc-4339-9182-1273d3e03b97 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:47:35.995975 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c91df70-32cc-4339-9182-1273d3e03b97 None admin] RBAC: Authorization granted {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:47:36.078660 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 556/1110] 10.222.0.59 () {60 vars in 1132 bytes} [Thu Jun 2 15:47:35 2022] POST /identity/v3/users => generated 286 bytes in 218 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 15:47:38.313600 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7597fc74-fd80-4774-be6b-c60838c14530 None None] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:47:38.314255 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7597fc74-fd80-4774-be6b-c60838c14530 None None] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:47:38.314255 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7597fc74-fd80-4774-be6b-c60838c14530 None None] PATH_INFO: `/` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:47:38.315934 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 555/1111] 10.222.0.59 () {54 vars in 926 bytes} [Thu Jun 2 15:47:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 15:47:38.321217 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6158b0-f395-4492-a51b-71afa63e3de2 None None] REQUEST_METHOD: `POST` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:47:38.321625 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6158b0-f395-4492-a51b-71afa63e3de2 None None] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:47:38.321782 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6158b0-f395-4492-a51b-71afa63e3de2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:47:38.339183 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.auth.core [None req-3a6158b0-f395-4492-a51b-71afa63e3de2 None None] MFA Rules not processed for user `400d1f4db9de49638549e5db29a041e1`. Rule list: `[]` (Enabled: `True`). {{(pid=80396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 15:47:38.340357 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.fernet_utils [None req-3a6158b0-f395-4492-a51b-71afa63e3de2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 15:47:38.405092 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 557/1112] 10.222.0.59 () {58 vars in 1023 bytes} [Thu Jun 2 15:47:38 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 02 15:47:38.429801 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7597fc74-fd80-4774-be6b-c60838c14530 None None] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:47:38.451994 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writing DB stats keystone:SELECT=100 {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:47:38.532289 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7597fc74-fd80-4774-be6b-c60838c14530 None None] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:47:38.566241 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b765c659-943f-4a13-b203-08f93461172b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:47:38.567082 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b765c659-943f-4a13-b203-08f93461172b None admin] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:47:38.567367 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b765c659-943f-4a13-b203-08f93461172b None admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:47:38.567642 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b765c659-943f-4a13-b203-08f93461172b None admin] PATH_INFO: `/v3/roles/21f49b1aa1e64120b7ef6fcf4667a641` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:47:38.569101 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b765c659-943f-4a13-b203-08f93461172b None admin] RBAC: Authorizing `identity:get_role(role_id=21f49b1aa1e64120b7ef6fcf4667a641)` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:47:38.570496 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b765c659-943f-4a13-b203-08f93461172b None admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:47:38.571845 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 556/1113] 10.222.0.59 () {56 vars in 1177 bytes} [Thu Jun 2 15:47:38 2022] GET /identity/v3/roles/21f49b1aa1e64120b7ef6fcf4667a641 => generated 223 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 15:47:38.577646 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a6158b0-f395-4492-a51b-71afa63e3de2 None None] Authenticating user token {{(pid=80396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:47:38.649694 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG dbcounter [-] [80396] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:47:38.673046 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a6158b0-f395-4492-a51b-71afa63e3de2 None None] Validating token access rules against request {{(pid=80396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:47:38.706188 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebefd66c-a282-4f2f-8c02-e0dd8816fe84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:47:38.706978 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebefd66c-a282-4f2f-8c02-e0dd8816fe84 None admin] REQUEST_METHOD: `GET` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:47:38.707258 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebefd66c-a282-4f2f-8c02-e0dd8816fe84 None admin] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:47:38.707532 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebefd66c-a282-4f2f-8c02-e0dd8816fe84 None admin] PATH_INFO: `/v3/users/ea632882b94745fb9939b1b34c1e08b1` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:47:38.720627 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebefd66c-a282-4f2f-8c02-e0dd8816fe84 None admin] RBAC: Authorizing `identity:get_user(user_id=ea632882b94745fb9939b1b34c1e08b1)` {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:47:38.722205 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebefd66c-a282-4f2f-8c02-e0dd8816fe84 None admin] RBAC: Authorization granted {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:47:38.724510 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 558/1114] 10.222.0.59 () {56 vars in 1177 bytes} [Thu Jun 2 15:47:38 2022] GET /identity/v3/users/ea632882b94745fb9939b1b34c1e08b1 => generated 286 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 15:47:38.729615 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b765c659-943f-4a13-b203-08f93461172b None admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:47:38.812630 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writing DB stats keystone:SELECT=100 {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:47:38.824821 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b765c659-943f-4a13-b203-08f93461172b None admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:47:38.858039 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f480b533-1cfc-4766-b7e9-8f98ce1415be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:47:38.858709 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f480b533-1cfc-4766-b7e9-8f98ce1415be None admin] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:47:38.858991 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f480b533-1cfc-4766-b7e9-8f98ce1415be None admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:47:38.859270 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f480b533-1cfc-4766-b7e9-8f98ce1415be None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:47:38.923526 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f480b533-1cfc-4766-b7e9-8f98ce1415be None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:47:38.925038 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f480b533-1cfc-4766-b7e9-8f98ce1415be None admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:47:39.006705 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writing DB stats keystone:SELECT=100 {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:47:39.018579 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 557/1115] 10.222.0.59 () {58 vars in 1282 bytes} [Thu Jun 2 15:47:38 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 289 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 02 15:47:39.024469 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebefd66c-a282-4f2f-8c02-e0dd8816fe84 None admin] Authenticating user token {{(pid=80396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:47:39.120611 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebefd66c-a282-4f2f-8c02-e0dd8816fe84 None admin] Validating token access rules against request {{(pid=80396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:47:39.148841 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG dbcounter [-] [80396] Writing DB stats keystone:SELECT=100 {{(pid=80396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:47:39.153561 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d490c97-f9db-4161-99d1-e43db9da4b09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:47:39.154420 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d490c97-f9db-4161-99d1-e43db9da4b09 None admin] REQUEST_METHOD: `GET` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:47:39.154705 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d490c97-f9db-4161-99d1-e43db9da4b09 None admin] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:47:39.154983 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d490c97-f9db-4161-99d1-e43db9da4b09 None admin] PATH_INFO: `/v3/projects/b493ca0feff84e37813d3a36919b8b4f` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:47:39.156146 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d490c97-f9db-4161-99d1-e43db9da4b09 None admin] RBAC: Authorizing `identity:get_project(project_id=b493ca0feff84e37813d3a36919b8b4f)` {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:47:39.158195 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d490c97-f9db-4161-99d1-e43db9da4b09 None admin] RBAC: Authorization granted {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:47:39.159951 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 559/1116] 10.222.0.59 () {56 vars in 1186 bytes} [Thu Jun 2 15:47:39 2022] GET /identity/v3/projects/b493ca0feff84e37813d3a36919b8b4f => generated 311 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 15:47:39.165943 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f480b533-1cfc-4766-b7e9-8f98ce1415be None admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:47:39.262028 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f480b533-1cfc-4766-b7e9-8f98ce1415be None admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:47:39.294344 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d96abc4-0fe6-4628-8f2b-b801bb951149 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:47:39.294976 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d96abc4-0fe6-4628-8f2b-b801bb951149 None admin] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:47:39.295257 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d96abc4-0fe6-4628-8f2b-b801bb951149 None admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:47:39.295528 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d96abc4-0fe6-4628-8f2b-b801bb951149 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:47:39.296346 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d96abc4-0fe6-4628-8f2b-b801bb951149 None admin] RBAC: Adding query filter params (role.id=21f49b1aa1e64120b7ef6fcf4667a641, scope.project.id=b493ca0feff84e37813d3a36919b8b4f, user.id=ea632882b94745fb9939b1b34c1e08b1) {{(pid=80395) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 15:47:39.296650 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d96abc4-0fe6-4628-8f2b-b801bb951149 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:47:39.298141 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d96abc4-0fe6-4628-8f2b-b801bb951149 None admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:47:39.303467 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 558/1117] 10.222.0.59 () {56 vars in 1374 bytes} [Thu Jun 2 15:47:39 2022] GET /identity/v3/role_assignments?user.id=ea632882b94745fb9939b1b34c1e08b1&scope.project.id=b493ca0feff84e37813d3a36919b8b4f&role.id=21f49b1aa1e64120b7ef6fcf4667a641 => generated 259 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 15:47:41.509144 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c274351d-ead0-4d27-bbee-0f5c88693fe0 None None] REQUEST_METHOD: `GET` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:47:41.509781 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c274351d-ead0-4d27-bbee-0f5c88693fe0 None None] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:47:41.509781 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c274351d-ead0-4d27-bbee-0f5c88693fe0 None None] PATH_INFO: `/` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:47:41.511000 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 560/1118] 10.222.0.59 () {54 vars in 926 bytes} [Thu Jun 2 15:47:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 15:47:41.516352 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb6f75d-4796-4c02-a467-e5c6532a2f39 None None] REQUEST_METHOD: `POST` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:47:41.516797 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb6f75d-4796-4c02-a467-e5c6532a2f39 None None] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:47:41.517546 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb6f75d-4796-4c02-a467-e5c6532a2f39 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:47:41.535614 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.auth.core [None req-0bb6f75d-4796-4c02-a467-e5c6532a2f39 None None] MFA Rules not processed for user `400d1f4db9de49638549e5db29a041e1`. Rule list: `[]` (Enabled: `True`). {{(pid=80395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 15:47:41.536796 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.fernet_utils [None req-0bb6f75d-4796-4c02-a467-e5c6532a2f39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 15:47:41.585141 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writing DB stats keystone:SELECT=100 {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:47:41.605528 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 559/1119] 10.222.0.59 () {58 vars in 1023 bytes} [Thu Jun 2 15:47:41 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 02 15:47:41.628780 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c274351d-ead0-4d27-bbee-0f5c88693fe0 None None] Authenticating user token {{(pid=80396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:47:41.727495 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c274351d-ead0-4d27-bbee-0f5c88693fe0 None None] Validating token access rules against request {{(pid=80396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:47:41.760135 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e32fd692-0dfe-466b-856a-a7d90ffc5009 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:47:41.760900 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32fd692-0dfe-466b-856a-a7d90ffc5009 None admin] REQUEST_METHOD: `GET` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:47:41.761185 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32fd692-0dfe-466b-856a-a7d90ffc5009 None admin] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:47:41.761460 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32fd692-0dfe-466b-856a-a7d90ffc5009 None admin] PATH_INFO: `/v3/roles/21f49b1aa1e64120b7ef6fcf4667a641` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:47:41.762930 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e32fd692-0dfe-466b-856a-a7d90ffc5009 None admin] RBAC: Authorizing `identity:get_role(role_id=21f49b1aa1e64120b7ef6fcf4667a641)` {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:47:41.764301 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e32fd692-0dfe-466b-856a-a7d90ffc5009 None admin] RBAC: Authorization granted {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:47:41.765629 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 561/1120] 10.222.0.59 () {56 vars in 1177 bytes} [Thu Jun 2 15:47:41 2022] GET /identity/v3/roles/21f49b1aa1e64120b7ef6fcf4667a641 => generated 223 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 15:47:41.771469 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bb6f75d-4796-4c02-a467-e5c6532a2f39 None None] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:47:41.868828 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bb6f75d-4796-4c02-a467-e5c6532a2f39 None None] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:47:41.901697 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-499c45c5-50d7-4a0a-913c-61f1cd23e81d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:47:41.902611 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499c45c5-50d7-4a0a-913c-61f1cd23e81d None admin] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:47:41.902897 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499c45c5-50d7-4a0a-913c-61f1cd23e81d None admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:47:41.903173 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499c45c5-50d7-4a0a-913c-61f1cd23e81d None admin] PATH_INFO: `/v3/users/ea632882b94745fb9939b1b34c1e08b1` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:47:41.904341 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-499c45c5-50d7-4a0a-913c-61f1cd23e81d None admin] RBAC: Authorizing `identity:get_user(user_id=ea632882b94745fb9939b1b34c1e08b1)` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:47:41.905763 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-499c45c5-50d7-4a0a-913c-61f1cd23e81d None admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:47:41.907566 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 560/1121] 10.222.0.59 () {56 vars in 1177 bytes} [Thu Jun 2 15:47:41 2022] GET /identity/v3/users/ea632882b94745fb9939b1b34c1e08b1 => generated 286 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 15:47:41.913128 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e32fd692-0dfe-466b-856a-a7d90ffc5009 None admin] Authenticating user token {{(pid=80396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:47:41.978405 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG dbcounter [-] [80396] Writing DB stats keystone:SELECT=100 {{(pid=80396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:47:42.010893 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e32fd692-0dfe-466b-856a-a7d90ffc5009 None admin] Validating token access rules against request {{(pid=80396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:47:42.043633 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-781292a8-5150-48b0-8af6-bb973e3d50d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:47:42.044477 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781292a8-5150-48b0-8af6-bb973e3d50d0 None admin] REQUEST_METHOD: `GET` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:47:42.044760 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781292a8-5150-48b0-8af6-bb973e3d50d0 None admin] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:47:42.045033 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781292a8-5150-48b0-8af6-bb973e3d50d0 None admin] PATH_INFO: `/v3/projects/b493ca0feff84e37813d3a36919b8b4f` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:47:42.046222 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-781292a8-5150-48b0-8af6-bb973e3d50d0 None admin] RBAC: Authorizing `identity:get_project(project_id=b493ca0feff84e37813d3a36919b8b4f)` {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:47:42.047656 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-781292a8-5150-48b0-8af6-bb973e3d50d0 None admin] RBAC: Authorization granted {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:47:42.050461 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 562/1122] 10.222.0.59 () {56 vars in 1186 bytes} [Thu Jun 2 15:47:41 2022] GET /identity/v3/projects/b493ca0feff84e37813d3a36919b8b4f => generated 311 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 15:47:42.056321 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-499c45c5-50d7-4a0a-913c-61f1cd23e81d None admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:47:42.106200 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writing DB stats keystone:SELECT=100 {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:47:42.154200 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-499c45c5-50d7-4a0a-913c-61f1cd23e81d None admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:47:42.186554 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-505e4f67-f096-4942-8e13-d478a4e9ad6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:47:42.187435 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505e4f67-f096-4942-8e13-d478a4e9ad6b None admin] REQUEST_METHOD: `PUT` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:47:42.187709 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505e4f67-f096-4942-8e13-d478a4e9ad6b None admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:47:42.187977 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505e4f67-f096-4942-8e13-d478a4e9ad6b None admin] PATH_INFO: `/v3/projects/b493ca0feff84e37813d3a36919b8b4f/users/ea632882b94745fb9939b1b34c1e08b1/roles/21f49b1aa1e64120b7ef6fcf4667a641` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:47:42.190763 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-505e4f67-f096-4942-8e13-d478a4e9ad6b None admin] RBAC: Authorizing `identity:create_grant(project_id=b493ca0feff84e37813d3a36919b8b4f, user_id=ea632882b94745fb9939b1b34c1e08b1, role_id=21f49b1aa1e64120b7ef6fcf4667a641)` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:47:42.192187 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-505e4f67-f096-4942-8e13-d478a4e9ad6b None admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:47:42.257564 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 561/1123] 10.222.0.59 () {58 vars in 1439 bytes} [Thu Jun 2 15:47:42 2022] PUT /identity/v3/projects/b493ca0feff84e37813d3a36919b8b4f/users/ea632882b94745fb9939b1b34c1e08b1/roles/21f49b1aa1e64120b7ef6fcf4667a641 => generated 0 bytes in 202 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 15:47:44.512044 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c38724-5851-477e-9636-d3e10f0f9ae5 None None] REQUEST_METHOD: `GET` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:47:44.512554 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c38724-5851-477e-9636-d3e10f0f9ae5 None None] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:47:44.512554 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c38724-5851-477e-9636-d3e10f0f9ae5 None None] PATH_INFO: `/` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:47:44.513895 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 563/1124] 10.222.0.59 () {54 vars in 926 bytes} [Thu Jun 2 15:47:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 15:47:44.519217 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c7ca39-6268-4cbd-b7f2-4e16dd22c250 None None] REQUEST_METHOD: `POST` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:47:44.519626 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c7ca39-6268-4cbd-b7f2-4e16dd22c250 None None] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:47:44.519768 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c7ca39-6268-4cbd-b7f2-4e16dd22c250 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:47:44.536461 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.auth.core [None req-c8c7ca39-6268-4cbd-b7f2-4e16dd22c250 None None] MFA Rules not processed for user `400d1f4db9de49638549e5db29a041e1`. Rule list: `[]` (Enabled: `True`). {{(pid=80395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 15:47:44.537617 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.fernet_utils [None req-c8c7ca39-6268-4cbd-b7f2-4e16dd22c250 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 15:47:44.602079 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 562/1125] 10.222.0.59 () {58 vars in 1023 bytes} [Thu Jun 2 15:47:44 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 02 15:47:44.625981 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52c38724-5851-477e-9636-d3e10f0f9ae5 None None] Authenticating user token {{(pid=80396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:47:44.727064 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52c38724-5851-477e-9636-d3e10f0f9ae5 None None] Validating token access rules against request {{(pid=80396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:47:44.759608 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79eabb6f-a117-480f-8c78-94fd8c07d907 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:47:44.760445 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79eabb6f-a117-480f-8c78-94fd8c07d907 None admin] REQUEST_METHOD: `GET` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:47:44.760723 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79eabb6f-a117-480f-8c78-94fd8c07d907 None admin] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:47:44.760992 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79eabb6f-a117-480f-8c78-94fd8c07d907 None admin] PATH_INFO: `/v3/roles/21f49b1aa1e64120b7ef6fcf4667a641` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:47:44.762517 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79eabb6f-a117-480f-8c78-94fd8c07d907 None admin] RBAC: Authorizing `identity:get_role(role_id=21f49b1aa1e64120b7ef6fcf4667a641)` {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:47:44.763816 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79eabb6f-a117-480f-8c78-94fd8c07d907 None admin] RBAC: Authorization granted {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:47:44.765178 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 564/1126] 10.222.0.59 () {56 vars in 1177 bytes} [Thu Jun 2 15:47:44 2022] GET /identity/v3/roles/21f49b1aa1e64120b7ef6fcf4667a641 => generated 223 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 15:47:44.770931 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8c7ca39-6268-4cbd-b7f2-4e16dd22c250 None None] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:47:44.811372 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:47:44.867183 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8c7ca39-6268-4cbd-b7f2-4e16dd22c250 None None] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:47:44.899859 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab352f7a-bd57-4265-9d21-7d53da53eb58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:47:44.900708 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab352f7a-bd57-4265-9d21-7d53da53eb58 None admin] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:47:44.900986 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab352f7a-bd57-4265-9d21-7d53da53eb58 None admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:47:44.901258 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab352f7a-bd57-4265-9d21-7d53da53eb58 None admin] PATH_INFO: `/v3/users/ea632882b94745fb9939b1b34c1e08b1` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:47:44.902443 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab352f7a-bd57-4265-9d21-7d53da53eb58 None admin] RBAC: Authorizing `identity:get_user(user_id=ea632882b94745fb9939b1b34c1e08b1)` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:47:44.903871 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab352f7a-bd57-4265-9d21-7d53da53eb58 None admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:47:44.905461 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 563/1127] 10.222.0.59 () {56 vars in 1177 bytes} [Thu Jun 2 15:47:44 2022] GET /identity/v3/users/ea632882b94745fb9939b1b34c1e08b1 => generated 286 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 15:47:44.912149 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79eabb6f-a117-480f-8c78-94fd8c07d907 None admin] Authenticating user token {{(pid=80396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:47:44.915857 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG dbcounter [-] [80396] Writing DB stats keystone:SELECT=100 {{(pid=80396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:47:45.009963 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79eabb6f-a117-480f-8c78-94fd8c07d907 None admin] Validating token access rules against request {{(pid=80396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:47:45.043032 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88a73fa1-2178-479a-9683-b739d95fbd87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:47:45.043599 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a73fa1-2178-479a-9683-b739d95fbd87 None admin] REQUEST_METHOD: `GET` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:47:45.043880 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a73fa1-2178-479a-9683-b739d95fbd87 None admin] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:47:45.044154 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a73fa1-2178-479a-9683-b739d95fbd87 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:47:45.108721 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88a73fa1-2178-479a-9683-b739d95fbd87 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:47:45.110292 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88a73fa1-2178-479a-9683-b739d95fbd87 None admin] RBAC: Authorization granted {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:47:45.112865 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG dbcounter [-] [80396] Writing DB stats keystone:SELECT=100 {{(pid=80396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:47:45.207021 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 565/1128] 10.222.0.59 () {58 vars in 1282 bytes} [Thu Jun 2 15:47:44 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 295 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 02 15:47:45.213254 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab352f7a-bd57-4265-9d21-7d53da53eb58 None admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:47:45.309874 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab352f7a-bd57-4265-9d21-7d53da53eb58 None admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:47:45.319390 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writing DB stats keystone:SELECT=100 {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:47:45.343820 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59905acf-75f1-4c27-8c24-9a82e575502c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:47:45.344977 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59905acf-75f1-4c27-8c24-9a82e575502c None admin] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:47:45.345261 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59905acf-75f1-4c27-8c24-9a82e575502c None admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:47:45.345538 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59905acf-75f1-4c27-8c24-9a82e575502c None admin] PATH_INFO: `/v3/projects/b493ca0feff84e37813d3a36919b8b4f` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:47:45.346718 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59905acf-75f1-4c27-8c24-9a82e575502c None admin] RBAC: Authorizing `identity:get_project(project_id=b493ca0feff84e37813d3a36919b8b4f)` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:47:45.348318 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59905acf-75f1-4c27-8c24-9a82e575502c None admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:47:45.349984 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 564/1129] 10.222.0.59 () {56 vars in 1186 bytes} [Thu Jun 2 15:47:45 2022] GET /identity/v3/projects/b493ca0feff84e37813d3a36919b8b4f => generated 311 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 15:47:45.356109 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88a73fa1-2178-479a-9683-b739d95fbd87 None admin] Authenticating user token {{(pid=80396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:47:45.451245 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88a73fa1-2178-479a-9683-b739d95fbd87 None admin] Validating token access rules against request {{(pid=80396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:47:45.453500 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG dbcounter [-] [80396] Writing DB stats keystone:SELECT=100 {{(pid=80396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:47:45.485322 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f043f2d4-478a-4705-ab56-dd00e443793c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:47:45.486238 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f043f2d4-478a-4705-ab56-dd00e443793c None admin] REQUEST_METHOD: `GET` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:47:45.486529 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f043f2d4-478a-4705-ab56-dd00e443793c None admin] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:47:45.486813 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f043f2d4-478a-4705-ab56-dd00e443793c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:47:45.487641 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f043f2d4-478a-4705-ab56-dd00e443793c None admin] RBAC: Adding query filter params (role.id=21f49b1aa1e64120b7ef6fcf4667a641, scope.project.id=b493ca0feff84e37813d3a36919b8b4f, user.id=ea632882b94745fb9939b1b34c1e08b1) {{(pid=80396) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 15:47:45.487956 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f043f2d4-478a-4705-ab56-dd00e443793c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:47:45.489392 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f043f2d4-478a-4705-ab56-dd00e443793c None admin] RBAC: Authorization granted {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:47:45.495136 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 566/1130] 10.222.0.59 () {56 vars in 1374 bytes} [Thu Jun 2 15:47:45 2022] GET /identity/v3/role_assignments?user.id=ea632882b94745fb9939b1b34c1e08b1&scope.project.id=b493ca0feff84e37813d3a36919b8b4f&role.id=21f49b1aa1e64120b7ef6fcf4667a641 => generated 608 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 15:47:47.727609 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f932165e-7d87-42d0-8508-9be4762031d1 None None] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:47:47.728151 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f932165e-7d87-42d0-8508-9be4762031d1 None None] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:47:47.728151 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f932165e-7d87-42d0-8508-9be4762031d1 None None] PATH_INFO: `/` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:47:47.729501 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 565/1131] 10.222.0.59 () {54 vars in 926 bytes} [Thu Jun 2 15:47:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 15:47:47.734711 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf9c8fd-c43d-47ee-b542-673adbc6eec6 None None] REQUEST_METHOD: `POST` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:47:47.735181 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf9c8fd-c43d-47ee-b542-673adbc6eec6 None None] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:47:47.735370 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf9c8fd-c43d-47ee-b542-673adbc6eec6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:47:47.753004 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.auth.core [None req-1bf9c8fd-c43d-47ee-b542-673adbc6eec6 None None] MFA Rules not processed for user `400d1f4db9de49638549e5db29a041e1`. Rule list: `[]` (Enabled: `True`). {{(pid=80396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 15:47:47.754211 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.fernet_utils [None req-1bf9c8fd-c43d-47ee-b542-673adbc6eec6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 15:47:47.820280 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 567/1132] 10.222.0.59 () {58 vars in 1023 bytes} [Thu Jun 2 15:47:47 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 02 15:47:47.844210 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f932165e-7d87-42d0-8508-9be4762031d1 None None] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:47:47.942370 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f932165e-7d87-42d0-8508-9be4762031d1 None None] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:47:47.975303 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-005cdbd6-804b-41c4-91de-b285230062cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:47:47.976076 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-005cdbd6-804b-41c4-91de-b285230062cb None admin] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:47:47.976354 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-005cdbd6-804b-41c4-91de-b285230062cb None admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:47:47.976622 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-005cdbd6-804b-41c4-91de-b285230062cb None admin] PATH_INFO: `/v3/domains/default` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:47:47.977821 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-005cdbd6-804b-41c4-91de-b285230062cb None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:47:47.979239 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-005cdbd6-804b-41c4-91de-b285230062cb None admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:47:47.980819 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 566/1133] 10.222.0.59 () {56 vars in 1108 bytes} [Thu Jun 2 15:47:47 2022] GET /identity/v3/domains/default => generated 199 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 15:47:47.987151 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bf9c8fd-c43d-47ee-b542-673adbc6eec6 None None] Authenticating user token {{(pid=80396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:47:48.081686 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG dbcounter [-] [80396] Writing DB stats keystone:SELECT=100 {{(pid=80396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:47:48.085126 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bf9c8fd-c43d-47ee-b542-673adbc6eec6 None None] Validating token access rules against request {{(pid=80396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:47:48.117966 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c7b7981-e82d-416b-8b01-1387f691a038 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:47:48.118639 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c7b7981-e82d-416b-8b01-1387f691a038 None admin] REQUEST_METHOD: `POST` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:47:48.118923 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c7b7981-e82d-416b-8b01-1387f691a038 None admin] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:47:48.119252 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c7b7981-e82d-416b-8b01-1387f691a038 None admin] PATH_INFO: `/v3/projects` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:47:48.119956 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c7b7981-e82d-416b-8b01-1387f691a038 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:47:48.121709 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c7b7981-e82d-416b-8b01-1387f691a038 None admin] RBAC: Authorization granted {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:47:48.211805 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 568/1134] 10.222.0.59 () {60 vars in 1141 bytes} [Thu Jun 2 15:47:47 2022] POST /identity/v3/projects => generated 311 bytes in 225 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 15:47:50.462752 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c05b8634-8459-4b00-b38f-52b13aa33b78 None None] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:47:50.463254 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c05b8634-8459-4b00-b38f-52b13aa33b78 None None] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:47:50.463254 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c05b8634-8459-4b00-b38f-52b13aa33b78 None None] PATH_INFO: `/` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:47:50.464572 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 567/1135] 10.222.0.59 () {54 vars in 926 bytes} [Thu Jun 2 15:47:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 15:47:50.470375 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a8e64d-5ca3-4a58-8e6d-490aa28e3f07 None None] REQUEST_METHOD: `POST` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:47:50.470794 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a8e64d-5ca3-4a58-8e6d-490aa28e3f07 None None] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:47:50.470974 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a8e64d-5ca3-4a58-8e6d-490aa28e3f07 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:47:50.488055 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.auth.core [None req-29a8e64d-5ca3-4a58-8e6d-490aa28e3f07 None None] MFA Rules not processed for user `400d1f4db9de49638549e5db29a041e1`. Rule list: `[]` (Enabled: `True`). {{(pid=80396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 15:47:50.489274 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.fernet_utils [None req-29a8e64d-5ca3-4a58-8e6d-490aa28e3f07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 15:47:50.555335 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 569/1136] 10.222.0.59 () {58 vars in 1023 bytes} [Thu Jun 2 15:47:50 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 02 15:47:50.578939 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c05b8634-8459-4b00-b38f-52b13aa33b78 None None] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:47:50.624823 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writing DB stats keystone:SELECT=100 {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:47:50.677459 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c05b8634-8459-4b00-b38f-52b13aa33b78 None None] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:47:50.710082 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ef3f162-9f88-44b4-b6e0-7e2f3c24e12a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:47:50.711123 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef3f162-9f88-44b4-b6e0-7e2f3c24e12a None admin] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:47:50.711403 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef3f162-9f88-44b4-b6e0-7e2f3c24e12a None admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:47:50.711673 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef3f162-9f88-44b4-b6e0-7e2f3c24e12a None admin] PATH_INFO: `/v3/domains/default` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:47:50.712864 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ef3f162-9f88-44b4-b6e0-7e2f3c24e12a None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:47:50.714257 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ef3f162-9f88-44b4-b6e0-7e2f3c24e12a None admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:47:50.715834 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 568/1137] 10.222.0.59 () {56 vars in 1108 bytes} [Thu Jun 2 15:47:50 2022] GET /identity/v3/domains/default => generated 199 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 15:47:50.722450 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29a8e64d-5ca3-4a58-8e6d-490aa28e3f07 None None] Authenticating user token {{(pid=80396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:47:50.802487 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG dbcounter [-] [80396] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:47:50.820780 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29a8e64d-5ca3-4a58-8e6d-490aa28e3f07 None None] Validating token access rules against request {{(pid=80396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:47:50.855338 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4237cb37-156f-4186-b669-ec865669afad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:47:50.855995 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4237cb37-156f-4186-b669-ec865669afad None admin] REQUEST_METHOD: `POST` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:47:50.856278 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4237cb37-156f-4186-b669-ec865669afad None admin] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:47:50.856585 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4237cb37-156f-4186-b669-ec865669afad None admin] PATH_INFO: `/v3/users` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:47:50.857303 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4237cb37-156f-4186-b669-ec865669afad None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:47:50.858755 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4237cb37-156f-4186-b669-ec865669afad None admin] RBAC: Authorization granted {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:47:50.964076 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 570/1138] 10.222.0.59 () {60 vars in 1132 bytes} [Thu Jun 2 15:47:50 2022] POST /identity/v3/users => generated 286 bytes in 242 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 02 15:47:53.274960 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0581b265-e119-4d82-bd60-1bba17c4f119 None None] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:47:53.275462 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0581b265-e119-4d82-bd60-1bba17c4f119 None None] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:47:53.275549 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0581b265-e119-4d82-bd60-1bba17c4f119 None None] PATH_INFO: `/` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:47:53.276899 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 569/1139] 10.222.0.59 () {54 vars in 926 bytes} [Thu Jun 2 15:47:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 15:47:53.282855 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67967113-fd6d-4a04-a7d0-1451523c3d16 None None] REQUEST_METHOD: `POST` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:47:53.283278 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67967113-fd6d-4a04-a7d0-1451523c3d16 None None] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:47:53.283416 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67967113-fd6d-4a04-a7d0-1451523c3d16 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:47:53.299885 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.auth.core [None req-67967113-fd6d-4a04-a7d0-1451523c3d16 None None] MFA Rules not processed for user `400d1f4db9de49638549e5db29a041e1`. Rule list: `[]` (Enabled: `True`). {{(pid=80396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 15:47:53.301060 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.fernet_utils [None req-67967113-fd6d-4a04-a7d0-1451523c3d16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 15:47:53.365887 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 571/1140] 10.222.0.59 () {58 vars in 1023 bytes} [Thu Jun 2 15:47:53 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 02 15:47:53.389350 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0581b265-e119-4d82-bd60-1bba17c4f119 None None] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:47:53.487831 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0581b265-e119-4d82-bd60-1bba17c4f119 None None] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:47:53.500697 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writing DB stats keystone:SELECT=100 {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:47:53.521033 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9afbb19-e28e-41ff-b11d-95b1ec3a87c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:47:53.521797 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9afbb19-e28e-41ff-b11d-95b1ec3a87c3 None admin] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:47:53.522097 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9afbb19-e28e-41ff-b11d-95b1ec3a87c3 None admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:47:53.522362 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9afbb19-e28e-41ff-b11d-95b1ec3a87c3 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:47:53.532136 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9afbb19-e28e-41ff-b11d-95b1ec3a87c3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 02 15:47:53.539600 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application [None req-e9afbb19-e28e-41ff-b11d-95b1ec3a87c3 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 02 15:47:53.539600 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 15:47:53.539600 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 15:47:53.539600 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 15:47:53.539600 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 15:47:53.539600 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 15:47:53.539600 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 15:47:53.539600 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 15:47:53.539600 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 15:47:53.539600 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 15:47:53.539600 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 15:47:53.539600 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 15:47:53.539600 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 02 15:47:53.539600 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 02 15:47:53.539600 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 02 15:47:53.539600 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 02 15:47:53.540719 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 02 15:47:53.540719 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 02 15:47:53.540719 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 02 15:47:53.540719 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 02 15:47:53.540719 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 15:47:53.540719 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 15:47:53.540719 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 15:47:53.540719 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 15:47:53.540719 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 15:47:53.540719 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 15:47:53.540719 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 15:47:53.540719 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application with Lock( Jun 02 15:47:53.540719 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 15:47:53.540719 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self._enter() Jun 02 15:47:53.540719 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 15:47:53.540719 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 15:47:53.541603 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 15:47:53.541603 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self.creator() Jun 02 15:47:53.541603 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 15:47:53.541603 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application created_value = creator( Jun 02 15:47:53.541603 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 02 15:47:53.541603 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 02 15:47:53.541603 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 02 15:47:53.541603 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 02 15:47:53.541603 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 02 15:47:53.541603 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 02 15:47:53.541603 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 02 15:47:53.541603 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application Jun 02 15:47:53.545591 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 570/1141] 10.222.0.59 () {56 vars in 1096 bytes} [Thu Jun 2 15:47:53 2022] GET /identity/v3/roles/admin => generated 83 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 15:47:53.546807 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67967113-fd6d-4a04-a7d0-1451523c3d16 None None] Authenticating user token {{(pid=80396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:47:53.609606 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG dbcounter [-] [80396] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:47:53.644664 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67967113-fd6d-4a04-a7d0-1451523c3d16 None None] Validating token access rules against request {{(pid=80396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:47:53.678236 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adffe6ce-561c-44d0-8f3f-5613711de15b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:47:53.678918 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adffe6ce-561c-44d0-8f3f-5613711de15b None admin] REQUEST_METHOD: `GET` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:47:53.679600 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adffe6ce-561c-44d0-8f3f-5613711de15b None admin] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:47:53.679906 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adffe6ce-561c-44d0-8f3f-5613711de15b None admin] PATH_INFO: `/v3/roles` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:47:53.680653 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adffe6ce-561c-44d0-8f3f-5613711de15b None admin] RBAC: Adding query filter params (name=admin) {{(pid=80396) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 15:47:53.680964 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adffe6ce-561c-44d0-8f3f-5613711de15b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:47:53.682377 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adffe6ce-561c-44d0-8f3f-5613711de15b None admin] RBAC: Authorization granted {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:47:53.691107 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 572/1142] 10.222.0.59 () {56 vars in 1099 bytes} [Thu Jun 2 15:47:53 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 15:47:53.696738 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9afbb19-e28e-41ff-b11d-95b1ec3a87c3 None admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:47:53.792590 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9afbb19-e28e-41ff-b11d-95b1ec3a87c3 None admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:47:53.824438 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fa25ab5-2259-4bf7-8ba3-ae886d090a8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:47:53.825281 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa25ab5-2259-4bf7-8ba3-ae886d090a8c None admin] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:47:53.825559 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa25ab5-2259-4bf7-8ba3-ae886d090a8c None admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:47:53.825832 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa25ab5-2259-4bf7-8ba3-ae886d090a8c None admin] PATH_INFO: `/v3/users/683ef9fe0e0b447fa79754de54b75fd9` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:47:53.839491 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fa25ab5-2259-4bf7-8ba3-ae886d090a8c None admin] RBAC: Authorizing `identity:get_user(user_id=683ef9fe0e0b447fa79754de54b75fd9)` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:47:53.840917 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fa25ab5-2259-4bf7-8ba3-ae886d090a8c None admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:47:53.842620 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 571/1143] 10.222.0.59 () {56 vars in 1177 bytes} [Thu Jun 2 15:47:53 2022] GET /identity/v3/users/683ef9fe0e0b447fa79754de54b75fd9 => generated 286 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 15:47:53.848579 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adffe6ce-561c-44d0-8f3f-5613711de15b None admin] Authenticating user token {{(pid=80396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:47:53.945370 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adffe6ce-561c-44d0-8f3f-5613711de15b None admin] Validating token access rules against request {{(pid=80396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:47:53.970903 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG dbcounter [-] [80396] Writing DB stats keystone:SELECT=100 {{(pid=80396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:47:53.978845 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39b22951-7ff7-485d-98dc-627fc1ab7cb2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:47:53.979537 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b22951-7ff7-485d-98dc-627fc1ab7cb2 None admin] REQUEST_METHOD: `GET` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:47:53.979820 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b22951-7ff7-485d-98dc-627fc1ab7cb2 None admin] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:47:53.980097 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b22951-7ff7-485d-98dc-627fc1ab7cb2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:47:54.046092 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39b22951-7ff7-485d-98dc-627fc1ab7cb2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:47:54.048107 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39b22951-7ff7-485d-98dc-627fc1ab7cb2 None admin] RBAC: Authorization granted {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:47:54.144670 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 573/1144] 10.222.0.59 () {58 vars in 1282 bytes} [Thu Jun 2 15:47:53 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 297 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 02 15:47:54.150538 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fa25ab5-2259-4bf7-8ba3-ae886d090a8c None admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:47:54.180403 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writing DB stats keystone:SELECT=100 {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:47:54.249846 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fa25ab5-2259-4bf7-8ba3-ae886d090a8c None admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:47:54.283435 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e2b2ece-07d7-40f8-b4fd-cd707df87da3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:47:54.284285 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2b2ece-07d7-40f8-b4fd-cd707df87da3 None admin] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:47:54.284561 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2b2ece-07d7-40f8-b4fd-cd707df87da3 None admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:47:54.284831 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2b2ece-07d7-40f8-b4fd-cd707df87da3 None admin] PATH_INFO: `/v3/projects/f2486d13b8c4463ea2985fe11b6baa3b` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:47:54.285982 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e2b2ece-07d7-40f8-b4fd-cd707df87da3 None admin] RBAC: Authorizing `identity:get_project(project_id=f2486d13b8c4463ea2985fe11b6baa3b)` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:47:54.287423 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e2b2ece-07d7-40f8-b4fd-cd707df87da3 None admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:47:54.289076 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 572/1145] 10.222.0.59 () {56 vars in 1186 bytes} [Thu Jun 2 15:47:54 2022] GET /identity/v3/projects/f2486d13b8c4463ea2985fe11b6baa3b => generated 311 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 15:47:54.295164 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39b22951-7ff7-485d-98dc-627fc1ab7cb2 None admin] Authenticating user token {{(pid=80396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:47:54.322585 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG dbcounter [-] [80396] Writing DB stats keystone:SELECT=100 {{(pid=80396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:47:54.391295 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39b22951-7ff7-485d-98dc-627fc1ab7cb2 None admin] Validating token access rules against request {{(pid=80396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:47:54.425086 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cbc657e-d3aa-4409-8685-db3c3321d338 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:47:54.425722 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cbc657e-d3aa-4409-8685-db3c3321d338 None admin] REQUEST_METHOD: `GET` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:47:54.426003 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cbc657e-d3aa-4409-8685-db3c3321d338 None admin] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:47:54.426304 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cbc657e-d3aa-4409-8685-db3c3321d338 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:47:54.427127 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cbc657e-d3aa-4409-8685-db3c3321d338 None admin] RBAC: Adding query filter params (role.id=f1e0c25f6e9049e897cb7350c7e54ab3, scope.project.id=f2486d13b8c4463ea2985fe11b6baa3b, user.id=683ef9fe0e0b447fa79754de54b75fd9) {{(pid=80396) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 15:47:54.427434 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cbc657e-d3aa-4409-8685-db3c3321d338 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:47:54.428843 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cbc657e-d3aa-4409-8685-db3c3321d338 None admin] RBAC: Authorization granted {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:47:54.434149 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 574/1146] 10.222.0.59 () {56 vars in 1374 bytes} [Thu Jun 2 15:47:54 2022] GET /identity/v3/role_assignments?user.id=683ef9fe0e0b447fa79754de54b75fd9&scope.project.id=f2486d13b8c4463ea2985fe11b6baa3b&role.id=f1e0c25f6e9049e897cb7350c7e54ab3 => generated 259 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 15:47:56.627951 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5728198f-c78a-4129-8cc5-b08037135171 None None] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:47:56.628502 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5728198f-c78a-4129-8cc5-b08037135171 None None] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:47:56.628502 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5728198f-c78a-4129-8cc5-b08037135171 None None] PATH_INFO: `/` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:47:56.629767 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 573/1147] 10.222.0.59 () {54 vars in 926 bytes} [Thu Jun 2 15:47:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 15:47:56.635071 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-582c48d7-3699-4041-b991-14c261474a1b None None] REQUEST_METHOD: `POST` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:47:56.635504 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-582c48d7-3699-4041-b991-14c261474a1b None None] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:47:56.635637 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-582c48d7-3699-4041-b991-14c261474a1b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:47:56.652792 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.auth.core [None req-582c48d7-3699-4041-b991-14c261474a1b None None] MFA Rules not processed for user `400d1f4db9de49638549e5db29a041e1`. Rule list: `[]` (Enabled: `True`). {{(pid=80396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 15:47:56.653998 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.fernet_utils [None req-582c48d7-3699-4041-b991-14c261474a1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 15:47:56.722869 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 575/1148] 10.222.0.59 () {58 vars in 1023 bytes} [Thu Jun 2 15:47:56 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 02 15:47:56.744945 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5728198f-c78a-4129-8cc5-b08037135171 None None] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:47:56.842652 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writing DB stats keystone:SELECT=100 {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:47:56.847882 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5728198f-c78a-4129-8cc5-b08037135171 None None] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:47:56.880879 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-521825b7-568c-421d-b2db-141e66c7f96d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:47:56.881585 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-521825b7-568c-421d-b2db-141e66c7f96d None admin] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:47:56.881866 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-521825b7-568c-421d-b2db-141e66c7f96d None admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:47:56.882178 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-521825b7-568c-421d-b2db-141e66c7f96d None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:47:56.892520 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-521825b7-568c-421d-b2db-141e66c7f96d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 02 15:47:56.900051 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application [None req-521825b7-568c-421d-b2db-141e66c7f96d None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 02 15:47:56.900051 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 15:47:56.900051 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 15:47:56.900051 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 15:47:56.900051 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 15:47:56.900051 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 15:47:56.900051 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 15:47:56.900051 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 15:47:56.900051 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 15:47:56.900051 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 15:47:56.900051 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 15:47:56.900051 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 15:47:56.900051 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 02 15:47:56.900051 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 02 15:47:56.900051 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 02 15:47:56.900051 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 02 15:47:56.901173 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 02 15:47:56.901173 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 02 15:47:56.901173 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 02 15:47:56.901173 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 02 15:47:56.901173 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 15:47:56.901173 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 15:47:56.901173 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 15:47:56.901173 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 15:47:56.901173 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 15:47:56.901173 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 15:47:56.901173 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 15:47:56.901173 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application with Lock( Jun 02 15:47:56.901173 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 15:47:56.901173 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self._enter() Jun 02 15:47:56.901173 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 15:47:56.901173 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 15:47:56.902145 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 15:47:56.902145 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self.creator() Jun 02 15:47:56.902145 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 15:47:56.902145 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application created_value = creator( Jun 02 15:47:56.902145 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 02 15:47:56.902145 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 02 15:47:56.902145 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 02 15:47:56.902145 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 02 15:47:56.902145 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 02 15:47:56.902145 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 02 15:47:56.902145 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 02 15:47:56.902145 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application Jun 02 15:47:56.902145 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 574/1149] 10.222.0.59 () {56 vars in 1096 bytes} [Thu Jun 2 15:47:56 2022] GET /identity/v3/roles/admin => generated 83 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 15:47:56.907279 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-582c48d7-3699-4041-b991-14c261474a1b None None] Authenticating user token {{(pid=80396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:47:56.931054 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG dbcounter [-] [80396] Writing DB stats keystone:SELECT=100 {{(pid=80396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:47:57.005742 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-582c48d7-3699-4041-b991-14c261474a1b None None] Validating token access rules against request {{(pid=80396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:47:57.040649 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d697a2e-be93-4c20-8ea5-16f6f79687d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:47:57.041293 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d697a2e-be93-4c20-8ea5-16f6f79687d3 None admin] REQUEST_METHOD: `GET` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:47:57.041573 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d697a2e-be93-4c20-8ea5-16f6f79687d3 None admin] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:47:57.041850 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d697a2e-be93-4c20-8ea5-16f6f79687d3 None admin] PATH_INFO: `/v3/roles` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:47:57.042612 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d697a2e-be93-4c20-8ea5-16f6f79687d3 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80396) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 15:47:57.042919 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d697a2e-be93-4c20-8ea5-16f6f79687d3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:47:57.044283 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d697a2e-be93-4c20-8ea5-16f6f79687d3 None admin] RBAC: Authorization granted {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:47:57.052556 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 576/1150] 10.222.0.59 () {56 vars in 1099 bytes} [Thu Jun 2 15:47:56 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 15:47:57.058510 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-521825b7-568c-421d-b2db-141e66c7f96d None admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:47:57.158351 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-521825b7-568c-421d-b2db-141e66c7f96d None admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:47:57.194443 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24e800fd-0457-4dcb-b7a8-31a4ad441494 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:47:57.195311 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e800fd-0457-4dcb-b7a8-31a4ad441494 None admin] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:47:57.195598 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e800fd-0457-4dcb-b7a8-31a4ad441494 None admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:47:57.195876 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e800fd-0457-4dcb-b7a8-31a4ad441494 None admin] PATH_INFO: `/v3/users/683ef9fe0e0b447fa79754de54b75fd9` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:47:57.197054 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24e800fd-0457-4dcb-b7a8-31a4ad441494 None admin] RBAC: Authorizing `identity:get_user(user_id=683ef9fe0e0b447fa79754de54b75fd9)` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:47:57.198521 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24e800fd-0457-4dcb-b7a8-31a4ad441494 None admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:47:57.200135 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 575/1151] 10.222.0.59 () {56 vars in 1177 bytes} [Thu Jun 2 15:47:57 2022] GET /identity/v3/users/683ef9fe0e0b447fa79754de54b75fd9 => generated 286 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 15:47:57.205866 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d697a2e-be93-4c20-8ea5-16f6f79687d3 None admin] Authenticating user token {{(pid=80396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:47:57.289924 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG dbcounter [-] [80396] Writing DB stats keystone:SELECT=100 {{(pid=80396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:47:57.305829 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d697a2e-be93-4c20-8ea5-16f6f79687d3 None admin] Validating token access rules against request {{(pid=80396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:47:57.339361 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0ff665d-dd97-428d-952a-94a66e0eb811 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:47:57.340206 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ff665d-dd97-428d-952a-94a66e0eb811 None admin] REQUEST_METHOD: `GET` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:47:57.340489 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ff665d-dd97-428d-952a-94a66e0eb811 None admin] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:47:57.340766 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ff665d-dd97-428d-952a-94a66e0eb811 None admin] PATH_INFO: `/v3/projects/f2486d13b8c4463ea2985fe11b6baa3b` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:47:57.341928 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0ff665d-dd97-428d-952a-94a66e0eb811 None admin] RBAC: Authorizing `identity:get_project(project_id=f2486d13b8c4463ea2985fe11b6baa3b)` {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:47:57.343393 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0ff665d-dd97-428d-952a-94a66e0eb811 None admin] RBAC: Authorization granted {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:47:57.345636 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 577/1152] 10.222.0.59 () {56 vars in 1186 bytes} [Thu Jun 2 15:47:57 2022] GET /identity/v3/projects/f2486d13b8c4463ea2985fe11b6baa3b => generated 311 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 15:47:57.351474 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24e800fd-0457-4dcb-b7a8-31a4ad441494 None admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:47:57.378635 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writing DB stats keystone:SELECT=100 {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:47:57.449395 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24e800fd-0457-4dcb-b7a8-31a4ad441494 None admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:47:57.482495 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c87a9a94-9af2-4f7d-84e8-16c54598589d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:47:57.483368 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c87a9a94-9af2-4f7d-84e8-16c54598589d None admin] REQUEST_METHOD: `PUT` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:47:57.483648 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c87a9a94-9af2-4f7d-84e8-16c54598589d None admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:47:57.483921 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c87a9a94-9af2-4f7d-84e8-16c54598589d None admin] PATH_INFO: `/v3/projects/f2486d13b8c4463ea2985fe11b6baa3b/users/683ef9fe0e0b447fa79754de54b75fd9/roles/f1e0c25f6e9049e897cb7350c7e54ab3` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:47:57.486899 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c87a9a94-9af2-4f7d-84e8-16c54598589d None admin] RBAC: Authorizing `identity:create_grant(project_id=f2486d13b8c4463ea2985fe11b6baa3b, user_id=683ef9fe0e0b447fa79754de54b75fd9, role_id=f1e0c25f6e9049e897cb7350c7e54ab3)` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:47:57.488328 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c87a9a94-9af2-4f7d-84e8-16c54598589d None admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:47:57.619816 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 576/1153] 10.222.0.59 () {58 vars in 1439 bytes} [Thu Jun 2 15:47:57 2022] PUT /identity/v3/projects/f2486d13b8c4463ea2985fe11b6baa3b/users/683ef9fe0e0b447fa79754de54b75fd9/roles/f1e0c25f6e9049e897cb7350c7e54ab3 => generated 0 bytes in 269 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 15:47:59.848924 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14fdc1be-c559-4ff9-995e-ebfbb995a78f None None] REQUEST_METHOD: `GET` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:47:59.849483 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14fdc1be-c559-4ff9-995e-ebfbb995a78f None None] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:47:59.849483 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14fdc1be-c559-4ff9-995e-ebfbb995a78f None None] PATH_INFO: `/` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:47:59.850851 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 578/1154] 10.222.0.59 () {54 vars in 926 bytes} [Thu Jun 2 15:47:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 15:47:59.855993 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d61f166-4d12-440a-911f-8ce00a0d398a None None] REQUEST_METHOD: `POST` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:47:59.856372 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d61f166-4d12-440a-911f-8ce00a0d398a None None] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:47:59.856554 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d61f166-4d12-440a-911f-8ce00a0d398a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:47:59.872960 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.auth.core [None req-9d61f166-4d12-440a-911f-8ce00a0d398a None None] MFA Rules not processed for user `400d1f4db9de49638549e5db29a041e1`. Rule list: `[]` (Enabled: `True`). {{(pid=80395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 15:47:59.874169 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.fernet_utils [None req-9d61f166-4d12-440a-911f-8ce00a0d398a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 15:47:59.938984 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 577/1155] 10.222.0.59 () {58 vars in 1023 bytes} [Thu Jun 2 15:47:59 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 02 15:47:59.963023 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14fdc1be-c559-4ff9-995e-ebfbb995a78f None None] Authenticating user token {{(pid=80396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:48:00.062495 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14fdc1be-c559-4ff9-995e-ebfbb995a78f None None] Validating token access rules against request {{(pid=80396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:48:00.095975 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04df23df-064c-4b47-9e01-daff5670a699 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:48:00.096741 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04df23df-064c-4b47-9e01-daff5670a699 None admin] REQUEST_METHOD: `GET` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:48:00.097020 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04df23df-064c-4b47-9e01-daff5670a699 None admin] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:48:00.097294 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04df23df-064c-4b47-9e01-daff5670a699 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:48:00.107131 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04df23df-064c-4b47-9e01-daff5670a699 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 02 15:48:00.114806 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application [None req-04df23df-064c-4b47-9e01-daff5670a699 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 02 15:48:00.114806 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 15:48:00.114806 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 15:48:00.114806 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 15:48:00.114806 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 15:48:00.114806 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 15:48:00.114806 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 15:48:00.114806 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 15:48:00.114806 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 15:48:00.114806 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 15:48:00.114806 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 15:48:00.114806 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 15:48:00.114806 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 02 15:48:00.114806 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 02 15:48:00.114806 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 02 15:48:00.114806 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 02 15:48:00.115899 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 02 15:48:00.115899 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 02 15:48:00.115899 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 02 15:48:00.115899 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 02 15:48:00.115899 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 15:48:00.115899 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 15:48:00.115899 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 15:48:00.115899 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 15:48:00.115899 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 15:48:00.115899 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 15:48:00.115899 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 15:48:00.115899 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application with Lock( Jun 02 15:48:00.115899 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 15:48:00.115899 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application return self._enter() Jun 02 15:48:00.115899 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 15:48:00.115899 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 15:48:00.116865 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 15:48:00.116865 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application return self.creator() Jun 02 15:48:00.116865 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 15:48:00.116865 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application created_value = creator( Jun 02 15:48:00.116865 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 02 15:48:00.116865 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 02 15:48:00.116865 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 02 15:48:00.116865 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 02 15:48:00.116865 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 02 15:48:00.116865 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 02 15:48:00.116865 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 02 15:48:00.116865 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application Jun 02 15:48:00.116865 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 579/1156] 10.222.0.59 () {56 vars in 1096 bytes} [Thu Jun 2 15:47:59 2022] GET /identity/v3/roles/admin => generated 83 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 15:48:00.121812 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d61f166-4d12-440a-911f-8ce00a0d398a None None] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:48:00.138881 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:48:00.221394 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d61f166-4d12-440a-911f-8ce00a0d398a None None] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:48:00.254611 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-469d750d-7d87-4009-a930-a97cc4229b27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:48:00.255269 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469d750d-7d87-4009-a930-a97cc4229b27 None admin] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:48:00.255555 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469d750d-7d87-4009-a930-a97cc4229b27 None admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:48:00.255834 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469d750d-7d87-4009-a930-a97cc4229b27 None admin] PATH_INFO: `/v3/roles` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:48:00.256573 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-469d750d-7d87-4009-a930-a97cc4229b27 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80395) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 15:48:00.256879 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-469d750d-7d87-4009-a930-a97cc4229b27 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:48:00.258267 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-469d750d-7d87-4009-a930-a97cc4229b27 None admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:48:00.266991 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 578/1157] 10.222.0.59 () {56 vars in 1099 bytes} [Thu Jun 2 15:48:00 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 15:48:00.272898 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04df23df-064c-4b47-9e01-daff5670a699 None admin] Authenticating user token {{(pid=80396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:48:00.288789 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG dbcounter [-] [80396] Writing DB stats keystone:SELECT=100 {{(pid=80396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:48:00.371532 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04df23df-064c-4b47-9e01-daff5670a699 None admin] Validating token access rules against request {{(pid=80396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:48:00.404748 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-074167d0-bb91-4a5d-88d4-46fcaa31f76b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:48:00.405600 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-074167d0-bb91-4a5d-88d4-46fcaa31f76b None admin] REQUEST_METHOD: `GET` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:48:00.406002 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-074167d0-bb91-4a5d-88d4-46fcaa31f76b None admin] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:48:00.406002 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-074167d0-bb91-4a5d-88d4-46fcaa31f76b None admin] PATH_INFO: `/v3/users/683ef9fe0e0b447fa79754de54b75fd9` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:48:00.407421 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-074167d0-bb91-4a5d-88d4-46fcaa31f76b None admin] RBAC: Authorizing `identity:get_user(user_id=683ef9fe0e0b447fa79754de54b75fd9)` {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:48:00.408861 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-074167d0-bb91-4a5d-88d4-46fcaa31f76b None admin] RBAC: Authorization granted {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:48:00.410535 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 580/1158] 10.222.0.59 () {56 vars in 1177 bytes} [Thu Jun 2 15:48:00 2022] GET /identity/v3/users/683ef9fe0e0b447fa79754de54b75fd9 => generated 286 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 15:48:00.416240 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-469d750d-7d87-4009-a930-a97cc4229b27 None admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:48:00.492136 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writing DB stats keystone:SELECT=100 {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:48:00.512481 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-469d750d-7d87-4009-a930-a97cc4229b27 None admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:48:00.544063 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d23c4ef8-5bfc-47b8-a036-5a9ffc3b7cca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:48:00.544684 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23c4ef8-5bfc-47b8-a036-5a9ffc3b7cca None admin] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:48:00.544963 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23c4ef8-5bfc-47b8-a036-5a9ffc3b7cca None admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:48:00.545235 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23c4ef8-5bfc-47b8-a036-5a9ffc3b7cca None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:48:00.610718 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d23c4ef8-5bfc-47b8-a036-5a9ffc3b7cca None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:48:00.612147 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d23c4ef8-5bfc-47b8-a036-5a9ffc3b7cca None admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:48:00.685897 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writing DB stats keystone:SELECT=100 {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:48:00.707802 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 579/1159] 10.222.0.59 () {58 vars in 1282 bytes} [Thu Jun 2 15:48:00 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 292 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 02 15:48:00.713961 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-074167d0-bb91-4a5d-88d4-46fcaa31f76b None admin] Authenticating user token {{(pid=80396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:48:00.792327 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG dbcounter [-] [80396] Writing DB stats keystone:SELECT=100 {{(pid=80396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:48:00.809940 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-074167d0-bb91-4a5d-88d4-46fcaa31f76b None admin] Validating token access rules against request {{(pid=80396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:48:00.843151 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0761888f-8fa1-4be4-b5b4-fbef7f7fab8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:48:00.844776 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0761888f-8fa1-4be4-b5b4-fbef7f7fab8b None admin] REQUEST_METHOD: `GET` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:48:00.845053 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0761888f-8fa1-4be4-b5b4-fbef7f7fab8b None admin] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:48:00.845324 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0761888f-8fa1-4be4-b5b4-fbef7f7fab8b None admin] PATH_INFO: `/v3/projects/f2486d13b8c4463ea2985fe11b6baa3b` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:48:00.846572 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0761888f-8fa1-4be4-b5b4-fbef7f7fab8b None admin] RBAC: Authorizing `identity:get_project(project_id=f2486d13b8c4463ea2985fe11b6baa3b)` {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:48:00.847998 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0761888f-8fa1-4be4-b5b4-fbef7f7fab8b None admin] RBAC: Authorization granted {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:48:00.849688 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 581/1160] 10.222.0.59 () {56 vars in 1186 bytes} [Thu Jun 2 15:48:00 2022] GET /identity/v3/projects/f2486d13b8c4463ea2985fe11b6baa3b => generated 311 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 15:48:00.855914 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d23c4ef8-5bfc-47b8-a036-5a9ffc3b7cca None admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:48:00.953203 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d23c4ef8-5bfc-47b8-a036-5a9ffc3b7cca None admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:48:00.986634 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-341eba7d-c2bd-44c2-bbb3-5f6cc894d92f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:48:00.987266 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-341eba7d-c2bd-44c2-bbb3-5f6cc894d92f None admin] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:48:00.987548 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-341eba7d-c2bd-44c2-bbb3-5f6cc894d92f None admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:48:00.987825 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-341eba7d-c2bd-44c2-bbb3-5f6cc894d92f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:48:00.988644 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-341eba7d-c2bd-44c2-bbb3-5f6cc894d92f None admin] RBAC: Adding query filter params (role.id=f1e0c25f6e9049e897cb7350c7e54ab3, scope.project.id=f2486d13b8c4463ea2985fe11b6baa3b, user.id=683ef9fe0e0b447fa79754de54b75fd9) {{(pid=80395) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 15:48:00.988954 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-341eba7d-c2bd-44c2-bbb3-5f6cc894d92f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:48:00.990426 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-341eba7d-c2bd-44c2-bbb3-5f6cc894d92f None admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:48:00.996103 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 580/1161] 10.222.0.59 () {56 vars in 1374 bytes} [Thu Jun 2 15:48:00 2022] GET /identity/v3/role_assignments?user.id=683ef9fe0e0b447fa79754de54b75fd9&scope.project.id=f2486d13b8c4463ea2985fe11b6baa3b&role.id=f1e0c25f6e9049e897cb7350c7e54ab3 => generated 608 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 15:48:03.248666 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd3d4ea6-d79b-4eb6-8e83-fe79002584af None None] REQUEST_METHOD: `GET` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:48:03.249195 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd3d4ea6-d79b-4eb6-8e83-fe79002584af None None] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:48:03.249799 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd3d4ea6-d79b-4eb6-8e83-fe79002584af None None] PATH_INFO: `/` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:48:03.251535 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 582/1162] 10.222.0.59 () {54 vars in 926 bytes} [Thu Jun 2 15:48:03 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 15:48:03.256756 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e8e8d97-2900-4650-a971-0cdc44b2a6ee None None] REQUEST_METHOD: `POST` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:48:03.257148 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e8e8d97-2900-4650-a971-0cdc44b2a6ee None None] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:48:03.257300 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e8e8d97-2900-4650-a971-0cdc44b2a6ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:48:03.274051 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.auth.core [None req-5e8e8d97-2900-4650-a971-0cdc44b2a6ee None None] MFA Rules not processed for user `400d1f4db9de49638549e5db29a041e1`. Rule list: `[]` (Enabled: `True`). {{(pid=80395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 15:48:03.275260 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.fernet_utils [None req-5e8e8d97-2900-4650-a971-0cdc44b2a6ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 15:48:03.308283 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writing DB stats keystone:SELECT=100 {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:48:03.338912 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 581/1163] 10.222.0.59 () {58 vars in 1023 bytes} [Thu Jun 2 15:48:03 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 02 15:48:03.360906 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd3d4ea6-d79b-4eb6-8e83-fe79002584af None None] Authenticating user token {{(pid=80396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:48:03.461721 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd3d4ea6-d79b-4eb6-8e83-fe79002584af None None] Validating token access rules against request {{(pid=80396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:48:03.493886 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0547669-2964-4aa8-9e68-5598595c1f20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:48:03.494543 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0547669-2964-4aa8-9e68-5598595c1f20 None admin] REQUEST_METHOD: `GET` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:48:03.494828 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0547669-2964-4aa8-9e68-5598595c1f20 None admin] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:48:03.495105 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0547669-2964-4aa8-9e68-5598595c1f20 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:48:03.512958 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG dbcounter [-] [80396] Writing DB stats keystone:SELECT=100 {{(pid=80396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:48:03.688416 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0547669-2964-4aa8-9e68-5598595c1f20 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:48:03.689844 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0547669-2964-4aa8-9e68-5598595c1f20 None admin] RBAC: Authorization granted {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:48:03.784861 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 583/1164] 10.222.0.59 () {58 vars in 1282 bytes} [Thu Jun 2 15:48:03 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 424 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 02 15:48:03.790934 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e8e8d97-2900-4650-a971-0cdc44b2a6ee None None] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:48:03.885599 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e8e8d97-2900-4650-a971-0cdc44b2a6ee None None] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:48:03.918539 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-231b7ef7-22d0-459a-9457-c306835a5b0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:48:03.919315 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-231b7ef7-22d0-459a-9457-c306835a5b0c None admin] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:48:03.919593 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-231b7ef7-22d0-459a-9457-c306835a5b0c None admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:48:03.919863 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-231b7ef7-22d0-459a-9457-c306835a5b0c None admin] PATH_INFO: `/v3/domains/swift_test` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:48:03.926984 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-231b7ef7-22d0-459a-9457-c306835a5b0c None admin] RBAC: Authorizing `identity:get_domain(domain_id=swift_test)` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:48:03.928415 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-231b7ef7-22d0-459a-9457-c306835a5b0c None admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:48:03.942277 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application [None req-231b7ef7-22d0-459a-9457-c306835a5b0c None admin] Could not find domain: swift_test.: keystone.exception.DomainNotFound: Could not find domain: swift_test. Jun 02 15:48:03.942277 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 15:48:03.942277 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Jun 02 15:48:03.942277 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Jun 02 15:48:03.942277 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 02 15:48:03.942277 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 02 15:48:03.942277 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 02 15:48:03.942277 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 02 15:48:03.942277 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: swift_test. Jun 02 15:48:03.942277 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application Jun 02 15:48:03.942277 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 02 15:48:03.942277 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application Jun 02 15:48:03.942277 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 15:48:03.942277 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 15:48:03.942277 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 15:48:03.942277 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 15:48:03.942277 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 15:48:03.943522 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 15:48:03.943522 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 15:48:03.943522 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 15:48:03.943522 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 15:48:03.943522 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 15:48:03.943522 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 15:48:03.943522 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 02 15:48:03.943522 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 02 15:48:03.943522 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 02 15:48:03.943522 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 02 15:48:03.943522 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 15:48:03.943522 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 15:48:03.943522 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 15:48:03.943522 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 15:48:03.943522 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 15:48:03.943522 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 15:48:03.944609 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 15:48:03.944609 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application with Lock( Jun 02 15:48:03.944609 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 15:48:03.944609 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self._enter() Jun 02 15:48:03.944609 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 15:48:03.944609 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 15:48:03.944609 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 15:48:03.944609 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self.creator() Jun 02 15:48:03.944609 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 15:48:03.944609 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application created_value = creator( Jun 02 15:48:03.944609 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Jun 02 15:48:03.944609 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 02 15:48:03.944609 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: swift_test. Jun 02 15:48:03.944609 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application Jun 02 15:48:03.944609 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 582/1165] 10.222.0.59 () {56 vars in 1117 bytes} [Thu Jun 2 15:48:03 2022] GET /identity/v3/domains/swift_test => generated 90 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 15:48:03.949445 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0547669-2964-4aa8-9e68-5598595c1f20 None admin] Authenticating user token {{(pid=80396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:48:03.997476 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG dbcounter [-] [80396] Writing DB stats keystone:SELECT=100 {{(pid=80396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:48:04.045867 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0547669-2964-4aa8-9e68-5598595c1f20 None admin] Validating token access rules against request {{(pid=80396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:48:04.078515 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c274689b-58bd-42ff-bf0d-f1ea94e5d3b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:48:04.079159 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c274689b-58bd-42ff-bf0d-f1ea94e5d3b4 None admin] REQUEST_METHOD: `GET` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:48:04.079443 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c274689b-58bd-42ff-bf0d-f1ea94e5d3b4 None admin] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:48:04.079721 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c274689b-58bd-42ff-bf0d-f1ea94e5d3b4 None admin] PATH_INFO: `/v3/domains` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:48:04.080430 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c274689b-58bd-42ff-bf0d-f1ea94e5d3b4 None admin] RBAC: Adding query filter params (name=swift_test) {{(pid=80396) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 15:48:04.080735 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c274689b-58bd-42ff-bf0d-f1ea94e5d3b4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:48:04.082107 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c274689b-58bd-42ff-bf0d-f1ea94e5d3b4 None admin] RBAC: Authorization granted {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:48:04.089295 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 584/1166] 10.222.0.59 () {56 vars in 1115 bytes} [Thu Jun 2 15:48:03 2022] GET /identity/v3/domains?name=swift_test => generated 125 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 15:48:06.325825 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac4427d7-f61b-48bc-822b-58bf9fd25dbf None None] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:48:06.326364 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac4427d7-f61b-48bc-822b-58bf9fd25dbf None None] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:48:06.326469 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac4427d7-f61b-48bc-822b-58bf9fd25dbf None None] PATH_INFO: `/` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:48:06.327799 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 583/1167] 10.222.0.59 () {54 vars in 926 bytes} [Thu Jun 2 15:48:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 15:48:06.333116 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c887163-094c-40cd-9f89-dd2a8e0a8d42 None None] REQUEST_METHOD: `POST` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:48:06.333532 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c887163-094c-40cd-9f89-dd2a8e0a8d42 None None] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:48:06.333674 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c887163-094c-40cd-9f89-dd2a8e0a8d42 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:48:06.350863 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.auth.core [None req-6c887163-094c-40cd-9f89-dd2a8e0a8d42 None None] MFA Rules not processed for user `400d1f4db9de49638549e5db29a041e1`. Rule list: `[]` (Enabled: `True`). {{(pid=80396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 15:48:06.352031 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.fernet_utils [None req-6c887163-094c-40cd-9f89-dd2a8e0a8d42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 15:48:06.415402 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 585/1168] 10.222.0.59 () {58 vars in 1023 bytes} [Thu Jun 2 15:48:06 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 02 15:48:06.438581 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac4427d7-f61b-48bc-822b-58bf9fd25dbf None None] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:48:06.469589 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writing DB stats keystone:SELECT=100 {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:48:06.547762 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac4427d7-f61b-48bc-822b-58bf9fd25dbf None None] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:48:06.580720 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d94df06-ac36-439d-863f-425d15a320bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:48:06.581364 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d94df06-ac36-439d-863f-425d15a320bc None admin] REQUEST_METHOD: `POST` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:48:06.581646 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d94df06-ac36-439d-863f-425d15a320bc None admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:48:06.581920 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d94df06-ac36-439d-863f-425d15a320bc None admin] PATH_INFO: `/v3/domains` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:48:06.582695 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d94df06-ac36-439d-863f-425d15a320bc None admin] RBAC: Authorizing `identity:create_domain()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:48:06.584112 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d94df06-ac36-439d-863f-425d15a320bc None admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:48:06.703652 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 584/1169] 10.222.0.59 () {60 vars in 1138 bytes} [Thu Jun 2 15:48:06 2022] POST /identity/v3/domains => generated 267 bytes in 265 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 15:48:08.974926 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6f2dfe-a2b4-4503-8c0a-2eeb8455e924 None None] REQUEST_METHOD: `GET` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:48:08.975465 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6f2dfe-a2b4-4503-8c0a-2eeb8455e924 None None] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:48:08.975465 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6f2dfe-a2b4-4503-8c0a-2eeb8455e924 None None] PATH_INFO: `/` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:48:08.976842 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 586/1170] 10.222.0.59 () {54 vars in 926 bytes} [Thu Jun 2 15:48:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 15:48:08.981968 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd8bef78-1a1e-4021-9c62-04158f49362d None None] REQUEST_METHOD: `POST` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:48:08.982419 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd8bef78-1a1e-4021-9c62-04158f49362d None None] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:48:08.982565 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd8bef78-1a1e-4021-9c62-04158f49362d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:48:08.999194 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.auth.core [None req-bd8bef78-1a1e-4021-9c62-04158f49362d None None] MFA Rules not processed for user `400d1f4db9de49638549e5db29a041e1`. Rule list: `[]` (Enabled: `True`). {{(pid=80395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 15:48:09.000541 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.fernet_utils [None req-bd8bef78-1a1e-4021-9c62-04158f49362d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 15:48:09.065469 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 585/1171] 10.222.0.59 () {58 vars in 1023 bytes} [Thu Jun 2 15:48:08 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 02 15:48:09.089020 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d6f2dfe-a2b4-4503-8c0a-2eeb8455e924 None None] Authenticating user token {{(pid=80396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:48:09.132010 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG dbcounter [-] [80396] Writing DB stats keystone:SELECT=100 {{(pid=80396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:48:09.188202 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d6f2dfe-a2b4-4503-8c0a-2eeb8455e924 None None] Validating token access rules against request {{(pid=80396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:48:09.221376 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-885e0fd3-b477-4cb1-af54-620a40b536a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:48:09.222237 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-885e0fd3-b477-4cb1-af54-620a40b536a0 None admin] REQUEST_METHOD: `GET` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:48:09.222517 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-885e0fd3-b477-4cb1-af54-620a40b536a0 None admin] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:48:09.222785 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-885e0fd3-b477-4cb1-af54-620a40b536a0 None admin] PATH_INFO: `/v3/domains/a24870a2af0a47cdb0dca286695a6a37` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:48:09.232958 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-885e0fd3-b477-4cb1-af54-620a40b536a0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=a24870a2af0a47cdb0dca286695a6a37)` {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:48:09.234386 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-885e0fd3-b477-4cb1-af54-620a40b536a0 None admin] RBAC: Authorization granted {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:48:09.235986 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 587/1172] 10.222.0.59 () {56 vars in 1183 bytes} [Thu Jun 2 15:48:09 2022] GET /identity/v3/domains/a24870a2af0a47cdb0dca286695a6a37 => generated 267 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 15:48:09.241725 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd8bef78-1a1e-4021-9c62-04158f49362d None None] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:48:09.266539 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:48:09.340729 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd8bef78-1a1e-4021-9c62-04158f49362d None None] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:48:09.374348 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-653605db-ecd1-4b0f-8bd2-06e8734a8d92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:48:09.375305 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653605db-ecd1-4b0f-8bd2-06e8734a8d92 None admin] REQUEST_METHOD: `POST` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:48:09.375593 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653605db-ecd1-4b0f-8bd2-06e8734a8d92 None admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:48:09.375871 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653605db-ecd1-4b0f-8bd2-06e8734a8d92 None admin] PATH_INFO: `/v3/projects` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:48:09.376583 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-653605db-ecd1-4b0f-8bd2-06e8734a8d92 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:48:09.377999 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-653605db-ecd1-4b0f-8bd2-06e8734a8d92 None admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:48:09.492256 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 586/1173] 10.222.0.59 () {60 vars in 1141 bytes} [Thu Jun 2 15:48:09 2022] POST /identity/v3/projects => generated 361 bytes in 251 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 15:48:11.763226 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f82890-7926-462c-9cd2-dc968bf7463d None None] REQUEST_METHOD: `GET` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:48:11.763750 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f82890-7926-462c-9cd2-dc968bf7463d None None] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:48:11.763858 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f82890-7926-462c-9cd2-dc968bf7463d None None] PATH_INFO: `/` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:48:11.765882 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 588/1174] 10.222.0.59 () {54 vars in 926 bytes} [Thu Jun 2 15:48:11 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 15:48:11.771351 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61bc1b36-4c1a-41ab-a2bf-90f8a7398e3c None None] REQUEST_METHOD: `POST` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:48:11.771774 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61bc1b36-4c1a-41ab-a2bf-90f8a7398e3c None None] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:48:11.771914 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61bc1b36-4c1a-41ab-a2bf-90f8a7398e3c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:48:11.788435 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.auth.core [None req-61bc1b36-4c1a-41ab-a2bf-90f8a7398e3c None None] MFA Rules not processed for user `400d1f4db9de49638549e5db29a041e1`. Rule list: `[]` (Enabled: `True`). {{(pid=80395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 15:48:11.789609 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.fernet_utils [None req-61bc1b36-4c1a-41ab-a2bf-90f8a7398e3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 15:48:11.854711 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 587/1175] 10.222.0.59 () {58 vars in 1023 bytes} [Thu Jun 2 15:48:11 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 02 15:48:11.880172 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f82890-7926-462c-9cd2-dc968bf7463d None None] Authenticating user token {{(pid=80396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:48:11.977393 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f82890-7926-462c-9cd2-dc968bf7463d None None] Validating token access rules against request {{(pid=80396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:48:11.978891 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG dbcounter [-] [80396] Writing DB stats keystone:SELECT=100 {{(pid=80396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:48:12.010766 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc81a3bd-23e8-44a7-bdf3-d62ccf6da7cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:48:12.011600 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc81a3bd-23e8-44a7-bdf3-d62ccf6da7cd None admin] REQUEST_METHOD: `GET` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:48:12.011879 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc81a3bd-23e8-44a7-bdf3-d62ccf6da7cd None admin] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:48:12.012150 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc81a3bd-23e8-44a7-bdf3-d62ccf6da7cd None admin] PATH_INFO: `/v3/domains/a24870a2af0a47cdb0dca286695a6a37` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:48:12.013357 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc81a3bd-23e8-44a7-bdf3-d62ccf6da7cd None admin] RBAC: Authorizing `identity:get_domain(domain_id=a24870a2af0a47cdb0dca286695a6a37)` {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:48:12.015035 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc81a3bd-23e8-44a7-bdf3-d62ccf6da7cd None admin] RBAC: Authorization granted {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:48:12.016903 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 589/1176] 10.222.0.59 () {56 vars in 1183 bytes} [Thu Jun 2 15:48:11 2022] GET /identity/v3/domains/a24870a2af0a47cdb0dca286695a6a37 => generated 267 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 15:48:12.022514 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61bc1b36-4c1a-41ab-a2bf-90f8a7398e3c None None] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:48:12.025534 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:48:12.118137 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61bc1b36-4c1a-41ab-a2bf-90f8a7398e3c None None] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:48:12.150566 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57fa027e-1867-4cd1-8aaf-6da32a4c556c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:48:12.151218 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57fa027e-1867-4cd1-8aaf-6da32a4c556c None admin] REQUEST_METHOD: `POST` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:48:12.151497 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57fa027e-1867-4cd1-8aaf-6da32a4c556c None admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:48:12.151767 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57fa027e-1867-4cd1-8aaf-6da32a4c556c None admin] PATH_INFO: `/v3/users` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:48:12.152469 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57fa027e-1867-4cd1-8aaf-6da32a4c556c None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:48:12.153884 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57fa027e-1867-4cd1-8aaf-6da32a4c556c None admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:48:12.262661 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 588/1177] 10.222.0.59 () {60 vars in 1132 bytes} [Thu Jun 2 15:48:12 2022] POST /identity/v3/users => generated 311 bytes in 241 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 15:48:14.593529 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a8693bc-de66-48c0-bf2f-65a7f5c22f5f None None] REQUEST_METHOD: `GET` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:48:14.594054 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a8693bc-de66-48c0-bf2f-65a7f5c22f5f None None] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:48:14.594054 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a8693bc-de66-48c0-bf2f-65a7f5c22f5f None None] PATH_INFO: `/` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:48:14.595396 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 590/1178] 10.222.0.59 () {54 vars in 926 bytes} [Thu Jun 2 15:48:14 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 15:48:14.600679 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f083907e-39e2-4265-919a-7670ef1e66e9 None None] REQUEST_METHOD: `POST` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:48:14.601082 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f083907e-39e2-4265-919a-7670ef1e66e9 None None] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:48:14.601241 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f083907e-39e2-4265-919a-7670ef1e66e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:48:14.618294 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.auth.core [None req-f083907e-39e2-4265-919a-7670ef1e66e9 None None] MFA Rules not processed for user `400d1f4db9de49638549e5db29a041e1`. Rule list: `[]` (Enabled: `True`). {{(pid=80395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 15:48:14.619463 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.fernet_utils [None req-f083907e-39e2-4265-919a-7670ef1e66e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 15:48:14.673120 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:48:14.683713 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 589/1179] 10.222.0.59 () {58 vars in 1023 bytes} [Thu Jun 2 15:48:14 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 02 15:48:14.707511 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a8693bc-de66-48c0-bf2f-65a7f5c22f5f None None] Authenticating user token {{(pid=80396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:48:14.806575 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a8693bc-de66-48c0-bf2f-65a7f5c22f5f None None] Validating token access rules against request {{(pid=80396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:48:14.839528 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88c33d30-4cb1-45b4-8145-2261c9cb2193 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:48:14.843458 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c33d30-4cb1-45b4-8145-2261c9cb2193 None admin] REQUEST_METHOD: `GET` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:48:14.843458 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c33d30-4cb1-45b4-8145-2261c9cb2193 None admin] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:48:14.843458 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c33d30-4cb1-45b4-8145-2261c9cb2193 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:48:14.854796 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88c33d30-4cb1-45b4-8145-2261c9cb2193 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 02 15:48:14.862817 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application [None req-88c33d30-4cb1-45b4-8145-2261c9cb2193 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 02 15:48:14.862817 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 15:48:14.862817 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 15:48:14.862817 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 15:48:14.862817 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 15:48:14.862817 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 15:48:14.862817 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 15:48:14.862817 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 15:48:14.862817 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 15:48:14.862817 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 15:48:14.862817 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 15:48:14.862817 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 15:48:14.862817 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 02 15:48:14.862817 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 02 15:48:14.862817 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 02 15:48:14.862817 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 02 15:48:14.863905 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 02 15:48:14.863905 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 02 15:48:14.863905 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 02 15:48:14.863905 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 02 15:48:14.863905 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 15:48:14.863905 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 15:48:14.863905 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 15:48:14.863905 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 15:48:14.863905 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 15:48:14.863905 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 15:48:14.863905 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 15:48:14.863905 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application with Lock( Jun 02 15:48:14.863905 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 15:48:14.863905 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application return self._enter() Jun 02 15:48:14.863905 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 15:48:14.863905 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 15:48:14.864933 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 15:48:14.864933 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application return self.creator() Jun 02 15:48:14.864933 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 15:48:14.864933 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application created_value = creator( Jun 02 15:48:14.864933 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 02 15:48:14.864933 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 02 15:48:14.864933 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 02 15:48:14.864933 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 02 15:48:14.864933 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 02 15:48:14.864933 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 02 15:48:14.864933 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 02 15:48:14.864933 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application Jun 02 15:48:14.864933 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 591/1180] 10.222.0.59 () {56 vars in 1096 bytes} [Thu Jun 2 15:48:14 2022] GET /identity/v3/roles/admin => generated 83 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 15:48:14.869939 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f083907e-39e2-4265-919a-7670ef1e66e9 None None] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:48:14.966453 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f083907e-39e2-4265-919a-7670ef1e66e9 None None] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:48:15.000027 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31414185-fdb6-461e-992f-c95669e7cb7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:48:15.000681 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31414185-fdb6-461e-992f-c95669e7cb7a None admin] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:48:15.000964 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31414185-fdb6-461e-992f-c95669e7cb7a None admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:48:15.001239 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31414185-fdb6-461e-992f-c95669e7cb7a None admin] PATH_INFO: `/v3/roles` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:48:15.001981 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31414185-fdb6-461e-992f-c95669e7cb7a None admin] RBAC: Adding query filter params (name=admin) {{(pid=80395) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 15:48:15.002345 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31414185-fdb6-461e-992f-c95669e7cb7a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:48:15.003712 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31414185-fdb6-461e-992f-c95669e7cb7a None admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:48:15.011608 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 590/1181] 10.222.0.59 () {56 vars in 1099 bytes} [Thu Jun 2 15:48:14 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 15:48:15.017213 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88c33d30-4cb1-45b4-8145-2261c9cb2193 None admin] Authenticating user token {{(pid=80396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:48:15.048040 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG dbcounter [-] [80396] Writing DB stats keystone:SELECT=100 {{(pid=80396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:48:15.116718 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88c33d30-4cb1-45b4-8145-2261c9cb2193 None admin] Validating token access rules against request {{(pid=80396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:48:15.149515 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1263188-6f93-4507-af31-eb12045bca2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:48:15.150391 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1263188-6f93-4507-af31-eb12045bca2e None admin] REQUEST_METHOD: `GET` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:48:15.150675 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1263188-6f93-4507-af31-eb12045bca2e None admin] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:48:15.150952 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1263188-6f93-4507-af31-eb12045bca2e None admin] PATH_INFO: `/v3/users/5f027096cbb042abb9e076ba16a4e22e` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:48:15.163557 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1263188-6f93-4507-af31-eb12045bca2e None admin] RBAC: Authorizing `identity:get_user(user_id=5f027096cbb042abb9e076ba16a4e22e)` {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:48:15.165002 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1263188-6f93-4507-af31-eb12045bca2e None admin] RBAC: Authorization granted {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:48:15.166658 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 592/1182] 10.222.0.59 () {56 vars in 1177 bytes} [Thu Jun 2 15:48:15 2022] GET /identity/v3/users/5f027096cbb042abb9e076ba16a4e22e => generated 311 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 15:48:15.176070 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31414185-fdb6-461e-992f-c95669e7cb7a None admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:48:15.226417 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writing DB stats keystone:SELECT=100 {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:48:15.272113 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31414185-fdb6-461e-992f-c95669e7cb7a None admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:48:15.305782 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3305696-0dcf-4b67-aa7a-2447ac43b258 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:48:15.306446 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3305696-0dcf-4b67-aa7a-2447ac43b258 None admin] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:48:15.306731 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3305696-0dcf-4b67-aa7a-2447ac43b258 None admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:48:15.307007 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3305696-0dcf-4b67-aa7a-2447ac43b258 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:48:15.372549 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3305696-0dcf-4b67-aa7a-2447ac43b258 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:48:15.374173 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3305696-0dcf-4b67-aa7a-2447ac43b258 None admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:48:15.424224 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writing DB stats keystone:SELECT=100 {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:48:15.470761 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 591/1183] 10.222.0.59 () {58 vars in 1282 bytes} [Thu Jun 2 15:48:15 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 298 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 02 15:48:15.476619 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1263188-6f93-4507-af31-eb12045bca2e None admin] Authenticating user token {{(pid=80396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:48:15.564302 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG dbcounter [-] [80396] Writing DB stats keystone:SELECT=100 {{(pid=80396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:48:15.575715 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1263188-6f93-4507-af31-eb12045bca2e None admin] Validating token access rules against request {{(pid=80396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:48:15.610150 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b2fda63-b3db-4d98-8b06-ef6c14933130 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:48:15.610987 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b2fda63-b3db-4d98-8b06-ef6c14933130 None admin] REQUEST_METHOD: `GET` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:48:15.611268 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b2fda63-b3db-4d98-8b06-ef6c14933130 None admin] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:48:15.611542 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b2fda63-b3db-4d98-8b06-ef6c14933130 None admin] PATH_INFO: `/v3/projects/31a533d6ec164bcf93518c0a72db7589` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:48:15.612698 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b2fda63-b3db-4d98-8b06-ef6c14933130 None admin] RBAC: Authorizing `identity:get_project(project_id=31a533d6ec164bcf93518c0a72db7589)` {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:48:15.614124 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b2fda63-b3db-4d98-8b06-ef6c14933130 None admin] RBAC: Authorization granted {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:48:15.615778 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 593/1184] 10.222.0.59 () {56 vars in 1186 bytes} [Thu Jun 2 15:48:15 2022] GET /identity/v3/projects/31a533d6ec164bcf93518c0a72db7589 => generated 361 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 15:48:15.621786 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3305696-0dcf-4b67-aa7a-2447ac43b258 None admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:48:15.719001 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3305696-0dcf-4b67-aa7a-2447ac43b258 None admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:48:15.751970 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a606feb1-1ae7-4c5b-9bbc-d30f51536c29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:48:15.752606 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a606feb1-1ae7-4c5b-9bbc-d30f51536c29 None admin] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:48:15.752891 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a606feb1-1ae7-4c5b-9bbc-d30f51536c29 None admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:48:15.753166 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a606feb1-1ae7-4c5b-9bbc-d30f51536c29 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:48:15.753995 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a606feb1-1ae7-4c5b-9bbc-d30f51536c29 None admin] RBAC: Adding query filter params (role.id=f1e0c25f6e9049e897cb7350c7e54ab3, scope.project.id=31a533d6ec164bcf93518c0a72db7589, user.id=5f027096cbb042abb9e076ba16a4e22e) {{(pid=80395) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 15:48:15.754332 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a606feb1-1ae7-4c5b-9bbc-d30f51536c29 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:48:15.755813 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a606feb1-1ae7-4c5b-9bbc-d30f51536c29 None admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:48:15.761186 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 592/1185] 10.222.0.59 () {56 vars in 1374 bytes} [Thu Jun 2 15:48:15 2022] GET /identity/v3/role_assignments?user.id=5f027096cbb042abb9e076ba16a4e22e&scope.project.id=31a533d6ec164bcf93518c0a72db7589&role.id=f1e0c25f6e9049e897cb7350c7e54ab3 => generated 259 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 15:48:17.941168 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef63dcf-8d27-4737-8784-ed6fb6b28d02 None None] REQUEST_METHOD: `GET` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:48:17.941702 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef63dcf-8d27-4737-8784-ed6fb6b28d02 None None] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:48:17.941702 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef63dcf-8d27-4737-8784-ed6fb6b28d02 None None] PATH_INFO: `/` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:48:17.943118 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 594/1186] 10.222.0.59 () {54 vars in 926 bytes} [Thu Jun 2 15:48:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 15:48:17.948195 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde9f0b3-3e2b-41b5-bd69-0b7e36bc6bcc None None] REQUEST_METHOD: `POST` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:48:17.948601 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde9f0b3-3e2b-41b5-bd69-0b7e36bc6bcc None None] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:48:17.948772 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde9f0b3-3e2b-41b5-bd69-0b7e36bc6bcc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:48:17.965470 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.auth.core [None req-bde9f0b3-3e2b-41b5-bd69-0b7e36bc6bcc None None] MFA Rules not processed for user `400d1f4db9de49638549e5db29a041e1`. Rule list: `[]` (Enabled: `True`). {{(pid=80395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 15:48:17.966712 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.fernet_utils [None req-bde9f0b3-3e2b-41b5-bd69-0b7e36bc6bcc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 15:48:17.977304 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writing DB stats keystone:SELECT=100 {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:48:18.033604 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 593/1187] 10.222.0.59 () {58 vars in 1023 bytes} [Thu Jun 2 15:48:17 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 02 15:48:18.057303 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cef63dcf-8d27-4737-8784-ed6fb6b28d02 None None] Authenticating user token {{(pid=80396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:48:18.156411 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cef63dcf-8d27-4737-8784-ed6fb6b28d02 None None] Validating token access rules against request {{(pid=80396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:48:18.193733 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcad67bb-b5b3-46e4-b1e6-e948c118af33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:48:18.194482 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcad67bb-b5b3-46e4-b1e6-e948c118af33 None admin] REQUEST_METHOD: `GET` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:48:18.194761 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcad67bb-b5b3-46e4-b1e6-e948c118af33 None admin] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:48:18.195142 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcad67bb-b5b3-46e4-b1e6-e948c118af33 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:48:18.205135 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcad67bb-b5b3-46e4-b1e6-e948c118af33 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 02 15:48:18.213002 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application [None req-fcad67bb-b5b3-46e4-b1e6-e948c118af33 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 02 15:48:18.213002 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 15:48:18.213002 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 15:48:18.213002 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 15:48:18.213002 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 15:48:18.213002 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 15:48:18.213002 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 15:48:18.213002 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 15:48:18.213002 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 15:48:18.213002 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 15:48:18.213002 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 15:48:18.213002 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 15:48:18.213002 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 02 15:48:18.213002 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 02 15:48:18.213002 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 02 15:48:18.213002 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 02 15:48:18.214128 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 02 15:48:18.214128 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 02 15:48:18.214128 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 02 15:48:18.214128 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 02 15:48:18.214128 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 15:48:18.214128 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 15:48:18.214128 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 15:48:18.214128 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 15:48:18.214128 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 15:48:18.214128 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 15:48:18.214128 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 15:48:18.214128 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application with Lock( Jun 02 15:48:18.214128 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 15:48:18.214128 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application return self._enter() Jun 02 15:48:18.214128 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 15:48:18.214128 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 15:48:18.215120 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 15:48:18.215120 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application return self.creator() Jun 02 15:48:18.215120 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 15:48:18.215120 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application created_value = creator( Jun 02 15:48:18.215120 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 02 15:48:18.215120 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 02 15:48:18.215120 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 02 15:48:18.215120 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 02 15:48:18.215120 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 02 15:48:18.215120 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 02 15:48:18.215120 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 02 15:48:18.215120 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application Jun 02 15:48:18.215120 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 595/1188] 10.222.0.59 () {56 vars in 1096 bytes} [Thu Jun 2 15:48:18 2022] GET /identity/v3/roles/admin => generated 83 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 15:48:18.220762 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bde9f0b3-3e2b-41b5-bd69-0b7e36bc6bcc None None] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:48:18.318004 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bde9f0b3-3e2b-41b5-bd69-0b7e36bc6bcc None None] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:48:18.351086 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81f6dda7-3868-4799-b0d1-3dd4fe79575f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:48:18.351747 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f6dda7-3868-4799-b0d1-3dd4fe79575f None admin] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:48:18.352029 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f6dda7-3868-4799-b0d1-3dd4fe79575f None admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:48:18.352303 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f6dda7-3868-4799-b0d1-3dd4fe79575f None admin] PATH_INFO: `/v3/roles` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:48:18.353049 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81f6dda7-3868-4799-b0d1-3dd4fe79575f None admin] RBAC: Adding query filter params (name=admin) {{(pid=80395) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 15:48:18.353356 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81f6dda7-3868-4799-b0d1-3dd4fe79575f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:48:18.354752 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81f6dda7-3868-4799-b0d1-3dd4fe79575f None admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:48:18.363421 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 594/1189] 10.222.0.59 () {56 vars in 1099 bytes} [Thu Jun 2 15:48:18 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 15:48:18.369238 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcad67bb-b5b3-46e4-b1e6-e948c118af33 None admin] Authenticating user token {{(pid=80396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:48:18.387620 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG dbcounter [-] [80396] Writing DB stats keystone:SELECT=100 {{(pid=80396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:48:18.466557 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcad67bb-b5b3-46e4-b1e6-e948c118af33 None admin] Validating token access rules against request {{(pid=80396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:48:18.499732 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3299afcf-af56-45e6-a764-357818a5a537 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:48:18.500569 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3299afcf-af56-45e6-a764-357818a5a537 None admin] REQUEST_METHOD: `GET` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:48:18.500842 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3299afcf-af56-45e6-a764-357818a5a537 None admin] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:48:18.501107 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3299afcf-af56-45e6-a764-357818a5a537 None admin] PATH_INFO: `/v3/users/5f027096cbb042abb9e076ba16a4e22e` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:48:18.502284 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3299afcf-af56-45e6-a764-357818a5a537 None admin] RBAC: Authorizing `identity:get_user(user_id=5f027096cbb042abb9e076ba16a4e22e)` {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:48:18.503695 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3299afcf-af56-45e6-a764-357818a5a537 None admin] RBAC: Authorization granted {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:48:18.505327 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 596/1190] 10.222.0.59 () {56 vars in 1177 bytes} [Thu Jun 2 15:48:18 2022] GET /identity/v3/users/5f027096cbb042abb9e076ba16a4e22e => generated 311 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 15:48:18.511135 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81f6dda7-3868-4799-b0d1-3dd4fe79575f None admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:48:18.522123 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writing DB stats keystone:SELECT=100 {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:48:18.607212 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81f6dda7-3868-4799-b0d1-3dd4fe79575f None admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:48:18.638671 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-054ad520-7a13-4e27-b020-018cc240ba02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:48:18.640166 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054ad520-7a13-4e27-b020-018cc240ba02 None admin] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:48:18.640445 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054ad520-7a13-4e27-b020-018cc240ba02 None admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:48:18.640718 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054ad520-7a13-4e27-b020-018cc240ba02 None admin] PATH_INFO: `/v3/projects/31a533d6ec164bcf93518c0a72db7589` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:48:18.641876 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-054ad520-7a13-4e27-b020-018cc240ba02 None admin] RBAC: Authorizing `identity:get_project(project_id=31a533d6ec164bcf93518c0a72db7589)` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:48:18.643319 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-054ad520-7a13-4e27-b020-018cc240ba02 None admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:48:18.644953 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 595/1191] 10.222.0.59 () {56 vars in 1186 bytes} [Thu Jun 2 15:48:18 2022] GET /identity/v3/projects/31a533d6ec164bcf93518c0a72db7589 => generated 361 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 15:48:18.650798 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3299afcf-af56-45e6-a764-357818a5a537 None admin] Authenticating user token {{(pid=80396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:48:18.733083 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG dbcounter [-] [80396] Writing DB stats keystone:SELECT=100 {{(pid=80396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:48:18.747389 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3299afcf-af56-45e6-a764-357818a5a537 None admin] Validating token access rules against request {{(pid=80396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:48:18.780702 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7df91f1c-fb2b-4b19-9257-534e3ad9f3d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:48:18.781553 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df91f1c-fb2b-4b19-9257-534e3ad9f3d4 None admin] REQUEST_METHOD: `PUT` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:48:18.781828 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df91f1c-fb2b-4b19-9257-534e3ad9f3d4 None admin] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:48:18.782118 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df91f1c-fb2b-4b19-9257-534e3ad9f3d4 None admin] PATH_INFO: `/v3/projects/31a533d6ec164bcf93518c0a72db7589/users/5f027096cbb042abb9e076ba16a4e22e/roles/f1e0c25f6e9049e897cb7350c7e54ab3` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:48:18.784003 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7df91f1c-fb2b-4b19-9257-534e3ad9f3d4 None admin] RBAC: Authorizing `identity:create_grant(project_id=31a533d6ec164bcf93518c0a72db7589, user_id=5f027096cbb042abb9e076ba16a4e22e, role_id=f1e0c25f6e9049e897cb7350c7e54ab3)` {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:48:18.785396 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7df91f1c-fb2b-4b19-9257-534e3ad9f3d4 None admin] RBAC: Authorization granted {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:48:18.873042 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 597/1192] 10.222.0.59 () {58 vars in 1439 bytes} [Thu Jun 2 15:48:18 2022] PUT /identity/v3/projects/31a533d6ec164bcf93518c0a72db7589/users/5f027096cbb042abb9e076ba16a4e22e/roles/f1e0c25f6e9049e897cb7350c7e54ab3 => generated 0 bytes in 223 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 15:48:21.097578 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e450410-dc53-42cc-8f94-49a081c175ff None None] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:48:21.098182 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e450410-dc53-42cc-8f94-49a081c175ff None None] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:48:21.098182 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e450410-dc53-42cc-8f94-49a081c175ff None None] PATH_INFO: `/` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:48:21.099512 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 596/1193] 10.222.0.59 () {54 vars in 926 bytes} [Thu Jun 2 15:48:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 15:48:21.104778 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b0113e-f02c-4fc4-8664-1f52c742893c None None] REQUEST_METHOD: `POST` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:48:21.105198 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b0113e-f02c-4fc4-8664-1f52c742893c None None] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:48:21.105326 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b0113e-f02c-4fc4-8664-1f52c742893c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:48:21.121535 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.auth.core [None req-58b0113e-f02c-4fc4-8664-1f52c742893c None None] MFA Rules not processed for user `400d1f4db9de49638549e5db29a041e1`. Rule list: `[]` (Enabled: `True`). {{(pid=80396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 15:48:21.122731 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.fernet_utils [None req-58b0113e-f02c-4fc4-8664-1f52c742893c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 15:48:21.188711 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 598/1194] 10.222.0.59 () {58 vars in 1023 bytes} [Thu Jun 2 15:48:21 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 02 15:48:21.212696 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e450410-dc53-42cc-8f94-49a081c175ff None None] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:48:21.288454 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writing DB stats keystone:SELECT=100 {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:48:21.313252 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e450410-dc53-42cc-8f94-49a081c175ff None None] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:48:21.351215 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bbba66d-59ad-468c-a4e8-9c3199abe950 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:48:21.351917 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bbba66d-59ad-468c-a4e8-9c3199abe950 None admin] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:48:21.352196 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bbba66d-59ad-468c-a4e8-9c3199abe950 None admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:48:21.352467 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bbba66d-59ad-468c-a4e8-9c3199abe950 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:48:21.363370 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bbba66d-59ad-468c-a4e8-9c3199abe950 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 02 15:48:21.370871 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application [None req-4bbba66d-59ad-468c-a4e8-9c3199abe950 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 02 15:48:21.370871 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 15:48:21.370871 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 15:48:21.370871 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 15:48:21.370871 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 15:48:21.370871 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 15:48:21.370871 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 15:48:21.370871 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 15:48:21.370871 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 15:48:21.370871 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 15:48:21.370871 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 15:48:21.370871 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 15:48:21.370871 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 02 15:48:21.370871 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 02 15:48:21.370871 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 02 15:48:21.370871 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 02 15:48:21.371945 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 02 15:48:21.371945 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 02 15:48:21.371945 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 02 15:48:21.371945 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 02 15:48:21.371945 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 15:48:21.371945 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 15:48:21.371945 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 15:48:21.371945 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 15:48:21.371945 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 15:48:21.371945 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 15:48:21.371945 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 15:48:21.371945 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application with Lock( Jun 02 15:48:21.371945 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 15:48:21.371945 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self._enter() Jun 02 15:48:21.371945 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 15:48:21.371945 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 15:48:21.373851 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 15:48:21.373851 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self.creator() Jun 02 15:48:21.373851 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 15:48:21.373851 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application created_value = creator( Jun 02 15:48:21.373851 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 02 15:48:21.373851 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 02 15:48:21.373851 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 02 15:48:21.373851 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 02 15:48:21.373851 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 02 15:48:21.373851 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 02 15:48:21.373851 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 02 15:48:21.373851 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application Jun 02 15:48:21.373851 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 597/1195] 10.222.0.59 () {56 vars in 1096 bytes} [Thu Jun 2 15:48:21 2022] GET /identity/v3/roles/admin => generated 83 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 15:48:21.378796 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58b0113e-f02c-4fc4-8664-1f52c742893c None None] Authenticating user token {{(pid=80396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:48:21.448505 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG dbcounter [-] [80396] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:48:21.472699 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58b0113e-f02c-4fc4-8664-1f52c742893c None None] Validating token access rules against request {{(pid=80396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:48:21.505922 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af16983d-de1f-4c8f-8f0d-7e47d8930c76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:48:21.506599 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af16983d-de1f-4c8f-8f0d-7e47d8930c76 None admin] REQUEST_METHOD: `GET` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:48:21.506880 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af16983d-de1f-4c8f-8f0d-7e47d8930c76 None admin] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:48:21.507153 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af16983d-de1f-4c8f-8f0d-7e47d8930c76 None admin] PATH_INFO: `/v3/roles` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:48:21.507880 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af16983d-de1f-4c8f-8f0d-7e47d8930c76 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80396) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 15:48:21.508181 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af16983d-de1f-4c8f-8f0d-7e47d8930c76 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:48:21.509521 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af16983d-de1f-4c8f-8f0d-7e47d8930c76 None admin] RBAC: Authorization granted {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:48:21.518025 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 599/1196] 10.222.0.59 () {56 vars in 1099 bytes} [Thu Jun 2 15:48:21 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 15:48:21.523683 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bbba66d-59ad-468c-a4e8-9c3199abe950 None admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:48:21.620547 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bbba66d-59ad-468c-a4e8-9c3199abe950 None admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:48:21.652992 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76f0aa66-6364-4d1d-b7cb-637f2300f01e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:48:21.653836 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f0aa66-6364-4d1d-b7cb-637f2300f01e None admin] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:48:21.654714 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f0aa66-6364-4d1d-b7cb-637f2300f01e None admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:48:21.655099 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f0aa66-6364-4d1d-b7cb-637f2300f01e None admin] PATH_INFO: `/v3/users/5f027096cbb042abb9e076ba16a4e22e` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:48:21.656272 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76f0aa66-6364-4d1d-b7cb-637f2300f01e None admin] RBAC: Authorizing `identity:get_user(user_id=5f027096cbb042abb9e076ba16a4e22e)` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:48:21.657693 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76f0aa66-6364-4d1d-b7cb-637f2300f01e None admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:48:21.659297 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 598/1197] 10.222.0.59 () {56 vars in 1177 bytes} [Thu Jun 2 15:48:21 2022] GET /identity/v3/users/5f027096cbb042abb9e076ba16a4e22e => generated 311 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 15:48:21.664898 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af16983d-de1f-4c8f-8f0d-7e47d8930c76 None admin] Authenticating user token {{(pid=80396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:48:21.761930 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af16983d-de1f-4c8f-8f0d-7e47d8930c76 None admin] Validating token access rules against request {{(pid=80396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:48:21.794589 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e89de4b-d474-4797-8320-2648b6144e7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:48:21.795831 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e89de4b-d474-4797-8320-2648b6144e7f None admin] REQUEST_METHOD: `GET` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:48:21.796128 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e89de4b-d474-4797-8320-2648b6144e7f None admin] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:48:21.796405 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e89de4b-d474-4797-8320-2648b6144e7f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:48:21.799731 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG dbcounter [-] [80396] Writing DB stats keystone:SELECT=100 {{(pid=80396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:48:21.862575 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e89de4b-d474-4797-8320-2648b6144e7f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:48:21.864005 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e89de4b-d474-4797-8320-2648b6144e7f None admin] RBAC: Authorization granted {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:48:21.958221 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 600/1198] 10.222.0.59 () {58 vars in 1282 bytes} [Thu Jun 2 15:48:21 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 294 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 02 15:48:21.964387 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76f0aa66-6364-4d1d-b7cb-637f2300f01e None admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:48:21.968673 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writing DB stats keystone:SELECT=100 {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:48:22.061002 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76f0aa66-6364-4d1d-b7cb-637f2300f01e None admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:48:22.094085 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14969803-3302-4eae-9d47-0ecedb220687 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:48:22.094988 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14969803-3302-4eae-9d47-0ecedb220687 None admin] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:48:22.095273 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14969803-3302-4eae-9d47-0ecedb220687 None admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:48:22.095551 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14969803-3302-4eae-9d47-0ecedb220687 None admin] PATH_INFO: `/v3/projects/31a533d6ec164bcf93518c0a72db7589` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:48:22.096715 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14969803-3302-4eae-9d47-0ecedb220687 None admin] RBAC: Authorizing `identity:get_project(project_id=31a533d6ec164bcf93518c0a72db7589)` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:48:22.098197 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14969803-3302-4eae-9d47-0ecedb220687 None admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:48:22.099866 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 599/1199] 10.222.0.59 () {56 vars in 1186 bytes} [Thu Jun 2 15:48:21 2022] GET /identity/v3/projects/31a533d6ec164bcf93518c0a72db7589 => generated 361 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 15:48:22.105818 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e89de4b-d474-4797-8320-2648b6144e7f None admin] Authenticating user token {{(pid=80396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:48:22.139946 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG dbcounter [-] [80396] Writing DB stats keystone:SELECT=100 {{(pid=80396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:48:22.205747 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e89de4b-d474-4797-8320-2648b6144e7f None admin] Validating token access rules against request {{(pid=80396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:48:22.240435 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6c3ca5a-0ac1-4fd2-9c6f-366f8022fb0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:48:22.241014 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c3ca5a-0ac1-4fd2-9c6f-366f8022fb0b None admin] REQUEST_METHOD: `GET` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:48:22.241298 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c3ca5a-0ac1-4fd2-9c6f-366f8022fb0b None admin] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:48:22.241574 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c3ca5a-0ac1-4fd2-9c6f-366f8022fb0b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:48:22.242428 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6c3ca5a-0ac1-4fd2-9c6f-366f8022fb0b None admin] RBAC: Adding query filter params (role.id=f1e0c25f6e9049e897cb7350c7e54ab3, scope.project.id=31a533d6ec164bcf93518c0a72db7589, user.id=5f027096cbb042abb9e076ba16a4e22e) {{(pid=80396) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 15:48:22.242741 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6c3ca5a-0ac1-4fd2-9c6f-366f8022fb0b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:48:22.244158 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6c3ca5a-0ac1-4fd2-9c6f-366f8022fb0b None admin] RBAC: Authorization granted {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:48:22.250217 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 601/1200] 10.222.0.59 () {56 vars in 1374 bytes} [Thu Jun 2 15:48:22 2022] GET /identity/v3/role_assignments?user.id=5f027096cbb042abb9e076ba16a4e22e&scope.project.id=31a533d6ec164bcf93518c0a72db7589&role.id=f1e0c25f6e9049e897cb7350c7e54ab3 => generated 608 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 15:48:32.089324 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writing DB stats keystone:SELECT=64 {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:48:32.247328 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG dbcounter [-] [80396] Writing DB stats keystone:SELECT=50 {{(pid=80396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:49:44.731499 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b806663d-7c78-42c6-94e6-9d4556ea003b None None] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:49:44.732109 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b806663d-7c78-42c6-94e6-9d4556ea003b None None] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:49:44.732109 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b806663d-7c78-42c6-94e6-9d4556ea003b None None] PATH_INFO: `/` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:49:44.733428 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 600/1201] 10.222.0.59 () {54 vars in 926 bytes} [Thu Jun 2 15:49:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 15:49:44.738813 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7deb5f33-aa03-49ee-8df0-133b19ba377f None None] REQUEST_METHOD: `POST` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:49:44.739263 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7deb5f33-aa03-49ee-8df0-133b19ba377f None None] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:49:44.739484 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7deb5f33-aa03-49ee-8df0-133b19ba377f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:49:44.756228 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.auth.core [None req-7deb5f33-aa03-49ee-8df0-133b19ba377f None None] MFA Rules not processed for user `400d1f4db9de49638549e5db29a041e1`. Rule list: `[]` (Enabled: `True`). {{(pid=80396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 15:49:44.757399 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.fernet_utils [None req-7deb5f33-aa03-49ee-8df0-133b19ba377f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 15:49:44.822961 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 602/1202] 10.222.0.59 () {58 vars in 1023 bytes} [Thu Jun 2 15:49:44 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 02 15:49:44.847811 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b806663d-7c78-42c6-94e6-9d4556ea003b None None] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:49:44.950067 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b806663d-7c78-42c6-94e6-9d4556ea003b None None] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:49:44.988325 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-873566c6-6bee-48d4-bcc3-18d8ad6915b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:49:44.988325 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-873566c6-6bee-48d4-bcc3-18d8ad6915b8 None admin] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:49:44.988325 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-873566c6-6bee-48d4-bcc3-18d8ad6915b8 None admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:49:44.988325 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-873566c6-6bee-48d4-bcc3-18d8ad6915b8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:49:44.995416 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-873566c6-6bee-48d4-bcc3-18d8ad6915b8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:49:44.996844 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-873566c6-6bee-48d4-bcc3-18d8ad6915b8 None admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:49:45.014061 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application [None req-873566c6-6bee-48d4-bcc3-18d8ad6915b8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 15:49:45.014061 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 15:49:45.014061 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 15:49:45.014061 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 15:49:45.014061 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 15:49:45.014061 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 15:49:45.014061 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 15:49:45.014061 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 15:49:45.014061 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 15:49:45.014061 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 15:49:45.014061 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 15:49:45.014061 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 15:49:45.014061 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 02 15:49:45.014061 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 02 15:49:45.014061 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 02 15:49:45.015219 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 02 15:49:45.015219 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 15:49:45.015219 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 15:49:45.015219 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 15:49:45.015219 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 15:49:45.015219 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 15:49:45.015219 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 15:49:45.015219 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 15:49:45.015219 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application with Lock( Jun 02 15:49:45.015219 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 15:49:45.015219 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self._enter() Jun 02 15:49:45.015219 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 15:49:45.015219 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 15:49:45.015219 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 15:49:45.015219 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self.creator() Jun 02 15:49:45.015219 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 15:49:45.015219 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application created_value = creator( Jun 02 15:49:45.021475 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 02 15:49:45.021475 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 02 15:49:45.021475 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 15:49:45.021475 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application Jun 02 15:49:45.021475 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 601/1203] 10.222.0.59 () {56 vars in 1108 bytes} [Thu Jun 2 15:49:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 15:49:45.021855 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7deb5f33-aa03-49ee-8df0-133b19ba377f None None] Authenticating user token {{(pid=80396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:49:45.117386 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7deb5f33-aa03-49ee-8df0-133b19ba377f None None] Validating token access rules against request {{(pid=80396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:49:45.145324 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG dbcounter [-] [80396] Writing DB stats keystone:SELECT=100 {{(pid=80396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:49:45.151523 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97f446ee-b04e-4a49-8964-04000d1e340d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:49:45.152172 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f446ee-b04e-4a49-8964-04000d1e340d None admin] REQUEST_METHOD: `GET` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:49:45.152455 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f446ee-b04e-4a49-8964-04000d1e340d None admin] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:49:45.152733 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f446ee-b04e-4a49-8964-04000d1e340d None admin] PATH_INFO: `/v3/domains` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:49:45.153439 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97f446ee-b04e-4a49-8964-04000d1e340d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80396) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 15:49:45.153744 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97f446ee-b04e-4a49-8964-04000d1e340d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:49:45.155127 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97f446ee-b04e-4a49-8964-04000d1e340d None admin] RBAC: Authorization granted {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:49:45.166618 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 603/1204] 10.222.0.59 () {56 vars in 1109 bytes} [Thu Jun 2 15:49:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 15:49:45.172542 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-873566c6-6bee-48d4-bcc3-18d8ad6915b8 None admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:49:45.225415 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writing DB stats keystone:SELECT=100 {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:49:45.270916 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-873566c6-6bee-48d4-bcc3-18d8ad6915b8 None admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:49:45.304740 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d804a98d-d757-427f-b06c-6749e12ed666 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:49:45.305398 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d804a98d-d757-427f-b06c-6749e12ed666 None admin] REQUEST_METHOD: `POST` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:49:45.305676 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d804a98d-d757-427f-b06c-6749e12ed666 None admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:49:45.306000 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d804a98d-d757-427f-b06c-6749e12ed666 None admin] PATH_INFO: `/v3/users` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:49:45.306727 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d804a98d-d757-427f-b06c-6749e12ed666 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:49:45.308292 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d804a98d-d757-427f-b06c-6749e12ed666 None admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:49:45.409617 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 602/1205] 10.222.0.59 () {60 vars in 1132 bytes} [Thu Jun 2 15:49:45 2022] POST /identity/v3/users => generated 251 bytes in 238 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 15:49:47.701291 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-885b92c4-18e1-4cf0-b914-c38df511d09b None None] REQUEST_METHOD: `GET` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:49:47.701847 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-885b92c4-18e1-4cf0-b914-c38df511d09b None None] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:49:47.701847 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-885b92c4-18e1-4cf0-b914-c38df511d09b None None] PATH_INFO: `/` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:49:47.703278 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 604/1206] 10.222.0.59 () {54 vars in 926 bytes} [Thu Jun 2 15:49:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 15:49:47.709317 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d23091-86df-4ee5-9022-d1ad5b983a7f None None] REQUEST_METHOD: `POST` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:49:47.709757 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d23091-86df-4ee5-9022-d1ad5b983a7f None None] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:49:47.709865 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d23091-86df-4ee5-9022-d1ad5b983a7f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:49:47.726607 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.auth.core [None req-78d23091-86df-4ee5-9022-d1ad5b983a7f None None] MFA Rules not processed for user `400d1f4db9de49638549e5db29a041e1`. Rule list: `[]` (Enabled: `True`). {{(pid=80395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 15:49:47.727795 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.fernet_utils [None req-78d23091-86df-4ee5-9022-d1ad5b983a7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 15:49:47.795211 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 603/1207] 10.222.0.59 () {58 vars in 1023 bytes} [Thu Jun 2 15:49:47 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 02 15:49:47.819799 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-885b92c4-18e1-4cf0-b914-c38df511d09b None None] Authenticating user token {{(pid=80396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:49:47.922284 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-885b92c4-18e1-4cf0-b914-c38df511d09b None None] Validating token access rules against request {{(pid=80396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:49:47.955880 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19654165-d069-482c-9a3d-d4c72c9c8ae0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:49:47.956588 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19654165-d069-482c-9a3d-d4c72c9c8ae0 None admin] REQUEST_METHOD: `GET` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:49:47.956865 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19654165-d069-482c-9a3d-d4c72c9c8ae0 None admin] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:49:47.957140 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19654165-d069-482c-9a3d-d4c72c9c8ae0 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:49:47.967313 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19654165-d069-482c-9a3d-d4c72c9c8ae0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 02 15:49:47.974915 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application [None req-19654165-d069-482c-9a3d-d4c72c9c8ae0 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 02 15:49:47.974915 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 15:49:47.974915 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 15:49:47.974915 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 15:49:47.974915 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 15:49:47.974915 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 15:49:47.974915 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 15:49:47.974915 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 15:49:47.974915 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 15:49:47.974915 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 15:49:47.974915 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 15:49:47.974915 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 15:49:47.974915 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 02 15:49:47.974915 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 02 15:49:47.974915 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 02 15:49:47.974915 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 02 15:49:47.975988 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 02 15:49:47.975988 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 02 15:49:47.975988 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 02 15:49:47.975988 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 02 15:49:47.975988 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 15:49:47.975988 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 15:49:47.975988 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 15:49:47.975988 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 15:49:47.975988 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 15:49:47.975988 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 15:49:47.975988 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 15:49:47.975988 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application with Lock( Jun 02 15:49:47.975988 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 15:49:47.975988 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application return self._enter() Jun 02 15:49:47.975988 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 15:49:47.975988 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 15:49:47.977040 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 15:49:47.977040 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application return self.creator() Jun 02 15:49:47.977040 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 15:49:47.977040 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application created_value = creator( Jun 02 15:49:47.977040 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 02 15:49:47.977040 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 02 15:49:47.977040 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 02 15:49:47.977040 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 02 15:49:47.977040 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 02 15:49:47.977040 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 02 15:49:47.977040 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 02 15:49:47.977040 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application Jun 02 15:49:47.977040 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 605/1208] 10.222.0.59 () {56 vars in 1102 bytes} [Thu Jun 2 15:49:47 2022] GET /identity/v3/roles/service => generated 85 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 15:49:47.983040 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78d23091-86df-4ee5-9022-d1ad5b983a7f None None] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:49:48.023269 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:49:48.081067 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78d23091-86df-4ee5-9022-d1ad5b983a7f None None] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:49:48.114336 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7300d02f-51b9-45d9-94b4-af6e96060811 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:49:48.115241 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7300d02f-51b9-45d9-94b4-af6e96060811 None admin] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:49:48.115585 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7300d02f-51b9-45d9-94b4-af6e96060811 None admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:49:48.116023 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7300d02f-51b9-45d9-94b4-af6e96060811 None admin] PATH_INFO: `/v3/roles` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:49:48.117123 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7300d02f-51b9-45d9-94b4-af6e96060811 None admin] RBAC: Adding query filter params (name=service) {{(pid=80395) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 15:49:48.117470 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7300d02f-51b9-45d9-94b4-af6e96060811 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:49:48.119532 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7300d02f-51b9-45d9-94b4-af6e96060811 None admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:49:48.127830 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 604/1209] 10.222.0.59 () {56 vars in 1103 bytes} [Thu Jun 2 15:49:47 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 15:49:48.132886 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19654165-d069-482c-9a3d-d4c72c9c8ae0 None admin] Authenticating user token {{(pid=80396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:49:48.184188 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG dbcounter [-] [80396] Writing DB stats keystone:SELECT=100 {{(pid=80396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:49:48.234633 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19654165-d069-482c-9a3d-d4c72c9c8ae0 None admin] Validating token access rules against request {{(pid=80396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:49:48.267890 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae3534e9-b327-470a-945a-a45cb733d2ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:49:48.268709 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae3534e9-b327-470a-945a-a45cb733d2ba None admin] REQUEST_METHOD: `GET` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:49:48.268992 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae3534e9-b327-470a-945a-a45cb733d2ba None admin] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:49:48.269267 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae3534e9-b327-470a-945a-a45cb733d2ba None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:49:48.280458 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae3534e9-b327-470a-945a-a45cb733d2ba None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:49:48.281880 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae3534e9-b327-470a-945a-a45cb733d2ba None admin] RBAC: Authorization granted {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:49:48.299303 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application [None req-ae3534e9-b327-470a-945a-a45cb733d2ba None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 15:49:48.299303 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 15:49:48.299303 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 15:49:48.299303 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 15:49:48.299303 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 15:49:48.299303 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 15:49:48.299303 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 15:49:48.299303 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 15:49:48.299303 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 15:49:48.299303 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 15:49:48.299303 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 15:49:48.299303 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 15:49:48.299303 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 02 15:49:48.299303 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 02 15:49:48.299303 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 02 15:49:48.300391 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 02 15:49:48.300391 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 15:49:48.300391 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 15:49:48.300391 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 15:49:48.300391 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 15:49:48.300391 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 15:49:48.300391 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 15:49:48.300391 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 15:49:48.300391 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application with Lock( Jun 02 15:49:48.300391 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 15:49:48.300391 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application return self._enter() Jun 02 15:49:48.300391 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 15:49:48.300391 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 15:49:48.300391 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 15:49:48.300391 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application return self.creator() Jun 02 15:49:48.300391 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 15:49:48.300391 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application created_value = creator( Jun 02 15:49:48.301351 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 02 15:49:48.301351 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 02 15:49:48.301351 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 15:49:48.301351 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application Jun 02 15:49:48.301351 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 606/1210] 10.222.0.59 () {56 vars in 1108 bytes} [Thu Jun 2 15:49:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 15:49:48.306470 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7300d02f-51b9-45d9-94b4-af6e96060811 None admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:49:48.410812 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writing DB stats keystone:SELECT=100 {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:49:48.413665 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7300d02f-51b9-45d9-94b4-af6e96060811 None admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:49:48.446884 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfbdd9c4-66a1-47aa-bb64-715c08e5d263 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:49:48.447619 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfbdd9c4-66a1-47aa-bb64-715c08e5d263 None admin] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:49:48.447904 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfbdd9c4-66a1-47aa-bb64-715c08e5d263 None admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:49:48.448182 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfbdd9c4-66a1-47aa-bb64-715c08e5d263 None admin] PATH_INFO: `/v3/domains` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:49:48.448920 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfbdd9c4-66a1-47aa-bb64-715c08e5d263 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80395) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 15:49:48.449218 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfbdd9c4-66a1-47aa-bb64-715c08e5d263 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:49:48.450620 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfbdd9c4-66a1-47aa-bb64-715c08e5d263 None admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:49:48.462083 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 605/1211] 10.222.0.59 () {56 vars in 1109 bytes} [Thu Jun 2 15:49:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 15:49:48.468570 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae3534e9-b327-470a-945a-a45cb733d2ba None admin] Authenticating user token {{(pid=80396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:49:48.569297 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae3534e9-b327-470a-945a-a45cb733d2ba None admin] Validating token access rules against request {{(pid=80396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:49:48.570773 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG dbcounter [-] [80396] Writing DB stats keystone:SELECT=100 {{(pid=80396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:49:48.605312 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcdbd70c-7835-4b65-9a89-3739396791db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:49:48.606132 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcdbd70c-7835-4b65-9a89-3739396791db None admin] REQUEST_METHOD: `GET` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:49:48.606436 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcdbd70c-7835-4b65-9a89-3739396791db None admin] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:49:48.606698 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcdbd70c-7835-4b65-9a89-3739396791db None admin] PATH_INFO: `/v3/users/placement` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:49:48.613801 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcdbd70c-7835-4b65-9a89-3739396791db None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:49:48.615465 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcdbd70c-7835-4b65-9a89-3739396791db None admin] RBAC: Authorization granted {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:49:48.631179 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application [None req-bcdbd70c-7835-4b65-9a89-3739396791db None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jun 02 15:49:48.631179 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 15:49:48.631179 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 15:49:48.631179 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 15:49:48.631179 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 15:49:48.631179 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 15:49:48.631179 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 15:49:48.631179 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 15:49:48.631179 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 15:49:48.631179 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 15:49:48.631179 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 15:49:48.631179 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 15:49:48.631179 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 02 15:49:48.631179 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 02 15:49:48.631179 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 02 15:49:48.631179 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 02 15:49:48.632340 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 15:49:48.632340 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 15:49:48.632340 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 02 15:49:48.632340 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 02 15:49:48.632340 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 02 15:49:48.632340 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 02 15:49:48.632340 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 15:49:48.632340 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 15:49:48.632340 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 15:49:48.632340 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 15:49:48.632340 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 15:49:48.632340 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application with Lock( Jun 02 15:49:48.632340 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 15:49:48.632340 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application return self._enter() Jun 02 15:49:48.632340 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 15:49:48.632340 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 15:49:48.632340 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 15:49:48.632340 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application return self.creator() Jun 02 15:49:48.633311 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 15:49:48.633311 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application created_value = creator( Jun 02 15:49:48.633311 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 02 15:49:48.633311 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 02 15:49:48.633311 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 02 15:49:48.633311 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 02 15:49:48.633311 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 02 15:49:48.633311 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 02 15:49:48.633311 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jun 02 15:49:48.633311 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application Jun 02 15:49:48.633311 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 607/1212] 10.222.0.59 () {56 vars in 1108 bytes} [Thu Jun 2 15:49:48 2022] GET /identity/v3/users/placement => generated 87 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 15:49:48.638937 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfbdd9c4-66a1-47aa-bb64-715c08e5d263 None admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:49:48.736295 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfbdd9c4-66a1-47aa-bb64-715c08e5d263 None admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:49:48.769631 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bcdbd08-202a-48b5-a647-0c0b1b1c603e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:49:48.770313 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bcdbd08-202a-48b5-a647-0c0b1b1c603e None admin] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:49:48.770594 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bcdbd08-202a-48b5-a647-0c0b1b1c603e None admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:49:48.770866 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bcdbd08-202a-48b5-a647-0c0b1b1c603e None admin] PATH_INFO: `/v3/users` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:49:48.771688 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bcdbd08-202a-48b5-a647-0c0b1b1c603e None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80395) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 15:49:48.771992 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bcdbd08-202a-48b5-a647-0c0b1b1c603e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:49:48.773410 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bcdbd08-202a-48b5-a647-0c0b1b1c603e None admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:49:48.791027 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 606/1213] 10.222.0.59 () {56 vars in 1143 bytes} [Thu Jun 2 15:49:48 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 15:49:48.797195 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcdbd70c-7835-4b65-9a89-3739396791db None admin] Authenticating user token {{(pid=80396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:49:48.952444 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcdbd70c-7835-4b65-9a89-3739396791db None admin] Validating token access rules against request {{(pid=80396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:49:48.952444 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf1c54a6-c626-4a59-bc05-7bea16338fd7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:49:48.952444 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf1c54a6-c626-4a59-bc05-7bea16338fd7 None admin] REQUEST_METHOD: `GET` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:49:48.952444 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf1c54a6-c626-4a59-bc05-7bea16338fd7 None admin] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:49:48.952873 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf1c54a6-c626-4a59-bc05-7bea16338fd7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:49:48.966717 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG dbcounter [-] [80396] Writing DB stats keystone:SELECT=100 {{(pid=80396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:49:49.002866 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf1c54a6-c626-4a59-bc05-7bea16338fd7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:49:49.004307 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf1c54a6-c626-4a59-bc05-7bea16338fd7 None admin] RBAC: Authorization granted {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:49:49.100595 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 608/1214] 10.222.0.59 () {58 vars in 1282 bytes} [Thu Jun 2 15:49:48 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 304 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 02 15:49:49.107071 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bcdbd08-202a-48b5-a647-0c0b1b1c603e None admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:49:49.125766 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writing DB stats keystone:SELECT=100 {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:49:49.205465 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bcdbd08-202a-48b5-a647-0c0b1b1c603e None admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:49:49.239455 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6908bbc9-a60c-4a93-8854-308867dd3d15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:49:49.240233 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6908bbc9-a60c-4a93-8854-308867dd3d15 None admin] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:49:49.240517 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6908bbc9-a60c-4a93-8854-308867dd3d15 None admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:49:49.240791 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6908bbc9-a60c-4a93-8854-308867dd3d15 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:49:49.251646 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6908bbc9-a60c-4a93-8854-308867dd3d15 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:49:49.256383 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6908bbc9-a60c-4a93-8854-308867dd3d15 None admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:49:49.270446 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application [None req-6908bbc9-a60c-4a93-8854-308867dd3d15 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 15:49:49.270446 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 15:49:49.270446 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 15:49:49.270446 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 15:49:49.270446 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 15:49:49.270446 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 15:49:49.270446 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 15:49:49.270446 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 15:49:49.270446 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 15:49:49.270446 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 15:49:49.270446 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 15:49:49.270446 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 15:49:49.270446 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 02 15:49:49.270446 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 02 15:49:49.270446 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 02 15:49:49.271528 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 02 15:49:49.271528 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 15:49:49.271528 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 15:49:49.271528 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 15:49:49.271528 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 15:49:49.271528 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 15:49:49.271528 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 15:49:49.271528 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 15:49:49.271528 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application with Lock( Jun 02 15:49:49.271528 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 15:49:49.271528 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self._enter() Jun 02 15:49:49.271528 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 15:49:49.271528 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 15:49:49.271528 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 15:49:49.271528 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self.creator() Jun 02 15:49:49.271528 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 15:49:49.271528 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application created_value = creator( Jun 02 15:49:49.272660 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 02 15:49:49.272660 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 02 15:49:49.272660 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 15:49:49.272660 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application Jun 02 15:49:49.272660 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 607/1215] 10.222.0.59 () {56 vars in 1108 bytes} [Thu Jun 2 15:49:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 15:49:49.278158 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf1c54a6-c626-4a59-bc05-7bea16338fd7 None admin] Authenticating user token {{(pid=80396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:49:49.338607 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG dbcounter [-] [80396] Writing DB stats keystone:SELECT=100 {{(pid=80396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:49:49.375692 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf1c54a6-c626-4a59-bc05-7bea16338fd7 None admin] Validating token access rules against request {{(pid=80396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:49:49.408588 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b22cf4c-c7c9-47c0-ab46-3e151b34d77d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:49:49.409245 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b22cf4c-c7c9-47c0-ab46-3e151b34d77d None admin] REQUEST_METHOD: `GET` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:49:49.409530 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b22cf4c-c7c9-47c0-ab46-3e151b34d77d None admin] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:49:49.409805 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b22cf4c-c7c9-47c0-ab46-3e151b34d77d None admin] PATH_INFO: `/v3/domains` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:49:49.410556 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b22cf4c-c7c9-47c0-ab46-3e151b34d77d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80396) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 15:49:49.410862 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b22cf4c-c7c9-47c0-ab46-3e151b34d77d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:49:49.412283 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b22cf4c-c7c9-47c0-ab46-3e151b34d77d None admin] RBAC: Authorization granted {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:49:49.424137 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 609/1216] 10.222.0.59 () {56 vars in 1109 bytes} [Thu Jun 2 15:49:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 15:49:49.429953 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6908bbc9-a60c-4a93-8854-308867dd3d15 None admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:49:49.499261 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writing DB stats keystone:SELECT=100 {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:49:49.529193 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6908bbc9-a60c-4a93-8854-308867dd3d15 None admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:49:49.563326 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bfdeb4b-b13b-4603-91af-b96242e111b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:49:49.564113 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bfdeb4b-b13b-4603-91af-b96242e111b7 None admin] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:49:49.564394 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bfdeb4b-b13b-4603-91af-b96242e111b7 None admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:49:49.564669 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bfdeb4b-b13b-4603-91af-b96242e111b7 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:49:49.571305 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bfdeb4b-b13b-4603-91af-b96242e111b7 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:49:49.574150 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bfdeb4b-b13b-4603-91af-b96242e111b7 None admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:49:49.588733 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application [None req-5bfdeb4b-b13b-4603-91af-b96242e111b7 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 02 15:49:49.588733 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 15:49:49.588733 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 15:49:49.588733 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 15:49:49.588733 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 15:49:49.588733 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 15:49:49.588733 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 15:49:49.588733 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 15:49:49.588733 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 15:49:49.588733 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 15:49:49.588733 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 15:49:49.588733 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 15:49:49.588733 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 02 15:49:49.588733 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 02 15:49:49.588733 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 02 15:49:49.589783 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 02 15:49:49.589783 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 15:49:49.589783 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 15:49:49.589783 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 15:49:49.589783 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 15:49:49.589783 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 15:49:49.589783 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 15:49:49.589783 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 15:49:49.589783 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application with Lock( Jun 02 15:49:49.589783 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 15:49:49.589783 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self._enter() Jun 02 15:49:49.589783 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 15:49:49.589783 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 15:49:49.589783 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 15:49:49.589783 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self.creator() Jun 02 15:49:49.589783 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 15:49:49.589783 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application created_value = creator( Jun 02 15:49:49.590958 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 02 15:49:49.590958 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 02 15:49:49.590958 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 02 15:49:49.590958 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 02 15:49:49.590958 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 02 15:49:49.590958 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 02 15:49:49.590958 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 02 15:49:49.590958 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application Jun 02 15:49:49.590958 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 608/1217] 10.222.0.59 () {56 vars in 1111 bytes} [Thu Jun 2 15:49:49 2022] GET /identity/v3/projects/service => generated 88 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 15:49:49.595938 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b22cf4c-c7c9-47c0-ab46-3e151b34d77d None admin] Authenticating user token {{(pid=80396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:49:49.696233 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b22cf4c-c7c9-47c0-ab46-3e151b34d77d None admin] Validating token access rules against request {{(pid=80396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:49:49.719541 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG dbcounter [-] [80396] Writing DB stats keystone:SELECT=100 {{(pid=80396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:49:49.730690 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c80009d6-a2f1-411e-b6e1-f4e09a7c2e69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:49:49.731332 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80009d6-a2f1-411e-b6e1-f4e09a7c2e69 None admin] REQUEST_METHOD: `GET` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:49:49.731610 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80009d6-a2f1-411e-b6e1-f4e09a7c2e69 None admin] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:49:49.731883 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80009d6-a2f1-411e-b6e1-f4e09a7c2e69 None admin] PATH_INFO: `/v3/projects` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:49:49.732651 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c80009d6-a2f1-411e-b6e1-f4e09a7c2e69 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80396) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 15:49:49.732956 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c80009d6-a2f1-411e-b6e1-f4e09a7c2e69 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:49:49.734438 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c80009d6-a2f1-411e-b6e1-f4e09a7c2e69 None admin] RBAC: Authorization granted {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:49:49.746842 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 610/1218] 10.222.0.59 () {56 vars in 1148 bytes} [Thu Jun 2 15:49:49 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 15:49:49.753034 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bfdeb4b-b13b-4603-91af-b96242e111b7 None admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:49:49.853115 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bfdeb4b-b13b-4603-91af-b96242e111b7 None admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:49:49.880814 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writing DB stats keystone:SELECT=100 {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:49:49.887296 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20ccfdcc-78fb-4567-af4f-dbdb57112c7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:49:49.887935 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ccfdcc-78fb-4567-af4f-dbdb57112c7f None admin] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:49:49.888213 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ccfdcc-78fb-4567-af4f-dbdb57112c7f None admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:49:49.888484 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ccfdcc-78fb-4567-af4f-dbdb57112c7f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:49:49.889296 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20ccfdcc-78fb-4567-af4f-dbdb57112c7f None admin] RBAC: Adding query filter params (role.id=36214aa6067e4493a555da410f965c5e, scope.project.id=9c87c981909d4b8db02783421818c79b, user.id=2b700f6d94374ba4b362a8f0d5b35796) {{(pid=80395) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 15:49:49.889604 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20ccfdcc-78fb-4567-af4f-dbdb57112c7f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:49:49.891100 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20ccfdcc-78fb-4567-af4f-dbdb57112c7f None admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:49:49.896490 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 609/1219] 10.222.0.59 () {56 vars in 1374 bytes} [Thu Jun 2 15:49:49 2022] GET /identity/v3/role_assignments?user.id=2b700f6d94374ba4b362a8f0d5b35796&scope.project.id=9c87c981909d4b8db02783421818c79b&role.id=36214aa6067e4493a555da410f965c5e => generated 259 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 15:49:52.102393 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b540a1-d7cd-479b-8168-d939dbd0f6fe None None] REQUEST_METHOD: `GET` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:49:52.102929 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b540a1-d7cd-479b-8168-d939dbd0f6fe None None] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:49:52.103038 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b540a1-d7cd-479b-8168-d939dbd0f6fe None None] PATH_INFO: `/` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:49:52.105057 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 611/1220] 10.222.0.59 () {54 vars in 926 bytes} [Thu Jun 2 15:49:52 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 15:49:52.110414 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b6aaea-b946-4ccc-99c2-17cc05ece202 None None] REQUEST_METHOD: `POST` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:49:52.110833 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b6aaea-b946-4ccc-99c2-17cc05ece202 None None] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:49:52.110971 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b6aaea-b946-4ccc-99c2-17cc05ece202 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:49:52.128535 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.auth.core [None req-e2b6aaea-b946-4ccc-99c2-17cc05ece202 None None] MFA Rules not processed for user `400d1f4db9de49638549e5db29a041e1`. Rule list: `[]` (Enabled: `True`). {{(pid=80395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 15:49:52.129799 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.fernet_utils [None req-e2b6aaea-b946-4ccc-99c2-17cc05ece202 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 15:49:52.194995 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 610/1221] 10.222.0.59 () {58 vars in 1023 bytes} [Thu Jun 2 15:49:52 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 02 15:49:52.219657 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62b540a1-d7cd-479b-8168-d939dbd0f6fe None None] Authenticating user token {{(pid=80396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:49:52.321687 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62b540a1-d7cd-479b-8168-d939dbd0f6fe None None] Validating token access rules against request {{(pid=80396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:49:52.359150 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e88f206-fafe-4734-8c8b-d38828bf1550 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:49:52.359150 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e88f206-fafe-4734-8c8b-d38828bf1550 None admin] REQUEST_METHOD: `GET` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:49:52.359150 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e88f206-fafe-4734-8c8b-d38828bf1550 None admin] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:49:52.359150 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e88f206-fafe-4734-8c8b-d38828bf1550 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:49:52.366933 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e88f206-fafe-4734-8c8b-d38828bf1550 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 02 15:49:52.375196 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application [None req-0e88f206-fafe-4734-8c8b-d38828bf1550 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 02 15:49:52.375196 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 15:49:52.375196 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 15:49:52.375196 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 15:49:52.375196 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 15:49:52.375196 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 15:49:52.375196 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 15:49:52.375196 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 15:49:52.375196 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 15:49:52.375196 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 15:49:52.375196 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 15:49:52.375196 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 15:49:52.375196 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 02 15:49:52.375196 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 02 15:49:52.375196 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 02 15:49:52.375196 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 02 15:49:52.376164 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 02 15:49:52.376164 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 02 15:49:52.376164 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 02 15:49:52.376164 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 02 15:49:52.376164 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 15:49:52.376164 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 15:49:52.376164 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 15:49:52.376164 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 15:49:52.376164 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 15:49:52.376164 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 15:49:52.376164 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 15:49:52.376164 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application with Lock( Jun 02 15:49:52.376164 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 15:49:52.376164 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application return self._enter() Jun 02 15:49:52.376164 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 15:49:52.376164 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 15:49:52.377137 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 15:49:52.377137 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application return self.creator() Jun 02 15:49:52.377137 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 15:49:52.377137 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application created_value = creator( Jun 02 15:49:52.377137 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 02 15:49:52.377137 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 02 15:49:52.377137 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 02 15:49:52.377137 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 02 15:49:52.377137 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 02 15:49:52.377137 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 02 15:49:52.377137 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 02 15:49:52.377137 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application Jun 02 15:49:52.377137 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 612/1222] 10.222.0.59 () {56 vars in 1102 bytes} [Thu Jun 2 15:49:52 2022] GET /identity/v3/roles/service => generated 85 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 02 15:49:52.382657 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2b6aaea-b946-4ccc-99c2-17cc05ece202 None None] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:49:52.480488 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2b6aaea-b946-4ccc-99c2-17cc05ece202 None None] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:49:52.503481 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writing DB stats keystone:SELECT=100 {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:49:52.513912 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82c54977-1377-40d3-9fe1-e1123103f2fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:49:52.514610 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c54977-1377-40d3-9fe1-e1123103f2fb None admin] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:49:52.514983 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c54977-1377-40d3-9fe1-e1123103f2fb None admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:49:52.515257 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c54977-1377-40d3-9fe1-e1123103f2fb None admin] PATH_INFO: `/v3/roles` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:49:52.515998 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82c54977-1377-40d3-9fe1-e1123103f2fb None admin] RBAC: Adding query filter params (name=service) {{(pid=80395) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 15:49:52.516309 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82c54977-1377-40d3-9fe1-e1123103f2fb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:49:52.517673 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82c54977-1377-40d3-9fe1-e1123103f2fb None admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:49:52.525677 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 611/1223] 10.222.0.59 () {56 vars in 1103 bytes} [Thu Jun 2 15:49:52 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 15:49:52.531681 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e88f206-fafe-4734-8c8b-d38828bf1550 None admin] Authenticating user token {{(pid=80396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:49:52.576159 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG dbcounter [-] [80396] Writing DB stats keystone:SELECT=100 {{(pid=80396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:49:52.631702 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e88f206-fafe-4734-8c8b-d38828bf1550 None admin] Validating token access rules against request {{(pid=80396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:49:52.664382 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba582853-6a2b-4d8e-a682-1f2325336c31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:49:52.669544 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba582853-6a2b-4d8e-a682-1f2325336c31 None admin] REQUEST_METHOD: `GET` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:49:52.669544 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba582853-6a2b-4d8e-a682-1f2325336c31 None admin] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:49:52.669544 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba582853-6a2b-4d8e-a682-1f2325336c31 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:49:52.676840 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba582853-6a2b-4d8e-a682-1f2325336c31 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:49:52.678305 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba582853-6a2b-4d8e-a682-1f2325336c31 None admin] RBAC: Authorization granted {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:49:52.694994 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application [None req-ba582853-6a2b-4d8e-a682-1f2325336c31 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 15:49:52.694994 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 15:49:52.694994 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 15:49:52.694994 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 15:49:52.694994 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 15:49:52.694994 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 15:49:52.694994 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 15:49:52.694994 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 15:49:52.694994 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 15:49:52.694994 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 15:49:52.694994 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 15:49:52.694994 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 15:49:52.694994 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 02 15:49:52.694994 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 02 15:49:52.694994 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 02 15:49:52.699262 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 02 15:49:52.699262 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 15:49:52.699262 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 15:49:52.699262 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 15:49:52.699262 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 15:49:52.699262 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 15:49:52.699262 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 15:49:52.699262 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 15:49:52.699262 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application with Lock( Jun 02 15:49:52.699262 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 15:49:52.699262 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application return self._enter() Jun 02 15:49:52.699262 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 15:49:52.699262 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 15:49:52.699262 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 15:49:52.699262 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application return self.creator() Jun 02 15:49:52.699262 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 15:49:52.699262 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application created_value = creator( Jun 02 15:49:52.700382 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 02 15:49:52.700382 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 02 15:49:52.700382 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 15:49:52.700382 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application Jun 02 15:49:52.700382 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 613/1224] 10.222.0.59 () {56 vars in 1108 bytes} [Thu Jun 2 15:49:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 15:49:52.702118 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82c54977-1377-40d3-9fe1-e1123103f2fb None admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:49:52.799951 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82c54977-1377-40d3-9fe1-e1123103f2fb None admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:49:52.832068 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d63783c8-a8e1-4557-b207-cd12889148af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:49:52.832754 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d63783c8-a8e1-4557-b207-cd12889148af None admin] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:49:52.833035 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d63783c8-a8e1-4557-b207-cd12889148af None admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:49:52.833309 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d63783c8-a8e1-4557-b207-cd12889148af None admin] PATH_INFO: `/v3/domains` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:49:52.834305 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d63783c8-a8e1-4557-b207-cd12889148af None admin] RBAC: Adding query filter params (name=Default) {{(pid=80395) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 15:49:52.834609 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d63783c8-a8e1-4557-b207-cd12889148af None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:49:52.835998 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d63783c8-a8e1-4557-b207-cd12889148af None admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:49:52.848102 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 612/1225] 10.222.0.59 () {56 vars in 1109 bytes} [Thu Jun 2 15:49:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 15:49:52.854405 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba582853-6a2b-4d8e-a682-1f2325336c31 None admin] Authenticating user token {{(pid=80396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:49:52.945717 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG dbcounter [-] [80396] Writing DB stats keystone:SELECT=100 {{(pid=80396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:49:52.953203 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba582853-6a2b-4d8e-a682-1f2325336c31 None admin] Validating token access rules against request {{(pid=80396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:49:52.987845 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09f26cd6-b330-4023-93c2-574ac6a4d047 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:49:52.988628 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f26cd6-b330-4023-93c2-574ac6a4d047 None admin] REQUEST_METHOD: `GET` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:49:52.988909 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f26cd6-b330-4023-93c2-574ac6a4d047 None admin] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:49:52.989181 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f26cd6-b330-4023-93c2-574ac6a4d047 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:49:52.996140 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09f26cd6-b330-4023-93c2-574ac6a4d047 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:49:52.997570 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09f26cd6-b330-4023-93c2-574ac6a4d047 None admin] RBAC: Authorization granted {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:49:53.012082 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application [None req-09f26cd6-b330-4023-93c2-574ac6a4d047 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jun 02 15:49:53.012082 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 15:49:53.012082 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 15:49:53.012082 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 15:49:53.012082 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 15:49:53.012082 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 15:49:53.012082 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 15:49:53.012082 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 15:49:53.012082 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 15:49:53.012082 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 15:49:53.012082 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 15:49:53.012082 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 15:49:53.012082 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 02 15:49:53.012082 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 02 15:49:53.012082 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 02 15:49:53.012082 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 02 15:49:53.013156 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 15:49:53.013156 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 15:49:53.013156 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 02 15:49:53.013156 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 02 15:49:53.013156 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 02 15:49:53.013156 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 02 15:49:53.013156 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 15:49:53.013156 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 15:49:53.013156 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 15:49:53.013156 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 15:49:53.013156 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 15:49:53.013156 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application with Lock( Jun 02 15:49:53.013156 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 15:49:53.013156 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application return self._enter() Jun 02 15:49:53.013156 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 15:49:53.013156 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 15:49:53.013156 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 15:49:53.013156 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application return self.creator() Jun 02 15:49:53.014593 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 15:49:53.014593 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application created_value = creator( Jun 02 15:49:53.014593 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 02 15:49:53.014593 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 02 15:49:53.014593 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 02 15:49:53.014593 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 02 15:49:53.014593 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 02 15:49:53.014593 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 02 15:49:53.014593 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jun 02 15:49:53.014593 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application Jun 02 15:49:53.014593 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 614/1226] 10.222.0.59 () {56 vars in 1108 bytes} [Thu Jun 2 15:49:52 2022] GET /identity/v3/users/placement => generated 87 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 15:49:53.019134 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d63783c8-a8e1-4557-b207-cd12889148af None admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:49:53.066716 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writing DB stats keystone:SELECT=100 {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:49:53.119707 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d63783c8-a8e1-4557-b207-cd12889148af None admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:49:53.153834 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a89acfe6-3300-4840-b852-2dcf0b5632fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:49:53.154519 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a89acfe6-3300-4840-b852-2dcf0b5632fd None admin] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:49:53.154804 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a89acfe6-3300-4840-b852-2dcf0b5632fd None admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:49:53.155077 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a89acfe6-3300-4840-b852-2dcf0b5632fd None admin] PATH_INFO: `/v3/users` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:49:53.155931 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a89acfe6-3300-4840-b852-2dcf0b5632fd None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80395) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 15:49:53.156236 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a89acfe6-3300-4840-b852-2dcf0b5632fd None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:49:53.157726 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a89acfe6-3300-4840-b852-2dcf0b5632fd None admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:49:53.177569 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 613/1227] 10.222.0.59 () {56 vars in 1143 bytes} [Thu Jun 2 15:49:53 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 15:49:53.184083 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09f26cd6-b330-4023-93c2-574ac6a4d047 None admin] Authenticating user token {{(pid=80396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:49:53.289072 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09f26cd6-b330-4023-93c2-574ac6a4d047 None admin] Validating token access rules against request {{(pid=80396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:49:53.324601 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-821e99b4-6f7e-485d-8dcd-222f57326c24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:49:53.325412 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821e99b4-6f7e-485d-8dcd-222f57326c24 None admin] REQUEST_METHOD: `GET` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:49:53.325698 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821e99b4-6f7e-485d-8dcd-222f57326c24 None admin] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:49:53.325976 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821e99b4-6f7e-485d-8dcd-222f57326c24 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:49:53.336510 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-821e99b4-6f7e-485d-8dcd-222f57326c24 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:49:53.338057 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-821e99b4-6f7e-485d-8dcd-222f57326c24 None admin] RBAC: Authorization granted {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:49:53.356556 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application [None req-821e99b4-6f7e-485d-8dcd-222f57326c24 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 15:49:53.356556 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 15:49:53.356556 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 15:49:53.356556 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 15:49:53.356556 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 15:49:53.356556 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 15:49:53.356556 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 15:49:53.356556 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 15:49:53.356556 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 15:49:53.356556 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 15:49:53.356556 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 15:49:53.356556 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 15:49:53.356556 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 02 15:49:53.356556 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 02 15:49:53.356556 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 02 15:49:53.363216 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 02 15:49:53.363216 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 15:49:53.363216 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 15:49:53.363216 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 15:49:53.363216 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 15:49:53.363216 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 15:49:53.363216 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 15:49:53.363216 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 15:49:53.363216 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application with Lock( Jun 02 15:49:53.363216 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 15:49:53.363216 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application return self._enter() Jun 02 15:49:53.363216 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 15:49:53.363216 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 15:49:53.363216 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 15:49:53.363216 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application return self.creator() Jun 02 15:49:53.363216 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 15:49:53.363216 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application created_value = creator( Jun 02 15:49:53.364107 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 02 15:49:53.364107 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 02 15:49:53.364107 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 15:49:53.364107 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application Jun 02 15:49:53.364107 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 615/1228] 10.222.0.59 () {56 vars in 1108 bytes} [Thu Jun 2 15:49:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 15:49:53.364389 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a89acfe6-3300-4840-b852-2dcf0b5632fd None admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:49:53.472026 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a89acfe6-3300-4840-b852-2dcf0b5632fd None admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:49:53.474335 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writing DB stats keystone:SELECT=100 {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:49:53.505114 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b41cf73-4985-4943-8c90-2f4c4b42d454 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:49:53.505789 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b41cf73-4985-4943-8c90-2f4c4b42d454 None admin] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:49:53.506066 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b41cf73-4985-4943-8c90-2f4c4b42d454 None admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:49:53.506362 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b41cf73-4985-4943-8c90-2f4c4b42d454 None admin] PATH_INFO: `/v3/domains` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:49:53.507068 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b41cf73-4985-4943-8c90-2f4c4b42d454 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80395) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 15:49:53.507382 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b41cf73-4985-4943-8c90-2f4c4b42d454 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:49:53.508935 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b41cf73-4985-4943-8c90-2f4c4b42d454 None admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:49:53.520131 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 614/1229] 10.222.0.59 () {56 vars in 1109 bytes} [Thu Jun 2 15:49:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 15:49:53.526953 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-821e99b4-6f7e-485d-8dcd-222f57326c24 None admin] Authenticating user token {{(pid=80396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:49:53.535869 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG dbcounter [-] [80396] Writing DB stats keystone:SELECT=100 {{(pid=80396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:49:53.628457 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-821e99b4-6f7e-485d-8dcd-222f57326c24 None admin] Validating token access rules against request {{(pid=80396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:49:53.662566 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09f74bd6-3a9b-46f8-82fc-d16dc00a7ea2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:49:53.663374 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f74bd6-3a9b-46f8-82fc-d16dc00a7ea2 None admin] REQUEST_METHOD: `GET` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:49:53.663660 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f74bd6-3a9b-46f8-82fc-d16dc00a7ea2 None admin] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:49:53.663935 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f74bd6-3a9b-46f8-82fc-d16dc00a7ea2 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:49:53.671488 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09f74bd6-3a9b-46f8-82fc-d16dc00a7ea2 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:49:53.672915 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09f74bd6-3a9b-46f8-82fc-d16dc00a7ea2 None admin] RBAC: Authorization granted {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:49:53.687169 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application [None req-09f74bd6-3a9b-46f8-82fc-d16dc00a7ea2 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 02 15:49:53.687169 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 15:49:53.687169 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 15:49:53.687169 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 15:49:53.687169 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 15:49:53.687169 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 15:49:53.687169 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 15:49:53.687169 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 15:49:53.687169 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 15:49:53.687169 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 15:49:53.687169 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 15:49:53.687169 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 15:49:53.687169 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 02 15:49:53.687169 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 02 15:49:53.687169 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 02 15:49:53.688212 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 02 15:49:53.688212 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 15:49:53.688212 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 15:49:53.688212 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 15:49:53.688212 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 15:49:53.688212 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 15:49:53.688212 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 15:49:53.688212 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 15:49:53.688212 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application with Lock( Jun 02 15:49:53.688212 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 15:49:53.688212 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application return self._enter() Jun 02 15:49:53.688212 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 15:49:53.688212 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 15:49:53.688212 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 15:49:53.688212 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application return self.creator() Jun 02 15:49:53.688212 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 15:49:53.688212 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application created_value = creator( Jun 02 15:49:53.689325 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 02 15:49:53.689325 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 02 15:49:53.689325 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 02 15:49:53.689325 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 02 15:49:53.689325 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 02 15:49:53.689325 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 02 15:49:53.689325 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 02 15:49:53.689325 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application Jun 02 15:49:53.689325 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 616/1230] 10.222.0.59 () {56 vars in 1111 bytes} [Thu Jun 2 15:49:53 2022] GET /identity/v3/projects/service => generated 88 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 02 15:49:53.694190 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b41cf73-4985-4943-8c90-2f4c4b42d454 None admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:49:53.794128 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b41cf73-4985-4943-8c90-2f4c4b42d454 None admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:49:53.827048 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d066cda-4d3a-4976-9cc1-c176b9825ff3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:49:53.827695 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d066cda-4d3a-4976-9cc1-c176b9825ff3 None admin] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:49:53.827976 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d066cda-4d3a-4976-9cc1-c176b9825ff3 None admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:49:53.828246 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d066cda-4d3a-4976-9cc1-c176b9825ff3 None admin] PATH_INFO: `/v3/projects` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:49:53.829025 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d066cda-4d3a-4976-9cc1-c176b9825ff3 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80395) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 15:49:53.829329 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d066cda-4d3a-4976-9cc1-c176b9825ff3 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:49:53.830777 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d066cda-4d3a-4976-9cc1-c176b9825ff3 None admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:49:53.843743 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 615/1231] 10.222.0.59 () {56 vars in 1148 bytes} [Thu Jun 2 15:49:53 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 15:49:53.849897 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09f74bd6-3a9b-46f8-82fc-d16dc00a7ea2 None admin] Authenticating user token {{(pid=80396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:49:53.915192 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG dbcounter [-] [80396] Writing DB stats keystone:SELECT=100 {{(pid=80396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:49:53.949620 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09f74bd6-3a9b-46f8-82fc-d16dc00a7ea2 None admin] Validating token access rules against request {{(pid=80396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:49:53.982609 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2077412d-0277-4faa-a826-e66bbf62b5ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:49:53.983478 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2077412d-0277-4faa-a826-e66bbf62b5ce None admin] REQUEST_METHOD: `PUT` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:49:53.983764 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2077412d-0277-4faa-a826-e66bbf62b5ce None admin] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:49:53.984042 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2077412d-0277-4faa-a826-e66bbf62b5ce None admin] PATH_INFO: `/v3/projects/9c87c981909d4b8db02783421818c79b/users/2b700f6d94374ba4b362a8f0d5b35796/roles/36214aa6067e4493a555da410f965c5e` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:49:53.998637 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2077412d-0277-4faa-a826-e66bbf62b5ce None admin] RBAC: Authorizing `identity:create_grant(project_id=9c87c981909d4b8db02783421818c79b, user_id=2b700f6d94374ba4b362a8f0d5b35796, role_id=36214aa6067e4493a555da410f965c5e)` {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:49:54.000067 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2077412d-0277-4faa-a826-e66bbf62b5ce None admin] RBAC: Authorization granted {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:49:54.124028 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 617/1232] 10.222.0.59 () {58 vars in 1439 bytes} [Thu Jun 2 15:49:53 2022] PUT /identity/v3/projects/9c87c981909d4b8db02783421818c79b/users/2b700f6d94374ba4b362a8f0d5b35796/roles/36214aa6067e4493a555da410f965c5e => generated 0 bytes in 275 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 15:49:56.322845 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e039c4af-cb64-4340-98d4-9fb28e1964f7 None None] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:49:56.323394 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e039c4af-cb64-4340-98d4-9fb28e1964f7 None None] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:49:56.323394 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e039c4af-cb64-4340-98d4-9fb28e1964f7 None None] PATH_INFO: `/` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:49:56.324790 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 616/1233] 10.222.0.59 () {54 vars in 926 bytes} [Thu Jun 2 15:49:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 15:49:56.330094 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca66aee-2e1c-42da-9a06-11f585ef9416 None None] REQUEST_METHOD: `POST` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:49:56.332139 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca66aee-2e1c-42da-9a06-11f585ef9416 None None] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:49:56.332139 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca66aee-2e1c-42da-9a06-11f585ef9416 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:49:56.347686 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.auth.core [None req-aca66aee-2e1c-42da-9a06-11f585ef9416 None None] MFA Rules not processed for user `400d1f4db9de49638549e5db29a041e1`. Rule list: `[]` (Enabled: `True`). {{(pid=80396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 15:49:56.348927 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.fernet_utils [None req-aca66aee-2e1c-42da-9a06-11f585ef9416 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 15:49:56.416290 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 618/1234] 10.222.0.59 () {58 vars in 1023 bytes} [Thu Jun 2 15:49:56 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 02 15:49:56.446646 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e039c4af-cb64-4340-98d4-9fb28e1964f7 None None] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:49:56.466649 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writing DB stats keystone:SELECT=100 {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:49:56.545569 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e039c4af-cb64-4340-98d4-9fb28e1964f7 None None] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:49:56.579404 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44fa4b09-5bf4-4067-aa4e-240dde2f113a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:49:56.580188 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44fa4b09-5bf4-4067-aa4e-240dde2f113a None admin] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:49:56.580468 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44fa4b09-5bf4-4067-aa4e-240dde2f113a None admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:49:56.580741 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44fa4b09-5bf4-4067-aa4e-240dde2f113a None admin] PATH_INFO: `/v3/roles/service` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:49:56.591574 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44fa4b09-5bf4-4067-aa4e-240dde2f113a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 02 15:49:56.601218 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application [None req-44fa4b09-5bf4-4067-aa4e-240dde2f113a None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 02 15:49:56.601218 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 15:49:56.601218 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 15:49:56.601218 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 15:49:56.601218 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 15:49:56.601218 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 15:49:56.601218 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 15:49:56.601218 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 15:49:56.601218 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 15:49:56.601218 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 15:49:56.601218 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 15:49:56.601218 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 15:49:56.601218 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 02 15:49:56.601218 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 02 15:49:56.601218 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 02 15:49:56.601218 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 02 15:49:56.602207 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 02 15:49:56.602207 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 02 15:49:56.602207 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 02 15:49:56.602207 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 02 15:49:56.602207 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 15:49:56.602207 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 15:49:56.602207 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 15:49:56.602207 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 15:49:56.602207 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 15:49:56.602207 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 15:49:56.602207 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 15:49:56.602207 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application with Lock( Jun 02 15:49:56.602207 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 15:49:56.602207 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self._enter() Jun 02 15:49:56.602207 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 15:49:56.602207 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 15:49:56.603355 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 15:49:56.603355 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self.creator() Jun 02 15:49:56.603355 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 15:49:56.603355 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application created_value = creator( Jun 02 15:49:56.603355 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 02 15:49:56.603355 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 02 15:49:56.603355 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 02 15:49:56.603355 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 02 15:49:56.603355 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 02 15:49:56.603355 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 02 15:49:56.603355 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 02 15:49:56.603355 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application Jun 02 15:49:56.603355 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 617/1235] 10.222.0.59 () {56 vars in 1102 bytes} [Thu Jun 2 15:49:56 2022] GET /identity/v3/roles/service => generated 85 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 15:49:56.609064 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aca66aee-2e1c-42da-9a06-11f585ef9416 None None] Authenticating user token {{(pid=80396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:49:56.657490 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG dbcounter [-] [80396] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:49:56.709308 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aca66aee-2e1c-42da-9a06-11f585ef9416 None None] Validating token access rules against request {{(pid=80396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:49:56.742653 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eea37db-8307-4cd1-a12f-0cb64a621e86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:49:56.743310 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eea37db-8307-4cd1-a12f-0cb64a621e86 None admin] REQUEST_METHOD: `GET` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:49:56.743595 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eea37db-8307-4cd1-a12f-0cb64a621e86 None admin] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:49:56.744953 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eea37db-8307-4cd1-a12f-0cb64a621e86 None admin] PATH_INFO: `/v3/roles` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:49:56.744953 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eea37db-8307-4cd1-a12f-0cb64a621e86 None admin] RBAC: Adding query filter params (name=service) {{(pid=80396) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 15:49:56.745239 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eea37db-8307-4cd1-a12f-0cb64a621e86 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:49:56.746631 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eea37db-8307-4cd1-a12f-0cb64a621e86 None admin] RBAC: Authorization granted {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:49:56.754342 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 619/1236] 10.222.0.59 () {56 vars in 1103 bytes} [Thu Jun 2 15:49:56 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 15:49:56.761044 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44fa4b09-5bf4-4067-aa4e-240dde2f113a None admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:49:56.848187 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writing DB stats keystone:SELECT=100 {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:49:56.863976 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44fa4b09-5bf4-4067-aa4e-240dde2f113a None admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:49:56.896091 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5d7cc14-724c-4d58-a433-3f509354220d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:49:56.896904 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d7cc14-724c-4d58-a433-3f509354220d None admin] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:49:56.897183 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d7cc14-724c-4d58-a433-3f509354220d None admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:49:56.897452 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d7cc14-724c-4d58-a433-3f509354220d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:49:56.908035 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5d7cc14-724c-4d58-a433-3f509354220d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:49:56.909478 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5d7cc14-724c-4d58-a433-3f509354220d None admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:49:56.925908 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application [None req-d5d7cc14-724c-4d58-a433-3f509354220d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 15:49:56.925908 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 15:49:56.925908 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 15:49:56.925908 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 15:49:56.925908 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 15:49:56.925908 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 15:49:56.925908 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 15:49:56.925908 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 15:49:56.925908 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 15:49:56.925908 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 15:49:56.925908 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 15:49:56.925908 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 15:49:56.925908 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 02 15:49:56.925908 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 02 15:49:56.925908 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 02 15:49:56.926975 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 02 15:49:56.926975 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 15:49:56.926975 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 15:49:56.926975 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 15:49:56.926975 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 15:49:56.926975 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 15:49:56.926975 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 15:49:56.926975 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 15:49:56.926975 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application with Lock( Jun 02 15:49:56.926975 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 15:49:56.926975 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self._enter() Jun 02 15:49:56.926975 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 15:49:56.926975 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 15:49:56.926975 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 15:49:56.926975 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self.creator() Jun 02 15:49:56.926975 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 15:49:56.926975 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application created_value = creator( Jun 02 15:49:56.928030 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 02 15:49:56.928030 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 02 15:49:56.928030 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 15:49:56.928030 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application Jun 02 15:49:56.928030 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 618/1237] 10.222.0.59 () {56 vars in 1108 bytes} [Thu Jun 2 15:49:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 15:49:56.933240 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eea37db-8307-4cd1-a12f-0cb64a621e86 None admin] Authenticating user token {{(pid=80396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:49:57.031940 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eea37db-8307-4cd1-a12f-0cb64a621e86 None admin] Validating token access rules against request {{(pid=80396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:49:57.040547 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG dbcounter [-] [80396] Writing DB stats keystone:SELECT=100 {{(pid=80396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:49:57.064825 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-686fd67c-210f-490b-920f-3b7d0d6dd31b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:49:57.065472 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-686fd67c-210f-490b-920f-3b7d0d6dd31b None admin] REQUEST_METHOD: `GET` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:49:57.065804 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-686fd67c-210f-490b-920f-3b7d0d6dd31b None admin] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:49:57.066102 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-686fd67c-210f-490b-920f-3b7d0d6dd31b None admin] PATH_INFO: `/v3/domains` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:49:57.066830 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-686fd67c-210f-490b-920f-3b7d0d6dd31b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80396) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 15:49:57.067145 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-686fd67c-210f-490b-920f-3b7d0d6dd31b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:49:57.068506 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-686fd67c-210f-490b-920f-3b7d0d6dd31b None admin] RBAC: Authorization granted {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:49:57.080618 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 620/1238] 10.222.0.59 () {56 vars in 1109 bytes} [Thu Jun 2 15:49:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 15:49:57.086704 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5d7cc14-724c-4d58-a433-3f509354220d None admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:49:57.192500 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5d7cc14-724c-4d58-a433-3f509354220d None admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:49:57.226263 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8678eda-b1e2-4622-a875-57044b2e6203 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:49:57.227057 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8678eda-b1e2-4622-a875-57044b2e6203 None admin] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:49:57.227341 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8678eda-b1e2-4622-a875-57044b2e6203 None admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:49:57.227616 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8678eda-b1e2-4622-a875-57044b2e6203 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:49:57.231005 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writing DB stats keystone:SELECT=100 {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:49:57.235990 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8678eda-b1e2-4622-a875-57044b2e6203 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:49:57.237445 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8678eda-b1e2-4622-a875-57044b2e6203 None admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:49:57.252340 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application [None req-e8678eda-b1e2-4622-a875-57044b2e6203 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jun 02 15:49:57.252340 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 15:49:57.252340 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 15:49:57.252340 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 15:49:57.252340 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 15:49:57.252340 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 15:49:57.252340 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 15:49:57.252340 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 15:49:57.252340 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 15:49:57.252340 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 15:49:57.252340 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 15:49:57.252340 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 15:49:57.252340 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 02 15:49:57.252340 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 02 15:49:57.252340 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 02 15:49:57.252340 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 02 15:49:57.253444 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 15:49:57.253444 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 15:49:57.253444 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 02 15:49:57.253444 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 02 15:49:57.253444 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 02 15:49:57.253444 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 02 15:49:57.253444 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 15:49:57.253444 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 15:49:57.253444 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 15:49:57.253444 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 15:49:57.253444 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 15:49:57.253444 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application with Lock( Jun 02 15:49:57.253444 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 15:49:57.253444 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self._enter() Jun 02 15:49:57.253444 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 15:49:57.253444 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 15:49:57.253444 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 15:49:57.253444 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self.creator() Jun 02 15:49:57.254670 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 15:49:57.254670 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application created_value = creator( Jun 02 15:49:57.254670 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 02 15:49:57.254670 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 02 15:49:57.254670 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 02 15:49:57.254670 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 02 15:49:57.254670 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 02 15:49:57.254670 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 02 15:49:57.254670 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jun 02 15:49:57.254670 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application Jun 02 15:49:57.254670 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 619/1239] 10.222.0.59 () {56 vars in 1108 bytes} [Thu Jun 2 15:49:57 2022] GET /identity/v3/users/placement => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 15:49:57.260106 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-686fd67c-210f-490b-920f-3b7d0d6dd31b None admin] Authenticating user token {{(pid=80396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:49:57.359640 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-686fd67c-210f-490b-920f-3b7d0d6dd31b None admin] Validating token access rules against request {{(pid=80396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:49:57.395873 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f24e76ab-22b1-4c8f-8a4f-ac41f02cb2a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:49:57.396532 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24e76ab-22b1-4c8f-8a4f-ac41f02cb2a5 None admin] REQUEST_METHOD: `GET` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:49:57.396816 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24e76ab-22b1-4c8f-8a4f-ac41f02cb2a5 None admin] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:49:57.397093 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24e76ab-22b1-4c8f-8a4f-ac41f02cb2a5 None admin] PATH_INFO: `/v3/users` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:49:57.397928 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f24e76ab-22b1-4c8f-8a4f-ac41f02cb2a5 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80396) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 15:49:57.398265 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f24e76ab-22b1-4c8f-8a4f-ac41f02cb2a5 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:49:57.399696 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f24e76ab-22b1-4c8f-8a4f-ac41f02cb2a5 None admin] RBAC: Authorization granted {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:49:57.417103 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 621/1240] 10.222.0.59 () {56 vars in 1143 bytes} [Thu Jun 2 15:49:57 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 15:49:57.422905 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8678eda-b1e2-4622-a875-57044b2e6203 None admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:49:57.524758 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8678eda-b1e2-4622-a875-57044b2e6203 None admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:49:57.559540 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59138992-7142-42c0-aead-159129d5b546 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:49:57.560229 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59138992-7142-42c0-aead-159129d5b546 None admin] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:49:57.560518 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59138992-7142-42c0-aead-159129d5b546 None admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:49:57.560795 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59138992-7142-42c0-aead-159129d5b546 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:49:57.621534 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writing DB stats keystone:SELECT=100 {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:49:57.627896 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59138992-7142-42c0-aead-159129d5b546 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:49:57.629348 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59138992-7142-42c0-aead-159129d5b546 None admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:49:57.734810 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 620/1241] 10.222.0.59 () {58 vars in 1282 bytes} [Thu Jun 2 15:49:57 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 02 15:49:57.740601 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f24e76ab-22b1-4c8f-8a4f-ac41f02cb2a5 None admin] Authenticating user token {{(pid=80396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:49:57.767959 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG dbcounter [-] [80396] Writing DB stats keystone:SELECT=100 {{(pid=80396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:49:57.837995 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f24e76ab-22b1-4c8f-8a4f-ac41f02cb2a5 None admin] Validating token access rules against request {{(pid=80396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:49:57.872112 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f80e2e4-b442-4860-ada3-cad6f9df803f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:49:57.872841 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f80e2e4-b442-4860-ada3-cad6f9df803f None admin] REQUEST_METHOD: `GET` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:49:57.873114 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f80e2e4-b442-4860-ada3-cad6f9df803f None admin] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:49:57.873381 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f80e2e4-b442-4860-ada3-cad6f9df803f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:49:57.883153 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f80e2e4-b442-4860-ada3-cad6f9df803f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:49:57.884624 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f80e2e4-b442-4860-ada3-cad6f9df803f None admin] RBAC: Authorization granted {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:49:57.902374 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application [None req-1f80e2e4-b442-4860-ada3-cad6f9df803f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 15:49:57.902374 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 15:49:57.902374 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 15:49:57.902374 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 15:49:57.902374 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 15:49:57.902374 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 15:49:57.902374 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 15:49:57.902374 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 15:49:57.902374 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 15:49:57.902374 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 15:49:57.902374 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 15:49:57.902374 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 15:49:57.902374 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 02 15:49:57.902374 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 02 15:49:57.902374 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 02 15:49:57.903615 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 02 15:49:57.903615 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 15:49:57.903615 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 15:49:57.903615 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 15:49:57.903615 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 15:49:57.903615 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 15:49:57.903615 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 15:49:57.903615 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 15:49:57.903615 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application with Lock( Jun 02 15:49:57.903615 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 15:49:57.903615 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application return self._enter() Jun 02 15:49:57.903615 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 15:49:57.903615 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 15:49:57.903615 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 15:49:57.903615 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application return self.creator() Jun 02 15:49:57.903615 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 15:49:57.903615 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application created_value = creator( Jun 02 15:49:57.904961 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 02 15:49:57.904961 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 02 15:49:57.904961 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 15:49:57.904961 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application Jun 02 15:49:57.904961 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 622/1242] 10.222.0.59 () {56 vars in 1108 bytes} [Thu Jun 2 15:49:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 15:49:57.909322 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59138992-7142-42c0-aead-159129d5b546 None admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:49:58.000690 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writing DB stats keystone:SELECT=100 {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:49:58.006254 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59138992-7142-42c0-aead-159129d5b546 None admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:49:58.039584 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a861b3f-930f-4a1d-9cb3-56ce756d1945 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:49:58.040233 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a861b3f-930f-4a1d-9cb3-56ce756d1945 None admin] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:49:58.040512 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a861b3f-930f-4a1d-9cb3-56ce756d1945 None admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:49:58.041387 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a861b3f-930f-4a1d-9cb3-56ce756d1945 None admin] PATH_INFO: `/v3/domains` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:49:58.042199 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a861b3f-930f-4a1d-9cb3-56ce756d1945 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80395) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 15:49:58.042508 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a861b3f-930f-4a1d-9cb3-56ce756d1945 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:49:58.043868 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a861b3f-930f-4a1d-9cb3-56ce756d1945 None admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:49:58.054618 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 621/1243] 10.222.0.59 () {56 vars in 1109 bytes} [Thu Jun 2 15:49:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 15:49:58.060700 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f80e2e4-b442-4860-ada3-cad6f9df803f None admin] Authenticating user token {{(pid=80396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:49:58.139744 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG dbcounter [-] [80396] Writing DB stats keystone:SELECT=100 {{(pid=80396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:49:58.159991 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f80e2e4-b442-4860-ada3-cad6f9df803f None admin] Validating token access rules against request {{(pid=80396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:49:58.193825 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d50ca330-5912-4aaa-8e9b-32c825df35db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:49:58.194634 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d50ca330-5912-4aaa-8e9b-32c825df35db None admin] REQUEST_METHOD: `GET` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:49:58.194913 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d50ca330-5912-4aaa-8e9b-32c825df35db None admin] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:49:58.195187 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d50ca330-5912-4aaa-8e9b-32c825df35db None admin] PATH_INFO: `/v3/projects/service` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:49:58.202444 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d50ca330-5912-4aaa-8e9b-32c825df35db None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:49:58.204742 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d50ca330-5912-4aaa-8e9b-32c825df35db None admin] RBAC: Authorization granted {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:49:58.217502 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application [None req-d50ca330-5912-4aaa-8e9b-32c825df35db None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 02 15:49:58.217502 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 15:49:58.217502 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 15:49:58.217502 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 15:49:58.217502 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 15:49:58.217502 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 15:49:58.217502 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 15:49:58.217502 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 15:49:58.217502 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 15:49:58.217502 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 15:49:58.217502 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 15:49:58.217502 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 15:49:58.217502 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 02 15:49:58.217502 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 02 15:49:58.217502 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 02 15:49:58.218591 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 02 15:49:58.218591 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 15:49:58.218591 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 15:49:58.218591 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 15:49:58.218591 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 15:49:58.218591 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 15:49:58.218591 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 15:49:58.218591 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 15:49:58.218591 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application with Lock( Jun 02 15:49:58.218591 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 15:49:58.218591 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application return self._enter() Jun 02 15:49:58.218591 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 15:49:58.218591 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 15:49:58.218591 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 15:49:58.218591 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application return self.creator() Jun 02 15:49:58.218591 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 15:49:58.218591 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application created_value = creator( Jun 02 15:49:58.219925 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 02 15:49:58.219925 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 02 15:49:58.219925 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 02 15:49:58.219925 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 02 15:49:58.219925 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 02 15:49:58.219925 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 02 15:49:58.219925 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 02 15:49:58.219925 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application Jun 02 15:49:58.219925 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 623/1244] 10.222.0.59 () {56 vars in 1111 bytes} [Thu Jun 2 15:49:58 2022] GET /identity/v3/projects/service => generated 88 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 15:49:58.224529 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a861b3f-930f-4a1d-9cb3-56ce756d1945 None admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:49:58.324713 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a861b3f-930f-4a1d-9cb3-56ce756d1945 None admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:49:58.359846 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fe51b62-9209-4a78-8c93-f6d240254bea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:49:58.360502 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe51b62-9209-4a78-8c93-f6d240254bea None admin] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:49:58.360817 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe51b62-9209-4a78-8c93-f6d240254bea None admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:49:58.361094 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe51b62-9209-4a78-8c93-f6d240254bea None admin] PATH_INFO: `/v3/projects` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:49:58.361954 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fe51b62-9209-4a78-8c93-f6d240254bea None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80395) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 15:49:58.362355 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fe51b62-9209-4a78-8c93-f6d240254bea None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:49:58.363790 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fe51b62-9209-4a78-8c93-f6d240254bea None admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:49:58.376211 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 622/1245] 10.222.0.59 () {56 vars in 1148 bytes} [Thu Jun 2 15:49:58 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 15:49:58.382323 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d50ca330-5912-4aaa-8e9b-32c825df35db None admin] Authenticating user token {{(pid=80396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:49:58.480643 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d50ca330-5912-4aaa-8e9b-32c825df35db None admin] Validating token access rules against request {{(pid=80396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:49:58.514055 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f7fc5a9-27eb-46a1-8dd7-e9060207ecce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:49:58.514800 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f7fc5a9-27eb-46a1-8dd7-e9060207ecce None admin] REQUEST_METHOD: `GET` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:49:58.515086 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f7fc5a9-27eb-46a1-8dd7-e9060207ecce None admin] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:49:58.515364 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f7fc5a9-27eb-46a1-8dd7-e9060207ecce None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:49:58.516194 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f7fc5a9-27eb-46a1-8dd7-e9060207ecce None admin] RBAC: Adding query filter params (role.id=36214aa6067e4493a555da410f965c5e, scope.project.id=9c87c981909d4b8db02783421818c79b, user.id=2b700f6d94374ba4b362a8f0d5b35796) {{(pid=80396) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 15:49:58.516508 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f7fc5a9-27eb-46a1-8dd7-e9060207ecce None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:49:58.517934 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f7fc5a9-27eb-46a1-8dd7-e9060207ecce None admin] RBAC: Authorization granted {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:49:58.523715 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 624/1246] 10.222.0.59 () {56 vars in 1374 bytes} [Thu Jun 2 15:49:58 2022] GET /identity/v3/role_assignments?user.id=2b700f6d94374ba4b362a8f0d5b35796&scope.project.id=9c87c981909d4b8db02783421818c79b&role.id=36214aa6067e4493a555da410f965c5e => generated 608 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 15:50:00.827148 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c5c402-f06a-431a-82f7-891cd3d4ba91 None None] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:50:00.827719 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c5c402-f06a-431a-82f7-891cd3d4ba91 None None] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:50:00.827719 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c5c402-f06a-431a-82f7-891cd3d4ba91 None None] PATH_INFO: `/` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:50:00.829059 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 623/1247] 10.222.0.59 () {54 vars in 926 bytes} [Thu Jun 2 15:50:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 15:50:00.834800 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec2820b-9e03-42dc-9e37-0e98383c739f None None] REQUEST_METHOD: `POST` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:50:00.835223 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec2820b-9e03-42dc-9e37-0e98383c739f None None] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:50:00.835454 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec2820b-9e03-42dc-9e37-0e98383c739f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:50:00.841232 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG dbcounter [-] [80396] Writing DB stats keystone:SELECT=100 {{(pid=80396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:50:00.853252 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.auth.core [None req-3ec2820b-9e03-42dc-9e37-0e98383c739f None None] MFA Rules not processed for user `400d1f4db9de49638549e5db29a041e1`. Rule list: `[]` (Enabled: `True`). {{(pid=80396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 15:50:00.854634 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.fernet_utils [None req-3ec2820b-9e03-42dc-9e37-0e98383c739f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 15:50:00.920679 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 625/1248] 10.222.0.59 () {58 vars in 1023 bytes} [Thu Jun 2 15:50:00 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 02 15:50:00.944207 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78c5c402-f06a-431a-82f7-891cd3d4ba91 None None] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:50:00.962764 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writing DB stats keystone:SELECT=100 {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:50:01.042926 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78c5c402-f06a-431a-82f7-891cd3d4ba91 None None] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:50:01.076474 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef0a7f69-3a81-4d9f-b2bb-c00122f655e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:50:01.077423 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0a7f69-3a81-4d9f-b2bb-c00122f655e3 None admin] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:50:01.077657 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0a7f69-3a81-4d9f-b2bb-c00122f655e3 None admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:50:01.077934 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0a7f69-3a81-4d9f-b2bb-c00122f655e3 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:50:01.088114 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef0a7f69-3a81-4d9f-b2bb-c00122f655e3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 02 15:50:01.095649 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application [None req-ef0a7f69-3a81-4d9f-b2bb-c00122f655e3 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 02 15:50:01.095649 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 15:50:01.095649 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 15:50:01.095649 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 15:50:01.095649 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 15:50:01.095649 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 15:50:01.095649 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 15:50:01.095649 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 15:50:01.095649 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 15:50:01.095649 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 15:50:01.095649 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 15:50:01.095649 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 15:50:01.095649 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 02 15:50:01.095649 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 02 15:50:01.095649 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 02 15:50:01.095649 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 02 15:50:01.100864 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 02 15:50:01.100864 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 02 15:50:01.100864 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 02 15:50:01.100864 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 02 15:50:01.100864 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 15:50:01.100864 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 15:50:01.100864 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 15:50:01.100864 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 15:50:01.100864 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 15:50:01.100864 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 15:50:01.100864 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 15:50:01.100864 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application with Lock( Jun 02 15:50:01.100864 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 15:50:01.100864 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self._enter() Jun 02 15:50:01.100864 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 15:50:01.100864 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 15:50:01.101861 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 15:50:01.101861 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self.creator() Jun 02 15:50:01.101861 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 15:50:01.101861 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application created_value = creator( Jun 02 15:50:01.101861 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 02 15:50:01.101861 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 02 15:50:01.101861 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 02 15:50:01.101861 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 02 15:50:01.101861 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 02 15:50:01.101861 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 02 15:50:01.101861 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 02 15:50:01.101861 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application Jun 02 15:50:01.101861 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 624/1249] 10.222.0.59 () {56 vars in 1096 bytes} [Thu Jun 2 15:50:00 2022] GET /identity/v3/roles/admin => generated 83 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 15:50:01.102917 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ec2820b-9e03-42dc-9e37-0e98383c739f None None] Authenticating user token {{(pid=80396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:50:01.204918 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ec2820b-9e03-42dc-9e37-0e98383c739f None None] Validating token access rules against request {{(pid=80396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:50:01.233756 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG dbcounter [-] [80396] Writing DB stats keystone:SELECT=100 {{(pid=80396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:50:01.238629 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8acd127a-e713-4352-9815-1b92f4c394a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:50:01.239290 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8acd127a-e713-4352-9815-1b92f4c394a4 None admin] REQUEST_METHOD: `GET` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:50:01.239573 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8acd127a-e713-4352-9815-1b92f4c394a4 None admin] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:50:01.239885 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8acd127a-e713-4352-9815-1b92f4c394a4 None admin] PATH_INFO: `/v3/roles` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:50:01.240749 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8acd127a-e713-4352-9815-1b92f4c394a4 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80396) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 15:50:01.241058 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8acd127a-e713-4352-9815-1b92f4c394a4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:50:01.242456 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8acd127a-e713-4352-9815-1b92f4c394a4 None admin] RBAC: Authorization granted {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:50:01.250828 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 626/1250] 10.222.0.59 () {56 vars in 1099 bytes} [Thu Jun 2 15:50:01 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 15:50:01.256659 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef0a7f69-3a81-4d9f-b2bb-c00122f655e3 None admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:50:01.331986 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writing DB stats keystone:SELECT=100 {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:50:01.353986 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef0a7f69-3a81-4d9f-b2bb-c00122f655e3 None admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:50:01.387963 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91c95e0a-ba08-4f8c-b501-cec89b86ba6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:50:01.388744 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c95e0a-ba08-4f8c-b501-cec89b86ba6a None admin] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:50:01.389027 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c95e0a-ba08-4f8c-b501-cec89b86ba6a None admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:50:01.389297 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c95e0a-ba08-4f8c-b501-cec89b86ba6a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:50:01.399413 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91c95e0a-ba08-4f8c-b501-cec89b86ba6a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:50:01.401183 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91c95e0a-ba08-4f8c-b501-cec89b86ba6a None admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:50:01.419381 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application [None req-91c95e0a-ba08-4f8c-b501-cec89b86ba6a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 15:50:01.419381 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 15:50:01.419381 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 15:50:01.419381 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 15:50:01.419381 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 15:50:01.419381 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 15:50:01.419381 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 15:50:01.419381 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 15:50:01.419381 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 15:50:01.419381 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 15:50:01.419381 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 15:50:01.419381 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 15:50:01.419381 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 02 15:50:01.419381 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 02 15:50:01.419381 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 02 15:50:01.420407 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 02 15:50:01.420407 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 15:50:01.420407 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 15:50:01.420407 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 15:50:01.420407 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 15:50:01.420407 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 15:50:01.420407 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 15:50:01.420407 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 15:50:01.420407 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application with Lock( Jun 02 15:50:01.420407 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 15:50:01.420407 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self._enter() Jun 02 15:50:01.420407 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 15:50:01.420407 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 15:50:01.420407 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 15:50:01.420407 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self.creator() Jun 02 15:50:01.420407 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 15:50:01.420407 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application created_value = creator( Jun 02 15:50:01.421493 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 02 15:50:01.421493 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 02 15:50:01.421493 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 15:50:01.421493 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application Jun 02 15:50:01.421493 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 625/1251] 10.222.0.59 () {56 vars in 1108 bytes} [Thu Jun 2 15:50:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 15:50:01.426549 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8acd127a-e713-4352-9815-1b92f4c394a4 None admin] Authenticating user token {{(pid=80396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:50:01.527627 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8acd127a-e713-4352-9815-1b92f4c394a4 None admin] Validating token access rules against request {{(pid=80396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:50:01.561242 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2ecfe59-6060-45b7-ba06-c7246808d4db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:50:01.561889 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ecfe59-6060-45b7-ba06-c7246808d4db None admin] REQUEST_METHOD: `GET` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:50:01.562200 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ecfe59-6060-45b7-ba06-c7246808d4db None admin] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:50:01.562476 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ecfe59-6060-45b7-ba06-c7246808d4db None admin] PATH_INFO: `/v3/domains` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:50:01.563225 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2ecfe59-6060-45b7-ba06-c7246808d4db None admin] RBAC: Adding query filter params (name=Default) {{(pid=80396) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 15:50:01.563527 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2ecfe59-6060-45b7-ba06-c7246808d4db None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:50:01.564878 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2ecfe59-6060-45b7-ba06-c7246808d4db None admin] RBAC: Authorization granted {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:50:01.576820 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 627/1252] 10.222.0.59 () {56 vars in 1109 bytes} [Thu Jun 2 15:50:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 15:50:01.582687 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91c95e0a-ba08-4f8c-b501-cec89b86ba6a None admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:50:01.681061 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91c95e0a-ba08-4f8c-b501-cec89b86ba6a None admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:50:01.706308 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writing DB stats keystone:SELECT=100 {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:50:01.714731 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac727cd7-0168-4c31-8a9c-d812f2544fb9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:50:01.715525 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac727cd7-0168-4c31-8a9c-d812f2544fb9 None admin] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:50:01.715807 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac727cd7-0168-4c31-8a9c-d812f2544fb9 None admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:50:01.716079 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac727cd7-0168-4c31-8a9c-d812f2544fb9 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:50:01.723428 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac727cd7-0168-4c31-8a9c-d812f2544fb9 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:50:01.724858 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac727cd7-0168-4c31-8a9c-d812f2544fb9 None admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:50:01.739467 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application [None req-ac727cd7-0168-4c31-8a9c-d812f2544fb9 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jun 02 15:50:01.739467 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 15:50:01.739467 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 15:50:01.739467 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 15:50:01.739467 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 15:50:01.739467 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 15:50:01.739467 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 15:50:01.739467 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 15:50:01.739467 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 15:50:01.739467 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 15:50:01.739467 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 15:50:01.739467 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 15:50:01.739467 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 02 15:50:01.739467 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 02 15:50:01.739467 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 02 15:50:01.739467 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 02 15:50:01.745333 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 15:50:01.745333 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 15:50:01.745333 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 02 15:50:01.745333 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 02 15:50:01.745333 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 02 15:50:01.745333 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 02 15:50:01.745333 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 15:50:01.745333 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 15:50:01.745333 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 15:50:01.745333 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 15:50:01.745333 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 15:50:01.745333 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application with Lock( Jun 02 15:50:01.745333 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 15:50:01.745333 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self._enter() Jun 02 15:50:01.745333 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 15:50:01.745333 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 15:50:01.745333 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 15:50:01.745333 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self.creator() Jun 02 15:50:01.746521 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 15:50:01.746521 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application created_value = creator( Jun 02 15:50:01.746521 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 02 15:50:01.746521 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 02 15:50:01.746521 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 02 15:50:01.746521 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 02 15:50:01.746521 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 02 15:50:01.746521 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 02 15:50:01.746521 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jun 02 15:50:01.746521 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application Jun 02 15:50:01.746521 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 626/1253] 10.222.0.59 () {56 vars in 1108 bytes} [Thu Jun 2 15:50:01 2022] GET /identity/v3/users/placement => generated 87 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 15:50:01.747275 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2ecfe59-6060-45b7-ba06-c7246808d4db None admin] Authenticating user token {{(pid=80396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:50:01.802631 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG dbcounter [-] [80396] Writing DB stats keystone:SELECT=100 {{(pid=80396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:50:01.847863 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2ecfe59-6060-45b7-ba06-c7246808d4db None admin] Validating token access rules against request {{(pid=80396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:50:01.882243 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78a298bd-df16-4675-977a-2d39525fc45c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:50:01.882910 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a298bd-df16-4675-977a-2d39525fc45c None admin] REQUEST_METHOD: `GET` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:50:01.883194 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a298bd-df16-4675-977a-2d39525fc45c None admin] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:50:01.883468 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a298bd-df16-4675-977a-2d39525fc45c None admin] PATH_INFO: `/v3/users` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:50:01.884302 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78a298bd-df16-4675-977a-2d39525fc45c None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80396) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 15:50:01.885250 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78a298bd-df16-4675-977a-2d39525fc45c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:50:01.886801 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78a298bd-df16-4675-977a-2d39525fc45c None admin] RBAC: Authorization granted {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:50:01.904481 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 628/1254] 10.222.0.59 () {56 vars in 1143 bytes} [Thu Jun 2 15:50:01 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 15:50:01.910189 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac727cd7-0168-4c31-8a9c-d812f2544fb9 None admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:50:02.006973 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac727cd7-0168-4c31-8a9c-d812f2544fb9 None admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:50:02.039459 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6534480-a174-441c-9951-a0f99f8fda05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:50:02.040093 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6534480-a174-441c-9951-a0f99f8fda05 None admin] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:50:02.040374 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6534480-a174-441c-9951-a0f99f8fda05 None admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:50:02.040650 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6534480-a174-441c-9951-a0f99f8fda05 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:50:02.094121 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writing DB stats keystone:SELECT=100 {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:50:02.106477 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6534480-a174-441c-9951-a0f99f8fda05 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:50:02.107860 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6534480-a174-441c-9951-a0f99f8fda05 None admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:50:02.202441 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 627/1255] 10.222.0.59 () {58 vars in 1282 bytes} [Thu Jun 2 15:50:01 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 293 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 02 15:50:02.208253 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78a298bd-df16-4675-977a-2d39525fc45c None admin] Authenticating user token {{(pid=80396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:50:02.308705 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78a298bd-df16-4675-977a-2d39525fc45c None admin] Validating token access rules against request {{(pid=80396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:50:02.321483 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG dbcounter [-] [80396] Writing DB stats keystone:SELECT=100 {{(pid=80396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:50:02.342547 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-647d1c97-ad7a-433f-b8e9-2643cf56d96e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:50:02.343327 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647d1c97-ad7a-433f-b8e9-2643cf56d96e None admin] REQUEST_METHOD: `GET` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:50:02.343610 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647d1c97-ad7a-433f-b8e9-2643cf56d96e None admin] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:50:02.343887 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647d1c97-ad7a-433f-b8e9-2643cf56d96e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:50:02.354384 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-647d1c97-ad7a-433f-b8e9-2643cf56d96e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:50:02.363421 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-647d1c97-ad7a-433f-b8e9-2643cf56d96e None admin] RBAC: Authorization granted {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:50:02.373181 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application [None req-647d1c97-ad7a-433f-b8e9-2643cf56d96e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 15:50:02.373181 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 15:50:02.373181 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 15:50:02.373181 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 15:50:02.373181 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 15:50:02.373181 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 15:50:02.373181 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 15:50:02.373181 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 15:50:02.373181 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 15:50:02.373181 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 15:50:02.373181 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 15:50:02.373181 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 15:50:02.373181 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 02 15:50:02.373181 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 02 15:50:02.373181 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 02 15:50:02.374272 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 02 15:50:02.374272 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 15:50:02.374272 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 15:50:02.374272 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 15:50:02.374272 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 15:50:02.374272 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 15:50:02.374272 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 15:50:02.374272 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 15:50:02.374272 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application with Lock( Jun 02 15:50:02.374272 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 15:50:02.374272 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application return self._enter() Jun 02 15:50:02.374272 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 15:50:02.374272 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 15:50:02.374272 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 15:50:02.374272 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application return self.creator() Jun 02 15:50:02.374272 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 15:50:02.374272 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application created_value = creator( Jun 02 15:50:02.375424 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 02 15:50:02.375424 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 02 15:50:02.375424 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 15:50:02.375424 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application Jun 02 15:50:02.375424 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 629/1256] 10.222.0.59 () {56 vars in 1108 bytes} [Thu Jun 2 15:50:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 15:50:02.380022 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6534480-a174-441c-9951-a0f99f8fda05 None admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:50:02.468234 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writing DB stats keystone:SELECT=100 {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:50:02.480408 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6534480-a174-441c-9951-a0f99f8fda05 None admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:50:02.512468 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb7f67e8-77df-44d4-960a-00d3c1a6b667 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:50:02.513118 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7f67e8-77df-44d4-960a-00d3c1a6b667 None admin] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:50:02.513393 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7f67e8-77df-44d4-960a-00d3c1a6b667 None admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:50:02.513663 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7f67e8-77df-44d4-960a-00d3c1a6b667 None admin] PATH_INFO: `/v3/domains` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:50:02.514470 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb7f67e8-77df-44d4-960a-00d3c1a6b667 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80395) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 15:50:02.514770 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb7f67e8-77df-44d4-960a-00d3c1a6b667 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:50:02.516119 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb7f67e8-77df-44d4-960a-00d3c1a6b667 None admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:50:02.527517 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 628/1257] 10.222.0.59 () {56 vars in 1109 bytes} [Thu Jun 2 15:50:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 15:50:02.533227 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-647d1c97-ad7a-433f-b8e9-2643cf56d96e None admin] Authenticating user token {{(pid=80396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:50:02.633853 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-647d1c97-ad7a-433f-b8e9-2643cf56d96e None admin] Validating token access rules against request {{(pid=80396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:50:02.669488 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af60e1b5-64b4-4926-93b8-33d9acad33bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:50:02.676050 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af60e1b5-64b4-4926-93b8-33d9acad33bb None admin] REQUEST_METHOD: `GET` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:50:02.676050 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af60e1b5-64b4-4926-93b8-33d9acad33bb None admin] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:50:02.676050 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af60e1b5-64b4-4926-93b8-33d9acad33bb None admin] PATH_INFO: `/v3/projects/service` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:50:02.677535 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af60e1b5-64b4-4926-93b8-33d9acad33bb None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:50:02.679012 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af60e1b5-64b4-4926-93b8-33d9acad33bb None admin] RBAC: Authorization granted {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:50:02.692922 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application [None req-af60e1b5-64b4-4926-93b8-33d9acad33bb None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 02 15:50:02.692922 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 15:50:02.692922 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 15:50:02.692922 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 15:50:02.692922 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 15:50:02.692922 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 15:50:02.692922 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 15:50:02.692922 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 15:50:02.692922 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 15:50:02.692922 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 15:50:02.692922 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 15:50:02.692922 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 15:50:02.692922 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 02 15:50:02.692922 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 02 15:50:02.692922 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 02 15:50:02.693969 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 02 15:50:02.693969 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 15:50:02.693969 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 15:50:02.693969 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 15:50:02.693969 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 15:50:02.693969 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 15:50:02.693969 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 15:50:02.693969 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 15:50:02.693969 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application with Lock( Jun 02 15:50:02.693969 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 15:50:02.693969 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application return self._enter() Jun 02 15:50:02.693969 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 15:50:02.693969 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 15:50:02.693969 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 15:50:02.693969 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application return self.creator() Jun 02 15:50:02.693969 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 15:50:02.693969 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application created_value = creator( Jun 02 15:50:02.695262 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 02 15:50:02.695262 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 02 15:50:02.695262 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 02 15:50:02.695262 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 02 15:50:02.695262 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 02 15:50:02.695262 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 02 15:50:02.695262 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 02 15:50:02.695262 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application Jun 02 15:50:02.695262 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 630/1258] 10.222.0.59 () {56 vars in 1111 bytes} [Thu Jun 2 15:50:02 2022] GET /identity/v3/projects/service => generated 88 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 15:50:02.700149 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb7f67e8-77df-44d4-960a-00d3c1a6b667 None admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:50:02.799161 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb7f67e8-77df-44d4-960a-00d3c1a6b667 None admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:50:02.832236 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-304d8af0-542a-4dd5-8dc8-933449b831ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:50:02.832886 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304d8af0-542a-4dd5-8dc8-933449b831ad None admin] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:50:02.833240 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304d8af0-542a-4dd5-8dc8-933449b831ad None admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:50:02.833503 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304d8af0-542a-4dd5-8dc8-933449b831ad None admin] PATH_INFO: `/v3/projects` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:50:02.834564 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-304d8af0-542a-4dd5-8dc8-933449b831ad None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80395) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 15:50:02.834868 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-304d8af0-542a-4dd5-8dc8-933449b831ad None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:50:02.836290 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-304d8af0-542a-4dd5-8dc8-933449b831ad None admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:50:02.848832 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 629/1259] 10.222.0.59 () {56 vars in 1148 bytes} [Thu Jun 2 15:50:02 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 15:50:02.855487 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af60e1b5-64b4-4926-93b8-33d9acad33bb None admin] Authenticating user token {{(pid=80396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:50:02.886429 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG dbcounter [-] [80396] Writing DB stats keystone:SELECT=100 {{(pid=80396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:50:02.957453 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af60e1b5-64b4-4926-93b8-33d9acad33bb None admin] Validating token access rules against request {{(pid=80396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:50:02.991190 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50afe1ca-1291-48c7-8d6c-5dc2356088d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:50:02.991826 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50afe1ca-1291-48c7-8d6c-5dc2356088d3 None admin] REQUEST_METHOD: `GET` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:50:02.992103 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50afe1ca-1291-48c7-8d6c-5dc2356088d3 None admin] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:50:02.992369 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50afe1ca-1291-48c7-8d6c-5dc2356088d3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:50:02.993179 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50afe1ca-1291-48c7-8d6c-5dc2356088d3 None admin] RBAC: Adding query filter params (role.id=f1e0c25f6e9049e897cb7350c7e54ab3, scope.project.id=9c87c981909d4b8db02783421818c79b, user.id=2b700f6d94374ba4b362a8f0d5b35796) {{(pid=80396) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 15:50:02.993482 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50afe1ca-1291-48c7-8d6c-5dc2356088d3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:50:02.995515 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50afe1ca-1291-48c7-8d6c-5dc2356088d3 None admin] RBAC: Authorization granted {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:50:03.000823 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 631/1260] 10.222.0.59 () {56 vars in 1374 bytes} [Thu Jun 2 15:50:02 2022] GET /identity/v3/role_assignments?user.id=2b700f6d94374ba4b362a8f0d5b35796&scope.project.id=9c87c981909d4b8db02783421818c79b&role.id=f1e0c25f6e9049e897cb7350c7e54ab3 => generated 259 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 15:50:05.187918 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f9f3b2-758c-4a72-b279-f8095c22607a None None] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:50:05.188400 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f9f3b2-758c-4a72-b279-f8095c22607a None None] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:50:05.188510 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f9f3b2-758c-4a72-b279-f8095c22607a None None] PATH_INFO: `/` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:50:05.189820 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 630/1261] 10.222.0.59 () {54 vars in 926 bytes} [Thu Jun 2 15:50:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 15:50:05.195204 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1689b8c2-4e42-4e32-a04b-d5ec2b6e2e50 None None] REQUEST_METHOD: `POST` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:50:05.196807 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1689b8c2-4e42-4e32-a04b-d5ec2b6e2e50 None None] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:50:05.196807 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1689b8c2-4e42-4e32-a04b-d5ec2b6e2e50 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:50:05.212566 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.auth.core [None req-1689b8c2-4e42-4e32-a04b-d5ec2b6e2e50 None None] MFA Rules not processed for user `400d1f4db9de49638549e5db29a041e1`. Rule list: `[]` (Enabled: `True`). {{(pid=80396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 15:50:05.213761 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.fernet_utils [None req-1689b8c2-4e42-4e32-a04b-d5ec2b6e2e50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 15:50:05.279799 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 632/1262] 10.222.0.59 () {58 vars in 1023 bytes} [Thu Jun 2 15:50:05 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 02 15:50:05.303273 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20f9f3b2-758c-4a72-b279-f8095c22607a None None] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:50:05.314442 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writing DB stats keystone:SELECT=100 {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:50:05.403462 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20f9f3b2-758c-4a72-b279-f8095c22607a None None] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:50:05.437152 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d85066a-33c3-41da-a396-fcea90c82ffe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:50:05.437863 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d85066a-33c3-41da-a396-fcea90c82ffe None admin] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:50:05.438172 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d85066a-33c3-41da-a396-fcea90c82ffe None admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:50:05.438451 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d85066a-33c3-41da-a396-fcea90c82ffe None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:50:05.448880 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d85066a-33c3-41da-a396-fcea90c82ffe None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 02 15:50:05.456553 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application [None req-0d85066a-33c3-41da-a396-fcea90c82ffe None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 02 15:50:05.456553 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 15:50:05.456553 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 15:50:05.456553 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 15:50:05.456553 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 15:50:05.456553 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 15:50:05.456553 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 15:50:05.456553 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 15:50:05.456553 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 15:50:05.456553 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 15:50:05.456553 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 15:50:05.456553 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 15:50:05.456553 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 02 15:50:05.456553 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 02 15:50:05.456553 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 02 15:50:05.456553 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 02 15:50:05.464278 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 02 15:50:05.464278 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 02 15:50:05.464278 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 02 15:50:05.464278 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 02 15:50:05.464278 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 15:50:05.464278 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 15:50:05.464278 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 15:50:05.464278 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 15:50:05.464278 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 15:50:05.464278 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 15:50:05.464278 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 15:50:05.464278 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application with Lock( Jun 02 15:50:05.464278 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 15:50:05.464278 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self._enter() Jun 02 15:50:05.464278 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 15:50:05.464278 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 15:50:05.465166 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 15:50:05.465166 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self.creator() Jun 02 15:50:05.465166 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 15:50:05.465166 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application created_value = creator( Jun 02 15:50:05.465166 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 02 15:50:05.465166 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 02 15:50:05.465166 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 02 15:50:05.465166 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 02 15:50:05.465166 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 02 15:50:05.465166 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 02 15:50:05.465166 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 02 15:50:05.465166 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application Jun 02 15:50:05.465166 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 631/1263] 10.222.0.59 () {56 vars in 1096 bytes} [Thu Jun 2 15:50:05 2022] GET /identity/v3/roles/admin => generated 83 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 15:50:05.465865 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1689b8c2-4e42-4e32-a04b-d5ec2b6e2e50 None None] Authenticating user token {{(pid=80396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:50:05.483483 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG dbcounter [-] [80396] Writing DB stats keystone:SELECT=100 {{(pid=80396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:50:05.561853 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1689b8c2-4e42-4e32-a04b-d5ec2b6e2e50 None None] Validating token access rules against request {{(pid=80396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:50:05.595673 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffa820cc-d63c-4630-8929-aca697664270 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:50:05.596317 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa820cc-d63c-4630-8929-aca697664270 None admin] REQUEST_METHOD: `GET` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:50:05.596597 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa820cc-d63c-4630-8929-aca697664270 None admin] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:50:05.596870 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa820cc-d63c-4630-8929-aca697664270 None admin] PATH_INFO: `/v3/roles` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:50:05.597595 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffa820cc-d63c-4630-8929-aca697664270 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80396) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 15:50:05.597895 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffa820cc-d63c-4630-8929-aca697664270 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:50:05.599305 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffa820cc-d63c-4630-8929-aca697664270 None admin] RBAC: Authorization granted {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:50:05.607908 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 633/1264] 10.222.0.59 () {56 vars in 1099 bytes} [Thu Jun 2 15:50:05 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 15:50:05.613858 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d85066a-33c3-41da-a396-fcea90c82ffe None admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:50:05.680213 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writing DB stats keystone:SELECT=100 {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:50:05.713174 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d85066a-33c3-41da-a396-fcea90c82ffe None admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:50:05.745377 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d81457db-7453-4e2f-b725-3a225ec8a163 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:50:05.746174 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d81457db-7453-4e2f-b725-3a225ec8a163 None admin] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:50:05.748229 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d81457db-7453-4e2f-b725-3a225ec8a163 None admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:50:05.748229 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d81457db-7453-4e2f-b725-3a225ec8a163 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:50:05.756916 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d81457db-7453-4e2f-b725-3a225ec8a163 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:50:05.758371 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d81457db-7453-4e2f-b725-3a225ec8a163 None admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:50:05.777386 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application [None req-d81457db-7453-4e2f-b725-3a225ec8a163 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 15:50:05.777386 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 15:50:05.777386 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 15:50:05.777386 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 15:50:05.777386 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 15:50:05.777386 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 15:50:05.777386 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 15:50:05.777386 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 15:50:05.777386 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 15:50:05.777386 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 15:50:05.777386 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 15:50:05.777386 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 15:50:05.777386 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 02 15:50:05.777386 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 02 15:50:05.777386 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 02 15:50:05.778568 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 02 15:50:05.778568 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 15:50:05.778568 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 15:50:05.778568 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 15:50:05.778568 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 15:50:05.778568 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 15:50:05.778568 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 15:50:05.778568 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 15:50:05.778568 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application with Lock( Jun 02 15:50:05.778568 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 15:50:05.778568 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self._enter() Jun 02 15:50:05.778568 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 15:50:05.778568 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 15:50:05.778568 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 15:50:05.778568 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self.creator() Jun 02 15:50:05.778568 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 15:50:05.778568 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application created_value = creator( Jun 02 15:50:05.779703 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 02 15:50:05.779703 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 02 15:50:05.779703 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 15:50:05.779703 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application Jun 02 15:50:05.779703 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 632/1265] 10.222.0.59 () {56 vars in 1108 bytes} [Thu Jun 2 15:50:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 15:50:05.784400 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffa820cc-d63c-4630-8929-aca697664270 None admin] Authenticating user token {{(pid=80396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:50:05.864431 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG dbcounter [-] [80396] Writing DB stats keystone:SELECT=100 {{(pid=80396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:50:05.882457 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffa820cc-d63c-4630-8929-aca697664270 None admin] Validating token access rules against request {{(pid=80396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:50:05.915579 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-497c96cf-9a77-4a81-a6f6-218b97001f56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:50:05.916421 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497c96cf-9a77-4a81-a6f6-218b97001f56 None admin] REQUEST_METHOD: `GET` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:50:05.916712 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497c96cf-9a77-4a81-a6f6-218b97001f56 None admin] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:50:05.916990 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497c96cf-9a77-4a81-a6f6-218b97001f56 None admin] PATH_INFO: `/v3/domains` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:50:05.917702 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-497c96cf-9a77-4a81-a6f6-218b97001f56 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80396) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 15:50:05.918009 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-497c96cf-9a77-4a81-a6f6-218b97001f56 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:50:05.919414 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-497c96cf-9a77-4a81-a6f6-218b97001f56 None admin] RBAC: Authorization granted {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:50:05.930431 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 634/1266] 10.222.0.59 () {56 vars in 1109 bytes} [Thu Jun 2 15:50:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 15:50:05.936201 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d81457db-7453-4e2f-b725-3a225ec8a163 None admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:50:06.042313 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d81457db-7453-4e2f-b725-3a225ec8a163 None admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:50:06.061638 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writing DB stats keystone:SELECT=100 {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:50:06.075925 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdcd1e55-8a73-4cb3-9580-619e232e9056 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:50:06.076710 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdcd1e55-8a73-4cb3-9580-619e232e9056 None admin] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:50:06.081465 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdcd1e55-8a73-4cb3-9580-619e232e9056 None admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:50:06.081465 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdcd1e55-8a73-4cb3-9580-619e232e9056 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:50:06.084840 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdcd1e55-8a73-4cb3-9580-619e232e9056 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:50:06.086366 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdcd1e55-8a73-4cb3-9580-619e232e9056 None admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:50:06.100977 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application [None req-bdcd1e55-8a73-4cb3-9580-619e232e9056 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jun 02 15:50:06.100977 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 15:50:06.100977 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 15:50:06.100977 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 15:50:06.100977 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 15:50:06.100977 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 15:50:06.100977 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 15:50:06.100977 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 15:50:06.100977 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 15:50:06.100977 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 15:50:06.100977 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 15:50:06.100977 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 15:50:06.100977 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 02 15:50:06.100977 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 02 15:50:06.100977 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 02 15:50:06.100977 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 02 15:50:06.102150 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 15:50:06.102150 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 15:50:06.102150 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 02 15:50:06.102150 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 02 15:50:06.102150 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 02 15:50:06.102150 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 02 15:50:06.102150 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 15:50:06.102150 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 15:50:06.102150 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 15:50:06.102150 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 15:50:06.102150 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 15:50:06.102150 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application with Lock( Jun 02 15:50:06.102150 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 15:50:06.102150 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self._enter() Jun 02 15:50:06.102150 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 15:50:06.102150 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 15:50:06.102150 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 15:50:06.102150 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self.creator() Jun 02 15:50:06.103500 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 15:50:06.103500 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application created_value = creator( Jun 02 15:50:06.103500 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 02 15:50:06.103500 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 02 15:50:06.103500 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 02 15:50:06.103500 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 02 15:50:06.103500 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 02 15:50:06.103500 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 02 15:50:06.103500 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jun 02 15:50:06.103500 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application Jun 02 15:50:06.103500 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 633/1267] 10.222.0.59 () {56 vars in 1108 bytes} [Thu Jun 2 15:50:05 2022] GET /identity/v3/users/placement => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 15:50:06.108614 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-497c96cf-9a77-4a81-a6f6-218b97001f56 None admin] Authenticating user token {{(pid=80396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:50:06.210241 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-497c96cf-9a77-4a81-a6f6-218b97001f56 None admin] Validating token access rules against request {{(pid=80396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:50:06.335059 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-934f7a40-d59b-4e28-bae5-e5e08344cfcc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:50:06.335059 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934f7a40-d59b-4e28-bae5-e5e08344cfcc None admin] REQUEST_METHOD: `GET` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:50:06.335059 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934f7a40-d59b-4e28-bae5-e5e08344cfcc None admin] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:50:06.335059 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934f7a40-d59b-4e28-bae5-e5e08344cfcc None admin] PATH_INFO: `/v3/users` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:50:06.335484 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-934f7a40-d59b-4e28-bae5-e5e08344cfcc None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80396) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 15:50:06.335484 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-934f7a40-d59b-4e28-bae5-e5e08344cfcc None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:50:06.335484 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-934f7a40-d59b-4e28-bae5-e5e08344cfcc None admin] RBAC: Authorization granted {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:50:06.335484 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG dbcounter [-] [80396] Writing DB stats keystone:SELECT=100 {{(pid=80396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:50:06.335484 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 635/1268] 10.222.0.59 () {56 vars in 1143 bytes} [Thu Jun 2 15:50:06 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 15:50:06.335886 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdcd1e55-8a73-4cb3-9580-619e232e9056 None admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:50:06.367374 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdcd1e55-8a73-4cb3-9580-619e232e9056 None admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:50:06.401424 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c293e3c-b18b-4907-9e7a-d051a36c5d7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:50:06.402253 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c293e3c-b18b-4907-9e7a-d051a36c5d7e None admin] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:50:06.402536 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c293e3c-b18b-4907-9e7a-d051a36c5d7e None admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:50:06.402805 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c293e3c-b18b-4907-9e7a-d051a36c5d7e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:50:06.413240 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c293e3c-b18b-4907-9e7a-d051a36c5d7e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:50:06.414713 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c293e3c-b18b-4907-9e7a-d051a36c5d7e None admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:50:06.432568 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application [None req-7c293e3c-b18b-4907-9e7a-d051a36c5d7e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 15:50:06.432568 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 15:50:06.432568 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 15:50:06.432568 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 15:50:06.432568 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 15:50:06.432568 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 15:50:06.432568 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 15:50:06.432568 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 15:50:06.432568 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 15:50:06.432568 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 15:50:06.432568 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 15:50:06.432568 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 15:50:06.432568 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 02 15:50:06.432568 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 02 15:50:06.432568 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 02 15:50:06.433676 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 02 15:50:06.433676 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 15:50:06.433676 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 15:50:06.433676 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 15:50:06.433676 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 15:50:06.433676 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 15:50:06.433676 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 15:50:06.433676 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 15:50:06.433676 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application with Lock( Jun 02 15:50:06.433676 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 15:50:06.433676 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self._enter() Jun 02 15:50:06.433676 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 15:50:06.433676 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 15:50:06.433676 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 15:50:06.433676 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self.creator() Jun 02 15:50:06.433676 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 15:50:06.433676 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application created_value = creator( Jun 02 15:50:06.434867 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 02 15:50:06.434867 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 02 15:50:06.434867 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 15:50:06.434867 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application Jun 02 15:50:06.434867 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 634/1269] 10.222.0.59 () {56 vars in 1108 bytes} [Thu Jun 2 15:50:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 15:50:06.439598 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-934f7a40-d59b-4e28-bae5-e5e08344cfcc None admin] Authenticating user token {{(pid=80396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:50:06.539143 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-934f7a40-d59b-4e28-bae5-e5e08344cfcc None admin] Validating token access rules against request {{(pid=80396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:50:06.573710 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46865d34-6a52-4b38-9ab8-34869e6512b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:50:06.574385 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46865d34-6a52-4b38-9ab8-34869e6512b8 None admin] REQUEST_METHOD: `GET` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:50:06.574669 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46865d34-6a52-4b38-9ab8-34869e6512b8 None admin] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:50:06.574944 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46865d34-6a52-4b38-9ab8-34869e6512b8 None admin] PATH_INFO: `/v3/domains` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:50:06.575653 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46865d34-6a52-4b38-9ab8-34869e6512b8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80396) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 15:50:06.575957 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46865d34-6a52-4b38-9ab8-34869e6512b8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:50:06.577310 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46865d34-6a52-4b38-9ab8-34869e6512b8 None admin] RBAC: Authorization granted {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:50:06.589313 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 636/1270] 10.222.0.59 () {56 vars in 1109 bytes} [Thu Jun 2 15:50:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 15:50:06.595049 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c293e3c-b18b-4907-9e7a-d051a36c5d7e None admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:50:06.626350 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writing DB stats keystone:SELECT=100 {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:50:06.695716 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c293e3c-b18b-4907-9e7a-d051a36c5d7e None admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:50:06.729459 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0f687dc-cd00-43e4-bb76-8eca3505059e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:50:06.730270 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f687dc-cd00-43e4-bb76-8eca3505059e None admin] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:50:06.730557 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f687dc-cd00-43e4-bb76-8eca3505059e None admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:50:06.730835 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f687dc-cd00-43e4-bb76-8eca3505059e None admin] PATH_INFO: `/v3/projects/service` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:50:06.737345 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0f687dc-cd00-43e4-bb76-8eca3505059e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:50:06.738897 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0f687dc-cd00-43e4-bb76-8eca3505059e None admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:50:06.752965 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application [None req-f0f687dc-cd00-43e4-bb76-8eca3505059e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 02 15:50:06.752965 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 15:50:06.752965 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 15:50:06.752965 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 15:50:06.752965 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 15:50:06.752965 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 15:50:06.752965 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 15:50:06.752965 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 15:50:06.752965 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 15:50:06.752965 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 15:50:06.752965 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 15:50:06.752965 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 15:50:06.752965 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 02 15:50:06.752965 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 02 15:50:06.752965 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 02 15:50:06.753999 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 02 15:50:06.753999 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 15:50:06.753999 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 15:50:06.753999 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 15:50:06.753999 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 15:50:06.753999 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 15:50:06.753999 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 15:50:06.753999 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 15:50:06.753999 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application with Lock( Jun 02 15:50:06.753999 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 15:50:06.753999 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self._enter() Jun 02 15:50:06.753999 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 15:50:06.753999 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 15:50:06.753999 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 15:50:06.753999 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self.creator() Jun 02 15:50:06.753999 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 15:50:06.753999 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application created_value = creator( Jun 02 15:50:06.755216 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 02 15:50:06.755216 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 02 15:50:06.755216 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 02 15:50:06.755216 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 02 15:50:06.755216 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 02 15:50:06.755216 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 02 15:50:06.755216 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 02 15:50:06.755216 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application Jun 02 15:50:06.755216 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 635/1271] 10.222.0.59 () {56 vars in 1111 bytes} [Thu Jun 2 15:50:06 2022] GET /identity/v3/projects/service => generated 88 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 15:50:06.762346 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46865d34-6a52-4b38-9ab8-34869e6512b8 None admin] Authenticating user token {{(pid=80396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:50:06.819902 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG dbcounter [-] [80396] Writing DB stats keystone:SELECT=100 {{(pid=80396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:50:06.861424 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46865d34-6a52-4b38-9ab8-34869e6512b8 None admin] Validating token access rules against request {{(pid=80396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:50:06.894921 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01a7419d-991b-403c-b60e-532b3fdb392e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:50:06.895577 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a7419d-991b-403c-b60e-532b3fdb392e None admin] REQUEST_METHOD: `GET` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:50:06.895862 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a7419d-991b-403c-b60e-532b3fdb392e None admin] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:50:06.896141 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a7419d-991b-403c-b60e-532b3fdb392e None admin] PATH_INFO: `/v3/projects` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:50:06.896918 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01a7419d-991b-403c-b60e-532b3fdb392e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80396) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 15:50:06.897228 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01a7419d-991b-403c-b60e-532b3fdb392e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:50:06.898693 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01a7419d-991b-403c-b60e-532b3fdb392e None admin] RBAC: Authorization granted {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:50:06.911346 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 637/1272] 10.222.0.59 () {56 vars in 1148 bytes} [Thu Jun 2 15:50:06 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 15:50:06.917736 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0f687dc-cd00-43e4-bb76-8eca3505059e None admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:50:07.007782 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writing DB stats keystone:SELECT=100 {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:50:07.016871 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0f687dc-cd00-43e4-bb76-8eca3505059e None admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:50:07.049519 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d437c23f-13cb-4932-a84c-bfc49a555e94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:50:07.050416 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d437c23f-13cb-4932-a84c-bfc49a555e94 None admin] REQUEST_METHOD: `PUT` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:50:07.050697 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d437c23f-13cb-4932-a84c-bfc49a555e94 None admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:50:07.050967 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d437c23f-13cb-4932-a84c-bfc49a555e94 None admin] PATH_INFO: `/v3/projects/9c87c981909d4b8db02783421818c79b/users/2b700f6d94374ba4b362a8f0d5b35796/roles/f1e0c25f6e9049e897cb7350c7e54ab3` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:50:07.052861 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d437c23f-13cb-4932-a84c-bfc49a555e94 None admin] RBAC: Authorizing `identity:create_grant(project_id=9c87c981909d4b8db02783421818c79b, user_id=2b700f6d94374ba4b362a8f0d5b35796, role_id=f1e0c25f6e9049e897cb7350c7e54ab3)` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:50:07.054342 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d437c23f-13cb-4932-a84c-bfc49a555e94 None admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:50:07.182694 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 636/1273] 10.222.0.59 () {58 vars in 1439 bytes} [Thu Jun 2 15:50:06 2022] PUT /identity/v3/projects/9c87c981909d4b8db02783421818c79b/users/2b700f6d94374ba4b362a8f0d5b35796/roles/f1e0c25f6e9049e897cb7350c7e54ab3 => generated 0 bytes in 265 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 15:50:09.395317 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41ad03a-e4d6-41ec-ab28-c9c60a9bb34d None None] REQUEST_METHOD: `GET` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:50:09.395863 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41ad03a-e4d6-41ec-ab28-c9c60a9bb34d None None] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:50:09.395863 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41ad03a-e4d6-41ec-ab28-c9c60a9bb34d None None] PATH_INFO: `/` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:50:09.397215 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 638/1274] 10.222.0.59 () {54 vars in 926 bytes} [Thu Jun 2 15:50:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 15:50:09.403148 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-865e1033-4f43-4f0c-a98c-1faf80468366 None None] REQUEST_METHOD: `POST` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:50:09.403641 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-865e1033-4f43-4f0c-a98c-1faf80468366 None None] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:50:09.403771 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-865e1033-4f43-4f0c-a98c-1faf80468366 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:50:09.420444 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.auth.core [None req-865e1033-4f43-4f0c-a98c-1faf80468366 None None] MFA Rules not processed for user `400d1f4db9de49638549e5db29a041e1`. Rule list: `[]` (Enabled: `True`). {{(pid=80395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 15:50:09.421679 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.fernet_utils [None req-865e1033-4f43-4f0c-a98c-1faf80468366 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 15:50:09.489369 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 637/1275] 10.222.0.59 () {58 vars in 1023 bytes} [Thu Jun 2 15:50:09 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 02 15:50:09.513118 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b41ad03a-e4d6-41ec-ab28-c9c60a9bb34d None None] Authenticating user token {{(pid=80396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:50:09.617836 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b41ad03a-e4d6-41ec-ab28-c9c60a9bb34d None None] Validating token access rules against request {{(pid=80396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:50:09.637733 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG dbcounter [-] [80396] Writing DB stats keystone:SELECT=100 {{(pid=80396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:50:09.656582 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b62b660e-6523-4d7c-9fca-01368bbfd128 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:50:09.657359 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62b660e-6523-4d7c-9fca-01368bbfd128 None admin] REQUEST_METHOD: `GET` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:50:09.657640 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62b660e-6523-4d7c-9fca-01368bbfd128 None admin] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:50:09.658098 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62b660e-6523-4d7c-9fca-01368bbfd128 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:50:09.670316 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b62b660e-6523-4d7c-9fca-01368bbfd128 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 02 15:50:09.678215 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application [None req-b62b660e-6523-4d7c-9fca-01368bbfd128 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 02 15:50:09.678215 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 15:50:09.678215 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 15:50:09.678215 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 15:50:09.678215 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 15:50:09.678215 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 15:50:09.678215 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 15:50:09.678215 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 15:50:09.678215 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 15:50:09.678215 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 15:50:09.678215 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 15:50:09.678215 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 15:50:09.678215 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 02 15:50:09.678215 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 02 15:50:09.678215 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 02 15:50:09.678215 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 02 15:50:09.679218 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 02 15:50:09.679218 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 02 15:50:09.679218 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 02 15:50:09.679218 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 02 15:50:09.679218 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 15:50:09.679218 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 15:50:09.679218 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 15:50:09.679218 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 15:50:09.679218 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 15:50:09.679218 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 15:50:09.679218 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 15:50:09.679218 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application with Lock( Jun 02 15:50:09.679218 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 15:50:09.679218 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application return self._enter() Jun 02 15:50:09.679218 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 15:50:09.679218 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 15:50:09.680115 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 15:50:09.680115 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application return self.creator() Jun 02 15:50:09.680115 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 15:50:09.680115 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application created_value = creator( Jun 02 15:50:09.680115 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 02 15:50:09.680115 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 02 15:50:09.680115 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 02 15:50:09.680115 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 02 15:50:09.680115 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 02 15:50:09.680115 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 02 15:50:09.680115 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 02 15:50:09.680115 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application Jun 02 15:50:09.680115 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 639/1276] 10.222.0.59 () {56 vars in 1096 bytes} [Thu Jun 2 15:50:09 2022] GET /identity/v3/roles/admin => generated 83 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 15:50:09.685863 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-865e1033-4f43-4f0c-a98c-1faf80468366 None None] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:50:09.766581 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:50:09.784443 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-865e1033-4f43-4f0c-a98c-1faf80468366 None None] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:50:09.818194 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e08c60-a345-4047-bff5-bd3b43bba844 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:50:09.818864 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e08c60-a345-4047-bff5-bd3b43bba844 None admin] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:50:09.819148 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e08c60-a345-4047-bff5-bd3b43bba844 None admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:50:09.819424 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e08c60-a345-4047-bff5-bd3b43bba844 None admin] PATH_INFO: `/v3/roles` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:50:09.820217 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94e08c60-a345-4047-bff5-bd3b43bba844 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80395) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 15:50:09.820759 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94e08c60-a345-4047-bff5-bd3b43bba844 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:50:09.823726 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94e08c60-a345-4047-bff5-bd3b43bba844 None admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:50:09.832568 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 638/1277] 10.222.0.59 () {56 vars in 1099 bytes} [Thu Jun 2 15:50:09 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 15:50:09.839453 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b62b660e-6523-4d7c-9fca-01368bbfd128 None admin] Authenticating user token {{(pid=80396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:50:09.940116 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b62b660e-6523-4d7c-9fca-01368bbfd128 None admin] Validating token access rules against request {{(pid=80396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:50:09.974080 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f0d572d-252f-4080-b4a2-196e8537588d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:50:09.979183 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f0d572d-252f-4080-b4a2-196e8537588d None admin] REQUEST_METHOD: `GET` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:50:09.979183 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f0d572d-252f-4080-b4a2-196e8537588d None admin] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:50:09.979183 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f0d572d-252f-4080-b4a2-196e8537588d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:50:09.986521 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f0d572d-252f-4080-b4a2-196e8537588d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:50:09.987950 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f0d572d-252f-4080-b4a2-196e8537588d None admin] RBAC: Authorization granted {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:50:10.005417 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application [None req-7f0d572d-252f-4080-b4a2-196e8537588d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 15:50:10.005417 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 15:50:10.005417 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 15:50:10.005417 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 15:50:10.005417 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 15:50:10.005417 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 15:50:10.005417 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 15:50:10.005417 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 15:50:10.005417 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 15:50:10.005417 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 15:50:10.005417 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 15:50:10.005417 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 15:50:10.005417 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 02 15:50:10.005417 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 02 15:50:10.005417 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 02 15:50:10.006516 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 02 15:50:10.006516 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 15:50:10.006516 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 15:50:10.006516 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 15:50:10.006516 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 15:50:10.006516 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 15:50:10.006516 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 15:50:10.006516 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 15:50:10.006516 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application with Lock( Jun 02 15:50:10.006516 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 15:50:10.006516 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application return self._enter() Jun 02 15:50:10.006516 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 15:50:10.006516 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 15:50:10.006516 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 15:50:10.006516 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application return self.creator() Jun 02 15:50:10.006516 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 15:50:10.006516 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application created_value = creator( Jun 02 15:50:10.007460 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 02 15:50:10.007460 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 02 15:50:10.007460 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 15:50:10.007460 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application Jun 02 15:50:10.007460 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 640/1278] 10.222.0.59 () {56 vars in 1108 bytes} [Thu Jun 2 15:50:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 15:50:10.012960 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e08c60-a345-4047-bff5-bd3b43bba844 None admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:50:10.110976 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e08c60-a345-4047-bff5-bd3b43bba844 None admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:50:10.144932 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-888a4f6a-d1cd-43f5-bdb2-3909b6f4e065 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:50:10.145585 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-888a4f6a-d1cd-43f5-bdb2-3909b6f4e065 None admin] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:50:10.145869 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-888a4f6a-d1cd-43f5-bdb2-3909b6f4e065 None admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:50:10.146173 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-888a4f6a-d1cd-43f5-bdb2-3909b6f4e065 None admin] PATH_INFO: `/v3/domains` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:50:10.146892 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-888a4f6a-d1cd-43f5-bdb2-3909b6f4e065 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80395) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 15:50:10.147199 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-888a4f6a-d1cd-43f5-bdb2-3909b6f4e065 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:50:10.148565 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-888a4f6a-d1cd-43f5-bdb2-3909b6f4e065 None admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:50:10.160464 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 639/1279] 10.222.0.59 () {56 vars in 1109 bytes} [Thu Jun 2 15:50:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 15:50:10.166980 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f0d572d-252f-4080-b4a2-196e8537588d None admin] Authenticating user token {{(pid=80396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:50:10.199734 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG dbcounter [-] [80396] Writing DB stats keystone:SELECT=100 {{(pid=80396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:50:10.272972 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f0d572d-252f-4080-b4a2-196e8537588d None admin] Validating token access rules against request {{(pid=80396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:50:10.311458 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba954ba0-ab92-405b-9825-75294e6b124c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:50:10.312255 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba954ba0-ab92-405b-9825-75294e6b124c None admin] REQUEST_METHOD: `GET` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:50:10.312542 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba954ba0-ab92-405b-9825-75294e6b124c None admin] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:50:10.312820 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba954ba0-ab92-405b-9825-75294e6b124c None admin] PATH_INFO: `/v3/users/placement` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:50:10.319883 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba954ba0-ab92-405b-9825-75294e6b124c None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:50:10.321320 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba954ba0-ab92-405b-9825-75294e6b124c None admin] RBAC: Authorization granted {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:50:10.336793 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application [None req-ba954ba0-ab92-405b-9825-75294e6b124c None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jun 02 15:50:10.336793 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 15:50:10.336793 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 15:50:10.336793 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 15:50:10.336793 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 15:50:10.336793 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 15:50:10.336793 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 15:50:10.336793 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 15:50:10.336793 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 15:50:10.336793 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 15:50:10.336793 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 15:50:10.336793 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 15:50:10.336793 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 02 15:50:10.336793 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 02 15:50:10.336793 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 02 15:50:10.336793 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 02 15:50:10.345186 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 15:50:10.345186 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 15:50:10.345186 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 02 15:50:10.345186 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 02 15:50:10.345186 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 02 15:50:10.345186 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 02 15:50:10.345186 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 15:50:10.345186 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 15:50:10.345186 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 15:50:10.345186 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 15:50:10.345186 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 15:50:10.345186 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application with Lock( Jun 02 15:50:10.345186 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 15:50:10.345186 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application return self._enter() Jun 02 15:50:10.345186 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 15:50:10.345186 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 15:50:10.345186 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 15:50:10.345186 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application return self.creator() Jun 02 15:50:10.346490 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 15:50:10.346490 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application created_value = creator( Jun 02 15:50:10.346490 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 02 15:50:10.346490 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 02 15:50:10.346490 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 02 15:50:10.346490 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 02 15:50:10.346490 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 02 15:50:10.346490 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 02 15:50:10.346490 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jun 02 15:50:10.346490 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application Jun 02 15:50:10.346490 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 641/1280] 10.222.0.59 () {56 vars in 1108 bytes} [Thu Jun 2 15:50:10 2022] GET /identity/v3/users/placement => generated 87 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 15:50:10.347272 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-888a4f6a-d1cd-43f5-bdb2-3909b6f4e065 None admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:50:10.347786 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writing DB stats keystone:SELECT=100 {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:50:10.443522 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-888a4f6a-d1cd-43f5-bdb2-3909b6f4e065 None admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:50:10.476733 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91979b30-f98b-47bd-bb7b-51eddd161e70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:50:10.477331 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91979b30-f98b-47bd-bb7b-51eddd161e70 None admin] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:50:10.477610 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91979b30-f98b-47bd-bb7b-51eddd161e70 None admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:50:10.477885 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91979b30-f98b-47bd-bb7b-51eddd161e70 None admin] PATH_INFO: `/v3/users` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:50:10.479309 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91979b30-f98b-47bd-bb7b-51eddd161e70 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80395) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 15:50:10.479608 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91979b30-f98b-47bd-bb7b-51eddd161e70 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:50:10.481060 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91979b30-f98b-47bd-bb7b-51eddd161e70 None admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:50:10.498034 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 640/1281] 10.222.0.59 () {56 vars in 1143 bytes} [Thu Jun 2 15:50:10 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 15:50:10.503885 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba954ba0-ab92-405b-9825-75294e6b124c None admin] Authenticating user token {{(pid=80396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:50:10.591674 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG dbcounter [-] [80396] Writing DB stats keystone:SELECT=100 {{(pid=80396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:50:10.601277 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba954ba0-ab92-405b-9825-75294e6b124c None admin] Validating token access rules against request {{(pid=80396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:50:10.635051 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96739799-8e46-4eef-af33-9ce0137c795f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:50:10.635685 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96739799-8e46-4eef-af33-9ce0137c795f None admin] REQUEST_METHOD: `GET` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:50:10.635966 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96739799-8e46-4eef-af33-9ce0137c795f None admin] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:50:10.636253 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96739799-8e46-4eef-af33-9ce0137c795f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:50:10.703667 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96739799-8e46-4eef-af33-9ce0137c795f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:50:10.705107 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96739799-8e46-4eef-af33-9ce0137c795f None admin] RBAC: Authorization granted {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:50:10.792193 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG dbcounter [-] [80396] Writing DB stats keystone:SELECT=100 {{(pid=80396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:50:10.801865 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 642/1282] 10.222.0.59 () {58 vars in 1282 bytes} [Thu Jun 2 15:50:10 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 298 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jun 02 15:50:10.808482 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91979b30-f98b-47bd-bb7b-51eddd161e70 None admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:50:10.870981 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writing DB stats keystone:SELECT=100 {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:50:10.908553 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91979b30-f98b-47bd-bb7b-51eddd161e70 None admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:50:10.942099 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e310a0c6-e6de-45fb-a79e-cab565e2d37c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:50:10.942874 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e310a0c6-e6de-45fb-a79e-cab565e2d37c None admin] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:50:10.943154 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e310a0c6-e6de-45fb-a79e-cab565e2d37c None admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:50:10.943424 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e310a0c6-e6de-45fb-a79e-cab565e2d37c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:50:10.953855 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e310a0c6-e6de-45fb-a79e-cab565e2d37c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:50:10.955320 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e310a0c6-e6de-45fb-a79e-cab565e2d37c None admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:50:10.972245 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application [None req-e310a0c6-e6de-45fb-a79e-cab565e2d37c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 15:50:10.972245 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 15:50:10.972245 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 15:50:10.972245 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 15:50:10.972245 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 15:50:10.972245 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 15:50:10.972245 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 15:50:10.972245 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 15:50:10.972245 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 15:50:10.972245 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 15:50:10.972245 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 15:50:10.972245 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 15:50:10.972245 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 02 15:50:10.972245 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 02 15:50:10.972245 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 02 15:50:10.973308 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 02 15:50:10.973308 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 15:50:10.973308 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 15:50:10.973308 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 15:50:10.973308 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 15:50:10.973308 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 15:50:10.973308 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 15:50:10.973308 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 15:50:10.973308 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application with Lock( Jun 02 15:50:10.973308 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 15:50:10.973308 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self._enter() Jun 02 15:50:10.973308 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 15:50:10.973308 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 15:50:10.973308 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 15:50:10.973308 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self.creator() Jun 02 15:50:10.973308 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 15:50:10.973308 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application created_value = creator( Jun 02 15:50:10.974412 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 02 15:50:10.974412 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 02 15:50:10.974412 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 15:50:10.974412 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application Jun 02 15:50:10.974412 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 641/1283] 10.222.0.59 () {56 vars in 1108 bytes} [Thu Jun 2 15:50:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 15:50:10.979279 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96739799-8e46-4eef-af33-9ce0137c795f None admin] Authenticating user token {{(pid=80396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:50:11.080343 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96739799-8e46-4eef-af33-9ce0137c795f None admin] Validating token access rules against request {{(pid=80396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:50:11.120736 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a9b20cb-079c-4808-8bd0-3e86fb47d6d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:50:11.121401 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a9b20cb-079c-4808-8bd0-3e86fb47d6d4 None admin] REQUEST_METHOD: `GET` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:50:11.122248 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a9b20cb-079c-4808-8bd0-3e86fb47d6d4 None admin] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:50:11.122552 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a9b20cb-079c-4808-8bd0-3e86fb47d6d4 None admin] PATH_INFO: `/v3/domains` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:50:11.123325 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a9b20cb-079c-4808-8bd0-3e86fb47d6d4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80396) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 15:50:11.123634 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a9b20cb-079c-4808-8bd0-3e86fb47d6d4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:50:11.125050 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a9b20cb-079c-4808-8bd0-3e86fb47d6d4 None admin] RBAC: Authorization granted {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:50:11.137120 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 643/1284] 10.222.0.59 () {56 vars in 1109 bytes} [Thu Jun 2 15:50:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 15:50:11.143035 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e310a0c6-e6de-45fb-a79e-cab565e2d37c None admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:50:11.248812 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e310a0c6-e6de-45fb-a79e-cab565e2d37c None admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:50:11.264901 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writing DB stats keystone:SELECT=100 {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:50:11.284410 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea209ab2-ff4b-414a-9e25-f63228c52862 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:50:11.285974 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea209ab2-ff4b-414a-9e25-f63228c52862 None admin] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:50:11.285974 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea209ab2-ff4b-414a-9e25-f63228c52862 None admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:50:11.285974 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea209ab2-ff4b-414a-9e25-f63228c52862 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:50:11.293257 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea209ab2-ff4b-414a-9e25-f63228c52862 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:50:11.294769 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea209ab2-ff4b-414a-9e25-f63228c52862 None admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:50:11.309218 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application [None req-ea209ab2-ff4b-414a-9e25-f63228c52862 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 02 15:50:11.309218 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 15:50:11.309218 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 15:50:11.309218 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 15:50:11.309218 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 15:50:11.309218 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 15:50:11.309218 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 15:50:11.309218 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 15:50:11.309218 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 15:50:11.309218 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 15:50:11.309218 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 15:50:11.309218 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 15:50:11.309218 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 02 15:50:11.309218 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 02 15:50:11.309218 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 02 15:50:11.310189 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 02 15:50:11.310189 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 15:50:11.310189 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 15:50:11.310189 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 15:50:11.310189 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 15:50:11.310189 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 15:50:11.310189 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 15:50:11.310189 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 15:50:11.310189 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application with Lock( Jun 02 15:50:11.310189 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 15:50:11.310189 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self._enter() Jun 02 15:50:11.310189 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 15:50:11.310189 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 15:50:11.310189 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 15:50:11.310189 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self.creator() Jun 02 15:50:11.310189 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 15:50:11.310189 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application created_value = creator( Jun 02 15:50:11.311111 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 02 15:50:11.311111 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 02 15:50:11.311111 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 02 15:50:11.311111 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 02 15:50:11.311111 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 02 15:50:11.311111 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 02 15:50:11.311111 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 02 15:50:11.311111 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application Jun 02 15:50:11.311111 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 642/1285] 10.222.0.59 () {56 vars in 1111 bytes} [Thu Jun 2 15:50:11 2022] GET /identity/v3/projects/service => generated 88 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 15:50:11.316441 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a9b20cb-079c-4808-8bd0-3e86fb47d6d4 None admin] Authenticating user token {{(pid=80396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:50:11.366065 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG dbcounter [-] [80396] Writing DB stats keystone:SELECT=100 {{(pid=80396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:50:11.415702 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a9b20cb-079c-4808-8bd0-3e86fb47d6d4 None admin] Validating token access rules against request {{(pid=80396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:50:11.449083 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-870ab8dc-192e-4df4-8c73-0757e18280d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:50:11.449737 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870ab8dc-192e-4df4-8c73-0757e18280d5 None admin] REQUEST_METHOD: `GET` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:50:11.450022 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870ab8dc-192e-4df4-8c73-0757e18280d5 None admin] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:50:11.450328 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870ab8dc-192e-4df4-8c73-0757e18280d5 None admin] PATH_INFO: `/v3/projects` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:50:11.451105 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-870ab8dc-192e-4df4-8c73-0757e18280d5 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80396) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 15:50:11.451413 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-870ab8dc-192e-4df4-8c73-0757e18280d5 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:50:11.452886 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-870ab8dc-192e-4df4-8c73-0757e18280d5 None admin] RBAC: Authorization granted {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:50:11.465486 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 644/1286] 10.222.0.59 () {56 vars in 1148 bytes} [Thu Jun 2 15:50:11 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 15:50:11.471647 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea209ab2-ff4b-414a-9e25-f63228c52862 None admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:50:11.572014 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea209ab2-ff4b-414a-9e25-f63228c52862 None admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:50:11.606679 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-405a704b-e620-4407-a92a-184439ca7ddd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:50:11.607324 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-405a704b-e620-4407-a92a-184439ca7ddd None admin] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:50:11.607611 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-405a704b-e620-4407-a92a-184439ca7ddd None admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:50:11.607891 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-405a704b-e620-4407-a92a-184439ca7ddd None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:50:11.608711 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-405a704b-e620-4407-a92a-184439ca7ddd None admin] RBAC: Adding query filter params (role.id=f1e0c25f6e9049e897cb7350c7e54ab3, scope.project.id=9c87c981909d4b8db02783421818c79b, user.id=2b700f6d94374ba4b362a8f0d5b35796) {{(pid=80395) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 15:50:11.609023 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-405a704b-e620-4407-a92a-184439ca7ddd None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:50:11.610495 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-405a704b-e620-4407-a92a-184439ca7ddd None admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:50:11.616249 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 643/1287] 10.222.0.59 () {56 vars in 1374 bytes} [Thu Jun 2 15:50:11 2022] GET /identity/v3/role_assignments?user.id=2b700f6d94374ba4b362a8f0d5b35796&scope.project.id=9c87c981909d4b8db02783421818c79b&role.id=f1e0c25f6e9049e897cb7350c7e54ab3 => generated 608 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 15:50:13.918331 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-695ef144-435a-4f80-beda-e7fee42da0c4 None None] REQUEST_METHOD: `GET` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:50:13.918887 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-695ef144-435a-4f80-beda-e7fee42da0c4 None None] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:50:13.918887 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-695ef144-435a-4f80-beda-e7fee42da0c4 None None] PATH_INFO: `/` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:50:13.920263 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 645/1288] 10.222.0.59 () {54 vars in 926 bytes} [Thu Jun 2 15:50:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 02 15:50:13.925516 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b922de-3fc0-4347-8da0-e2a311420153 None None] REQUEST_METHOD: `POST` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:50:13.925926 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b922de-3fc0-4347-8da0-e2a311420153 None None] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:50:13.926098 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b922de-3fc0-4347-8da0-e2a311420153 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:50:13.943333 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.auth.core [None req-56b922de-3fc0-4347-8da0-e2a311420153 None None] MFA Rules not processed for user `400d1f4db9de49638549e5db29a041e1`. Rule list: `[]` (Enabled: `True`). {{(pid=80395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 15:50:13.944518 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.fernet_utils [None req-56b922de-3fc0-4347-8da0-e2a311420153 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 15:50:13.974700 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writing DB stats keystone:SELECT=100 {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:50:14.012166 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 644/1289] 10.222.0.59 () {58 vars in 1023 bytes} [Thu Jun 2 15:50:13 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 02 15:50:14.034638 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-695ef144-435a-4f80-beda-e7fee42da0c4 None None] Authenticating user token {{(pid=80396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:50:14.135681 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-695ef144-435a-4f80-beda-e7fee42da0c4 None None] Validating token access rules against request {{(pid=80396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:50:14.146896 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG dbcounter [-] [80396] Writing DB stats keystone:SELECT=100 {{(pid=80396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:50:14.170338 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f64e5d1-8cfb-4d46-88c3-2d4c16740a10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:50:14.171135 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f64e5d1-8cfb-4d46-88c3-2d4c16740a10 None admin] REQUEST_METHOD: `GET` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:50:14.171418 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f64e5d1-8cfb-4d46-88c3-2d4c16740a10 None admin] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:50:14.171693 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f64e5d1-8cfb-4d46-88c3-2d4c16740a10 None admin] PATH_INFO: `/v3/services/placement` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:50:14.172351 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f64e5d1-8cfb-4d46-88c3-2d4c16740a10 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:50:14.173772 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f64e5d1-8cfb-4d46-88c3-2d4c16740a10 None admin] RBAC: Authorization granted {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:50:14.186284 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application [None req-9f64e5d1-8cfb-4d46-88c3-2d4c16740a10 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Jun 02 15:50:14.186284 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 15:50:14.186284 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 02 15:50:14.186284 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 02 15:50:14.186284 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 02 15:50:14.186284 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 02 15:50:14.186284 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 02 15:50:14.186284 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 02 15:50:14.186284 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jun 02 15:50:14.186284 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application Jun 02 15:50:14.186284 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 02 15:50:14.186284 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application Jun 02 15:50:14.186284 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 15:50:14.186284 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 15:50:14.186284 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 15:50:14.186284 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 15:50:14.186284 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 15:50:14.187526 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 15:50:14.187526 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 15:50:14.187526 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 15:50:14.187526 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 15:50:14.187526 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 15:50:14.187526 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 15:50:14.187526 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 02 15:50:14.187526 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 02 15:50:14.187526 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 02 15:50:14.187526 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 02 15:50:14.187526 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 15:50:14.187526 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 15:50:14.187526 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 15:50:14.187526 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 15:50:14.187526 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 15:50:14.187526 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 15:50:14.188945 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 15:50:14.188945 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application with Lock( Jun 02 15:50:14.188945 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 15:50:14.188945 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application return self._enter() Jun 02 15:50:14.188945 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 15:50:14.188945 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 15:50:14.188945 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 15:50:14.188945 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application return self.creator() Jun 02 15:50:14.188945 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 15:50:14.188945 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application created_value = creator( Jun 02 15:50:14.188945 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 02 15:50:14.188945 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 02 15:50:14.188945 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jun 02 15:50:14.188945 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application Jun 02 15:50:14.188945 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 646/1290] 10.222.0.59 () {56 vars in 1117 bytes} [Thu Jun 2 15:50:14 2022] GET /identity/v3/services/placement => generated 90 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 15:50:14.193715 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56b922de-3fc0-4347-8da0-e2a311420153 None None] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:50:14.294313 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56b922de-3fc0-4347-8da0-e2a311420153 None None] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:50:14.327196 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93b524c8-bc14-4041-8e43-126f094bb265 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:50:14.327852 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b524c8-bc14-4041-8e43-126f094bb265 None admin] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:50:14.328139 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b524c8-bc14-4041-8e43-126f094bb265 None admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:50:14.328419 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b524c8-bc14-4041-8e43-126f094bb265 None admin] PATH_INFO: `/v3/services` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:50:14.329117 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93b524c8-bc14-4041-8e43-126f094bb265 None admin] RBAC: Adding query filter params (name=placement) {{(pid=80395) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 15:50:14.329423 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93b524c8-bc14-4041-8e43-126f094bb265 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:50:14.330822 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93b524c8-bc14-4041-8e43-126f094bb265 None admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:50:14.335804 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 645/1291] 10.222.0.59 () {56 vars in 1116 bytes} [Thu Jun 2 15:50:14 2022] GET /identity/v3/services?name=placement => generated 126 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 15:50:14.342506 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f64e5d1-8cfb-4d46-88c3-2d4c16740a10 None admin] Authenticating user token {{(pid=80396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:50:14.440887 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f64e5d1-8cfb-4d46-88c3-2d4c16740a10 None admin] Validating token access rules against request {{(pid=80396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:50:14.473980 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bed2553c-35be-4161-a034-8ab579f0be75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:50:14.474658 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed2553c-35be-4161-a034-8ab579f0be75 None admin] REQUEST_METHOD: `GET` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:50:14.474939 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed2553c-35be-4161-a034-8ab579f0be75 None admin] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:50:14.475211 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed2553c-35be-4161-a034-8ab579f0be75 None admin] PATH_INFO: `/v3/services` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:50:14.475908 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bed2553c-35be-4161-a034-8ab579f0be75 None admin] RBAC: Adding query filter params (type=placement) {{(pid=80396) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 15:50:14.476213 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bed2553c-35be-4161-a034-8ab579f0be75 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:50:14.477611 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bed2553c-35be-4161-a034-8ab579f0be75 None admin] RBAC: Authorization granted {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:50:14.482154 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 647/1292] 10.222.0.59 () {56 vars in 1116 bytes} [Thu Jun 2 15:50:14 2022] GET /identity/v3/services?type=placement => generated 126 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 15:50:16.727232 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70aa0a9-68b8-4d93-b0ff-502071f1f30c None None] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:50:16.727795 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70aa0a9-68b8-4d93-b0ff-502071f1f30c None None] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:50:16.727795 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70aa0a9-68b8-4d93-b0ff-502071f1f30c None None] PATH_INFO: `/` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:50:16.729713 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 646/1293] 10.222.0.59 () {54 vars in 926 bytes} [Thu Jun 2 15:50:16 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 15:50:16.735014 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-627d943b-44fc-4d36-b61f-bb528fa1b3f4 None None] REQUEST_METHOD: `POST` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:50:16.735427 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-627d943b-44fc-4d36-b61f-bb528fa1b3f4 None None] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:50:16.735582 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-627d943b-44fc-4d36-b61f-bb528fa1b3f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:50:16.752762 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.auth.core [None req-627d943b-44fc-4d36-b61f-bb528fa1b3f4 None None] MFA Rules not processed for user `400d1f4db9de49638549e5db29a041e1`. Rule list: `[]` (Enabled: `True`). {{(pid=80396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 15:50:16.753934 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.fernet_utils [None req-627d943b-44fc-4d36-b61f-bb528fa1b3f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 15:50:16.783651 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG dbcounter [-] [80396] Writing DB stats keystone:SELECT=100 {{(pid=80396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:50:16.820434 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 648/1294] 10.222.0.59 () {58 vars in 1023 bytes} [Thu Jun 2 15:50:16 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 02 15:50:16.844741 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e70aa0a9-68b8-4d93-b0ff-502071f1f30c None None] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:50:16.876278 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writing DB stats keystone:SELECT=100 {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:50:16.943638 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e70aa0a9-68b8-4d93-b0ff-502071f1f30c None None] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:50:16.976782 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf0bac79-74e3-4cf4-bcd4-52402d11c241 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:50:16.977480 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf0bac79-74e3-4cf4-bcd4-52402d11c241 None admin] REQUEST_METHOD: `POST` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:50:16.977714 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf0bac79-74e3-4cf4-bcd4-52402d11c241 None admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:50:16.977996 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf0bac79-74e3-4cf4-bcd4-52402d11c241 None admin] PATH_INFO: `/v3/services` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:50:16.978868 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf0bac79-74e3-4cf4-bcd4-52402d11c241 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:50:16.980226 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf0bac79-74e3-4cf4-bcd4-52402d11c241 None admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:50:17.073628 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 647/1295] 10.222.0.59 () {60 vars in 1141 bytes} [Thu Jun 2 15:50:16 2022] POST /identity/v3/services => generated 246 bytes in 229 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 15:50:19.357250 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa8447f5-9ac5-443d-858a-bcffd207f156 None None] REQUEST_METHOD: `GET` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:50:19.357794 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa8447f5-9ac5-443d-858a-bcffd207f156 None None] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:50:19.357794 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa8447f5-9ac5-443d-858a-bcffd207f156 None None] PATH_INFO: `/` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:50:19.359313 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 649/1296] 10.222.0.59 () {54 vars in 926 bytes} [Thu Jun 2 15:50:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 15:50:19.364620 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b43fbe2c-b797-40b5-b4fc-3e4aa232c4ca None None] REQUEST_METHOD: `POST` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:50:19.364999 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b43fbe2c-b797-40b5-b4fc-3e4aa232c4ca None None] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:50:19.365185 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b43fbe2c-b797-40b5-b4fc-3e4aa232c4ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:50:19.382559 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.auth.core [None req-b43fbe2c-b797-40b5-b4fc-3e4aa232c4ca None None] MFA Rules not processed for user `400d1f4db9de49638549e5db29a041e1`. Rule list: `[]` (Enabled: `True`). {{(pid=80395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 15:50:19.383772 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.fernet_utils [None req-b43fbe2c-b797-40b5-b4fc-3e4aa232c4ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 15:50:19.455130 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 648/1297] 10.222.0.59 () {58 vars in 1023 bytes} [Thu Jun 2 15:50:19 2022] POST /identity/v3/auth/tokens => generated 2211 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 02 15:50:19.478827 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa8447f5-9ac5-443d-858a-bcffd207f156 None None] Authenticating user token {{(pid=80396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:50:19.576866 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa8447f5-9ac5-443d-858a-bcffd207f156 None None] Validating token access rules against request {{(pid=80396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:50:19.610806 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb280185-b70a-49b0-b405-ad21b74cc8ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:50:19.611584 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb280185-b70a-49b0-b405-ad21b74cc8ce None admin] REQUEST_METHOD: `GET` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:50:19.611869 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb280185-b70a-49b0-b405-ad21b74cc8ce None admin] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:50:19.612140 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb280185-b70a-49b0-b405-ad21b74cc8ce None admin] PATH_INFO: `/v3/services/placement` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:50:19.612778 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb280185-b70a-49b0-b405-ad21b74cc8ce None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:50:19.614158 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb280185-b70a-49b0-b405-ad21b74cc8ce None admin] RBAC: Authorization granted {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:50:19.626669 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application [None req-cb280185-b70a-49b0-b405-ad21b74cc8ce None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Jun 02 15:50:19.626669 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 15:50:19.626669 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 02 15:50:19.626669 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 02 15:50:19.626669 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 02 15:50:19.626669 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 02 15:50:19.626669 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 02 15:50:19.626669 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 02 15:50:19.626669 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jun 02 15:50:19.626669 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application Jun 02 15:50:19.626669 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 02 15:50:19.626669 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application Jun 02 15:50:19.626669 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 15:50:19.626669 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 15:50:19.626669 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 15:50:19.626669 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 15:50:19.626669 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 15:50:19.627834 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 15:50:19.627834 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 15:50:19.627834 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 15:50:19.627834 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 15:50:19.627834 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 15:50:19.627834 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 15:50:19.627834 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 02 15:50:19.627834 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 02 15:50:19.627834 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 02 15:50:19.627834 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 02 15:50:19.627834 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 15:50:19.627834 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 15:50:19.627834 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 15:50:19.627834 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 15:50:19.627834 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 15:50:19.627834 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 15:50:19.628929 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 15:50:19.628929 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application with Lock( Jun 02 15:50:19.628929 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 15:50:19.628929 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application return self._enter() Jun 02 15:50:19.628929 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 15:50:19.628929 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 15:50:19.628929 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 15:50:19.628929 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application return self.creator() Jun 02 15:50:19.628929 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 15:50:19.628929 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application created_value = creator( Jun 02 15:50:19.628929 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 02 15:50:19.628929 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 02 15:50:19.628929 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jun 02 15:50:19.628929 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application Jun 02 15:50:19.628929 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 650/1298] 10.222.0.59 () {56 vars in 1117 bytes} [Thu Jun 2 15:50:19 2022] GET /identity/v3/services/placement => generated 90 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 15:50:19.634011 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b43fbe2c-b797-40b5-b4fc-3e4aa232c4ca None None] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:50:19.652188 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:50:19.731579 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b43fbe2c-b797-40b5-b4fc-3e4aa232c4ca None None] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:50:19.765193 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca9e03de-45e9-4685-9324-0ee9f62e8571 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:50:19.765834 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca9e03de-45e9-4685-9324-0ee9f62e8571 None admin] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:50:19.766135 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca9e03de-45e9-4685-9324-0ee9f62e8571 None admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:50:19.766407 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca9e03de-45e9-4685-9324-0ee9f62e8571 None admin] PATH_INFO: `/v3/services` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:50:19.767094 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca9e03de-45e9-4685-9324-0ee9f62e8571 None admin] RBAC: Adding query filter params (name=placement) {{(pid=80395) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 15:50:19.767392 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca9e03de-45e9-4685-9324-0ee9f62e8571 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:50:19.768740 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca9e03de-45e9-4685-9324-0ee9f62e8571 None admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:50:19.773806 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 649/1299] 10.222.0.59 () {56 vars in 1116 bytes} [Thu Jun 2 15:50:19 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 15:50:19.780862 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb280185-b70a-49b0-b405-ad21b74cc8ce None admin] Authenticating user token {{(pid=80396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:50:19.813062 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG dbcounter [-] [80396] Writing DB stats keystone:SELECT=100 {{(pid=80396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:50:19.879634 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb280185-b70a-49b0-b405-ad21b74cc8ce None admin] Validating token access rules against request {{(pid=80396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:50:19.912054 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa81414c-5de6-44ba-8310-a1c53bee5710 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:50:19.912689 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa81414c-5de6-44ba-8310-a1c53bee5710 None admin] REQUEST_METHOD: `GET` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:50:19.912969 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa81414c-5de6-44ba-8310-a1c53bee5710 None admin] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:50:19.913240 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa81414c-5de6-44ba-8310-a1c53bee5710 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:50:19.914012 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa81414c-5de6-44ba-8310-a1c53bee5710 None admin] RBAC: Adding query filter params (interface=public, service_id=3a3cda45459b45c99941a24a5c9d1790, region_id=RegionOne) {{(pid=80396) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 15:50:19.914348 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa81414c-5de6-44ba-8310-a1c53bee5710 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:50:19.915695 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa81414c-5de6-44ba-8310-a1c53bee5710 None admin] RBAC: Authorization granted {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:50:19.921203 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 651/1300] 10.222.0.59 () {56 vars in 1251 bytes} [Thu Jun 2 15:50:19 2022] GET /identity/v3/endpoints?service_id=3a3cda45459b45c99941a24a5c9d1790&interface=public®ion_id=RegionOne => generated 194 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 15:50:19.927029 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca9e03de-45e9-4685-9324-0ee9f62e8571 None admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:50:20.009704 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writing DB stats keystone:SELECT=100 {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:50:20.027785 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca9e03de-45e9-4685-9324-0ee9f62e8571 None admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:50:20.060474 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59534b47-a6e2-46e9-ae16-af86ed59d75a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:50:20.061131 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59534b47-a6e2-46e9-ae16-af86ed59d75a None admin] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:50:20.061416 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59534b47-a6e2-46e9-ae16-af86ed59d75a None admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:50:20.061691 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59534b47-a6e2-46e9-ae16-af86ed59d75a None admin] PATH_INFO: `/v3/services` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:50:20.062395 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59534b47-a6e2-46e9-ae16-af86ed59d75a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:50:20.063760 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59534b47-a6e2-46e9-ae16-af86ed59d75a None admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:50:20.070349 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 650/1301] 10.222.0.59 () {56 vars in 1087 bytes} [Thu Jun 2 15:50:19 2022] GET /identity/v3/services => generated 2191 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 15:50:22.330096 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-908ede72-2147-4b29-8266-10698613aab2 None None] REQUEST_METHOD: `GET` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:50:22.330625 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-908ede72-2147-4b29-8266-10698613aab2 None None] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:50:22.330748 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-908ede72-2147-4b29-8266-10698613aab2 None None] PATH_INFO: `/` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:50:22.332031 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 652/1302] 10.222.0.59 () {54 vars in 926 bytes} [Thu Jun 2 15:50:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 15:50:22.337515 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca26f2f-989d-40e5-88ce-389f66046b3a None None] REQUEST_METHOD: `POST` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:50:22.338550 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca26f2f-989d-40e5-88ce-389f66046b3a None None] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:50:22.338731 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca26f2f-989d-40e5-88ce-389f66046b3a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:50:22.354738 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.auth.core [None req-3ca26f2f-989d-40e5-88ce-389f66046b3a None None] MFA Rules not processed for user `400d1f4db9de49638549e5db29a041e1`. Rule list: `[]` (Enabled: `True`). {{(pid=80395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 15:50:22.355917 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.fernet_utils [None req-3ca26f2f-989d-40e5-88ce-389f66046b3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 15:50:22.421716 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 651/1303] 10.222.0.59 () {58 vars in 1023 bytes} [Thu Jun 2 15:50:22 2022] POST /identity/v3/auth/tokens => generated 2211 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 02 15:50:22.445198 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-908ede72-2147-4b29-8266-10698613aab2 None None] Authenticating user token {{(pid=80396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:50:22.539218 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG dbcounter [-] [80396] Writing DB stats keystone:SELECT=100 {{(pid=80396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:50:22.546350 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-908ede72-2147-4b29-8266-10698613aab2 None None] Validating token access rules against request {{(pid=80396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:50:22.579194 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81efccc6-7a3c-4c75-9e6d-33a9d43c91f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:50:22.580766 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81efccc6-7a3c-4c75-9e6d-33a9d43c91f1 None admin] REQUEST_METHOD: `GET` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:50:22.580766 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81efccc6-7a3c-4c75-9e6d-33a9d43c91f1 None admin] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:50:22.580766 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81efccc6-7a3c-4c75-9e6d-33a9d43c91f1 None admin] PATH_INFO: `/v3/services/placement` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:50:22.581329 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81efccc6-7a3c-4c75-9e6d-33a9d43c91f1 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:50:22.582725 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81efccc6-7a3c-4c75-9e6d-33a9d43c91f1 None admin] RBAC: Authorization granted {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:50:22.594594 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application [None req-81efccc6-7a3c-4c75-9e6d-33a9d43c91f1 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Jun 02 15:50:22.594594 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 15:50:22.594594 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 02 15:50:22.594594 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 02 15:50:22.594594 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 02 15:50:22.594594 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 02 15:50:22.594594 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 02 15:50:22.594594 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 02 15:50:22.594594 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jun 02 15:50:22.594594 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application Jun 02 15:50:22.594594 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 02 15:50:22.594594 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application Jun 02 15:50:22.594594 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 15:50:22.594594 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 15:50:22.594594 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 15:50:22.594594 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 15:50:22.594594 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 15:50:22.595773 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 15:50:22.595773 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 15:50:22.595773 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 15:50:22.595773 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 15:50:22.595773 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 15:50:22.595773 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 15:50:22.595773 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 02 15:50:22.595773 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 02 15:50:22.595773 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 02 15:50:22.595773 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 02 15:50:22.595773 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 15:50:22.595773 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 15:50:22.595773 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 15:50:22.595773 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 15:50:22.595773 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 15:50:22.595773 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 15:50:22.596970 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 15:50:22.596970 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application with Lock( Jun 02 15:50:22.596970 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 15:50:22.596970 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application return self._enter() Jun 02 15:50:22.596970 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 15:50:22.596970 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 15:50:22.596970 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 15:50:22.596970 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application return self.creator() Jun 02 15:50:22.596970 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 15:50:22.596970 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application created_value = creator( Jun 02 15:50:22.596970 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 02 15:50:22.596970 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 02 15:50:22.596970 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jun 02 15:50:22.596970 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: ERROR keystone.server.flask.application Jun 02 15:50:22.596970 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 653/1304] 10.222.0.59 () {56 vars in 1117 bytes} [Thu Jun 2 15:50:22 2022] GET /identity/v3/services/placement => generated 90 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 15:50:22.601975 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ca26f2f-989d-40e5-88ce-389f66046b3a None None] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:50:22.678020 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writing DB stats keystone:SELECT=100 {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:50:22.700645 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ca26f2f-989d-40e5-88ce-389f66046b3a None None] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:50:22.734825 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e5bb14-12d0-4b7b-a5a3-c8de68501cda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:50:22.735479 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e5bb14-12d0-4b7b-a5a3-c8de68501cda None admin] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:50:22.735761 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e5bb14-12d0-4b7b-a5a3-c8de68501cda None admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:50:22.736037 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e5bb14-12d0-4b7b-a5a3-c8de68501cda None admin] PATH_INFO: `/v3/services` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:50:22.736730 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7e5bb14-12d0-4b7b-a5a3-c8de68501cda None admin] RBAC: Adding query filter params (name=placement) {{(pid=80395) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 15:50:22.737033 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7e5bb14-12d0-4b7b-a5a3-c8de68501cda None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:50:22.738464 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7e5bb14-12d0-4b7b-a5a3-c8de68501cda None admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:50:22.743477 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 652/1305] 10.222.0.59 () {56 vars in 1116 bytes} [Thu Jun 2 15:50:22 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 15:50:22.749818 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81efccc6-7a3c-4c75-9e6d-33a9d43c91f1 None admin] Authenticating user token {{(pid=80396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:50:22.853312 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81efccc6-7a3c-4c75-9e6d-33a9d43c91f1 None admin] Validating token access rules against request {{(pid=80396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:50:22.886806 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a5dc27b-3efc-4af2-ac0a-44ec866b309f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:50:22.887447 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5dc27b-3efc-4af2-ac0a-44ec866b309f None admin] REQUEST_METHOD: `POST` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:50:22.887726 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5dc27b-3efc-4af2-ac0a-44ec866b309f None admin] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:50:22.887999 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5dc27b-3efc-4af2-ac0a-44ec866b309f None admin] PATH_INFO: `/v3/endpoints` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:50:22.888719 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a5dc27b-3efc-4af2-ac0a-44ec866b309f None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:50:22.890184 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a5dc27b-3efc-4af2-ac0a-44ec866b309f None admin] RBAC: Authorization granted {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:50:23.007389 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 654/1306] 10.222.0.59 () {60 vars in 1144 bytes} [Thu Jun 2 15:50:22 2022] POST /identity/v3/endpoints => generated 331 bytes in 253 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 15:50:32.793503 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writing DB stats keystone:SELECT=30 {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:50:32.997552 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG dbcounter [-] [80396] Writing DB stats keystone:SELECT=91,keystone:INSERT=1 {{(pid=80396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:57:50.818382 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f42b9fd-cfb3-467e-8cc8-981b90ac96e0 None None] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:57:50.818948 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f42b9fd-cfb3-467e-8cc8-981b90ac96e0 None None] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:57:50.818948 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f42b9fd-cfb3-467e-8cc8-981b90ac96e0 None None] PATH_INFO: `/` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:57:50.825566 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce880f2-3d19-45dd-98eb-e246917fd73e None None] REQUEST_METHOD: `POST` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:57:50.825997 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce880f2-3d19-45dd-98eb-e246917fd73e None None] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:57:50.826239 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce880f2-3d19-45dd-98eb-e246917fd73e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:57:50.829593 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 653/1307] 10.222.0.59 () {54 vars in 926 bytes} [Thu Jun 2 15:57:50 2022] GET /identity => generated 270 bytes in 12 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 15:57:50.921763 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.auth.core [None req-4ce880f2-3d19-45dd-98eb-e246917fd73e None None] MFA Rules not processed for user `400d1f4db9de49638549e5db29a041e1`. Rule list: `[]` (Enabled: `True`). {{(pid=80396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 15:57:50.923374 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.fernet_utils [None req-4ce880f2-3d19-45dd-98eb-e246917fd73e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 15:57:51.070611 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 655/1308] 10.222.0.59 () {58 vars in 1023 bytes} [Thu Jun 2 15:57:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 246 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 02 15:57:51.125434 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17f314c-2e5c-4577-b634-7bcbd474bfdc None None] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:57:51.125732 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17f314c-2e5c-4577-b634-7bcbd474bfdc None None] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:57:51.126016 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17f314c-2e5c-4577-b634-7bcbd474bfdc None None] PATH_INFO: `/` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:57:51.127732 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 654/1309] 10.222.0.59 () {54 vars in 964 bytes} [Thu Jun 2 15:57:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 15:57:51.135931 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3186ea86-7a17-49ed-80e9-f3ad16190172 None None] REQUEST_METHOD: `POST` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:57:51.136293 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3186ea86-7a17-49ed-80e9-f3ad16190172 None None] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:57:51.136492 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3186ea86-7a17-49ed-80e9-f3ad16190172 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:57:51.265267 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.auth.core [None req-3186ea86-7a17-49ed-80e9-f3ad16190172 None None] MFA Rules not processed for user `9af40ddfe9ff4be3887b068f13a28dc0`. Rule list: `[]` (Enabled: `True`). {{(pid=80396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 15:57:51.266830 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.fernet_utils [None req-3186ea86-7a17-49ed-80e9-f3ad16190172 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 15:57:51.292342 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG dbcounter [-] [80396] Writing DB stats keystone:SELECT=100 {{(pid=80396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:57:51.378878 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b17f314c-2e5c-4577-b634-7bcbd474bfdc None None] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:57:51.381570 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.fernet_utils [None req-b17f314c-2e5c-4577-b634-7bcbd474bfdc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 15:57:51.389723 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 656/1310] 10.222.0.59 () {58 vars in 1061 bytes} [Thu Jun 2 15:57:51 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 255 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 15:57:51.523459 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b17f314c-2e5c-4577-b634-7bcbd474bfdc None None] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:57:51.612818 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d03dad11-78b3-42f1-8a8c-4b0f048718ab service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9af40ddfe9ff4be3887b068f13a28dc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c87c981909d4b8db02783421818c79b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:57:51.613475 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d03dad11-78b3-42f1-8a8c-4b0f048718ab service neutron] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:57:51.613757 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d03dad11-78b3-42f1-8a8c-4b0f048718ab service neutron] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:57:51.614102 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d03dad11-78b3-42f1-8a8c-4b0f048718ab service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:57:51.616503 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.fernet_utils [None req-d03dad11-78b3-42f1-8a8c-4b0f048718ab service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 15:57:51.680660 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writing DB stats keystone:SELECT=100 {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:57:51.749807 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d03dad11-78b3-42f1-8a8c-4b0f048718ab service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:57:51.751588 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d03dad11-78b3-42f1-8a8c-4b0f048718ab service neutron] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:57:51.779081 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 655/1311] 10.222.0.59 () {60 vars in 1365 bytes} [Thu Jun 2 15:57:51 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 400 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 02 15:57:54.461497 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b560669-e931-4407-9e3b-6dd771b6d555 None None] REQUEST_METHOD: `GET` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:57:54.462056 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b560669-e931-4407-9e3b-6dd771b6d555 None None] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:57:54.462056 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b560669-e931-4407-9e3b-6dd771b6d555 None None] PATH_INFO: `/` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:57:54.467637 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 657/1312] 10.222.0.59 () {54 vars in 926 bytes} [Thu Jun 2 15:57:54 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 15:57:54.469111 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b639444a-8482-4979-8ea7-0b6fbbf9d2a3 None None] REQUEST_METHOD: `POST` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:57:54.469554 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b639444a-8482-4979-8ea7-0b6fbbf9d2a3 None None] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:57:54.469718 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b639444a-8482-4979-8ea7-0b6fbbf9d2a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:57:54.554552 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.auth.core [None req-b639444a-8482-4979-8ea7-0b6fbbf9d2a3 None None] MFA Rules not processed for user `400d1f4db9de49638549e5db29a041e1`. Rule list: `[]` (Enabled: `True`). {{(pid=80395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 15:57:54.555789 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.fernet_utils [None req-b639444a-8482-4979-8ea7-0b6fbbf9d2a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 15:57:54.663552 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 656/1313] 10.222.0.59 () {58 vars in 1023 bytes} [Thu Jun 2 15:57:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 02 15:57:54.717831 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e507fde8-9dfe-4cb8-be5a-082d74bd6a5b None None] REQUEST_METHOD: `GET` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:57:54.718159 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e507fde8-9dfe-4cb8-be5a-082d74bd6a5b None None] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:57:54.718446 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e507fde8-9dfe-4cb8-be5a-082d74bd6a5b None None] PATH_INFO: `/` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:57:54.719835 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 658/1314] 10.222.0.59 () {54 vars in 964 bytes} [Thu Jun 2 15:57:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 15:57:54.726352 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7f13d1-39c6-4a85-9cc1-7cb05242b36c None None] REQUEST_METHOD: `POST` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:57:54.726650 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7f13d1-39c6-4a85-9cc1-7cb05242b36c None None] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:57:54.726934 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7f13d1-39c6-4a85-9cc1-7cb05242b36c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:57:54.737268 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writing DB stats keystone:SELECT=100 {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:57:54.802338 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.auth.core [None req-6c7f13d1-39c6-4a85-9cc1-7cb05242b36c None None] MFA Rules not processed for user `9af40ddfe9ff4be3887b068f13a28dc0`. Rule list: `[]` (Enabled: `True`). {{(pid=80395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 15:57:54.803432 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.fernet_utils [None req-6c7f13d1-39c6-4a85-9cc1-7cb05242b36c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 15:57:54.879160 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 657/1315] 10.222.0.59 () {58 vars in 1061 bytes} [Thu Jun 2 15:57:54 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 02 15:57:54.889406 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e507fde8-9dfe-4cb8-be5a-082d74bd6a5b None None] Authenticating user token {{(pid=80396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:57:54.891028 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.fernet_utils [None req-e507fde8-9dfe-4cb8-be5a-082d74bd6a5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 15:57:54.996643 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e507fde8-9dfe-4cb8-be5a-082d74bd6a5b None None] Validating token access rules against request {{(pid=80396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:57:55.074517 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG dbcounter [-] [80396] Writing DB stats keystone:SELECT=100 {{(pid=80396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:57:55.076869 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cd73ea7-02c3-4cef-8d38-48547c3bed4c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9af40ddfe9ff4be3887b068f13a28dc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c87c981909d4b8db02783421818c79b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:57:55.077517 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd73ea7-02c3-4cef-8d38-48547c3bed4c service neutron] REQUEST_METHOD: `GET` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:57:55.077801 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd73ea7-02c3-4cef-8d38-48547c3bed4c service neutron] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:57:55.078109 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd73ea7-02c3-4cef-8d38-48547c3bed4c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:57:55.079845 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.fernet_utils [None req-6cd73ea7-02c3-4cef-8d38-48547c3bed4c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 15:57:55.208449 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cd73ea7-02c3-4cef-8d38-48547c3bed4c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:57:55.210048 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cd73ea7-02c3-4cef-8d38-48547c3bed4c service neutron] RBAC: Authorization granted {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:57:55.231249 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 659/1316] 10.222.0.59 () {60 vars in 1365 bytes} [Thu Jun 2 15:57:54 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 342 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 02 15:57:58.270467 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f5c3052-96f1-4fbd-b7c5-431c6007d2e3 None None] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:57:58.270992 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f5c3052-96f1-4fbd-b7c5-431c6007d2e3 None None] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:57:58.271082 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f5c3052-96f1-4fbd-b7c5-431c6007d2e3 None None] PATH_INFO: `/` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:57:58.272373 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 658/1317] 10.222.0.59 () {54 vars in 926 bytes} [Thu Jun 2 15:57:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 15:57:58.277441 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f51ae3a6-b738-4643-985c-053e5a7a6caf None None] REQUEST_METHOD: `POST` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:57:58.277860 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f51ae3a6-b738-4643-985c-053e5a7a6caf None None] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:57:58.283143 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f51ae3a6-b738-4643-985c-053e5a7a6caf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:57:58.344451 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.auth.core [None req-f51ae3a6-b738-4643-985c-053e5a7a6caf None None] MFA Rules not processed for user `8defb7300e7949f180b3f6ccd787ddf9`. Rule list: `[]` (Enabled: `True`). {{(pid=80396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 15:57:58.345654 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.fernet_utils [None req-f51ae3a6-b738-4643-985c-053e5a7a6caf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 15:57:58.398295 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG dbcounter [-] [80396] Writing DB stats keystone:SELECT=100 {{(pid=80396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:57:58.442874 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 660/1318] 10.222.0.59 () {58 vars in 1023 bytes} [Thu Jun 2 15:57:58 2022] POST /identity/v3/auth/tokens => generated 3233 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 15:57:58.482315 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f5c3052-96f1-4fbd-b7c5-431c6007d2e3 None None] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:57:58.483854 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.fernet_utils [None req-3f5c3052-96f1-4fbd-b7c5-431c6007d2e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 15:57:58.584450 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f5c3052-96f1-4fbd-b7c5-431c6007d2e3 None None] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:57:58.587299 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writing DB stats keystone:SELECT=100 {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:57:58.658547 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-376857ab-1f21-4e08-9f31-5c7a017bda92 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9af40ddfe9ff4be3887b068f13a28dc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c87c981909d4b8db02783421818c79b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:57:58.659189 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376857ab-1f21-4e08-9f31-5c7a017bda92 service neutron] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:57:58.659470 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376857ab-1f21-4e08-9f31-5c7a017bda92 service neutron] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:57:58.659740 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376857ab-1f21-4e08-9f31-5c7a017bda92 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:57:58.661660 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.fernet_utils [None req-376857ab-1f21-4e08-9f31-5c7a017bda92 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 15:57:58.765449 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-376857ab-1f21-4e08-9f31-5c7a017bda92 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:57:58.766833 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-376857ab-1f21-4e08-9f31-5c7a017bda92 service neutron] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:57:58.785005 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 659/1319] 10.222.0.59 () {60 vars in 1365 bytes} [Thu Jun 2 15:57:58 2022] GET /identity/v3/auth/tokens => generated 3233 bytes in 303 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 15:58:02.001325 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2230a948-dd0d-4a30-9c53-79d675c21930 None None] REQUEST_METHOD: `GET` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:58:02.001891 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2230a948-dd0d-4a30-9c53-79d675c21930 None None] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:58:02.001891 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2230a948-dd0d-4a30-9c53-79d675c21930 None None] PATH_INFO: `/` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:58:02.003272 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 661/1320] 10.222.0.59 () {54 vars in 926 bytes} [Thu Jun 2 15:58:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 15:58:02.008913 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dcd3496-2296-4955-ba78-9665609462aa None None] REQUEST_METHOD: `POST` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:58:02.009348 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dcd3496-2296-4955-ba78-9665609462aa None None] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:58:02.009458 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dcd3496-2296-4955-ba78-9665609462aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:58:02.048021 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writing DB stats keystone:SELECT=100 {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:58:02.072656 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.auth.core [None req-6dcd3496-2296-4955-ba78-9665609462aa None None] MFA Rules not processed for user `400d1f4db9de49638549e5db29a041e1`. Rule list: `[]` (Enabled: `True`). {{(pid=80395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 15:58:02.073982 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.fernet_utils [None req-6dcd3496-2296-4955-ba78-9665609462aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 15:58:02.168204 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 660/1321] 10.222.0.59 () {58 vars in 1023 bytes} [Thu Jun 2 15:58:02 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 15:58:02.206616 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2230a948-dd0d-4a30-9c53-79d675c21930 None None] Authenticating user token {{(pid=80396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:58:02.208258 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.fernet_utils [None req-2230a948-dd0d-4a30-9c53-79d675c21930 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 15:58:02.312339 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2230a948-dd0d-4a30-9c53-79d675c21930 None None] Validating token access rules against request {{(pid=80396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:58:02.384856 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e05dbd-6288-42cd-99b4-f9e9d3174ad2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9af40ddfe9ff4be3887b068f13a28dc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c87c981909d4b8db02783421818c79b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:58:02.385496 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e05dbd-6288-42cd-99b4-f9e9d3174ad2 service neutron] REQUEST_METHOD: `GET` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:58:02.385775 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e05dbd-6288-42cd-99b4-f9e9d3174ad2 service neutron] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:58:02.386048 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e05dbd-6288-42cd-99b4-f9e9d3174ad2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:58:02.387694 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.fernet_utils [None req-b7e05dbd-6288-42cd-99b4-f9e9d3174ad2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 15:58:02.396008 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG dbcounter [-] [80396] Writing DB stats keystone:SELECT=100 {{(pid=80396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:58:02.498485 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7e05dbd-6288-42cd-99b4-f9e9d3174ad2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:58:02.499954 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7e05dbd-6288-42cd-99b4-f9e9d3174ad2 service neutron] RBAC: Authorization granted {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:58:02.517799 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 662/1322] 10.222.0.59 () {60 vars in 1365 bytes} [Thu Jun 2 15:58:02 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 15:58:05.828190 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4099954b-61fe-44c0-92ab-19d6bcf73a80 None None] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:58:05.828722 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4099954b-61fe-44c0-92ab-19d6bcf73a80 None None] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:58:05.828838 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4099954b-61fe-44c0-92ab-19d6bcf73a80 None None] PATH_INFO: `/` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:58:05.830200 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 661/1323] 10.222.0.59 () {54 vars in 926 bytes} [Thu Jun 2 15:58:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 15:58:05.836188 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186a3311-51a6-4105-a393-4a637e1e433c None None] REQUEST_METHOD: `POST` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:58:05.836628 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186a3311-51a6-4105-a393-4a637e1e433c None None] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:58:05.836891 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186a3311-51a6-4105-a393-4a637e1e433c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:58:05.902823 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.auth.core [None req-186a3311-51a6-4105-a393-4a637e1e433c None None] MFA Rules not processed for user `400d1f4db9de49638549e5db29a041e1`. Rule list: `[]` (Enabled: `True`). {{(pid=80396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 15:58:05.904070 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.fernet_utils [None req-186a3311-51a6-4105-a393-4a637e1e433c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 15:58:05.965183 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG dbcounter [-] [80396] Writing DB stats keystone:SELECT=100 {{(pid=80396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:58:06.002848 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 663/1324] 10.222.0.59 () {58 vars in 1023 bytes} [Thu Jun 2 15:58:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 15:58:06.038927 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4099954b-61fe-44c0-92ab-19d6bcf73a80 None None] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:58:06.040477 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.fernet_utils [None req-4099954b-61fe-44c0-92ab-19d6bcf73a80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 15:58:06.145654 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4099954b-61fe-44c0-92ab-19d6bcf73a80 None None] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:58:06.157602 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writing DB stats keystone:SELECT=100 {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:58:06.221170 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4927e772-2563-4411-8f87-3ec2ff4531ed service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9af40ddfe9ff4be3887b068f13a28dc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c87c981909d4b8db02783421818c79b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:58:06.221851 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4927e772-2563-4411-8f87-3ec2ff4531ed service neutron] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:58:06.222167 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4927e772-2563-4411-8f87-3ec2ff4531ed service neutron] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:58:06.222448 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4927e772-2563-4411-8f87-3ec2ff4531ed service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:58:06.224106 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.fernet_utils [None req-4927e772-2563-4411-8f87-3ec2ff4531ed service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 15:58:06.337640 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4927e772-2563-4411-8f87-3ec2ff4531ed service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:58:06.339151 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4927e772-2563-4411-8f87-3ec2ff4531ed service neutron] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:58:06.357392 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 662/1325] 10.222.0.59 () {60 vars in 1365 bytes} [Thu Jun 2 15:58:06 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 319 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 15:58:08.643459 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a7abc1-3c30-4e75-b6cc-bd055df79323 None None] REQUEST_METHOD: `GET` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:58:08.643993 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a7abc1-3c30-4e75-b6cc-bd055df79323 None None] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:58:08.643993 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a7abc1-3c30-4e75-b6cc-bd055df79323 None None] PATH_INFO: `/` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:58:08.645501 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 664/1326] 10.222.0.59 () {54 vars in 926 bytes} [Thu Jun 2 15:58:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 15:58:08.650739 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21245693-fa16-4f45-8383-eba377d2fd67 None None] REQUEST_METHOD: `POST` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:58:08.651171 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21245693-fa16-4f45-8383-eba377d2fd67 None None] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:58:08.651297 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21245693-fa16-4f45-8383-eba377d2fd67 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:58:08.697614 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writing DB stats keystone:SELECT=100 {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:58:08.715842 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.auth.core [None req-21245693-fa16-4f45-8383-eba377d2fd67 None None] MFA Rules not processed for user `400d1f4db9de49638549e5db29a041e1`. Rule list: `[]` (Enabled: `True`). {{(pid=80395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 15:58:08.717664 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.fernet_utils [None req-21245693-fa16-4f45-8383-eba377d2fd67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 15:58:08.812989 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 663/1327] 10.222.0.59 () {58 vars in 1023 bytes} [Thu Jun 2 15:58:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 15:58:08.848504 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36a7abc1-3c30-4e75-b6cc-bd055df79323 None None] Authenticating user token {{(pid=80396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:58:08.850010 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.fernet_utils [None req-36a7abc1-3c30-4e75-b6cc-bd055df79323 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 15:58:08.954013 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36a7abc1-3c30-4e75-b6cc-bd055df79323 None None] Validating token access rules against request {{(pid=80396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:58:09.026161 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a35b7e04-ee5b-4426-890b-be6ef0bb0385 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9af40ddfe9ff4be3887b068f13a28dc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c87c981909d4b8db02783421818c79b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:58:09.026800 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a35b7e04-ee5b-4426-890b-be6ef0bb0385 service neutron] REQUEST_METHOD: `GET` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:58:09.027079 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a35b7e04-ee5b-4426-890b-be6ef0bb0385 service neutron] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:58:09.027348 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a35b7e04-ee5b-4426-890b-be6ef0bb0385 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:58:09.028959 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.fernet_utils [None req-a35b7e04-ee5b-4426-890b-be6ef0bb0385 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 15:58:09.045916 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG dbcounter [-] [80396] Writing DB stats keystone:SELECT=100 {{(pid=80396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:58:09.138610 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a35b7e04-ee5b-4426-890b-be6ef0bb0385 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:58:09.140074 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a35b7e04-ee5b-4426-890b-be6ef0bb0385 service neutron] RBAC: Authorization granted {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:58:09.158642 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 665/1328] 10.222.0.59 () {60 vars in 1365 bytes} [Thu Jun 2 15:58:08 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 15:58:11.482964 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643fa62f-540f-4c83-9acc-5447ca882331 None None] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:58:11.483552 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643fa62f-540f-4c83-9acc-5447ca882331 None None] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:58:11.483552 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643fa62f-540f-4c83-9acc-5447ca882331 None None] PATH_INFO: `/` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:58:11.484815 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 664/1329] 10.222.0.59 () {54 vars in 926 bytes} [Thu Jun 2 15:58:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 15:58:11.490688 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1552823c-94e6-4089-b690-5e6975e31ea7 None None] REQUEST_METHOD: `POST` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:58:11.491145 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1552823c-94e6-4089-b690-5e6975e31ea7 None None] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:58:11.491375 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1552823c-94e6-4089-b690-5e6975e31ea7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:58:11.555523 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.auth.core [None req-1552823c-94e6-4089-b690-5e6975e31ea7 None None] MFA Rules not processed for user `8defb7300e7949f180b3f6ccd787ddf9`. Rule list: `[]` (Enabled: `True`). {{(pid=80396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 15:58:11.556712 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.fernet_utils [None req-1552823c-94e6-4089-b690-5e6975e31ea7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 15:58:11.621206 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG dbcounter [-] [80396] Writing DB stats keystone:SELECT=100 {{(pid=80396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:58:11.653704 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 666/1330] 10.222.0.59 () {58 vars in 1023 bytes} [Thu Jun 2 15:58:11 2022] POST /identity/v3/auth/tokens => generated 3233 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 15:58:11.690660 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-643fa62f-540f-4c83-9acc-5447ca882331 None None] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:58:11.693145 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.fernet_utils [None req-643fa62f-540f-4c83-9acc-5447ca882331 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 15:58:11.797590 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-643fa62f-540f-4c83-9acc-5447ca882331 None None] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:58:11.818665 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writing DB stats keystone:SELECT=100 {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:58:11.874192 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65863006-8ff4-4208-8da0-24555b0dbed1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9af40ddfe9ff4be3887b068f13a28dc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c87c981909d4b8db02783421818c79b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:58:11.874840 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65863006-8ff4-4208-8da0-24555b0dbed1 service neutron] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:58:11.875119 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65863006-8ff4-4208-8da0-24555b0dbed1 service neutron] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:58:11.875390 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65863006-8ff4-4208-8da0-24555b0dbed1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:58:11.877041 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.fernet_utils [None req-65863006-8ff4-4208-8da0-24555b0dbed1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 15:58:11.985823 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65863006-8ff4-4208-8da0-24555b0dbed1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:58:11.987304 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65863006-8ff4-4208-8da0-24555b0dbed1 service neutron] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:58:12.012806 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 665/1331] 10.222.0.59 () {60 vars in 1365 bytes} [Thu Jun 2 15:58:11 2022] GET /identity/v3/auth/tokens => generated 3233 bytes in 323 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 15:58:14.752651 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f09e962-e3be-433e-a82f-655f391153e5 None None] REQUEST_METHOD: `GET` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:58:14.753138 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f09e962-e3be-433e-a82f-655f391153e5 None None] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:58:14.753252 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f09e962-e3be-433e-a82f-655f391153e5 None None] PATH_INFO: `/` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:58:14.755182 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 667/1332] 10.222.0.59 () {54 vars in 926 bytes} [Thu Jun 2 15:58:14 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 15:58:14.761084 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59cba2f4-f821-4880-abc8-3f99a9db433a None None] REQUEST_METHOD: `POST` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:58:14.761534 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59cba2f4-f821-4880-abc8-3f99a9db433a None None] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:58:14.761648 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59cba2f4-f821-4880-abc8-3f99a9db433a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:58:14.824886 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writing DB stats keystone:SELECT=100 {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:58:14.827538 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.auth.core [None req-59cba2f4-f821-4880-abc8-3f99a9db433a None None] MFA Rules not processed for user `400d1f4db9de49638549e5db29a041e1`. Rule list: `[]` (Enabled: `True`). {{(pid=80395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 15:58:14.828744 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.fernet_utils [None req-59cba2f4-f821-4880-abc8-3f99a9db433a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 15:58:14.928434 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 666/1333] 10.222.0.59 () {58 vars in 1023 bytes} [Thu Jun 2 15:58:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 15:58:14.963911 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f09e962-e3be-433e-a82f-655f391153e5 None None] Authenticating user token {{(pid=80396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:58:14.965676 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.fernet_utils [None req-8f09e962-e3be-433e-a82f-655f391153e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 15:58:15.072271 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f09e962-e3be-433e-a82f-655f391153e5 None None] Validating token access rules against request {{(pid=80396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:58:15.152066 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f70ffa6e-ae37-4713-8584-9f8ef80bd484 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9af40ddfe9ff4be3887b068f13a28dc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c87c981909d4b8db02783421818c79b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:58:15.152721 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70ffa6e-ae37-4713-8584-9f8ef80bd484 service neutron] REQUEST_METHOD: `GET` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:58:15.153002 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70ffa6e-ae37-4713-8584-9f8ef80bd484 service neutron] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:58:15.153286 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70ffa6e-ae37-4713-8584-9f8ef80bd484 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:58:15.155889 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.fernet_utils [None req-f70ffa6e-ae37-4713-8584-9f8ef80bd484 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 15:58:15.187816 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG dbcounter [-] [80396] Writing DB stats keystone:SELECT=100 {{(pid=80396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:58:15.271003 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f70ffa6e-ae37-4713-8584-9f8ef80bd484 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:58:15.272511 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f70ffa6e-ae37-4713-8584-9f8ef80bd484 service neutron] RBAC: Authorization granted {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:58:15.294961 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 668/1334] 10.222.0.59 () {60 vars in 1365 bytes} [Thu Jun 2 15:58:14 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 331 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 15:58:17.585535 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7559eefd-3667-4a2a-a9c2-c322e100d6e3 None None] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:58:17.586045 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7559eefd-3667-4a2a-a9c2-c322e100d6e3 None None] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:58:17.586045 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7559eefd-3667-4a2a-a9c2-c322e100d6e3 None None] PATH_INFO: `/` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:58:17.587429 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 667/1335] 10.222.0.59 () {54 vars in 926 bytes} [Thu Jun 2 15:58:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 15:58:17.593107 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-350ba7f2-31b5-421a-af13-ebfa992dbde9 None None] REQUEST_METHOD: `POST` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:58:17.593524 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-350ba7f2-31b5-421a-af13-ebfa992dbde9 None None] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:58:17.593645 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-350ba7f2-31b5-421a-af13-ebfa992dbde9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:58:17.656287 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.auth.core [None req-350ba7f2-31b5-421a-af13-ebfa992dbde9 None None] MFA Rules not processed for user `400d1f4db9de49638549e5db29a041e1`. Rule list: `[]` (Enabled: `True`). {{(pid=80396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 15:58:17.657464 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.fernet_utils [None req-350ba7f2-31b5-421a-af13-ebfa992dbde9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 15:58:17.730558 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG dbcounter [-] [80396] Writing DB stats keystone:SELECT=100 {{(pid=80396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:58:17.752093 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 669/1336] 10.222.0.59 () {58 vars in 1023 bytes} [Thu Jun 2 15:58:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 02 15:58:17.791708 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7559eefd-3667-4a2a-a9c2-c322e100d6e3 None None] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:58:17.793219 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.fernet_utils [None req-7559eefd-3667-4a2a-a9c2-c322e100d6e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 15:58:17.897187 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7559eefd-3667-4a2a-a9c2-c322e100d6e3 None None] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:58:17.924387 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writing DB stats keystone:SELECT=100 {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:58:17.969519 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a2452eb-37e7-40a1-aea4-d39f6588735c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9af40ddfe9ff4be3887b068f13a28dc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c87c981909d4b8db02783421818c79b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:58:17.970202 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a2452eb-37e7-40a1-aea4-d39f6588735c service neutron] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:58:17.970484 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a2452eb-37e7-40a1-aea4-d39f6588735c service neutron] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:58:17.970753 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a2452eb-37e7-40a1-aea4-d39f6588735c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:58:17.972395 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.fernet_utils [None req-8a2452eb-37e7-40a1-aea4-d39f6588735c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 15:58:18.076803 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a2452eb-37e7-40a1-aea4-d39f6588735c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:58:18.078262 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a2452eb-37e7-40a1-aea4-d39f6588735c service neutron] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:58:18.099009 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 668/1337] 10.222.0.59 () {60 vars in 1365 bytes} [Thu Jun 2 15:58:17 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 15:58:21.048035 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e6f6f6-0b2b-43fd-90e5-da068f636cdb None None] REQUEST_METHOD: `GET` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:58:21.048581 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e6f6f6-0b2b-43fd-90e5-da068f636cdb None None] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:58:21.048581 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e6f6f6-0b2b-43fd-90e5-da068f636cdb None None] PATH_INFO: `/` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:58:21.049980 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 670/1338] 10.222.0.59 () {54 vars in 926 bytes} [Thu Jun 2 15:58:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 15:58:21.055370 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d34aaaa-59f3-46fb-92aa-5a1be9ed80ee None None] REQUEST_METHOD: `POST` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:58:21.055817 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d34aaaa-59f3-46fb-92aa-5a1be9ed80ee None None] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:58:21.055912 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d34aaaa-59f3-46fb-92aa-5a1be9ed80ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:58:21.118930 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.auth.core [None req-1d34aaaa-59f3-46fb-92aa-5a1be9ed80ee None None] MFA Rules not processed for user `400d1f4db9de49638549e5db29a041e1`. Rule list: `[]` (Enabled: `True`). {{(pid=80395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 15:58:21.120112 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.fernet_utils [None req-1d34aaaa-59f3-46fb-92aa-5a1be9ed80ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 15:58:21.129022 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writing DB stats keystone:SELECT=100 {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:58:21.218844 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 669/1339] 10.222.0.59 () {58 vars in 1023 bytes} [Thu Jun 2 15:58:21 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 15:58:21.255676 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e6f6f6-0b2b-43fd-90e5-da068f636cdb None None] Authenticating user token {{(pid=80396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:58:21.259192 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.fernet_utils [None req-17e6f6f6-0b2b-43fd-90e5-da068f636cdb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 15:58:21.372910 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e6f6f6-0b2b-43fd-90e5-da068f636cdb None None] Validating token access rules against request {{(pid=80396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:58:21.376567 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87fa4475-145a-4b38-8457-a36ffca9f764 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9af40ddfe9ff4be3887b068f13a28dc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c87c981909d4b8db02783421818c79b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:58:21.377201 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87fa4475-145a-4b38-8457-a36ffca9f764 service neutron] REQUEST_METHOD: `GET` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:58:21.377504 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87fa4475-145a-4b38-8457-a36ffca9f764 service neutron] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:58:21.377776 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87fa4475-145a-4b38-8457-a36ffca9f764 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:58:21.381988 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.fernet_utils [None req-87fa4475-145a-4b38-8457-a36ffca9f764 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 15:58:21.484432 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87fa4475-145a-4b38-8457-a36ffca9f764 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:58:21.485861 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87fa4475-145a-4b38-8457-a36ffca9f764 service neutron] RBAC: Authorization granted {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:58:21.496941 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG dbcounter [-] [80396] Writing DB stats keystone:SELECT=100 {{(pid=80396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:58:21.507352 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 671/1340] 10.222.0.59 () {60 vars in 1365 bytes} [Thu Jun 2 15:58:21 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 252 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 02 15:58:25.996912 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f15498-cec2-4759-bdc3-a05fc0098252 None None] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:58:25.997450 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f15498-cec2-4759-bdc3-a05fc0098252 None None] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:58:25.997450 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f15498-cec2-4759-bdc3-a05fc0098252 None None] PATH_INFO: `/` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:58:25.999026 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 670/1341] 10.222.0.59 () {54 vars in 926 bytes} [Thu Jun 2 15:58:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 15:58:26.004732 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655f38f2-bb85-4d77-b482-9e4708025336 None None] REQUEST_METHOD: `POST` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:58:26.005197 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655f38f2-bb85-4d77-b482-9e4708025336 None None] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:58:26.005288 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655f38f2-bb85-4d77-b482-9e4708025336 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:58:26.053810 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.auth.core [None req-655f38f2-bb85-4d77-b482-9e4708025336 None None] MFA Rules not processed for user `400d1f4db9de49638549e5db29a041e1`. Rule list: `[]` (Enabled: `True`). {{(pid=80396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 15:58:26.055028 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.fernet_utils [None req-655f38f2-bb85-4d77-b482-9e4708025336 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 15:58:26.131332 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 672/1342] 10.222.0.59 () {58 vars in 1023 bytes} [Thu Jun 2 15:58:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 02 15:58:26.169990 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4f15498-cec2-4759-bdc3-a05fc0098252 None None] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:58:26.182886 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4f15498-cec2-4759-bdc3-a05fc0098252 None None] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:58:26.191477 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c5ecfb2-65e2-438e-816e-97928754af59 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9af40ddfe9ff4be3887b068f13a28dc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c87c981909d4b8db02783421818c79b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:58:26.192122 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5ecfb2-65e2-438e-816e-97928754af59 service neutron] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:58:26.192408 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5ecfb2-65e2-438e-816e-97928754af59 service neutron] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:58:26.192691 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5ecfb2-65e2-438e-816e-97928754af59 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:58:26.201636 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c5ecfb2-65e2-438e-816e-97928754af59 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:58:26.203123 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c5ecfb2-65e2-438e-816e-97928754af59 service neutron] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:58:26.213163 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 671/1343] 10.222.0.59 () {60 vars in 1365 bytes} [Thu Jun 2 15:58:26 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 15:58:29.483393 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9403fb9-4d8a-4928-8507-a1d846e69b60 None None] REQUEST_METHOD: `GET` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:58:29.483935 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9403fb9-4d8a-4928-8507-a1d846e69b60 None None] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:58:29.484056 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9403fb9-4d8a-4928-8507-a1d846e69b60 None None] PATH_INFO: `/` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:58:29.485421 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 673/1344] 10.222.0.59 () {54 vars in 926 bytes} [Thu Jun 2 15:58:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 15:58:29.491154 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f18a83ec-3a4a-40b9-a534-25ada772e86f None None] REQUEST_METHOD: `POST` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:58:29.493856 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f18a83ec-3a4a-40b9-a534-25ada772e86f None None] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:58:29.493856 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f18a83ec-3a4a-40b9-a534-25ada772e86f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:58:29.519535 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.auth.core [None req-f18a83ec-3a4a-40b9-a534-25ada772e86f None None] MFA Rules not processed for user `400d1f4db9de49638549e5db29a041e1`. Rule list: `[]` (Enabled: `True`). {{(pid=80395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 15:58:29.520717 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.fernet_utils [None req-f18a83ec-3a4a-40b9-a534-25ada772e86f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 15:58:29.528847 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 672/1345] 10.222.0.59 () {58 vars in 1023 bytes} [Thu Jun 2 15:58:29 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 15:58:29.565922 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9403fb9-4d8a-4928-8507-a1d846e69b60 None None] Authenticating user token {{(pid=80396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:58:29.576730 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9403fb9-4d8a-4928-8507-a1d846e69b60 None None] Validating token access rules against request {{(pid=80396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:58:29.580133 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50106959-9d15-4e2d-ac7f-1ca334f45f05 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9af40ddfe9ff4be3887b068f13a28dc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c87c981909d4b8db02783421818c79b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:58:29.581294 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50106959-9d15-4e2d-ac7f-1ca334f45f05 service neutron] REQUEST_METHOD: `GET` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:58:29.581573 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50106959-9d15-4e2d-ac7f-1ca334f45f05 service neutron] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:58:29.581845 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50106959-9d15-4e2d-ac7f-1ca334f45f05 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:58:29.591430 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50106959-9d15-4e2d-ac7f-1ca334f45f05 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:58:29.592852 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50106959-9d15-4e2d-ac7f-1ca334f45f05 service neutron] RBAC: Authorization granted {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:58:29.603203 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 674/1346] 10.222.0.59 () {60 vars in 1365 bytes} [Thu Jun 2 15:58:29 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 15:58:34.136011 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44df2de8-06a0-41cf-8744-0557b0bb105e None None] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:58:34.136534 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44df2de8-06a0-41cf-8744-0557b0bb105e None None] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:58:34.136534 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44df2de8-06a0-41cf-8744-0557b0bb105e None None] PATH_INFO: `/` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:58:34.137864 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 673/1347] 10.222.0.59 () {54 vars in 926 bytes} [Thu Jun 2 15:58:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 15:58:34.143121 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5861d67-5a16-4167-84ae-e8e2ec7c1119 None None] REQUEST_METHOD: `POST` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:58:34.143566 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5861d67-5a16-4167-84ae-e8e2ec7c1119 None None] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:58:34.143676 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5861d67-5a16-4167-84ae-e8e2ec7c1119 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:58:34.161660 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.auth.core [None req-b5861d67-5a16-4167-84ae-e8e2ec7c1119 None None] MFA Rules not processed for user `400d1f4db9de49638549e5db29a041e1`. Rule list: `[]` (Enabled: `True`). {{(pid=80396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 15:58:34.162879 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.fernet_utils [None req-b5861d67-5a16-4167-84ae-e8e2ec7c1119 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 15:58:34.170852 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 675/1348] 10.222.0.59 () {58 vars in 1023 bytes} [Thu Jun 2 15:58:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 15:58:34.208583 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44df2de8-06a0-41cf-8744-0557b0bb105e None None] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:58:34.210274 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.fernet_utils [None req-44df2de8-06a0-41cf-8744-0557b0bb105e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 15:58:34.223535 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44df2de8-06a0-41cf-8744-0557b0bb105e None None] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:58:34.226975 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50f4d7da-5886-48fd-8849-493cc6ee555b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9af40ddfe9ff4be3887b068f13a28dc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c87c981909d4b8db02783421818c79b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:58:34.227602 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f4d7da-5886-48fd-8849-493cc6ee555b service neutron] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:58:34.227880 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f4d7da-5886-48fd-8849-493cc6ee555b service neutron] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:58:34.228150 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f4d7da-5886-48fd-8849-493cc6ee555b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:58:34.237415 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50f4d7da-5886-48fd-8849-493cc6ee555b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:58:34.239097 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50f4d7da-5886-48fd-8849-493cc6ee555b service neutron] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:58:34.248278 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 674/1349] 10.222.0.59 () {60 vars in 1365 bytes} [Thu Jun 2 15:58:34 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 15:58:39.782954 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd19efa-8108-4caa-9f21-37d97da40eda None None] REQUEST_METHOD: `GET` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:58:39.784842 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd19efa-8108-4caa-9f21-37d97da40eda None None] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:58:39.785425 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd19efa-8108-4caa-9f21-37d97da40eda None None] PATH_INFO: `/` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:58:39.788376 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 676/1350] 10.222.0.59 () {54 vars in 921 bytes} [Thu Jun 2 15:58:39 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 15:58:39.794012 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-369769cd-abf6-460d-9892-1831648a7d6b None None] REQUEST_METHOD: `POST` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:58:39.794856 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-369769cd-abf6-460d-9892-1831648a7d6b None None] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:58:39.795336 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-369769cd-abf6-460d-9892-1831648a7d6b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:58:39.870835 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.auth.core [None req-369769cd-abf6-460d-9892-1831648a7d6b None None] MFA Rules not processed for user `2b700f6d94374ba4b362a8f0d5b35796`. Rule list: `[]` (Enabled: `True`). {{(pid=80395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 15:58:39.872513 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.fernet_utils [None req-369769cd-abf6-460d-9892-1831648a7d6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 15:58:39.925852 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writing DB stats keystone:SELECT=100 {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:58:39.971046 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 675/1351] 10.222.0.59 () {58 vars in 1018 bytes} [Thu Jun 2 15:58:39 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 15:58:44.156961 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG dbcounter [-] [80396] Writing DB stats keystone:SELECT=56 {{(pid=80396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:58:44.357270 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f5ba00-1fb8-4af3-bf28-3ef2bfeff89d None None] REQUEST_METHOD: `GET` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:58:44.358246 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f5ba00-1fb8-4af3-bf28-3ef2bfeff89d None None] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:58:44.358745 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f5ba00-1fb8-4af3-bf28-3ef2bfeff89d None None] PATH_INFO: `/` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:58:44.360748 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 677/1352] 10.222.0.59 () {54 vars in 921 bytes} [Thu Jun 2 15:58:44 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 15:58:44.366711 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f026219-9e74-48c3-ac39-3c4cd5215360 None None] REQUEST_METHOD: `POST` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:58:44.367582 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f026219-9e74-48c3-ac39-3c4cd5215360 None None] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:58:44.368141 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f026219-9e74-48c3-ac39-3c4cd5215360 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:58:44.387505 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.auth.core [None req-9f026219-9e74-48c3-ac39-3c4cd5215360 None None] MFA Rules not processed for user `2b700f6d94374ba4b362a8f0d5b35796`. Rule list: `[]` (Enabled: `True`). {{(pid=80395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 15:58:44.389278 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.fernet_utils [None req-9f026219-9e74-48c3-ac39-3c4cd5215360 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 15:58:44.401732 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 676/1353] 10.222.0.59 () {58 vars in 1018 bytes} [Thu Jun 2 15:58:44 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 15:58:46.035217 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16ad1d1-e62c-4ed8-857a-a520b7943645 None None] REQUEST_METHOD: `GET` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:58:46.035785 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16ad1d1-e62c-4ed8-857a-a520b7943645 None None] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:58:46.035785 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16ad1d1-e62c-4ed8-857a-a520b7943645 None None] PATH_INFO: `/` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:58:46.037196 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 678/1354] 10.222.0.59 () {54 vars in 921 bytes} [Thu Jun 2 15:58:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 15:58:46.042804 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9398929-2e72-44f2-8332-cc4cfe6d254e None None] REQUEST_METHOD: `POST` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:58:46.043339 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9398929-2e72-44f2-8332-cc4cfe6d254e None None] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:58:46.043506 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9398929-2e72-44f2-8332-cc4cfe6d254e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:58:46.063467 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.auth.core [None req-e9398929-2e72-44f2-8332-cc4cfe6d254e None None] MFA Rules not processed for user `2b700f6d94374ba4b362a8f0d5b35796`. Rule list: `[]` (Enabled: `True`). {{(pid=80395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 15:58:46.065728 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.fernet_utils [None req-e9398929-2e72-44f2-8332-cc4cfe6d254e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 15:58:46.074578 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 677/1355] 10.222.0.59 () {58 vars in 1018 bytes} [Thu Jun 2 15:58:46 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 15:58:49.878025 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-511d6fcc-a2a9-48de-80b8-a4eccbf1d4ff None None] REQUEST_METHOD: `GET` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:58:49.878624 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-511d6fcc-a2a9-48de-80b8-a4eccbf1d4ff None None] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:58:49.878624 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-511d6fcc-a2a9-48de-80b8-a4eccbf1d4ff None None] PATH_INFO: `/` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:58:49.879966 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 679/1356] 10.222.0.59 () {54 vars in 926 bytes} [Thu Jun 2 15:58:49 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 15:58:49.885156 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14af0581-f336-4e86-9fc6-3a7b3403058e None None] REQUEST_METHOD: `POST` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:58:49.885597 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14af0581-f336-4e86-9fc6-3a7b3403058e None None] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:58:49.885722 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14af0581-f336-4e86-9fc6-3a7b3403058e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:58:49.903953 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.auth.core [None req-14af0581-f336-4e86-9fc6-3a7b3403058e None None] MFA Rules not processed for user `400d1f4db9de49638549e5db29a041e1`. Rule list: `[]` (Enabled: `True`). {{(pid=80395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 15:58:49.905346 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.fernet_utils [None req-14af0581-f336-4e86-9fc6-3a7b3403058e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 15:58:49.913473 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 678/1357] 10.222.0.59 () {58 vars in 1023 bytes} [Thu Jun 2 15:58:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 15:58:49.967914 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bade207-7857-4814-8f5f-2c30321f5e08 None None] REQUEST_METHOD: `GET` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:58:49.968384 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bade207-7857-4814-8f5f-2c30321f5e08 None None] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:58:49.968888 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bade207-7857-4814-8f5f-2c30321f5e08 None None] PATH_INFO: `/` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:58:49.970914 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 680/1358] 10.222.0.59 () {54 vars in 961 bytes} [Thu Jun 2 15:58:49 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 15:58:49.984062 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fbd1d10-000b-441c-ba86-608ed8281341 None None] REQUEST_METHOD: `POST` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:58:49.984590 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fbd1d10-000b-441c-ba86-608ed8281341 None None] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:58:49.985273 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fbd1d10-000b-441c-ba86-608ed8281341 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:58:50.175296 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.auth.core [None req-0fbd1d10-000b-441c-ba86-608ed8281341 None None] MFA Rules not processed for user `52f9fe4b13574516bb0a8e2aa11a61e8`. Rule list: `[]` (Enabled: `True`). {{(pid=80395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 15:58:50.176602 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.fernet_utils [None req-0fbd1d10-000b-441c-ba86-608ed8281341 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 15:58:50.271732 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 679/1359] 10.222.0.59 () {58 vars in 1058 bytes} [Thu Jun 2 15:58:49 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 289 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 15:58:50.280485 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bade207-7857-4814-8f5f-2c30321f5e08 None None] Authenticating user token {{(pid=80396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:58:50.301028 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bade207-7857-4814-8f5f-2c30321f5e08 None None] Validating token access rules against request {{(pid=80396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:58:50.306900 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f42538da-a1b0-42bc-a442-745486f8c72a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52f9fe4b13574516bb0a8e2aa11a61e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c87c981909d4b8db02783421818c79b', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:58:50.307538 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42538da-a1b0-42bc-a442-745486f8c72a service nova] REQUEST_METHOD: `GET` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:58:50.307816 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42538da-a1b0-42bc-a442-745486f8c72a service nova] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:58:50.313446 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42538da-a1b0-42bc-a442-745486f8c72a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:58:50.318057 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f42538da-a1b0-42bc-a442-745486f8c72a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:58:50.319763 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f42538da-a1b0-42bc-a442-745486f8c72a service nova] RBAC: Authorization granted {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:58:50.330054 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 681/1360] 10.222.0.59 () {60 vars in 1365 bytes} [Thu Jun 2 15:58:50 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 15:58:52.823599 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5815b3b2-3cb2-4019-9b57-03bc2de3124f None None] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:58:52.824075 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5815b3b2-3cb2-4019-9b57-03bc2de3124f None None] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:58:52.824180 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5815b3b2-3cb2-4019-9b57-03bc2de3124f None None] PATH_INFO: `/` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:58:52.825508 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 680/1361] 10.222.0.59 () {54 vars in 926 bytes} [Thu Jun 2 15:58:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 15:58:52.831565 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b72632-a8d8-4932-b7eb-21b371b0ede2 None None] REQUEST_METHOD: `POST` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:58:52.831992 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b72632-a8d8-4932-b7eb-21b371b0ede2 None None] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:58:52.832124 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b72632-a8d8-4932-b7eb-21b371b0ede2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:58:52.850831 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.auth.core [None req-b5b72632-a8d8-4932-b7eb-21b371b0ede2 None None] MFA Rules not processed for user `400d1f4db9de49638549e5db29a041e1`. Rule list: `[]` (Enabled: `True`). {{(pid=80396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 15:58:52.852323 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.fernet_utils [None req-b5b72632-a8d8-4932-b7eb-21b371b0ede2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 15:58:52.860185 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 682/1362] 10.222.0.59 () {58 vars in 1023 bytes} [Thu Jun 2 15:58:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 15:58:52.903782 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5815b3b2-3cb2-4019-9b57-03bc2de3124f None None] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:58:52.920209 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5815b3b2-3cb2-4019-9b57-03bc2de3124f None None] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:58:52.926997 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-002222e9-9caf-4e2c-b1f9-ff542ba46705 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52f9fe4b13574516bb0a8e2aa11a61e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c87c981909d4b8db02783421818c79b', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:58:52.927848 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002222e9-9caf-4e2c-b1f9-ff542ba46705 service nova] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:58:52.928521 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002222e9-9caf-4e2c-b1f9-ff542ba46705 service nova] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:58:52.929003 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002222e9-9caf-4e2c-b1f9-ff542ba46705 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:58:52.939577 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-002222e9-9caf-4e2c-b1f9-ff542ba46705 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:58:52.941374 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-002222e9-9caf-4e2c-b1f9-ff542ba46705 service nova] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:58:52.952068 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 681/1363] 10.222.0.59 () {60 vars in 1365 bytes} [Thu Jun 2 15:58:52 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 15:58:55.698139 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb669ae-ca7b-447d-a0a8-7d716f275445 None None] REQUEST_METHOD: `GET` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:58:55.698658 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb669ae-ca7b-447d-a0a8-7d716f275445 None None] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:58:55.698658 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb669ae-ca7b-447d-a0a8-7d716f275445 None None] PATH_INFO: `/` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:58:55.700033 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 683/1364] 10.222.0.59 () {54 vars in 926 bytes} [Thu Jun 2 15:58:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 15:58:55.705208 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf1c530-31ee-41de-bddf-bf3a71f6a24a None None] REQUEST_METHOD: `POST` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:58:55.705630 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf1c530-31ee-41de-bddf-bf3a71f6a24a None None] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:58:55.705759 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf1c530-31ee-41de-bddf-bf3a71f6a24a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:58:55.723931 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.auth.core [None req-bbf1c530-31ee-41de-bddf-bf3a71f6a24a None None] MFA Rules not processed for user `400d1f4db9de49638549e5db29a041e1`. Rule list: `[]` (Enabled: `True`). {{(pid=80395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 15:58:55.725223 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.fernet_utils [None req-bbf1c530-31ee-41de-bddf-bf3a71f6a24a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 15:58:55.733111 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 682/1365] 10.222.0.59 () {58 vars in 1023 bytes} [Thu Jun 2 15:58:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 15:58:55.780033 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f41ef4-c0c7-4299-b152-46e47b27dc6c None None] REQUEST_METHOD: `GET` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:58:55.780324 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f41ef4-c0c7-4299-b152-46e47b27dc6c None None] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:58:55.780602 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f41ef4-c0c7-4299-b152-46e47b27dc6c None None] PATH_INFO: `/` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:58:55.782026 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 684/1366] 10.222.0.59 () {54 vars in 961 bytes} [Thu Jun 2 15:58:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 15:58:55.787400 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b398f9-3f3d-4e13-b65e-1323917a7f97 None None] REQUEST_METHOD: `POST` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:58:55.787814 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b398f9-3f3d-4e13-b65e-1323917a7f97 None None] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:58:55.788097 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b398f9-3f3d-4e13-b65e-1323917a7f97 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:58:55.806481 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.auth.core [None req-b8b398f9-3f3d-4e13-b65e-1323917a7f97 None None] MFA Rules not processed for user `52f9fe4b13574516bb0a8e2aa11a61e8`. Rule list: `[]` (Enabled: `True`). {{(pid=80395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 15:58:55.807653 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.fernet_utils [None req-b8b398f9-3f3d-4e13-b65e-1323917a7f97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 15:58:55.817273 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 683/1367] 10.222.0.59 () {58 vars in 1058 bytes} [Thu Jun 2 15:58:55 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 15:58:55.824960 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f41ef4-c0c7-4299-b152-46e47b27dc6c None None] Authenticating user token {{(pid=80396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:58:55.839220 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f41ef4-c0c7-4299-b152-46e47b27dc6c None None] Validating token access rules against request {{(pid=80396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:58:55.845244 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cdbb5c7-53e9-4f45-bc7e-907b20fed650 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52f9fe4b13574516bb0a8e2aa11a61e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c87c981909d4b8db02783421818c79b', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:58:55.845981 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cdbb5c7-53e9-4f45-bc7e-907b20fed650 service nova] REQUEST_METHOD: `GET` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:58:55.846294 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cdbb5c7-53e9-4f45-bc7e-907b20fed650 service nova] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:58:55.846573 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cdbb5c7-53e9-4f45-bc7e-907b20fed650 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:58:55.854583 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cdbb5c7-53e9-4f45-bc7e-907b20fed650 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:58:55.856261 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cdbb5c7-53e9-4f45-bc7e-907b20fed650 service nova] RBAC: Authorization granted {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:58:55.866496 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 685/1368] 10.222.0.59 () {60 vars in 1365 bytes} [Thu Jun 2 15:58:55 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 15:58:58.323919 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a5a6166-1e01-4994-b675-3d349cfa6c66 None None] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:58:58.324478 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a5a6166-1e01-4994-b675-3d349cfa6c66 None None] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:58:58.324478 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a5a6166-1e01-4994-b675-3d349cfa6c66 None None] PATH_INFO: `/` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:58:58.325854 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 684/1369] 10.222.0.59 () {54 vars in 926 bytes} [Thu Jun 2 15:58:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 15:58:58.336598 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3880f636-3d46-4f69-b8ab-0e5c60d108c6 None None] REQUEST_METHOD: `POST` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:58:58.337120 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3880f636-3d46-4f69-b8ab-0e5c60d108c6 None None] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:58:58.337120 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3880f636-3d46-4f69-b8ab-0e5c60d108c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:58:58.358600 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.auth.core [None req-3880f636-3d46-4f69-b8ab-0e5c60d108c6 None None] MFA Rules not processed for user `400d1f4db9de49638549e5db29a041e1`. Rule list: `[]` (Enabled: `True`). {{(pid=80396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 15:58:58.360264 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.fernet_utils [None req-3880f636-3d46-4f69-b8ab-0e5c60d108c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 15:58:58.370002 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 686/1370] 10.222.0.59 () {58 vars in 1023 bytes} [Thu Jun 2 15:58:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 15:58:58.416959 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f08a9b-a422-4f19-9540-edfa7c57815a None None] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:58:58.417284 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f08a9b-a422-4f19-9540-edfa7c57815a None None] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:58:58.417413 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3880f636-3d46-4f69-b8ab-0e5c60d108c6 None None] Authenticating user token {{(pid=80396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:58:58.417503 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f08a9b-a422-4f19-9540-edfa7c57815a None None] PATH_INFO: `/` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:58:58.419551 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 685/1371] 10.222.0.59 () {54 vars in 926 bytes} [Thu Jun 2 15:58:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 15:58:58.424320 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c4b7572-1358-46db-a70a-e7e372145c1e None None] REQUEST_METHOD: `POST` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:58:58.424657 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c4b7572-1358-46db-a70a-e7e372145c1e None None] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:58:58.425001 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c4b7572-1358-46db-a70a-e7e372145c1e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:58:58.430701 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3880f636-3d46-4f69-b8ab-0e5c60d108c6 None None] Validating token access rules against request {{(pid=80396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:58:58.437518 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3524c7f4-7b2d-41e2-8ee5-3c28ceaf5247 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52f9fe4b13574516bb0a8e2aa11a61e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c87c981909d4b8db02783421818c79b', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:58:58.437518 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3524c7f4-7b2d-41e2-8ee5-3c28ceaf5247 service nova] REQUEST_METHOD: `GET` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:58:58.437518 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3524c7f4-7b2d-41e2-8ee5-3c28ceaf5247 service nova] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:58:58.437772 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3524c7f4-7b2d-41e2-8ee5-3c28ceaf5247 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:58:58.443824 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.auth.core [None req-6c4b7572-1358-46db-a70a-e7e372145c1e None None] MFA Rules not processed for user `400d1f4db9de49638549e5db29a041e1`. Rule list: `[]` (Enabled: `True`). {{(pid=80395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 15:58:58.444995 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.fernet_utils [None req-6c4b7572-1358-46db-a70a-e7e372145c1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 15:58:58.447358 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3524c7f4-7b2d-41e2-8ee5-3c28ceaf5247 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:58:58.449108 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3524c7f4-7b2d-41e2-8ee5-3c28ceaf5247 service nova] RBAC: Authorization granted {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:58:58.458733 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 686/1372] 10.222.0.59 () {58 vars in 1023 bytes} [Thu Jun 2 15:58:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 02 15:58:58.464654 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 687/1373] 10.222.0.59 () {60 vars in 1365 bytes} [Thu Jun 2 15:58:58 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 15:58:58.764198 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35afeaed-12e7-45d2-837c-98274d554d80 None None] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:58:58.764198 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35afeaed-12e7-45d2-837c-98274d554d80 None None] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:58:58.764198 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35afeaed-12e7-45d2-837c-98274d554d80 None None] PATH_INFO: `/` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:58:58.765653 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 687/1374] 10.222.0.59 () {54 vars in 963 bytes} [Thu Jun 2 15:58:58 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 15:58:58.771443 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b112305-804b-4410-b141-35e8c30f311a None None] REQUEST_METHOD: `POST` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:58:58.771734 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b112305-804b-4410-b141-35e8c30f311a None None] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:58:58.772011 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b112305-804b-4410-b141-35e8c30f311a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:58:58.830978 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.auth.core [None req-6b112305-804b-4410-b141-35e8c30f311a None None] MFA Rules not processed for user `6534961c369940a5b88f310c6450250b`. Rule list: `[]` (Enabled: `True`). {{(pid=80396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 15:58:58.832207 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.fernet_utils [None req-6b112305-804b-4410-b141-35e8c30f311a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 15:58:58.904095 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 688/1375] 10.222.0.59 () {58 vars in 1060 bytes} [Thu Jun 2 15:58:58 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 15:58:58.912943 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35afeaed-12e7-45d2-837c-98274d554d80 None None] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:58:58.924822 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35afeaed-12e7-45d2-837c-98274d554d80 None None] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:58:58.928623 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bdc1de6-b36c-4dc4-9da3-8dc51f9f2ce7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6534961c369940a5b88f310c6450250b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c87c981909d4b8db02783421818c79b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:58:58.929264 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bdc1de6-b36c-4dc4-9da3-8dc51f9f2ce7 service cinder] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:58:58.929541 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bdc1de6-b36c-4dc4-9da3-8dc51f9f2ce7 service cinder] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:58:58.929813 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bdc1de6-b36c-4dc4-9da3-8dc51f9f2ce7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:58:58.939750 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bdc1de6-b36c-4dc4-9da3-8dc51f9f2ce7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:58:58.941172 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bdc1de6-b36c-4dc4-9da3-8dc51f9f2ce7 service cinder] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:58:58.951024 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 688/1376] 10.222.0.59 () {60 vars in 1365 bytes} [Thu Jun 2 15:58:58 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 15:59:00.879732 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28615c63-66aa-4776-a9cc-64052d48f0bf None None] REQUEST_METHOD: `GET` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:59:00.880290 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28615c63-66aa-4776-a9cc-64052d48f0bf None None] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:59:00.880290 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28615c63-66aa-4776-a9cc-64052d48f0bf None None] PATH_INFO: `/` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:59:00.881874 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 689/1377] 10.222.0.59 () {54 vars in 926 bytes} [Thu Jun 2 15:59:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 15:59:00.887481 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-becaf47c-8209-4143-9993-41e728f5f4ca None None] REQUEST_METHOD: `POST` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:59:00.888032 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-becaf47c-8209-4143-9993-41e728f5f4ca None None] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:59:00.888032 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-becaf47c-8209-4143-9993-41e728f5f4ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:59:00.906893 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.auth.core [None req-becaf47c-8209-4143-9993-41e728f5f4ca None None] MFA Rules not processed for user `400d1f4db9de49638549e5db29a041e1`. Rule list: `[]` (Enabled: `True`). {{(pid=80395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 15:59:00.908652 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.fernet_utils [None req-becaf47c-8209-4143-9993-41e728f5f4ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 15:59:00.916862 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 689/1378] 10.222.0.59 () {58 vars in 1023 bytes} [Thu Jun 2 15:59:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 15:59:00.962683 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28615c63-66aa-4776-a9cc-64052d48f0bf None None] Authenticating user token {{(pid=80396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:59:00.978671 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28615c63-66aa-4776-a9cc-64052d48f0bf None None] Validating token access rules against request {{(pid=80396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:59:00.984111 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f43d1f5-712f-47a7-9ae2-3dfbeaea9203 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52f9fe4b13574516bb0a8e2aa11a61e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c87c981909d4b8db02783421818c79b', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:59:00.984769 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f43d1f5-712f-47a7-9ae2-3dfbeaea9203 service nova] REQUEST_METHOD: `GET` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:59:00.985311 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f43d1f5-712f-47a7-9ae2-3dfbeaea9203 service nova] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:59:00.985890 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f43d1f5-712f-47a7-9ae2-3dfbeaea9203 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:59:00.994543 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f43d1f5-712f-47a7-9ae2-3dfbeaea9203 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:59:00.996244 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f43d1f5-712f-47a7-9ae2-3dfbeaea9203 service nova] RBAC: Authorization granted {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:59:01.007397 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 690/1379] 10.222.0.59 () {60 vars in 1365 bytes} [Thu Jun 2 15:59:00 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 02 15:59:03.481777 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5316ba34-c277-40a7-b18c-317ffcc342e6 None None] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:59:03.482850 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5316ba34-c277-40a7-b18c-317ffcc342e6 None None] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:59:03.483369 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5316ba34-c277-40a7-b18c-317ffcc342e6 None None] PATH_INFO: `/` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:59:03.486439 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 690/1380] 10.222.0.59 () {54 vars in 926 bytes} [Thu Jun 2 15:59:03 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 15:59:03.490706 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6de5c2-ecb4-484b-aefa-2b2b41ea2015 None None] REQUEST_METHOD: `POST` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:59:03.491155 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6de5c2-ecb4-484b-aefa-2b2b41ea2015 None None] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:59:03.491335 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6de5c2-ecb4-484b-aefa-2b2b41ea2015 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:59:03.510676 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.auth.core [None req-fc6de5c2-ecb4-484b-aefa-2b2b41ea2015 None None] MFA Rules not processed for user `400d1f4db9de49638549e5db29a041e1`. Rule list: `[]` (Enabled: `True`). {{(pid=80396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 15:59:03.511866 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.fernet_utils [None req-fc6de5c2-ecb4-484b-aefa-2b2b41ea2015 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 15:59:03.520727 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 691/1381] 10.222.0.59 () {58 vars in 1023 bytes} [Thu Jun 2 15:59:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 15:59:03.564560 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5316ba34-c277-40a7-b18c-317ffcc342e6 None None] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:59:03.579881 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5316ba34-c277-40a7-b18c-317ffcc342e6 None None] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:59:03.585245 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a32107b0-beaa-4bf2-a5b1-224c9ed806a3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52f9fe4b13574516bb0a8e2aa11a61e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c87c981909d4b8db02783421818c79b', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:59:03.585877 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a32107b0-beaa-4bf2-a5b1-224c9ed806a3 service nova] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:59:03.586192 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a32107b0-beaa-4bf2-a5b1-224c9ed806a3 service nova] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:59:03.586794 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a32107b0-beaa-4bf2-a5b1-224c9ed806a3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:59:03.595929 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a32107b0-beaa-4bf2-a5b1-224c9ed806a3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:59:03.597509 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a32107b0-beaa-4bf2-a5b1-224c9ed806a3 service nova] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:59:03.607250 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 691/1382] 10.222.0.59 () {60 vars in 1365 bytes} [Thu Jun 2 15:59:03 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 15:59:06.025226 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97e06fe-f193-4b50-940e-f3c0301f1257 None None] REQUEST_METHOD: `GET` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:59:06.025802 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97e06fe-f193-4b50-940e-f3c0301f1257 None None] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:59:06.025802 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97e06fe-f193-4b50-940e-f3c0301f1257 None None] PATH_INFO: `/` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:59:06.027184 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 692/1383] 10.222.0.59 () {54 vars in 926 bytes} [Thu Jun 2 15:59:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 15:59:06.032796 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263b49dc-b989-4690-81f0-3208d9fa2544 None None] REQUEST_METHOD: `POST` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:59:06.033267 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263b49dc-b989-4690-81f0-3208d9fa2544 None None] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:59:06.033364 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263b49dc-b989-4690-81f0-3208d9fa2544 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:59:06.041369 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writing DB stats keystone:SELECT=100 {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:59:06.052228 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.auth.core [None req-263b49dc-b989-4690-81f0-3208d9fa2544 None None] MFA Rules not processed for user `400d1f4db9de49638549e5db29a041e1`. Rule list: `[]` (Enabled: `True`). {{(pid=80395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 15:59:06.057190 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.fernet_utils [None req-263b49dc-b989-4690-81f0-3208d9fa2544 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 15:59:06.061362 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 692/1384] 10.222.0.59 () {58 vars in 1023 bytes} [Thu Jun 2 15:59:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 15:59:06.104322 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a97e06fe-f193-4b50-940e-f3c0301f1257 None None] Authenticating user token {{(pid=80396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:59:06.119632 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a97e06fe-f193-4b50-940e-f3c0301f1257 None None] Validating token access rules against request {{(pid=80396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:59:06.126024 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36fcba90-219e-492a-9fe9-97ec69960ead service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52f9fe4b13574516bb0a8e2aa11a61e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c87c981909d4b8db02783421818c79b', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:59:06.127061 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36fcba90-219e-492a-9fe9-97ec69960ead service nova] REQUEST_METHOD: `GET` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:59:06.127452 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36fcba90-219e-492a-9fe9-97ec69960ead service nova] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:59:06.127796 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36fcba90-219e-492a-9fe9-97ec69960ead service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:59:06.137224 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36fcba90-219e-492a-9fe9-97ec69960ead service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:59:06.138917 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36fcba90-219e-492a-9fe9-97ec69960ead service nova] RBAC: Authorization granted {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:59:06.149745 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 693/1385] 10.222.0.59 () {60 vars in 1365 bytes} [Thu Jun 2 15:59:06 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 15:59:08.470047 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9005f9e-dcf5-4c93-9204-11512c39f680 None None] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:59:08.470586 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9005f9e-dcf5-4c93-9204-11512c39f680 None None] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:59:08.470772 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9005f9e-dcf5-4c93-9204-11512c39f680 None None] PATH_INFO: `/` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:59:08.472658 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 693/1386] 10.222.0.59 () {54 vars in 926 bytes} [Thu Jun 2 15:59:08 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 15:59:08.478341 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d0dadf2-676b-4a7b-b71e-114dfd0fb0e6 None None] REQUEST_METHOD: `POST` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:59:08.478760 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d0dadf2-676b-4a7b-b71e-114dfd0fb0e6 None None] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:59:08.479054 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d0dadf2-676b-4a7b-b71e-114dfd0fb0e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:59:08.501385 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.auth.core [None req-9d0dadf2-676b-4a7b-b71e-114dfd0fb0e6 None None] MFA Rules not processed for user `400d1f4db9de49638549e5db29a041e1`. Rule list: `[]` (Enabled: `True`). {{(pid=80396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 15:59:08.502972 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.fernet_utils [None req-9d0dadf2-676b-4a7b-b71e-114dfd0fb0e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 15:59:08.512693 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 694/1387] 10.222.0.59 () {58 vars in 1023 bytes} [Thu Jun 2 15:59:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 15:59:08.559028 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9005f9e-dcf5-4c93-9204-11512c39f680 None None] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:59:08.573822 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9005f9e-dcf5-4c93-9204-11512c39f680 None None] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:59:08.580007 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-809f4308-3cd7-4996-aae1-35431793fb71 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52f9fe4b13574516bb0a8e2aa11a61e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c87c981909d4b8db02783421818c79b', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:59:08.580661 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809f4308-3cd7-4996-aae1-35431793fb71 service nova] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:59:08.580943 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809f4308-3cd7-4996-aae1-35431793fb71 service nova] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:59:08.581228 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809f4308-3cd7-4996-aae1-35431793fb71 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:59:08.589979 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-809f4308-3cd7-4996-aae1-35431793fb71 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:59:08.591629 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-809f4308-3cd7-4996-aae1-35431793fb71 service nova] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:59:08.602297 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 694/1388] 10.222.0.59 () {60 vars in 1365 bytes} [Thu Jun 2 15:59:08 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 15:59:11.230935 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962084e5-16e7-4fd5-a868-090eb78df69c None None] REQUEST_METHOD: `GET` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:59:11.231464 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962084e5-16e7-4fd5-a868-090eb78df69c None None] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:59:11.231571 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962084e5-16e7-4fd5-a868-090eb78df69c None None] PATH_INFO: `/` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:59:11.232872 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 695/1389] 10.222.0.59 () {54 vars in 926 bytes} [Thu Jun 2 15:59:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 15:59:11.238891 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f60dd20-b18e-43fa-b7c2-612571179d86 None None] REQUEST_METHOD: `POST` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:59:11.239344 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f60dd20-b18e-43fa-b7c2-612571179d86 None None] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:59:11.239507 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f60dd20-b18e-43fa-b7c2-612571179d86 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:59:11.258028 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.auth.core [None req-6f60dd20-b18e-43fa-b7c2-612571179d86 None None] MFA Rules not processed for user `400d1f4db9de49638549e5db29a041e1`. Rule list: `[]` (Enabled: `True`). {{(pid=80395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 15:59:11.259298 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.fernet_utils [None req-6f60dd20-b18e-43fa-b7c2-612571179d86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 15:59:11.267706 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 695/1390] 10.222.0.59 () {58 vars in 1023 bytes} [Thu Jun 2 15:59:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 15:59:11.320434 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-962084e5-16e7-4fd5-a868-090eb78df69c None None] Authenticating user token {{(pid=80396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:59:11.335718 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-962084e5-16e7-4fd5-a868-090eb78df69c None None] Validating token access rules against request {{(pid=80396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:59:11.341376 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-418ff0f1-740c-4ddc-81e9-51b799229688 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52f9fe4b13574516bb0a8e2aa11a61e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c87c981909d4b8db02783421818c79b', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:59:11.342042 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-418ff0f1-740c-4ddc-81e9-51b799229688 service nova] REQUEST_METHOD: `GET` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:59:11.342351 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-418ff0f1-740c-4ddc-81e9-51b799229688 service nova] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:59:11.342621 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-418ff0f1-740c-4ddc-81e9-51b799229688 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:59:11.351184 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-418ff0f1-740c-4ddc-81e9-51b799229688 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:59:11.352744 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-418ff0f1-740c-4ddc-81e9-51b799229688 service nova] RBAC: Authorization granted {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:59:11.362672 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 696/1391] 10.222.0.59 () {60 vars in 1365 bytes} [Thu Jun 2 15:59:11 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 15:59:13.967955 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462c7b79-df5e-433a-846e-2d18677cee8d None None] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:59:13.968653 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462c7b79-df5e-433a-846e-2d18677cee8d None None] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:59:13.968653 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462c7b79-df5e-433a-846e-2d18677cee8d None None] PATH_INFO: `/` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:59:13.970045 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 696/1392] 10.222.0.59 () {54 vars in 926 bytes} [Thu Jun 2 15:59:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 15:59:13.975448 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15114863-d8e6-4bb7-83e1-45d6b33bd5c7 None None] REQUEST_METHOD: `POST` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:59:13.975900 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15114863-d8e6-4bb7-83e1-45d6b33bd5c7 None None] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:59:13.976080 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15114863-d8e6-4bb7-83e1-45d6b33bd5c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:59:13.994312 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.auth.core [None req-15114863-d8e6-4bb7-83e1-45d6b33bd5c7 None None] MFA Rules not processed for user `400d1f4db9de49638549e5db29a041e1`. Rule list: `[]` (Enabled: `True`). {{(pid=80396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 15:59:13.995502 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.fernet_utils [None req-15114863-d8e6-4bb7-83e1-45d6b33bd5c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 15:59:14.004135 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 697/1393] 10.222.0.59 () {58 vars in 1023 bytes} [Thu Jun 2 15:59:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 15:59:14.048332 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-462c7b79-df5e-433a-846e-2d18677cee8d None None] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:59:14.063113 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-462c7b79-df5e-433a-846e-2d18677cee8d None None] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:59:14.069420 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d40732c9-ebe2-4545-82de-bedccba30299 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52f9fe4b13574516bb0a8e2aa11a61e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c87c981909d4b8db02783421818c79b', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:59:14.070166 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d40732c9-ebe2-4545-82de-bedccba30299 service nova] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:59:14.070397 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d40732c9-ebe2-4545-82de-bedccba30299 service nova] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:59:14.070674 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d40732c9-ebe2-4545-82de-bedccba30299 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:59:14.079729 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d40732c9-ebe2-4545-82de-bedccba30299 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:59:14.081311 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d40732c9-ebe2-4545-82de-bedccba30299 service nova] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:59:14.091024 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 697/1394] 10.222.0.59 () {60 vars in 1365 bytes} [Thu Jun 2 15:59:14 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 15:59:15.208461 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910036d4-6bf7-445b-af46-5eb93145f9c1 None None] REQUEST_METHOD: `GET` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:59:15.209003 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910036d4-6bf7-445b-af46-5eb93145f9c1 None None] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:59:15.209003 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910036d4-6bf7-445b-af46-5eb93145f9c1 None None] PATH_INFO: `/` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:59:15.210484 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 698/1395] 10.222.0.59 () {54 vars in 926 bytes} [Thu Jun 2 15:59:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 15:59:15.216127 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d2efd8-8c8f-49de-91ec-d3aabbae6d00 None None] REQUEST_METHOD: `POST` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:59:15.216583 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d2efd8-8c8f-49de-91ec-d3aabbae6d00 None None] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:59:15.216691 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d2efd8-8c8f-49de-91ec-d3aabbae6d00 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:59:15.234454 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.auth.core [None req-51d2efd8-8c8f-49de-91ec-d3aabbae6d00 None None] MFA Rules not processed for user `400d1f4db9de49638549e5db29a041e1`. Rule list: `[]` (Enabled: `True`). {{(pid=80395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 15:59:15.235638 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.fernet_utils [None req-51d2efd8-8c8f-49de-91ec-d3aabbae6d00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 15:59:15.243083 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 698/1396] 10.222.0.59 () {58 vars in 1023 bytes} [Thu Jun 2 15:59:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 15:59:15.297990 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92fdc87-f805-420a-a6c0-bac8fe3b61f9 None None] REQUEST_METHOD: `GET` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:59:15.304016 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92fdc87-f805-420a-a6c0-bac8fe3b61f9 None None] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:59:15.304016 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92fdc87-f805-420a-a6c0-bac8fe3b61f9 None None] PATH_INFO: `/` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:59:15.304016 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 699/1397] 10.222.0.59 () {54 vars in 962 bytes} [Thu Jun 2 15:59:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 15:59:15.305279 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d691477-d917-4eee-9ad0-c1a2f4a5912f None None] REQUEST_METHOD: `POST` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:59:15.305565 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d691477-d917-4eee-9ad0-c1a2f4a5912f None None] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:59:15.305835 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d691477-d917-4eee-9ad0-c1a2f4a5912f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:59:15.355208 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.auth.core [None req-8d691477-d917-4eee-9ad0-c1a2f4a5912f None None] MFA Rules not processed for user `e673e7e0a4bf4c77bdb3e5325d0d3275`. Rule list: `[]` (Enabled: `True`). {{(pid=80395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 15:59:15.356420 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.fernet_utils [None req-8d691477-d917-4eee-9ad0-c1a2f4a5912f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 15:59:15.418134 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 699/1398] 10.222.0.59 () {58 vars in 1059 bytes} [Thu Jun 2 15:59:15 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 15:59:15.425832 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b92fdc87-f805-420a-a6c0-bac8fe3b61f9 None None] Authenticating user token {{(pid=80396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:59:15.431168 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG dbcounter [-] [80396] Writing DB stats keystone:SELECT=90 {{(pid=80396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:59:15.436991 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b92fdc87-f805-420a-a6c0-bac8fe3b61f9 None None] Validating token access rules against request {{(pid=80396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:59:15.440937 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25a55512-2b08-4566-83b5-cd7fa67e0a5f service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e673e7e0a4bf4c77bdb3e5325d0d3275', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c87c981909d4b8db02783421818c79b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:59:15.445893 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a55512-2b08-4566-83b5-cd7fa67e0a5f service glance] REQUEST_METHOD: `GET` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:59:15.445893 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a55512-2b08-4566-83b5-cd7fa67e0a5f service glance] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:59:15.445893 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a55512-2b08-4566-83b5-cd7fa67e0a5f service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:59:15.451605 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25a55512-2b08-4566-83b5-cd7fa67e0a5f service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:59:15.453597 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25a55512-2b08-4566-83b5-cd7fa67e0a5f service glance] RBAC: Authorization granted {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:59:15.463649 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 700/1399] 10.222.0.59 () {60 vars in 1365 bytes} [Thu Jun 2 15:59:15 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 15:59:16.130404 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b53601-ebfa-4758-8978-48bf47476adb None None] REQUEST_METHOD: `POST` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:59:16.130691 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b53601-ebfa-4758-8978-48bf47476adb None None] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:59:16.130961 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b53601-ebfa-4758-8978-48bf47476adb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:59:16.189825 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.auth.core [None req-c6b53601-ebfa-4758-8978-48bf47476adb None None] MFA Rules not processed for user `11b714eb2dda4460a8ff52215e671bfa`. Rule list: `[]` (Enabled: `True`). {{(pid=80395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 15:59:16.191082 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.fernet_utils [None req-c6b53601-ebfa-4758-8978-48bf47476adb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 15:59:16.255713 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 700/1400] 10.222.0.59 () {58 vars in 1009 bytes} [Thu Jun 2 15:59:16 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 15:59:16.297178 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd645f5c-c539-433e-9a58-d76713509692 None None] REQUEST_METHOD: `GET` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:59:16.297688 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd645f5c-c539-433e-9a58-d76713509692 None None] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:59:16.297799 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd645f5c-c539-433e-9a58-d76713509692 None None] PATH_INFO: `/` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:59:16.299393 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 701/1401] 10.222.0.59 () {54 vars in 942 bytes} [Thu Jun 2 15:59:16 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 15:59:16.305486 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad15694-1a95-4ca5-a160-616769e7803f None None] REQUEST_METHOD: `POST` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:59:16.305774 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad15694-1a95-4ca5-a160-616769e7803f None None] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:59:16.306051 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad15694-1a95-4ca5-a160-616769e7803f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:59:16.318363 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writing DB stats keystone:SELECT=100 {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:59:16.355187 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.auth.core [None req-6ad15694-1a95-4ca5-a160-616769e7803f None None] MFA Rules not processed for user `31bd858bf7674f43a99b77d11bc3c1a3`. Rule list: `[]` (Enabled: `True`). {{(pid=80395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 15:59:16.357041 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.fernet_utils [None req-6ad15694-1a95-4ca5-a160-616769e7803f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 15:59:16.430392 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 701/1402] 10.222.0.59 () {58 vars in 1039 bytes} [Thu Jun 2 15:59:16 2022] POST /identity/v3/auth/tokens => generated 3294 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 02 15:59:16.439933 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd645f5c-c539-433e-9a58-d76713509692 None None] Authenticating user token {{(pid=80396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:59:16.453993 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd645f5c-c539-433e-9a58-d76713509692 None None] Validating token access rules against request {{(pid=80396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:59:16.459204 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fdfef1a-af6a-4c4c-810c-d82ea2314429 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31bd858bf7674f43a99b77d11bc3c1a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c87c981909d4b8db02783421818c79b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:59:16.459866 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fdfef1a-af6a-4c4c-810c-d82ea2314429 service swift] REQUEST_METHOD: `GET` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:59:16.460132 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fdfef1a-af6a-4c4c-810c-d82ea2314429 service swift] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:59:16.460408 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fdfef1a-af6a-4c4c-810c-d82ea2314429 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:59:16.469721 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fdfef1a-af6a-4c4c-810c-d82ea2314429 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:59:16.471378 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fdfef1a-af6a-4c4c-810c-d82ea2314429 service swift] RBAC: Authorization granted {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:59:16.479462 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 702/1403] 10.222.0.59 () {60 vars in 1384 bytes} [Thu Jun 2 15:59:16 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 02 15:59:16.502973 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1760357-0826-4075-90df-1d13cb237fa0 None None] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:59:16.503262 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1760357-0826-4075-90df-1d13cb237fa0 None None] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:59:16.503537 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1760357-0826-4075-90df-1d13cb237fa0 None None] PATH_INFO: `/` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:59:16.505062 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 702/1404] 10.222.0.59 () {54 vars in 926 bytes} [Thu Jun 2 15:59:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 15:59:16.510305 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af9c3e8-dc68-4651-9705-d0d162cd0fbd None None] REQUEST_METHOD: `POST` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:59:16.510599 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af9c3e8-dc68-4651-9705-d0d162cd0fbd None None] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:59:16.510881 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af9c3e8-dc68-4651-9705-d0d162cd0fbd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:59:16.529984 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.auth.core [None req-4af9c3e8-dc68-4651-9705-d0d162cd0fbd None None] MFA Rules not processed for user `400d1f4db9de49638549e5db29a041e1`. Rule list: `[]` (Enabled: `True`). {{(pid=80396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 15:59:16.531747 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.fernet_utils [None req-4af9c3e8-dc68-4651-9705-d0d162cd0fbd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 15:59:16.539557 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 703/1405] 10.222.0.59 () {58 vars in 1023 bytes} [Thu Jun 2 15:59:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 15:59:16.583961 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1760357-0826-4075-90df-1d13cb237fa0 None None] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:59:16.599167 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1760357-0826-4075-90df-1d13cb237fa0 None None] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:59:16.604393 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-395cba49-f47f-4a12-a6c3-1f35956d5990 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52f9fe4b13574516bb0a8e2aa11a61e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c87c981909d4b8db02783421818c79b', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:59:16.605025 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-395cba49-f47f-4a12-a6c3-1f35956d5990 service nova] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:59:16.605306 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-395cba49-f47f-4a12-a6c3-1f35956d5990 service nova] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:59:16.605578 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-395cba49-f47f-4a12-a6c3-1f35956d5990 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:59:16.614401 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-395cba49-f47f-4a12-a6c3-1f35956d5990 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:59:16.615974 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-395cba49-f47f-4a12-a6c3-1f35956d5990 service nova] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:59:16.625150 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 703/1406] 10.222.0.59 () {60 vars in 1365 bytes} [Thu Jun 2 15:59:16 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 15:59:19.219832 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619e6039-f613-4560-bf8e-c94b0ca5823f None None] REQUEST_METHOD: `GET` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:59:19.220369 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619e6039-f613-4560-bf8e-c94b0ca5823f None None] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:59:19.220369 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619e6039-f613-4560-bf8e-c94b0ca5823f None None] PATH_INFO: `/` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:59:19.221887 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 704/1407] 10.222.0.59 () {54 vars in 926 bytes} [Thu Jun 2 15:59:19 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 15:59:19.227012 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07db4b86-ae12-499d-9e95-a4f4e1ecaa3b None None] REQUEST_METHOD: `POST` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:59:19.227486 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07db4b86-ae12-499d-9e95-a4f4e1ecaa3b None None] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:59:19.227583 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07db4b86-ae12-499d-9e95-a4f4e1ecaa3b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:59:19.251988 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.auth.core [None req-07db4b86-ae12-499d-9e95-a4f4e1ecaa3b None None] MFA Rules not processed for user `400d1f4db9de49638549e5db29a041e1`. Rule list: `[]` (Enabled: `True`). {{(pid=80395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 15:59:19.256745 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.fernet_utils [None req-07db4b86-ae12-499d-9e95-a4f4e1ecaa3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 15:59:19.261779 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 704/1408] 10.222.0.59 () {58 vars in 1023 bytes} [Thu Jun 2 15:59:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 15:59:19.307760 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-619e6039-f613-4560-bf8e-c94b0ca5823f None None] Authenticating user token {{(pid=80396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:59:19.323267 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-619e6039-f613-4560-bf8e-c94b0ca5823f None None] Validating token access rules against request {{(pid=80396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:59:19.329724 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8257f17-7d65-4445-9ce1-bd676f96c20b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52f9fe4b13574516bb0a8e2aa11a61e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c87c981909d4b8db02783421818c79b', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:59:19.330402 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8257f17-7d65-4445-9ce1-bd676f96c20b service nova] REQUEST_METHOD: `GET` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:59:19.330685 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8257f17-7d65-4445-9ce1-bd676f96c20b service nova] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:59:19.330963 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8257f17-7d65-4445-9ce1-bd676f96c20b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:59:19.341633 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8257f17-7d65-4445-9ce1-bd676f96c20b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:59:19.343285 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8257f17-7d65-4445-9ce1-bd676f96c20b service nova] RBAC: Authorization granted {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:59:19.353483 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 705/1409] 10.222.0.59 () {60 vars in 1365 bytes} [Thu Jun 2 15:59:19 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 15:59:29.561234 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writing DB stats keystone:SELECT=50 {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:59:29.562652 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG dbcounter [-] [80396] Writing DB stats keystone:SELECT=20 {{(pid=80396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:59:41.388512 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f7783de-315c-4272-879d-9ca7645d6588 None None] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:59:41.389104 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f7783de-315c-4272-879d-9ca7645d6588 None None] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:59:41.389422 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f7783de-315c-4272-879d-9ca7645d6588 None None] PATH_INFO: `/` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:59:41.390767 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 705/1410] 10.222.0.59 () {54 vars in 918 bytes} [Thu Jun 2 15:59:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 15:59:41.395728 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3109c659-073a-4f4a-8c06-786529cc42a9 None None] REQUEST_METHOD: `POST` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:59:41.396165 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3109c659-073a-4f4a-8c06-786529cc42a9 None None] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:59:41.396270 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3109c659-073a-4f4a-8c06-786529cc42a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:59:41.414033 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.auth.core [None req-3109c659-073a-4f4a-8c06-786529cc42a9 None None] MFA Rules not processed for user `2b700f6d94374ba4b362a8f0d5b35796`. Rule list: `[]` (Enabled: `True`). {{(pid=80396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 15:59:41.415250 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.fernet_utils [None req-3109c659-073a-4f4a-8c06-786529cc42a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 15:59:41.424408 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 706/1411] 10.222.0.59 () {58 vars in 1015 bytes} [Thu Jun 2 15:59:41 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 15:59:41.439034 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c4ae304-0ca6-483f-9d21-842b9ef5c51a None None] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:59:41.439319 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c4ae304-0ca6-483f-9d21-842b9ef5c51a None None] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:59:41.439592 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c4ae304-0ca6-483f-9d21-842b9ef5c51a None None] PATH_INFO: `/` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:59:41.440923 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 706/1412] 10.222.0.59 () {54 vars in 918 bytes} [Thu Jun 2 15:59:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 15:59:41.445383 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d0a850-057d-47c4-8226-ea628d3f1b06 None None] REQUEST_METHOD: `POST` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:59:41.445703 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d0a850-057d-47c4-8226-ea628d3f1b06 None None] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:59:41.445983 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d0a850-057d-47c4-8226-ea628d3f1b06 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:59:41.463583 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.auth.core [None req-d4d0a850-057d-47c4-8226-ea628d3f1b06 None None] MFA Rules not processed for user `52f9fe4b13574516bb0a8e2aa11a61e8`. Rule list: `[]` (Enabled: `True`). {{(pid=80396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 15:59:41.465015 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.fernet_utils [None req-d4d0a850-057d-47c4-8226-ea628d3f1b06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 15:59:41.474175 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 707/1413] 10.222.0.59 () {58 vars in 1015 bytes} [Thu Jun 2 15:59:41 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 15:59:44.263176 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc3af42-2eb6-42a1-aaf7-6cb057b3b4dd None None] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:59:44.264323 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc3af42-2eb6-42a1-aaf7-6cb057b3b4dd None None] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:59:44.264811 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc3af42-2eb6-42a1-aaf7-6cb057b3b4dd None None] PATH_INFO: `/` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:59:44.266223 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 707/1414] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jun 2 15:59:44 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 15:59:44.271499 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0348a82-9164-4004-9848-10bd47a26fe5 None None] REQUEST_METHOD: `POST` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:59:44.271933 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0348a82-9164-4004-9848-10bd47a26fe5 None None] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:59:44.272061 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0348a82-9164-4004-9848-10bd47a26fe5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:59:44.289727 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.auth.core [None req-b0348a82-9164-4004-9848-10bd47a26fe5 None None] MFA Rules not processed for user `400d1f4db9de49638549e5db29a041e1`. Rule list: `[]` (Enabled: `True`). {{(pid=80396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 15:59:44.290951 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.fernet_utils [None req-b0348a82-9164-4004-9848-10bd47a26fe5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 15:59:44.298781 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 708/1415] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jun 2 15:59:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 15:59:44.343298 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bc3af42-2eb6-42a1-aaf7-6cb057b3b4dd None None] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:59:44.357058 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bc3af42-2eb6-42a1-aaf7-6cb057b3b4dd None None] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:59:44.363046 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-946ae267-9741-48a3-adb7-01cf379a297d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52f9fe4b13574516bb0a8e2aa11a61e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c87c981909d4b8db02783421818c79b', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:59:44.363672 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946ae267-9741-48a3-adb7-01cf379a297d service nova] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:59:44.363983 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946ae267-9741-48a3-adb7-01cf379a297d service nova] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:59:44.364259 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946ae267-9741-48a3-adb7-01cf379a297d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:59:44.372590 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-946ae267-9741-48a3-adb7-01cf379a297d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:59:44.374968 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-946ae267-9741-48a3-adb7-01cf379a297d service nova] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:59:44.384543 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 708/1416] 10.222.0.59 () {60 vars in 1365 bytes} [Thu Jun 2 15:59:44 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 02 15:59:45.356719 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a84a6d-6532-4815-a2f0-95dd8507074c None None] REQUEST_METHOD: `GET` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:59:45.357797 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a84a6d-6532-4815-a2f0-95dd8507074c None None] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:59:45.357914 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a84a6d-6532-4815-a2f0-95dd8507074c None None] PATH_INFO: `/` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:59:45.359337 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 709/1417] 127.0.0.1 () {54 vars in 901 bytes} [Thu Jun 2 15:59:45 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 15:59:45.364170 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7437b4-c91b-4068-b964-0c3577c2b947 None None] REQUEST_METHOD: `POST` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:59:45.364600 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7437b4-c91b-4068-b964-0c3577c2b947 None None] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:59:45.364705 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7437b4-c91b-4068-b964-0c3577c2b947 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:59:45.382030 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.auth.core [None req-cc7437b4-c91b-4068-b964-0c3577c2b947 None None] MFA Rules not processed for user `400d1f4db9de49638549e5db29a041e1`. Rule list: `[]` (Enabled: `True`). {{(pid=80395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 15:59:45.383223 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.fernet_utils [None req-cc7437b4-c91b-4068-b964-0c3577c2b947 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 15:59:45.391366 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 709/1418] 127.0.0.1 () {58 vars in 998 bytes} [Thu Jun 2 15:59:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 15:59:45.557365 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9a84a6d-6532-4815-a2f0-95dd8507074c None None] Authenticating user token {{(pid=80396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:59:45.572433 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9a84a6d-6532-4815-a2f0-95dd8507074c None None] Validating token access rules against request {{(pid=80396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:59:45.578953 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a91ff62-7061-4ee9-b576-f7dcd56fd589 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52f9fe4b13574516bb0a8e2aa11a61e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c87c981909d4b8db02783421818c79b', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:59:45.579596 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a91ff62-7061-4ee9-b576-f7dcd56fd589 service nova] REQUEST_METHOD: `GET` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:59:45.579884 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a91ff62-7061-4ee9-b576-f7dcd56fd589 service nova] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:59:45.580183 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a91ff62-7061-4ee9-b576-f7dcd56fd589 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:59:45.588683 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a91ff62-7061-4ee9-b576-f7dcd56fd589 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:59:45.591812 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a91ff62-7061-4ee9-b576-f7dcd56fd589 service nova] RBAC: Authorization granted {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:59:45.600313 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 710/1419] 10.222.0.59 () {60 vars in 1365 bytes} [Thu Jun 2 15:59:45 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 15:59:46.536570 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e24e37-f595-495c-97a3-1c8e8db64a44 None None] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:59:46.537090 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e24e37-f595-495c-97a3-1c8e8db64a44 None None] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:59:46.537090 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e24e37-f595-495c-97a3-1c8e8db64a44 None None] PATH_INFO: `/` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:59:46.538467 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 710/1420] 127.0.0.1 () {54 vars in 901 bytes} [Thu Jun 2 15:59:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 15:59:46.543453 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9762abd-692f-4338-aa61-13a4a2c3145b None None] REQUEST_METHOD: `POST` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:59:46.543902 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9762abd-692f-4338-aa61-13a4a2c3145b None None] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:59:46.544002 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9762abd-692f-4338-aa61-13a4a2c3145b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:59:46.562066 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.auth.core [None req-d9762abd-692f-4338-aa61-13a4a2c3145b None None] MFA Rules not processed for user `400d1f4db9de49638549e5db29a041e1`. Rule list: `[]` (Enabled: `True`). {{(pid=80396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 15:59:46.563270 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.fernet_utils [None req-d9762abd-692f-4338-aa61-13a4a2c3145b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 15:59:46.570830 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 711/1421] 127.0.0.1 () {58 vars in 998 bytes} [Thu Jun 2 15:59:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 15:59:46.723550 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16e24e37-f595-495c-97a3-1c8e8db64a44 None None] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:59:46.738049 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16e24e37-f595-495c-97a3-1c8e8db64a44 None None] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:59:46.745914 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7afca0b7-e653-42c2-a615-499275c88bcc service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52f9fe4b13574516bb0a8e2aa11a61e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c87c981909d4b8db02783421818c79b', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:59:46.745914 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7afca0b7-e653-42c2-a615-499275c88bcc service nova] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:59:46.745914 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7afca0b7-e653-42c2-a615-499275c88bcc service nova] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:59:46.745914 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7afca0b7-e653-42c2-a615-499275c88bcc service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:59:46.752988 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7afca0b7-e653-42c2-a615-499275c88bcc service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:59:46.754600 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7afca0b7-e653-42c2-a615-499275c88bcc service nova] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:59:46.763878 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 711/1422] 10.222.0.59 () {60 vars in 1365 bytes} [Thu Jun 2 15:59:46 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 15:59:47.677382 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc22ce15-084e-4830-903b-f745db64275f None None] REQUEST_METHOD: `GET` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:59:47.677928 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc22ce15-084e-4830-903b-f745db64275f None None] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:59:47.677928 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc22ce15-084e-4830-903b-f745db64275f None None] PATH_INFO: `/` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:59:47.679350 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 712/1423] 127.0.0.1 () {54 vars in 901 bytes} [Thu Jun 2 15:59:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 15:59:47.684149 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abaa2ece-c9bc-416b-bb33-874e1e37ef51 None None] REQUEST_METHOD: `POST` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:59:47.684590 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abaa2ece-c9bc-416b-bb33-874e1e37ef51 None None] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:59:47.684716 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abaa2ece-c9bc-416b-bb33-874e1e37ef51 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:59:47.702740 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.auth.core [None req-abaa2ece-c9bc-416b-bb33-874e1e37ef51 None None] MFA Rules not processed for user `400d1f4db9de49638549e5db29a041e1`. Rule list: `[]` (Enabled: `True`). {{(pid=80395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 15:59:47.703903 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.fernet_utils [None req-abaa2ece-c9bc-416b-bb33-874e1e37ef51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 15:59:47.711471 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 712/1424] 127.0.0.1 () {58 vars in 998 bytes} [Thu Jun 2 15:59:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 15:59:47.862232 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc22ce15-084e-4830-903b-f745db64275f None None] Authenticating user token {{(pid=80396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:59:47.876208 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc22ce15-084e-4830-903b-f745db64275f None None] Validating token access rules against request {{(pid=80396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:59:47.881490 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0810ff8-0517-4dd8-87f1-31a2d8016e1a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52f9fe4b13574516bb0a8e2aa11a61e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c87c981909d4b8db02783421818c79b', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:59:47.882144 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0810ff8-0517-4dd8-87f1-31a2d8016e1a service nova] REQUEST_METHOD: `GET` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:59:47.882429 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0810ff8-0517-4dd8-87f1-31a2d8016e1a service nova] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:59:47.882704 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0810ff8-0517-4dd8-87f1-31a2d8016e1a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:59:47.890846 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0810ff8-0517-4dd8-87f1-31a2d8016e1a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:59:47.892865 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0810ff8-0517-4dd8-87f1-31a2d8016e1a service nova] RBAC: Authorization granted {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:59:47.901967 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 713/1425] 10.222.0.59 () {60 vars in 1365 bytes} [Thu Jun 2 15:59:47 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 15:59:48.818910 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0bcfeed-ed38-412a-aa8a-baa63ea00e53 None None] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:59:48.819457 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0bcfeed-ed38-412a-aa8a-baa63ea00e53 None None] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:59:48.819457 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0bcfeed-ed38-412a-aa8a-baa63ea00e53 None None] PATH_INFO: `/` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:59:48.820837 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 713/1426] 127.0.0.1 () {54 vars in 901 bytes} [Thu Jun 2 15:59:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 15:59:48.825633 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95fbb6a1-40e3-46e2-b6e0-b2c0f7aa1675 None None] REQUEST_METHOD: `POST` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:59:48.826139 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95fbb6a1-40e3-46e2-b6e0-b2c0f7aa1675 None None] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:59:48.826386 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95fbb6a1-40e3-46e2-b6e0-b2c0f7aa1675 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:59:48.844852 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.auth.core [None req-95fbb6a1-40e3-46e2-b6e0-b2c0f7aa1675 None None] MFA Rules not processed for user `400d1f4db9de49638549e5db29a041e1`. Rule list: `[]` (Enabled: `True`). {{(pid=80396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 15:59:48.846063 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.fernet_utils [None req-95fbb6a1-40e3-46e2-b6e0-b2c0f7aa1675 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 15:59:48.853761 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 714/1427] 127.0.0.1 () {58 vars in 998 bytes} [Thu Jun 2 15:59:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 15:59:49.002029 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0bcfeed-ed38-412a-aa8a-baa63ea00e53 None None] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:59:49.016625 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0bcfeed-ed38-412a-aa8a-baa63ea00e53 None None] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:59:49.021883 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66f2a1b7-58cd-4ed1-ba4a-b5fb59b86b2d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52f9fe4b13574516bb0a8e2aa11a61e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c87c981909d4b8db02783421818c79b', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:59:49.022537 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f2a1b7-58cd-4ed1-ba4a-b5fb59b86b2d service nova] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:59:49.022822 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f2a1b7-58cd-4ed1-ba4a-b5fb59b86b2d service nova] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:59:49.023099 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f2a1b7-58cd-4ed1-ba4a-b5fb59b86b2d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:59:49.031597 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66f2a1b7-58cd-4ed1-ba4a-b5fb59b86b2d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:59:49.033175 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66f2a1b7-58cd-4ed1-ba4a-b5fb59b86b2d service nova] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:59:49.042280 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 714/1428] 10.222.0.59 () {60 vars in 1365 bytes} [Thu Jun 2 15:59:49 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 02 15:59:49.962462 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485fe03a-21e2-41df-919d-8f9e5c76d62c None None] REQUEST_METHOD: `GET` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:59:49.963027 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485fe03a-21e2-41df-919d-8f9e5c76d62c None None] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:59:49.963027 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485fe03a-21e2-41df-919d-8f9e5c76d62c None None] PATH_INFO: `/` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:59:49.964655 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 715/1429] 127.0.0.1 () {54 vars in 901 bytes} [Thu Jun 2 15:59:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 15:59:49.969991 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96612926-4aff-4da8-a571-1a14dd04df00 None None] REQUEST_METHOD: `POST` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:59:49.970489 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96612926-4aff-4da8-a571-1a14dd04df00 None None] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:59:49.970680 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96612926-4aff-4da8-a571-1a14dd04df00 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:59:49.988799 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.auth.core [None req-96612926-4aff-4da8-a571-1a14dd04df00 None None] MFA Rules not processed for user `400d1f4db9de49638549e5db29a041e1`. Rule list: `[]` (Enabled: `True`). {{(pid=80395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 15:59:49.989976 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.fernet_utils [None req-96612926-4aff-4da8-a571-1a14dd04df00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 15:59:49.998997 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 715/1430] 127.0.0.1 () {58 vars in 998 bytes} [Thu Jun 2 15:59:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 02 15:59:50.149130 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-485fe03a-21e2-41df-919d-8f9e5c76d62c None None] Authenticating user token {{(pid=80396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:59:50.164390 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-485fe03a-21e2-41df-919d-8f9e5c76d62c None None] Validating token access rules against request {{(pid=80396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:59:50.170393 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae62a8c3-4718-44f5-b736-9467dc4b6932 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52f9fe4b13574516bb0a8e2aa11a61e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c87c981909d4b8db02783421818c79b', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:59:50.171035 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae62a8c3-4718-44f5-b736-9467dc4b6932 service nova] REQUEST_METHOD: `GET` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:59:50.171320 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae62a8c3-4718-44f5-b736-9467dc4b6932 service nova] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:59:50.171598 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae62a8c3-4718-44f5-b736-9467dc4b6932 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:59:50.180905 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae62a8c3-4718-44f5-b736-9467dc4b6932 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:59:50.182528 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae62a8c3-4718-44f5-b736-9467dc4b6932 service nova] RBAC: Authorization granted {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:59:50.194535 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 716/1431] 10.222.0.59 () {60 vars in 1365 bytes} [Thu Jun 2 15:59:50 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 15:59:51.096808 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c52ec12-55c1-4de3-bd2b-7d07e7696f29 None None] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:59:51.097362 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c52ec12-55c1-4de3-bd2b-7d07e7696f29 None None] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:59:51.097476 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c52ec12-55c1-4de3-bd2b-7d07e7696f29 None None] PATH_INFO: `/` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:59:51.098807 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 716/1432] 127.0.0.1 () {54 vars in 901 bytes} [Thu Jun 2 15:59:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 15:59:51.103581 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f6e761-5531-44e6-8d68-c6159eaf7362 None None] REQUEST_METHOD: `POST` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:59:51.104022 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f6e761-5531-44e6-8d68-c6159eaf7362 None None] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:59:51.104149 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f6e761-5531-44e6-8d68-c6159eaf7362 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:59:51.123627 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.auth.core [None req-a8f6e761-5531-44e6-8d68-c6159eaf7362 None None] MFA Rules not processed for user `400d1f4db9de49638549e5db29a041e1`. Rule list: `[]` (Enabled: `True`). {{(pid=80396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 15:59:51.124816 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.fernet_utils [None req-a8f6e761-5531-44e6-8d68-c6159eaf7362 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 15:59:51.132533 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 717/1433] 127.0.0.1 () {58 vars in 998 bytes} [Thu Jun 2 15:59:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 15:59:51.292285 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c52ec12-55c1-4de3-bd2b-7d07e7696f29 None None] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:59:51.306861 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c52ec12-55c1-4de3-bd2b-7d07e7696f29 None None] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:59:51.312748 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db10cfd6-8702-48fc-9efb-85bf9bcf893e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52f9fe4b13574516bb0a8e2aa11a61e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c87c981909d4b8db02783421818c79b', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:59:51.313370 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db10cfd6-8702-48fc-9efb-85bf9bcf893e service nova] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:59:51.313649 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db10cfd6-8702-48fc-9efb-85bf9bcf893e service nova] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:59:51.313921 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db10cfd6-8702-48fc-9efb-85bf9bcf893e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:59:51.323172 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db10cfd6-8702-48fc-9efb-85bf9bcf893e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:59:51.329167 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db10cfd6-8702-48fc-9efb-85bf9bcf893e service nova] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:59:51.334112 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 717/1434] 10.222.0.59 () {60 vars in 1365 bytes} [Thu Jun 2 15:59:51 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 15:59:52.228355 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6494988b-0e4a-4c80-8fb9-12d7a1d5c026 None None] REQUEST_METHOD: `GET` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:59:52.228916 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6494988b-0e4a-4c80-8fb9-12d7a1d5c026 None None] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:59:52.229054 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6494988b-0e4a-4c80-8fb9-12d7a1d5c026 None None] PATH_INFO: `/` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:59:52.230418 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 718/1435] 127.0.0.1 () {54 vars in 901 bytes} [Thu Jun 2 15:59:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 15:59:52.235415 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e012cc5c-5734-4dbe-902d-2343e461927b None None] REQUEST_METHOD: `POST` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:59:52.235843 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e012cc5c-5734-4dbe-902d-2343e461927b None None] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:59:52.235949 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e012cc5c-5734-4dbe-902d-2343e461927b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:59:52.253867 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.auth.core [None req-e012cc5c-5734-4dbe-902d-2343e461927b None None] MFA Rules not processed for user `400d1f4db9de49638549e5db29a041e1`. Rule list: `[]` (Enabled: `True`). {{(pid=80395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 15:59:52.255066 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.fernet_utils [None req-e012cc5c-5734-4dbe-902d-2343e461927b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 15:59:52.262672 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 718/1436] 127.0.0.1 () {58 vars in 998 bytes} [Thu Jun 2 15:59:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 15:59:52.410089 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6494988b-0e4a-4c80-8fb9-12d7a1d5c026 None None] Authenticating user token {{(pid=80396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:59:52.424508 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6494988b-0e4a-4c80-8fb9-12d7a1d5c026 None None] Validating token access rules against request {{(pid=80396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:59:52.429715 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb299667-d2ee-49b7-8305-4ba388d6e525 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52f9fe4b13574516bb0a8e2aa11a61e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c87c981909d4b8db02783421818c79b', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:59:52.430380 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb299667-d2ee-49b7-8305-4ba388d6e525 service nova] REQUEST_METHOD: `GET` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:59:52.430672 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb299667-d2ee-49b7-8305-4ba388d6e525 service nova] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:59:52.430951 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb299667-d2ee-49b7-8305-4ba388d6e525 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:59:52.440087 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb299667-d2ee-49b7-8305-4ba388d6e525 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:59:52.441656 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb299667-d2ee-49b7-8305-4ba388d6e525 service nova] RBAC: Authorization granted {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:59:52.452065 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 719/1437] 10.222.0.59 () {60 vars in 1365 bytes} [Thu Jun 2 15:59:52 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 15:59:53.342951 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75545edc-03d3-47fc-bbea-e73a27f706f8 None None] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:59:53.343498 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75545edc-03d3-47fc-bbea-e73a27f706f8 None None] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:59:53.343498 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75545edc-03d3-47fc-bbea-e73a27f706f8 None None] PATH_INFO: `/` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:59:53.344932 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 719/1438] 127.0.0.1 () {54 vars in 901 bytes} [Thu Jun 2 15:59:53 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 15:59:53.349860 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8700efd-c207-417f-8465-9adf7ce5cad8 None None] REQUEST_METHOD: `POST` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:59:53.350320 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8700efd-c207-417f-8465-9adf7ce5cad8 None None] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:59:53.350454 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8700efd-c207-417f-8465-9adf7ce5cad8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:59:53.368949 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.auth.core [None req-a8700efd-c207-417f-8465-9adf7ce5cad8 None None] MFA Rules not processed for user `400d1f4db9de49638549e5db29a041e1`. Rule list: `[]` (Enabled: `True`). {{(pid=80396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 15:59:53.370273 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.fernet_utils [None req-a8700efd-c207-417f-8465-9adf7ce5cad8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 15:59:53.378463 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 720/1439] 127.0.0.1 () {58 vars in 998 bytes} [Thu Jun 2 15:59:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 15:59:53.527265 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75545edc-03d3-47fc-bbea-e73a27f706f8 None None] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:59:53.541994 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75545edc-03d3-47fc-bbea-e73a27f706f8 None None] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:59:53.547743 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4f8cd93-5db6-49d1-8ac8-dfdc47e110da service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52f9fe4b13574516bb0a8e2aa11a61e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c87c981909d4b8db02783421818c79b', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:59:53.548380 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f8cd93-5db6-49d1-8ac8-dfdc47e110da service nova] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:59:53.548663 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f8cd93-5db6-49d1-8ac8-dfdc47e110da service nova] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:59:53.548941 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f8cd93-5db6-49d1-8ac8-dfdc47e110da service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:59:53.557157 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4f8cd93-5db6-49d1-8ac8-dfdc47e110da service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:59:53.558787 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4f8cd93-5db6-49d1-8ac8-dfdc47e110da service nova] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:59:53.568195 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 720/1440] 10.222.0.59 () {60 vars in 1365 bytes} [Thu Jun 2 15:59:53 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 02 15:59:55.677976 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e0e322-d3fe-4e3a-8b16-427d9066994a None None] REQUEST_METHOD: `GET` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:59:55.678591 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e0e322-d3fe-4e3a-8b16-427d9066994a None None] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:59:55.678591 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e0e322-d3fe-4e3a-8b16-427d9066994a None None] PATH_INFO: `/` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:59:55.680026 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 721/1441] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jun 2 15:59:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 15:59:55.686668 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f94732d-fa6f-4881-95af-90935a2324c6 None None] REQUEST_METHOD: `POST` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:59:55.687103 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f94732d-fa6f-4881-95af-90935a2324c6 None None] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:59:55.687474 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f94732d-fa6f-4881-95af-90935a2324c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:59:55.705569 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.auth.core [None req-7f94732d-fa6f-4881-95af-90935a2324c6 None None] MFA Rules not processed for user `400d1f4db9de49638549e5db29a041e1`. Rule list: `[]` (Enabled: `True`). {{(pid=80395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 15:59:55.706801 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.fernet_utils [None req-7f94732d-fa6f-4881-95af-90935a2324c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 15:59:55.715657 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 721/1442] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jun 2 15:59:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 15:59:55.755405 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35e0e322-d3fe-4e3a-8b16-427d9066994a None None] Authenticating user token {{(pid=80396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:59:55.766428 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35e0e322-d3fe-4e3a-8b16-427d9066994a None None] Validating token access rules against request {{(pid=80396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:59:55.770476 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9097cf89-879a-470b-b18e-98dbb0d00411 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9af40ddfe9ff4be3887b068f13a28dc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c87c981909d4b8db02783421818c79b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:59:55.771226 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9097cf89-879a-470b-b18e-98dbb0d00411 service neutron] REQUEST_METHOD: `GET` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:59:55.771583 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9097cf89-879a-470b-b18e-98dbb0d00411 service neutron] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:59:55.771933 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9097cf89-879a-470b-b18e-98dbb0d00411 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:59:55.782140 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9097cf89-879a-470b-b18e-98dbb0d00411 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:59:55.783702 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9097cf89-879a-470b-b18e-98dbb0d00411 service neutron] RBAC: Authorization granted {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:59:55.793488 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 722/1443] 10.222.0.59 () {60 vars in 1365 bytes} [Thu Jun 2 15:59:55 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 15:59:58.248854 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-887fa3fd-e2d1-4369-ab00-26c0faebe446 None None] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:59:58.249387 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-887fa3fd-e2d1-4369-ab00-26c0faebe446 None None] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:59:58.249387 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-887fa3fd-e2d1-4369-ab00-26c0faebe446 None None] PATH_INFO: `/` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:59:58.250818 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 722/1444] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jun 2 15:59:58 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 15:59:58.256194 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208f2b08-4fc8-454c-a033-0a3482281d03 None None] REQUEST_METHOD: `POST` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:59:58.256602 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208f2b08-4fc8-454c-a033-0a3482281d03 None None] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:59:58.256755 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208f2b08-4fc8-454c-a033-0a3482281d03 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:59:58.275090 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.auth.core [None req-208f2b08-4fc8-454c-a033-0a3482281d03 None None] MFA Rules not processed for user `400d1f4db9de49638549e5db29a041e1`. Rule list: `[]` (Enabled: `True`). {{(pid=80396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 15:59:58.276284 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.fernet_utils [None req-208f2b08-4fc8-454c-a033-0a3482281d03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 15:59:58.284402 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 723/1445] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jun 2 15:59:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 15:59:58.322368 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-887fa3fd-e2d1-4369-ab00-26c0faebe446 None None] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:59:58.333497 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-887fa3fd-e2d1-4369-ab00-26c0faebe446 None None] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:59:58.337026 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f9c5652-c39b-44a5-98c4-b49394f2204e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9af40ddfe9ff4be3887b068f13a28dc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c87c981909d4b8db02783421818c79b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:59:58.337656 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f9c5652-c39b-44a5-98c4-b49394f2204e service neutron] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:59:58.339263 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f9c5652-c39b-44a5-98c4-b49394f2204e service neutron] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:59:58.339263 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f9c5652-c39b-44a5-98c4-b49394f2204e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:59:58.347563 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f9c5652-c39b-44a5-98c4-b49394f2204e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:59:58.348997 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f9c5652-c39b-44a5-98c4-b49394f2204e service neutron] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:59:58.358715 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 723/1446] 10.222.0.59 () {60 vars in 1365 bytes} [Thu Jun 2 15:59:58 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 16:00:01.076324 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c22a1a2-c13a-4d76-98df-07943bd096a9 None None] REQUEST_METHOD: `GET` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:00:01.076985 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c22a1a2-c13a-4d76-98df-07943bd096a9 None None] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:00:01.076985 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c22a1a2-c13a-4d76-98df-07943bd096a9 None None] PATH_INFO: `/` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:00:01.078400 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 724/1447] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jun 2 16:00:01 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 02 16:00:01.084010 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46cb7c73-d863-4d66-8c41-3e81af4f8469 None None] REQUEST_METHOD: `POST` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:00:01.084420 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46cb7c73-d863-4d66-8c41-3e81af4f8469 None None] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:00:01.084579 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46cb7c73-d863-4d66-8c41-3e81af4f8469 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:00:01.103656 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.auth.core [None req-46cb7c73-d863-4d66-8c41-3e81af4f8469 None None] MFA Rules not processed for user `400d1f4db9de49638549e5db29a041e1`. Rule list: `[]` (Enabled: `True`). {{(pid=80395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 16:00:01.104838 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.fernet_utils [None req-46cb7c73-d863-4d66-8c41-3e81af4f8469 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:00:01.112657 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 724/1448] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jun 2 16:00:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 16:00:01.151513 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c22a1a2-c13a-4d76-98df-07943bd096a9 None None] Authenticating user token {{(pid=80396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:00:01.162348 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c22a1a2-c13a-4d76-98df-07943bd096a9 None None] Validating token access rules against request {{(pid=80396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:00:01.165727 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f16ebf44-0917-40e6-8b1f-4571eb70907b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9af40ddfe9ff4be3887b068f13a28dc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c87c981909d4b8db02783421818c79b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:00:01.166392 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16ebf44-0917-40e6-8b1f-4571eb70907b service neutron] REQUEST_METHOD: `GET` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:00:01.166679 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16ebf44-0917-40e6-8b1f-4571eb70907b service neutron] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:00:01.166957 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16ebf44-0917-40e6-8b1f-4571eb70907b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:00:01.176755 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f16ebf44-0917-40e6-8b1f-4571eb70907b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:00:01.178208 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f16ebf44-0917-40e6-8b1f-4571eb70907b service neutron] RBAC: Authorization granted {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:00:01.188138 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 725/1449] 10.222.0.59 () {60 vars in 1365 bytes} [Thu Jun 2 16:00:01 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 16:00:03.561889 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42a5423-7400-40e5-93f2-0098d4da158c None None] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:00:03.562491 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42a5423-7400-40e5-93f2-0098d4da158c None None] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:00:03.562491 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42a5423-7400-40e5-93f2-0098d4da158c None None] PATH_INFO: `/` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:00:03.563833 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 725/1450] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jun 2 16:00:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 16:00:03.569041 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f824d0f9-93ac-4db2-9702-86e436cc0c3d None None] REQUEST_METHOD: `POST` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:00:03.569456 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f824d0f9-93ac-4db2-9702-86e436cc0c3d None None] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:00:03.569606 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f824d0f9-93ac-4db2-9702-86e436cc0c3d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:00:03.587641 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.auth.core [None req-f824d0f9-93ac-4db2-9702-86e436cc0c3d None None] MFA Rules not processed for user `400d1f4db9de49638549e5db29a041e1`. Rule list: `[]` (Enabled: `True`). {{(pid=80396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 16:00:03.589084 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.fernet_utils [None req-f824d0f9-93ac-4db2-9702-86e436cc0c3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:00:03.596963 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 726/1451] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jun 2 16:00:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 16:00:03.635187 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f42a5423-7400-40e5-93f2-0098d4da158c None None] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:00:03.646567 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f42a5423-7400-40e5-93f2-0098d4da158c None None] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:00:03.649972 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d13f808-c5d7-4c05-ae5f-884fca0cdb92 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9af40ddfe9ff4be3887b068f13a28dc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c87c981909d4b8db02783421818c79b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:00:03.650626 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d13f808-c5d7-4c05-ae5f-884fca0cdb92 service neutron] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:00:03.650913 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d13f808-c5d7-4c05-ae5f-884fca0cdb92 service neutron] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:00:03.651188 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d13f808-c5d7-4c05-ae5f-884fca0cdb92 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:00:03.660177 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d13f808-c5d7-4c05-ae5f-884fca0cdb92 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:00:03.661603 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d13f808-c5d7-4c05-ae5f-884fca0cdb92 service neutron] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:00:03.671097 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 726/1452] 10.222.0.59 () {60 vars in 1365 bytes} [Thu Jun 2 16:00:03 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 16:00:05.957847 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9882de95-ceff-4c16-9619-353a58a063b1 None None] REQUEST_METHOD: `GET` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:00:05.958456 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9882de95-ceff-4c16-9619-353a58a063b1 None None] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:00:05.958456 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9882de95-ceff-4c16-9619-353a58a063b1 None None] PATH_INFO: `/` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:00:05.959872 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 727/1453] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jun 2 16:00:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 16:00:05.966156 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e47bd752-4d78-4d55-9ce2-9d8c2d63fd18 None None] REQUEST_METHOD: `POST` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:00:05.966754 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e47bd752-4d78-4d55-9ce2-9d8c2d63fd18 None None] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:00:05.966754 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e47bd752-4d78-4d55-9ce2-9d8c2d63fd18 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:00:05.984664 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.auth.core [None req-e47bd752-4d78-4d55-9ce2-9d8c2d63fd18 None None] MFA Rules not processed for user `400d1f4db9de49638549e5db29a041e1`. Rule list: `[]` (Enabled: `True`). {{(pid=80395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 16:00:05.985818 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.fernet_utils [None req-e47bd752-4d78-4d55-9ce2-9d8c2d63fd18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:00:05.993267 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 727/1454] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jun 2 16:00:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 02 16:00:06.030634 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9882de95-ceff-4c16-9619-353a58a063b1 None None] Authenticating user token {{(pid=80396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:00:06.041225 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9882de95-ceff-4c16-9619-353a58a063b1 None None] Validating token access rules against request {{(pid=80396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:00:06.045224 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9843db83-45b8-42ea-b895-ef1a0ac9270d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9af40ddfe9ff4be3887b068f13a28dc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c87c981909d4b8db02783421818c79b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:00:06.045855 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9843db83-45b8-42ea-b895-ef1a0ac9270d service neutron] REQUEST_METHOD: `GET` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:00:06.046166 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9843db83-45b8-42ea-b895-ef1a0ac9270d service neutron] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:00:06.046443 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9843db83-45b8-42ea-b895-ef1a0ac9270d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:00:06.055087 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9843db83-45b8-42ea-b895-ef1a0ac9270d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:00:06.056502 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9843db83-45b8-42ea-b895-ef1a0ac9270d service neutron] RBAC: Authorization granted {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:00:06.065823 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 728/1455] 10.222.0.59 () {60 vars in 1365 bytes} [Thu Jun 2 16:00:06 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 16:00:08.428362 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb800a44-68b7-45e1-bfe5-235a8f65b0fe None None] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:00:08.428892 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb800a44-68b7-45e1-bfe5-235a8f65b0fe None None] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:00:08.428892 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb800a44-68b7-45e1-bfe5-235a8f65b0fe None None] PATH_INFO: `/` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:00:08.430311 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 728/1456] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jun 2 16:00:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 16:00:08.435597 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b315b26b-ee25-4dc6-9044-37407afe83b0 None None] REQUEST_METHOD: `POST` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:00:08.435993 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b315b26b-ee25-4dc6-9044-37407afe83b0 None None] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:00:08.436162 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b315b26b-ee25-4dc6-9044-37407afe83b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:00:08.454544 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.auth.core [None req-b315b26b-ee25-4dc6-9044-37407afe83b0 None None] MFA Rules not processed for user `400d1f4db9de49638549e5db29a041e1`. Rule list: `[]` (Enabled: `True`). {{(pid=80396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 16:00:08.455739 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.fernet_utils [None req-b315b26b-ee25-4dc6-9044-37407afe83b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:00:08.463608 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 729/1457] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jun 2 16:00:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 16:00:08.502186 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb800a44-68b7-45e1-bfe5-235a8f65b0fe None None] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:00:08.513246 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb800a44-68b7-45e1-bfe5-235a8f65b0fe None None] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:00:08.516679 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e558eb-e21c-43e1-9e50-16dc4809f432 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9af40ddfe9ff4be3887b068f13a28dc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c87c981909d4b8db02783421818c79b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:00:08.517309 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e558eb-e21c-43e1-9e50-16dc4809f432 service neutron] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:00:08.517594 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e558eb-e21c-43e1-9e50-16dc4809f432 service neutron] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:00:08.517871 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e558eb-e21c-43e1-9e50-16dc4809f432 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:00:08.526660 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07e558eb-e21c-43e1-9e50-16dc4809f432 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:00:08.528854 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07e558eb-e21c-43e1-9e50-16dc4809f432 service neutron] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:00:08.538026 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 729/1458] 10.222.0.59 () {60 vars in 1365 bytes} [Thu Jun 2 16:00:08 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 16:00:10.893224 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73bb31e2-762b-435a-825e-f1ca97db0181 None None] REQUEST_METHOD: `GET` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:00:10.893794 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73bb31e2-762b-435a-825e-f1ca97db0181 None None] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:00:10.893794 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73bb31e2-762b-435a-825e-f1ca97db0181 None None] PATH_INFO: `/` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:00:10.895232 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 730/1459] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jun 2 16:00:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 16:00:10.900697 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1220e4-38fe-4415-94a6-1eb732cc0565 None None] REQUEST_METHOD: `POST` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:00:10.901118 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1220e4-38fe-4415-94a6-1eb732cc0565 None None] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:00:10.901258 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1220e4-38fe-4415-94a6-1eb732cc0565 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:00:10.908304 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writing DB stats keystone:SELECT=70 {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 16:00:10.920217 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.auth.core [None req-eb1220e4-38fe-4415-94a6-1eb732cc0565 None None] MFA Rules not processed for user `400d1f4db9de49638549e5db29a041e1`. Rule list: `[]` (Enabled: `True`). {{(pid=80395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 16:00:10.921400 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.fernet_utils [None req-eb1220e4-38fe-4415-94a6-1eb732cc0565 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:00:10.929331 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 730/1460] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jun 2 16:00:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 16:00:10.968869 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73bb31e2-762b-435a-825e-f1ca97db0181 None None] Authenticating user token {{(pid=80396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:00:10.974281 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG dbcounter [-] [80396] Writing DB stats keystone:SELECT=73 {{(pid=80396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 16:00:10.980582 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73bb31e2-762b-435a-825e-f1ca97db0181 None None] Validating token access rules against request {{(pid=80396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:00:10.984748 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee8fd6a4-d632-4d98-a1c5-564d668fe4d1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9af40ddfe9ff4be3887b068f13a28dc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c87c981909d4b8db02783421818c79b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:00:10.985385 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8fd6a4-d632-4d98-a1c5-564d668fe4d1 service neutron] REQUEST_METHOD: `GET` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:00:10.985671 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8fd6a4-d632-4d98-a1c5-564d668fe4d1 service neutron] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:00:10.985951 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8fd6a4-d632-4d98-a1c5-564d668fe4d1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:00:10.995117 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee8fd6a4-d632-4d98-a1c5-564d668fe4d1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:00:10.997632 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee8fd6a4-d632-4d98-a1c5-564d668fe4d1 service neutron] RBAC: Authorization granted {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:00:11.007152 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 731/1461] 10.222.0.59 () {60 vars in 1365 bytes} [Thu Jun 2 16:00:10 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 16:00:13.287925 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152cf48b-98f7-43d1-a0db-f01e5aedb15b None None] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:00:13.288456 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152cf48b-98f7-43d1-a0db-f01e5aedb15b None None] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:00:13.288456 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152cf48b-98f7-43d1-a0db-f01e5aedb15b None None] PATH_INFO: `/` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:00:13.289803 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 731/1462] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jun 2 16:00:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 16:00:13.295733 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63459533-bdce-4474-8400-1b79f66ee3b7 None None] REQUEST_METHOD: `POST` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:00:13.296149 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63459533-bdce-4474-8400-1b79f66ee3b7 None None] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:00:13.296298 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63459533-bdce-4474-8400-1b79f66ee3b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:00:13.313934 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.auth.core [None req-63459533-bdce-4474-8400-1b79f66ee3b7 None None] MFA Rules not processed for user `400d1f4db9de49638549e5db29a041e1`. Rule list: `[]` (Enabled: `True`). {{(pid=80396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 16:00:13.315174 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.fernet_utils [None req-63459533-bdce-4474-8400-1b79f66ee3b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:00:13.322929 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 732/1463] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jun 2 16:00:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 16:00:13.361527 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-152cf48b-98f7-43d1-a0db-f01e5aedb15b None None] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:00:13.371976 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-152cf48b-98f7-43d1-a0db-f01e5aedb15b None None] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:00:13.375451 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-129b9bae-c305-46a9-b85f-293915a82edb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9af40ddfe9ff4be3887b068f13a28dc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c87c981909d4b8db02783421818c79b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:00:13.376073 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-129b9bae-c305-46a9-b85f-293915a82edb service neutron] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:00:13.376348 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-129b9bae-c305-46a9-b85f-293915a82edb service neutron] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:00:13.376618 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-129b9bae-c305-46a9-b85f-293915a82edb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:00:13.385642 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-129b9bae-c305-46a9-b85f-293915a82edb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:00:13.387181 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-129b9bae-c305-46a9-b85f-293915a82edb service neutron] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:00:13.396469 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 732/1464] 10.222.0.59 () {60 vars in 1365 bytes} [Thu Jun 2 16:00:13 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 16:00:15.668770 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f676709-8ead-4be2-97a8-fd07b73c4b6b None None] REQUEST_METHOD: `GET` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:00:15.669333 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f676709-8ead-4be2-97a8-fd07b73c4b6b None None] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:00:15.669543 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f676709-8ead-4be2-97a8-fd07b73c4b6b None None] PATH_INFO: `/` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:00:15.670994 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 733/1465] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jun 2 16:00:15 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 16:00:15.676364 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-740f2d34-f092-4cd7-a9ee-f9524eaea25b None None] REQUEST_METHOD: `POST` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:00:15.676773 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-740f2d34-f092-4cd7-a9ee-f9524eaea25b None None] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:00:15.676922 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-740f2d34-f092-4cd7-a9ee-f9524eaea25b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:00:15.694578 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.auth.core [None req-740f2d34-f092-4cd7-a9ee-f9524eaea25b None None] MFA Rules not processed for user `400d1f4db9de49638549e5db29a041e1`. Rule list: `[]` (Enabled: `True`). {{(pid=80395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 16:00:15.695758 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.fernet_utils [None req-740f2d34-f092-4cd7-a9ee-f9524eaea25b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:00:15.703564 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 733/1466] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jun 2 16:00:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 02 16:00:15.740997 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f676709-8ead-4be2-97a8-fd07b73c4b6b None None] Authenticating user token {{(pid=80396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:00:15.751887 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f676709-8ead-4be2-97a8-fd07b73c4b6b None None] Validating token access rules against request {{(pid=80396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:00:15.755326 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee3deb93-407c-410b-a11a-75251247e61e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9af40ddfe9ff4be3887b068f13a28dc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c87c981909d4b8db02783421818c79b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:00:15.755948 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee3deb93-407c-410b-a11a-75251247e61e service neutron] REQUEST_METHOD: `GET` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:00:15.756262 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee3deb93-407c-410b-a11a-75251247e61e service neutron] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:00:15.756539 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee3deb93-407c-410b-a11a-75251247e61e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:00:15.765616 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee3deb93-407c-410b-a11a-75251247e61e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:00:15.767069 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee3deb93-407c-410b-a11a-75251247e61e service neutron] RBAC: Authorization granted {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:00:15.776219 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 734/1467] 10.222.0.59 () {60 vars in 1365 bytes} [Thu Jun 2 16:00:15 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 16:00:18.041490 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bab28a5-27ea-4f6f-8400-07b528441237 None None] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:00:18.042059 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bab28a5-27ea-4f6f-8400-07b528441237 None None] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:00:18.042203 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bab28a5-27ea-4f6f-8400-07b528441237 None None] PATH_INFO: `/` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:00:18.043591 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 734/1468] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jun 2 16:00:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 16:00:18.048852 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1791854-890b-49f5-ac9c-b0be2ca0007d None None] REQUEST_METHOD: `POST` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:00:18.049262 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1791854-890b-49f5-ac9c-b0be2ca0007d None None] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:00:18.049438 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1791854-890b-49f5-ac9c-b0be2ca0007d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:00:18.068383 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.auth.core [None req-e1791854-890b-49f5-ac9c-b0be2ca0007d None None] MFA Rules not processed for user `400d1f4db9de49638549e5db29a041e1`. Rule list: `[]` (Enabled: `True`). {{(pid=80396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 16:00:18.069578 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.fernet_utils [None req-e1791854-890b-49f5-ac9c-b0be2ca0007d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:00:18.078039 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 735/1469] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jun 2 16:00:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 16:00:18.114531 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bab28a5-27ea-4f6f-8400-07b528441237 None None] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:00:18.125607 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bab28a5-27ea-4f6f-8400-07b528441237 None None] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:00:18.129000 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fbff6d6-4068-435b-87ff-da0795d6fb9f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9af40ddfe9ff4be3887b068f13a28dc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c87c981909d4b8db02783421818c79b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:00:18.129623 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fbff6d6-4068-435b-87ff-da0795d6fb9f service neutron] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:00:18.129898 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fbff6d6-4068-435b-87ff-da0795d6fb9f service neutron] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:00:18.130203 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fbff6d6-4068-435b-87ff-da0795d6fb9f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:00:18.138745 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fbff6d6-4068-435b-87ff-da0795d6fb9f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:00:18.140159 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fbff6d6-4068-435b-87ff-da0795d6fb9f service neutron] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:00:18.149138 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 735/1470] 10.222.0.59 () {60 vars in 1365 bytes} [Thu Jun 2 16:00:18 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 16:00:28.062666 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG dbcounter [-] [80396] Writing DB stats keystone:SELECT=17 {{(pid=80396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 16:00:28.145145 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writing DB stats keystone:SELECT=17 {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 16:00:50.065598 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd8f54d-30c0-49d8-b5bb-08d22cc9b38b None None] REQUEST_METHOD: `GET` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:00:50.066192 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd8f54d-30c0-49d8-b5bb-08d22cc9b38b None None] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:00:50.066192 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd8f54d-30c0-49d8-b5bb-08d22cc9b38b None None] PATH_INFO: `/` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:00:50.067485 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 736/1471] 10.222.0.59 () {54 vars in 926 bytes} [Thu Jun 2 16:00:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 16:00:50.073156 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-918ed0f0-a3ef-4341-b572-554c17ff3b8f None None] REQUEST_METHOD: `POST` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:00:50.073599 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-918ed0f0-a3ef-4341-b572-554c17ff3b8f None None] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:00:50.073703 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-918ed0f0-a3ef-4341-b572-554c17ff3b8f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:00:50.090976 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.auth.core [None req-918ed0f0-a3ef-4341-b572-554c17ff3b8f None None] MFA Rules not processed for user `400d1f4db9de49638549e5db29a041e1`. Rule list: `[]` (Enabled: `True`). {{(pid=80395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 16:00:50.092137 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.fernet_utils [None req-918ed0f0-a3ef-4341-b572-554c17ff3b8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:00:50.099640 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 736/1472] 10.222.0.59 () {58 vars in 1023 bytes} [Thu Jun 2 16:00:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 16:00:50.146577 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b0925d8-642e-4b90-8f8d-fb35de7c250e None None] REQUEST_METHOD: `GET` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:00:50.149337 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b0925d8-642e-4b90-8f8d-fb35de7c250e None None] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:00:50.149337 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b0925d8-642e-4b90-8f8d-fb35de7c250e None None] PATH_INFO: `/` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:00:50.149337 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 737/1473] 10.222.0.59 () {54 vars in 962 bytes} [Thu Jun 2 16:00:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 16:00:50.153294 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f03886-6ed2-4849-a60d-9ce49e28816a None None] REQUEST_METHOD: `POST` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:00:50.153576 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f03886-6ed2-4849-a60d-9ce49e28816a None None] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:00:50.153852 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f03886-6ed2-4849-a60d-9ce49e28816a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:00:50.172239 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.auth.core [None req-d1f03886-6ed2-4849-a60d-9ce49e28816a None None] MFA Rules not processed for user `e673e7e0a4bf4c77bdb3e5325d0d3275`. Rule list: `[]` (Enabled: `True`). {{(pid=80395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 16:00:50.173730 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.fernet_utils [None req-d1f03886-6ed2-4849-a60d-9ce49e28816a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:00:50.180220 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 737/1474] 10.222.0.59 () {58 vars in 1059 bytes} [Thu Jun 2 16:00:50 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 16:00:50.188566 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b0925d8-642e-4b90-8f8d-fb35de7c250e None None] Authenticating user token {{(pid=80396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:00:50.200778 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b0925d8-642e-4b90-8f8d-fb35de7c250e None None] Validating token access rules against request {{(pid=80396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:00:50.204328 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-840bfe94-556e-4756-97f9-63878a65e3d5 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e673e7e0a4bf4c77bdb3e5325d0d3275', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c87c981909d4b8db02783421818c79b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:00:50.204983 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-840bfe94-556e-4756-97f9-63878a65e3d5 service glance] REQUEST_METHOD: `GET` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:00:50.205268 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-840bfe94-556e-4756-97f9-63878a65e3d5 service glance] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:00:50.205549 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-840bfe94-556e-4756-97f9-63878a65e3d5 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:00:50.215275 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-840bfe94-556e-4756-97f9-63878a65e3d5 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:00:50.216693 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-840bfe94-556e-4756-97f9-63878a65e3d5 service glance] RBAC: Authorization granted {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:00:50.226036 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 738/1475] 10.222.0.59 () {60 vars in 1365 bytes} [Thu Jun 2 16:00:50 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 02 16:00:52.547144 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b204e656-0724-4914-a523-4546bd07e11d None None] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:00:52.547676 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b204e656-0724-4914-a523-4546bd07e11d None None] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:00:52.547676 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b204e656-0724-4914-a523-4546bd07e11d None None] PATH_INFO: `/` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:00:52.548973 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 738/1476] 10.222.0.59 () {54 vars in 926 bytes} [Thu Jun 2 16:00:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 16:00:52.554245 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916e9815-1280-4577-8b12-619c56277a38 None None] REQUEST_METHOD: `POST` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:00:52.554680 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916e9815-1280-4577-8b12-619c56277a38 None None] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:00:52.554793 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916e9815-1280-4577-8b12-619c56277a38 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:00:52.574296 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.auth.core [None req-916e9815-1280-4577-8b12-619c56277a38 None None] MFA Rules not processed for user `400d1f4db9de49638549e5db29a041e1`. Rule list: `[]` (Enabled: `True`). {{(pid=80396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 16:00:52.575488 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.fernet_utils [None req-916e9815-1280-4577-8b12-619c56277a38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:00:52.583907 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 739/1477] 10.222.0.59 () {58 vars in 1023 bytes} [Thu Jun 2 16:00:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 16:00:52.608556 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b204e656-0724-4914-a523-4546bd07e11d None None] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:00:52.621421 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b204e656-0724-4914-a523-4546bd07e11d None None] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:00:52.630066 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed0a7515-2b6c-4170-a5a2-975e859fedf7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f73d5a98be74242b45222df39fb6213', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:00:52.630066 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0a7515-2b6c-4170-a5a2-975e859fedf7 admin admin] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:00:52.630066 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0a7515-2b6c-4170-a5a2-975e859fedf7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:00:52.630066 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0a7515-2b6c-4170-a5a2-975e859fedf7 admin admin] PATH_INFO: `/v3/projects` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:00:52.630464 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed0a7515-2b6c-4170-a5a2-975e859fedf7 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:00:52.630464 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: WARNING py.warnings [None req-ed0a7515-2b6c-4170-a5a2-975e859fedf7 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_projects": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 02 16:00:52.630464 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: warnings.warn(msg) Jun 02 16:00:52.630464 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: Jun 02 16:00:52.630799 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed0a7515-2b6c-4170-a5a2-975e859fedf7 admin admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:00:52.649578 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 739/1478] 10.222.0.59 () {56 vars in 1108 bytes} [Thu Jun 2 16:00:52 2022] GET /identity/v3/projects => generated 2553 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 16:00:54.907900 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317d97ea-3465-4dd0-9416-1888365a5964 None None] REQUEST_METHOD: `GET` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:00:54.908433 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317d97ea-3465-4dd0-9416-1888365a5964 None None] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:00:54.908433 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317d97ea-3465-4dd0-9416-1888365a5964 None None] PATH_INFO: `/` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:00:54.909734 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 740/1479] 10.222.0.59 () {54 vars in 926 bytes} [Thu Jun 2 16:00:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 16:00:54.915056 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10435aca-70ef-4feb-906f-3e135fbdff4e None None] REQUEST_METHOD: `POST` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:00:54.916072 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10435aca-70ef-4feb-906f-3e135fbdff4e None None] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:00:54.916178 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10435aca-70ef-4feb-906f-3e135fbdff4e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:00:54.934147 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.auth.core [None req-10435aca-70ef-4feb-906f-3e135fbdff4e None None] MFA Rules not processed for user `400d1f4db9de49638549e5db29a041e1`. Rule list: `[]` (Enabled: `True`). {{(pid=80395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 16:00:54.935338 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.fernet_utils [None req-10435aca-70ef-4feb-906f-3e135fbdff4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:00:54.943075 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 740/1480] 10.222.0.59 () {58 vars in 1023 bytes} [Thu Jun 2 16:00:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 16:00:54.986433 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-317d97ea-3465-4dd0-9416-1888365a5964 None None] Authenticating user token {{(pid=80396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:00:55.000737 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-317d97ea-3465-4dd0-9416-1888365a5964 None None] Validating token access rules against request {{(pid=80396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:00:55.005889 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90e3ed4d-75a7-4b75-b1bc-7809dfe2ffc7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52f9fe4b13574516bb0a8e2aa11a61e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c87c981909d4b8db02783421818c79b', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:00:55.006540 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e3ed4d-75a7-4b75-b1bc-7809dfe2ffc7 service nova] REQUEST_METHOD: `GET` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:00:55.006819 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e3ed4d-75a7-4b75-b1bc-7809dfe2ffc7 service nova] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:00:55.007093 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e3ed4d-75a7-4b75-b1bc-7809dfe2ffc7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:00:55.015127 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90e3ed4d-75a7-4b75-b1bc-7809dfe2ffc7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:00:55.016681 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90e3ed4d-75a7-4b75-b1bc-7809dfe2ffc7 service nova] RBAC: Authorization granted {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:00:55.025954 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 741/1481] 10.222.0.59 () {60 vars in 1365 bytes} [Thu Jun 2 16:00:54 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 16:00:57.463583 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f09adbc3-3263-4ac3-83df-950ec0f15e76 None None] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:00:57.464094 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f09adbc3-3263-4ac3-83df-950ec0f15e76 None None] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:00:57.464094 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f09adbc3-3263-4ac3-83df-950ec0f15e76 None None] PATH_INFO: `/` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:00:57.465410 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 741/1482] 10.222.0.59 () {54 vars in 926 bytes} [Thu Jun 2 16:00:57 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 16:00:57.470730 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe0b82e9-bf10-4c26-aea0-a6fa6efe407e None None] REQUEST_METHOD: `POST` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:00:57.471163 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe0b82e9-bf10-4c26-aea0-a6fa6efe407e None None] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:00:57.471358 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe0b82e9-bf10-4c26-aea0-a6fa6efe407e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:00:57.488749 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.auth.core [None req-fe0b82e9-bf10-4c26-aea0-a6fa6efe407e None None] MFA Rules not processed for user `400d1f4db9de49638549e5db29a041e1`. Rule list: `[]` (Enabled: `True`). {{(pid=80396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 16:00:57.489917 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.fernet_utils [None req-fe0b82e9-bf10-4c26-aea0-a6fa6efe407e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:00:57.498217 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 742/1483] 10.222.0.59 () {58 vars in 1023 bytes} [Thu Jun 2 16:00:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 16:00:57.534778 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f09adbc3-3263-4ac3-83df-950ec0f15e76 None None] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:00:57.545311 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f09adbc3-3263-4ac3-83df-950ec0f15e76 None None] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:00:57.548823 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4751b7eb-a70a-438f-ba7d-b6b88fa91381 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9af40ddfe9ff4be3887b068f13a28dc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c87c981909d4b8db02783421818c79b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:00:57.549453 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4751b7eb-a70a-438f-ba7d-b6b88fa91381 service neutron] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:00:57.549736 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4751b7eb-a70a-438f-ba7d-b6b88fa91381 service neutron] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:00:57.550015 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4751b7eb-a70a-438f-ba7d-b6b88fa91381 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:00:57.559334 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4751b7eb-a70a-438f-ba7d-b6b88fa91381 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:00:57.560765 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4751b7eb-a70a-438f-ba7d-b6b88fa91381 service neutron] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:00:57.570087 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 742/1484] 10.222.0.59 () {60 vars in 1365 bytes} [Thu Jun 2 16:00:57 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 16:00:59.837474 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5fe47ac-b0ac-41de-b2d8-565ca8e5d4cf None None] REQUEST_METHOD: `GET` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:00:59.838301 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5fe47ac-b0ac-41de-b2d8-565ca8e5d4cf None None] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:00:59.838301 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5fe47ac-b0ac-41de-b2d8-565ca8e5d4cf None None] PATH_INFO: `/` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:00:59.839684 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 743/1485] 10.222.0.59 () {54 vars in 926 bytes} [Thu Jun 2 16:00:59 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 16:00:59.844817 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3547dd5d-55bd-44df-ad40-f43af7586723 None None] REQUEST_METHOD: `POST` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:00:59.845264 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3547dd5d-55bd-44df-ad40-f43af7586723 None None] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:00:59.845434 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3547dd5d-55bd-44df-ad40-f43af7586723 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:00:59.864803 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.auth.core [None req-3547dd5d-55bd-44df-ad40-f43af7586723 None None] MFA Rules not processed for user `400d1f4db9de49638549e5db29a041e1`. Rule list: `[]` (Enabled: `True`). {{(pid=80395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 16:00:59.866043 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.fernet_utils [None req-3547dd5d-55bd-44df-ad40-f43af7586723 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:00:59.874214 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 743/1486] 10.222.0.59 () {58 vars in 1023 bytes} [Thu Jun 2 16:00:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 16:00:59.910946 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5fe47ac-b0ac-41de-b2d8-565ca8e5d4cf None None] Authenticating user token {{(pid=80396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:00:59.921951 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5fe47ac-b0ac-41de-b2d8-565ca8e5d4cf None None] Validating token access rules against request {{(pid=80396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:00:59.925393 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bd4f0d1-ae07-4b69-9a7d-9e2a2c3abcef service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9af40ddfe9ff4be3887b068f13a28dc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c87c981909d4b8db02783421818c79b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:00:59.926015 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd4f0d1-ae07-4b69-9a7d-9e2a2c3abcef service neutron] REQUEST_METHOD: `GET` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:00:59.926325 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd4f0d1-ae07-4b69-9a7d-9e2a2c3abcef service neutron] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:00:59.926602 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd4f0d1-ae07-4b69-9a7d-9e2a2c3abcef service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:00:59.935206 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bd4f0d1-ae07-4b69-9a7d-9e2a2c3abcef service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:00:59.936639 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bd4f0d1-ae07-4b69-9a7d-9e2a2c3abcef service neutron] RBAC: Authorization granted {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:00:59.945748 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 744/1487] 10.222.0.59 () {60 vars in 1365 bytes} [Thu Jun 2 16:00:59 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 16:01:02.346508 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1796337d-2856-4a5e-8420-c6a015324e69 None None] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:01:02.347137 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1796337d-2856-4a5e-8420-c6a015324e69 None None] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:01:02.347137 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1796337d-2856-4a5e-8420-c6a015324e69 None None] PATH_INFO: `/` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:01:02.348513 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 744/1488] 10.222.0.59 () {54 vars in 926 bytes} [Thu Jun 2 16:01:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 16:01:02.354224 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f405d1c-e283-439e-9156-5186d6be77e0 None None] REQUEST_METHOD: `POST` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:01:02.354669 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f405d1c-e283-439e-9156-5186d6be77e0 None None] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:01:02.354788 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f405d1c-e283-439e-9156-5186d6be77e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:01:02.371986 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.auth.core [None req-0f405d1c-e283-439e-9156-5186d6be77e0 None None] MFA Rules not processed for user `400d1f4db9de49638549e5db29a041e1`. Rule list: `[]` (Enabled: `True`). {{(pid=80396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 16:01:02.373162 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.fernet_utils [None req-0f405d1c-e283-439e-9156-5186d6be77e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:01:02.380942 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 745/1489] 10.222.0.59 () {58 vars in 1023 bytes} [Thu Jun 2 16:01:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 16:01:02.421143 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1796337d-2856-4a5e-8420-c6a015324e69 None None] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:01:02.431601 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1796337d-2856-4a5e-8420-c6a015324e69 None None] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:01:02.434939 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97c4cb14-00b2-4bee-8901-f856afbf86e1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9af40ddfe9ff4be3887b068f13a28dc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c87c981909d4b8db02783421818c79b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:01:02.435565 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c4cb14-00b2-4bee-8901-f856afbf86e1 service neutron] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:01:02.435843 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c4cb14-00b2-4bee-8901-f856afbf86e1 service neutron] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:01:02.436115 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c4cb14-00b2-4bee-8901-f856afbf86e1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:01:02.444725 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97c4cb14-00b2-4bee-8901-f856afbf86e1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:01:02.446799 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97c4cb14-00b2-4bee-8901-f856afbf86e1 service neutron] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:01:02.456075 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 745/1490] 10.222.0.59 () {60 vars in 1365 bytes} [Thu Jun 2 16:01:02 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 16:01:05.007889 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0be5465-b5e7-499f-8a9e-6e85f66841ea None None] REQUEST_METHOD: `GET` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:01:05.008583 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0be5465-b5e7-499f-8a9e-6e85f66841ea None None] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:01:05.008583 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0be5465-b5e7-499f-8a9e-6e85f66841ea None None] PATH_INFO: `/` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:01:05.009861 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 746/1491] 10.222.0.59 () {54 vars in 926 bytes} [Thu Jun 2 16:01:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 16:01:05.015000 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e4dda0-78b7-4f16-85f4-929849c44c61 None None] REQUEST_METHOD: `POST` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:01:05.015416 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e4dda0-78b7-4f16-85f4-929849c44c61 None None] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:01:05.015560 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e4dda0-78b7-4f16-85f4-929849c44c61 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:01:05.033479 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.auth.core [None req-d6e4dda0-78b7-4f16-85f4-929849c44c61 None None] MFA Rules not processed for user `400d1f4db9de49638549e5db29a041e1`. Rule list: `[]` (Enabled: `True`). {{(pid=80395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 16:01:05.034694 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.fernet_utils [None req-d6e4dda0-78b7-4f16-85f4-929849c44c61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:01:05.043009 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 746/1492] 10.222.0.59 () {58 vars in 1023 bytes} [Thu Jun 2 16:01:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 16:01:05.080686 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0be5465-b5e7-499f-8a9e-6e85f66841ea None None] Authenticating user token {{(pid=80396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:01:05.092263 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0be5465-b5e7-499f-8a9e-6e85f66841ea None None] Validating token access rules against request {{(pid=80396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:01:05.095761 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f32b309c-f5a5-44f8-b2ed-fb4f16d6b72a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9af40ddfe9ff4be3887b068f13a28dc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c87c981909d4b8db02783421818c79b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:01:05.096385 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f32b309c-f5a5-44f8-b2ed-fb4f16d6b72a service neutron] REQUEST_METHOD: `GET` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:01:05.096666 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f32b309c-f5a5-44f8-b2ed-fb4f16d6b72a service neutron] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:01:05.096938 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f32b309c-f5a5-44f8-b2ed-fb4f16d6b72a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:01:05.106603 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f32b309c-f5a5-44f8-b2ed-fb4f16d6b72a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:01:05.108022 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f32b309c-f5a5-44f8-b2ed-fb4f16d6b72a service neutron] RBAC: Authorization granted {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:01:05.117157 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 747/1493] 10.222.0.59 () {60 vars in 1365 bytes} [Thu Jun 2 16:01:05 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 16:01:15.028379 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writing DB stats keystone:SELECT=33 {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 16:01:15.113099 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG dbcounter [-] [80396] Writing DB stats keystone:SELECT=33 {{(pid=80396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 16:02:39.874413 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11b917b-3722-4384-8206-035d883bb525 None None] REQUEST_METHOD: `POST` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:02:39.875059 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11b917b-3722-4384-8206-035d883bb525 None None] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:02:39.875059 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11b917b-3722-4384-8206-035d883bb525 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:02:39.892549 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.auth.core [None req-a11b917b-3722-4384-8206-035d883bb525 None None] MFA Rules not processed for user `400d1f4db9de49638549e5db29a041e1`. Rule list: `[]` (Enabled: `True`). {{(pid=80395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 16:02:39.894444 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.fernet_utils [None req-a11b917b-3722-4384-8206-035d883bb525 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:02:39.902309 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 747/1494] 10.222.0.59 () {58 vars in 957 bytes} [Thu Jun 2 16:02:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 16:02:39.910789 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a86a3d-3599-4731-b67d-b6a351e814d6 None None] REQUEST_METHOD: `POST` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:02:39.911263 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a86a3d-3599-4731-b67d-b6a351e814d6 None None] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:02:39.911366 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a86a3d-3599-4731-b67d-b6a351e814d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:02:39.928581 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.auth.core [None req-50a86a3d-3599-4731-b67d-b6a351e814d6 None None] MFA Rules not processed for user `400d1f4db9de49638549e5db29a041e1`. Rule list: `[]` (Enabled: `True`). {{(pid=80396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 16:02:39.929743 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.fernet_utils [None req-50a86a3d-3599-4731-b67d-b6a351e814d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:02:39.937322 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 748/1495] 10.222.0.59 () {58 vars in 957 bytes} [Thu Jun 2 16:02:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 16:02:39.943054 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a11b917b-3722-4384-8206-035d883bb525 None None] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:02:39.952631 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a11b917b-3722-4384-8206-035d883bb525 None None] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:02:39.958286 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b393f0be-8205-4f35-ba26-c4abb9a53bad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f73d5a98be74242b45222df39fb6213', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:02:39.958931 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b393f0be-8205-4f35-ba26-c4abb9a53bad admin admin] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:02:39.959217 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b393f0be-8205-4f35-ba26-c4abb9a53bad admin admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:02:39.959496 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b393f0be-8205-4f35-ba26-c4abb9a53bad admin admin] PATH_INFO: `/v3/domains` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:02:39.960215 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b393f0be-8205-4f35-ba26-c4abb9a53bad admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80395) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 16:02:39.960519 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b393f0be-8205-4f35-ba26-c4abb9a53bad admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:02:39.961866 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: WARNING py.warnings [None req-b393f0be-8205-4f35-ba26-c4abb9a53bad admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 02 16:02:39.961866 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: warnings.warn(msg) Jun 02 16:02:39.961866 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: Jun 02 16:02:39.962768 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b393f0be-8205-4f35-ba26-c4abb9a53bad admin admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:02:39.974903 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 748/1496] 10.222.0.59 () {58 vars in 1152 bytes} [Thu Jun 2 16:02:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 16:02:39.982894 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50a86a3d-3599-4731-b67d-b6a351e814d6 None None] Authenticating user token {{(pid=80396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:02:39.991993 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50a86a3d-3599-4731-b67d-b6a351e814d6 None None] Validating token access rules against request {{(pid=80396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:02:39.996497 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6ff45e3-3024-46dd-b406-8bd38c429361 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f73d5a98be74242b45222df39fb6213', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:02:39.997136 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ff45e3-3024-46dd-b406-8bd38c429361 admin admin] REQUEST_METHOD: `POST` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:02:39.997412 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ff45e3-3024-46dd-b406-8bd38c429361 admin admin] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:02:39.997683 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ff45e3-3024-46dd-b406-8bd38c429361 admin admin] PATH_INFO: `/v3/projects` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:02:39.998403 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6ff45e3-3024-46dd-b406-8bd38c429361 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:02:40.000226 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: WARNING py.warnings [None req-c6ff45e3-3024-46dd-b406-8bd38c429361 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 02 16:02:40.000226 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: warnings.warn(msg) Jun 02 16:02:40.000226 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: Jun 02 16:02:40.001403 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6ff45e3-3024-46dd-b406-8bd38c429361 admin admin] RBAC: Authorization granted {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:02:40.119619 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 749/1497] 10.222.0.59 () {60 vars in 1152 bytes} [Thu Jun 2 16:02:39 2022] POST /identity/v3/projects => generated 377 bytes in 137 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 02 16:02:40.123804 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b393f0be-8205-4f35-ba26-c4abb9a53bad admin admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:02:40.134624 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b393f0be-8205-4f35-ba26-c4abb9a53bad admin admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:02:40.191444 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-806f27b5-8b1c-4b13-83f9-5a8e33922e0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f73d5a98be74242b45222df39fb6213', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:02:40.192115 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-806f27b5-8b1c-4b13-83f9-5a8e33922e0e admin admin] REQUEST_METHOD: `POST` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:02:40.192399 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-806f27b5-8b1c-4b13-83f9-5a8e33922e0e admin admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:02:40.192674 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-806f27b5-8b1c-4b13-83f9-5a8e33922e0e admin admin] PATH_INFO: `/v3/users` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:02:40.193359 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-806f27b5-8b1c-4b13-83f9-5a8e33922e0e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:02:40.194435 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: WARNING py.warnings [None req-806f27b5-8b1c-4b13-83f9-5a8e33922e0e admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 02 16:02:40.194435 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: warnings.warn(msg) Jun 02 16:02:40.194435 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: Jun 02 16:02:40.195693 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-806f27b5-8b1c-4b13-83f9-5a8e33922e0e admin admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:02:40.272493 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 749/1498] 10.222.0.59 () {60 vars in 1143 bytes} [Thu Jun 2 16:02:40 2022] POST /identity/v3/users => generated 289 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 16:02:40.276706 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6ff45e3-3024-46dd-b406-8bd38c429361 admin admin] Authenticating user token {{(pid=80396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:02:40.286813 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6ff45e3-3024-46dd-b406-8bd38c429361 admin admin] Validating token access rules against request {{(pid=80396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:02:40.291260 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08d9be13-dd77-4483-8f70-7201b6adf3a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f73d5a98be74242b45222df39fb6213', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:02:40.291906 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d9be13-dd77-4483-8f70-7201b6adf3a3 admin admin] REQUEST_METHOD: `GET` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:02:40.292187 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d9be13-dd77-4483-8f70-7201b6adf3a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:02:40.292461 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d9be13-dd77-4483-8f70-7201b6adf3a3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:02:40.293178 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08d9be13-dd77-4483-8f70-7201b6adf3a3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:02:40.294215 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: WARNING py.warnings [None req-08d9be13-dd77-4483-8f70-7201b6adf3a3 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 02 16:02:40.294215 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: warnings.warn(msg) Jun 02 16:02:40.294215 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: Jun 02 16:02:40.295089 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08d9be13-dd77-4483-8f70-7201b6adf3a3 admin admin] RBAC: Authorization granted {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:02:40.307679 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 750/1499] 10.222.0.59 () {58 vars in 1121 bytes} [Thu Jun 2 16:02:40 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 16:02:40.311528 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-806f27b5-8b1c-4b13-83f9-5a8e33922e0e admin admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:02:40.321640 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-806f27b5-8b1c-4b13-83f9-5a8e33922e0e admin admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:02:40.326060 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fda00944-ad03-4103-b374-ae6353a18342 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f73d5a98be74242b45222df39fb6213', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:02:40.326732 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda00944-ad03-4103-b374-ae6353a18342 admin admin] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:02:40.327014 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda00944-ad03-4103-b374-ae6353a18342 admin admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:02:40.327288 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda00944-ad03-4103-b374-ae6353a18342 admin admin] PATH_INFO: `/v3/roles` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:02:40.328004 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fda00944-ad03-4103-b374-ae6353a18342 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:02:40.329011 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: WARNING py.warnings [None req-fda00944-ad03-4103-b374-ae6353a18342 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 02 16:02:40.329011 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: warnings.warn(msg) Jun 02 16:02:40.329011 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: Jun 02 16:02:40.329881 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fda00944-ad03-4103-b374-ae6353a18342 admin admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:02:40.343024 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 750/1500] 10.222.0.59 () {58 vars in 1121 bytes} [Thu Jun 2 16:02:40 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 16:02:40.347078 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08d9be13-dd77-4483-8f70-7201b6adf3a3 admin admin] Authenticating user token {{(pid=80396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:02:40.356904 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08d9be13-dd77-4483-8f70-7201b6adf3a3 admin admin] Validating token access rules against request {{(pid=80396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:02:40.361337 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7013510d-b15c-494c-9909-92352325d756 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f73d5a98be74242b45222df39fb6213', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:02:40.362759 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7013510d-b15c-494c-9909-92352325d756 admin admin] REQUEST_METHOD: `PUT` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:02:40.363038 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7013510d-b15c-494c-9909-92352325d756 admin admin] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:02:40.363311 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7013510d-b15c-494c-9909-92352325d756 admin admin] PATH_INFO: `/v3/projects/24b73b0b463946e59c6a6c29c4713b67/users/15e0ac58cdaf4026a48fdf16f91b1f7a/roles/649e0f2b5a264c419ea6a1441f123a03` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:02:40.378050 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7013510d-b15c-494c-9909-92352325d756 admin admin] RBAC: Authorizing `identity:create_grant(project_id=24b73b0b463946e59c6a6c29c4713b67, user_id=15e0ac58cdaf4026a48fdf16f91b1f7a, role_id=649e0f2b5a264c419ea6a1441f123a03)` {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:02:40.379194 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: WARNING py.warnings [None req-7013510d-b15c-494c-9909-92352325d756 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 02 16:02:40.379194 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: warnings.warn(msg) Jun 02 16:02:40.379194 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: Jun 02 16:02:40.381106 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7013510d-b15c-494c-9909-92352325d756 admin admin] RBAC: Authorization granted {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:02:40.454669 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 751/1501] 10.222.0.59 () {60 vars in 1482 bytes} [Thu Jun 2 16:02:40 2022] PUT /identity/v3/projects/24b73b0b463946e59c6a6c29c4713b67/users/15e0ac58cdaf4026a48fdf16f91b1f7a/roles/649e0f2b5a264c419ea6a1441f123a03 => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 02 16:02:40.466932 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f29cf4-7222-455d-a095-412377b7b3b5 None None] REQUEST_METHOD: `POST` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:02:40.467220 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f29cf4-7222-455d-a095-412377b7b3b5 None None] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:02:40.467497 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f29cf4-7222-455d-a095-412377b7b3b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:02:40.493827 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.auth.core [None req-42f29cf4-7222-455d-a095-412377b7b3b5 None None] MFA Rules not processed for user `15e0ac58cdaf4026a48fdf16f91b1f7a`. Rule list: `[]` (Enabled: `True`). {{(pid=80395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 16:02:40.506144 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.fernet_utils [None req-42f29cf4-7222-455d-a095-412377b7b3b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:02:40.556709 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 751/1502] 10.222.0.59 () {58 vars in 957 bytes} [Thu Jun 2 16:02:40 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 16:02:40.571256 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7d8893-1471-4c72-b2d1-7887345fe6d0 None None] REQUEST_METHOD: `GET` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:02:40.571546 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7d8893-1471-4c72-b2d1-7887345fe6d0 None None] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:02:40.571824 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7d8893-1471-4c72-b2d1-7887345fe6d0 None None] PATH_INFO: `/` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:02:40.573202 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 752/1503] 10.222.0.59 () {54 vars in 963 bytes} [Thu Jun 2 16:02:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 16:02:40.578067 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f1137b-5f82-436b-8fa6-fca961b6cf35 None None] REQUEST_METHOD: `POST` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:02:40.578387 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f1137b-5f82-436b-8fa6-fca961b6cf35 None None] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:02:40.578670 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f1137b-5f82-436b-8fa6-fca961b6cf35 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:02:40.596867 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.auth.core [None req-94f1137b-5f82-436b-8fa6-fca961b6cf35 None None] MFA Rules not processed for user `6534961c369940a5b88f310c6450250b`. Rule list: `[]` (Enabled: `True`). {{(pid=80395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 16:02:40.598041 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.fernet_utils [None req-94f1137b-5f82-436b-8fa6-fca961b6cf35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:02:40.641085 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 16:02:40.648657 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 752/1504] 10.222.0.59 () {58 vars in 1060 bytes} [Thu Jun 2 16:02:40 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 71 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 16:02:40.656497 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db7d8893-1471-4c72-b2d1-7887345fe6d0 None None] Authenticating user token {{(pid=80396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:02:40.668806 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db7d8893-1471-4c72-b2d1-7887345fe6d0 None None] Validating token access rules against request {{(pid=80396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:02:40.672265 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e11450ac-c996-4462-9ab3-405f93e24100 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6534961c369940a5b88f310c6450250b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c87c981909d4b8db02783421818c79b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:02:40.672885 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11450ac-c996-4462-9ab3-405f93e24100 service cinder] REQUEST_METHOD: `GET` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:02:40.673171 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11450ac-c996-4462-9ab3-405f93e24100 service cinder] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:02:40.673432 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11450ac-c996-4462-9ab3-405f93e24100 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:02:40.682241 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e11450ac-c996-4462-9ab3-405f93e24100 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:02:40.683764 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e11450ac-c996-4462-9ab3-405f93e24100 service cinder] RBAC: Authorization granted {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:02:40.692936 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 753/1505] 10.222.0.59 () {60 vars in 1365 bytes} [Thu Jun 2 16:02:40 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 16:02:40.740416 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e7980f6-21bd-42e8-b9de-c40654a27de8 None None] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:02:40.740707 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e7980f6-21bd-42e8-b9de-c40654a27de8 None None] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:02:40.740988 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e7980f6-21bd-42e8-b9de-c40654a27de8 None None] PATH_INFO: `/` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:02:40.742301 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 753/1506] 10.222.0.59 () {52 vars in 829 bytes} [Thu Jun 2 16:02:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 16:02:40.745840 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e11450ac-c996-4462-9ab3-405f93e24100 service cinder] Authenticating user token {{(pid=80396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:02:40.828420 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e11450ac-c996-4462-9ab3-405f93e24100 service cinder] Validating token access rules against request {{(pid=80396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:02:40.832909 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-905f8cea-e4e6-441e-abec-8f9eecb10bd2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f73d5a98be74242b45222df39fb6213', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:02:40.833767 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905f8cea-e4e6-441e-abec-8f9eecb10bd2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:02:40.834044 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905f8cea-e4e6-441e-abec-8f9eecb10bd2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:02:40.834348 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905f8cea-e4e6-441e-abec-8f9eecb10bd2 admin admin] PATH_INFO: `/v3/users/15e0ac58cdaf4026a48fdf16f91b1f7a` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:02:40.835513 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-905f8cea-e4e6-441e-abec-8f9eecb10bd2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=15e0ac58cdaf4026a48fdf16f91b1f7a)` {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:02:40.836769 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: WARNING py.warnings [None req-905f8cea-e4e6-441e-abec-8f9eecb10bd2 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 02 16:02:40.836769 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: warnings.warn(msg) Jun 02 16:02:40.836769 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: Jun 02 16:02:40.837952 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-905f8cea-e4e6-441e-abec-8f9eecb10bd2 admin admin] RBAC: Authorization granted {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:02:41.020563 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.notifications [None req-905f8cea-e4e6-441e-abec-8f9eecb10bd2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '15e0ac58cdaf4026a48fdf16f91b1f7a'} {{(pid=80396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:02:41.021199 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.notifications [None req-905f8cea-e4e6-441e-abec-8f9eecb10bd2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '15e0ac58cdaf4026a48fdf16f91b1f7a'} {{(pid=80396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:02:41.111756 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.notifications [None req-905f8cea-e4e6-441e-abec-8f9eecb10bd2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '15e0ac58cdaf4026a48fdf16f91b1f7a'} {{(pid=80396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:02:41.130396 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.notifications [None req-905f8cea-e4e6-441e-abec-8f9eecb10bd2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '15e0ac58cdaf4026a48fdf16f91b1f7a'} {{(pid=80396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:02:41.138281 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG dbcounter [-] [80396] Writing DB stats keystone:SELECT=87,keystone:INSERT=3,keystone:DELETE=10 {{(pid=80396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 16:02:41.145253 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.notifications [None req-905f8cea-e4e6-441e-abec-8f9eecb10bd2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '15e0ac58cdaf4026a48fdf16f91b1f7a'} {{(pid=80396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:02:41.151348 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 754/1507] 10.222.0.59 () {58 vars in 1223 bytes} [Thu Jun 2 16:02:40 2022] DELETE /identity/v3/users/15e0ac58cdaf4026a48fdf16f91b1f7a => generated 0 bytes in 406 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 02 16:02:41.155703 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebdd1a2d-043c-4dff-9fe1-e16fab9c0e23 None None] REQUEST_METHOD: `POST` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:02:41.156207 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebdd1a2d-043c-4dff-9fe1-e16fab9c0e23 None None] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:02:41.156321 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebdd1a2d-043c-4dff-9fe1-e16fab9c0e23 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:02:41.174240 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.auth.core [None req-ebdd1a2d-043c-4dff-9fe1-e16fab9c0e23 None None] MFA Rules not processed for user `400d1f4db9de49638549e5db29a041e1`. Rule list: `[]` (Enabled: `True`). {{(pid=80395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 16:02:41.175621 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.fernet_utils [None req-ebdd1a2d-043c-4dff-9fe1-e16fab9c0e23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:02:41.237347 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 754/1508] 10.222.0.59 () {58 vars in 957 bytes} [Thu Jun 2 16:02:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 16:02:41.246859 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-905f8cea-e4e6-441e-abec-8f9eecb10bd2 admin admin] Authenticating user token {{(pid=80396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:02:41.248259 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.fernet_utils [None req-905f8cea-e4e6-441e-abec-8f9eecb10bd2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:02:41.303486 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-905f8cea-e4e6-441e-abec-8f9eecb10bd2 admin admin] Validating token access rules against request {{(pid=80396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:02:41.306903 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4127adf-3334-4e71-b94b-329ea16e0878 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9af40ddfe9ff4be3887b068f13a28dc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c87c981909d4b8db02783421818c79b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:02:41.307539 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4127adf-3334-4e71-b94b-329ea16e0878 service neutron] REQUEST_METHOD: `GET` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:02:41.307819 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4127adf-3334-4e71-b94b-329ea16e0878 service neutron] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:02:41.308092 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4127adf-3334-4e71-b94b-329ea16e0878 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:02:41.316743 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4127adf-3334-4e71-b94b-329ea16e0878 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:02:41.318191 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4127adf-3334-4e71-b94b-329ea16e0878 service neutron] RBAC: Authorization granted {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:02:41.327264 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 755/1509] 10.222.0.59 () {60 vars in 1365 bytes} [Thu Jun 2 16:02:41 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 16:02:41.770725 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebdd1a2d-043c-4dff-9fe1-e16fab9c0e23 None None] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:02:41.772153 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.fernet_utils [None req-ebdd1a2d-043c-4dff-9fe1-e16fab9c0e23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:02:41.785323 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebdd1a2d-043c-4dff-9fe1-e16fab9c0e23 None None] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:02:41.790016 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a9a3a09-32af-490b-8d67-abc554a39146 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f73d5a98be74242b45222df39fb6213', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:02:41.790931 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a9a3a09-32af-490b-8d67-abc554a39146 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:02:41.791216 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a9a3a09-32af-490b-8d67-abc554a39146 admin admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:02:41.791493 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a9a3a09-32af-490b-8d67-abc554a39146 admin admin] PATH_INFO: `/v3/projects/24b73b0b463946e59c6a6c29c4713b67` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:02:41.792683 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a9a3a09-32af-490b-8d67-abc554a39146 admin admin] RBAC: Authorizing `identity:delete_project(project_id=24b73b0b463946e59c6a6c29c4713b67)` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:02:41.793768 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: WARNING py.warnings [None req-0a9a3a09-32af-490b-8d67-abc554a39146 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 02 16:02:41.793768 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: warnings.warn(msg) Jun 02 16:02:41.793768 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: Jun 02 16:02:41.794994 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a9a3a09-32af-490b-8d67-abc554a39146 admin admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:02:41.892992 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.notifications [None req-0a9a3a09-32af-490b-8d67-abc554a39146 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '24b73b0b463946e59c6a6c29c4713b67', 'request_id': 'req-0a9a3a09-32af-490b-8d67-abc554a39146'} {{(pid=80395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:02:41.905847 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.notifications [None req-0a9a3a09-32af-490b-8d67-abc554a39146 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '24b73b0b463946e59c6a6c29c4713b67', 'request_id': 'req-0a9a3a09-32af-490b-8d67-abc554a39146'} {{(pid=80395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:02:41.951691 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.notifications [None req-0a9a3a09-32af-490b-8d67-abc554a39146 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '24b73b0b463946e59c6a6c29c4713b67', 'request_id': 'req-0a9a3a09-32af-490b-8d67-abc554a39146'} {{(pid=80395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:02:41.963285 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.notifications [None req-0a9a3a09-32af-490b-8d67-abc554a39146 admin admin] The token cache is being invalidate because project 24b73b0b463946e59c6a6c29c4713b67 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80395) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 02 16:02:41.963577 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.notifications [None req-0a9a3a09-32af-490b-8d67-abc554a39146 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:02:41.964306 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.notifications [None req-0a9a3a09-32af-490b-8d67-abc554a39146 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:02:41.965849 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 755/1510] 10.222.0.59 () {58 vars in 1232 bytes} [Thu Jun 2 16:02:41 2022] DELETE /identity/v3/projects/24b73b0b463946e59c6a6c29c4713b67 => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 16:02:51.323233 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG dbcounter [-] [80396] Writing DB stats keystone:SELECT=29 {{(pid=80396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 16:02:51.959921 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writing DB stats keystone:SELECT=55,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 16:04:20.994448 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ff3a47-ad94-4376-bf02-29118b362102 None None] REQUEST_METHOD: `GET` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:04:20.995044 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ff3a47-ad94-4376-bf02-29118b362102 None None] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:04:20.995044 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ff3a47-ad94-4376-bf02-29118b362102 None None] PATH_INFO: `/` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:04:20.996391 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 756/1511] 127.0.0.1 () {54 vars in 901 bytes} [Thu Jun 2 16:04:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 16:04:21.001900 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f726b4e1-7caa-44be-8d40-05ea624bc056 None None] REQUEST_METHOD: `POST` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:04:21.002353 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f726b4e1-7caa-44be-8d40-05ea624bc056 None None] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:04:21.002455 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f726b4e1-7caa-44be-8d40-05ea624bc056 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:04:21.020212 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.auth.core [None req-f726b4e1-7caa-44be-8d40-05ea624bc056 None None] MFA Rules not processed for user `400d1f4db9de49638549e5db29a041e1`. Rule list: `[]` (Enabled: `True`). {{(pid=80395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 16:04:21.021383 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.fernet_utils [None req-f726b4e1-7caa-44be-8d40-05ea624bc056 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:04:21.081724 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 756/1512] 127.0.0.1 () {58 vars in 998 bytes} [Thu Jun 2 16:04:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 16:04:21.254025 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3ff3a47-ad94-4376-bf02-29118b362102 None None] Authenticating user token {{(pid=80396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:04:21.255748 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.fernet_utils [None req-e3ff3a47-ad94-4376-bf02-29118b362102 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:04:21.332988 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3ff3a47-ad94-4376-bf02-29118b362102 None None] Validating token access rules against request {{(pid=80396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:04:21.338537 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-074d5b92-0269-4048-8df4-762fff6d69a1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52f9fe4b13574516bb0a8e2aa11a61e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c87c981909d4b8db02783421818c79b', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:04:21.339176 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-074d5b92-0269-4048-8df4-762fff6d69a1 service nova] REQUEST_METHOD: `GET` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:04:21.339457 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-074d5b92-0269-4048-8df4-762fff6d69a1 service nova] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:04:21.339730 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-074d5b92-0269-4048-8df4-762fff6d69a1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:04:21.347770 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-074d5b92-0269-4048-8df4-762fff6d69a1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:04:21.349334 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-074d5b92-0269-4048-8df4-762fff6d69a1 service nova] RBAC: Authorization granted {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:04:21.358534 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 757/1513] 10.222.0.59 () {60 vars in 1365 bytes} [Thu Jun 2 16:04:21 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 16:04:22.234050 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8190e75b-008b-49c4-8af0-7efc48bcefd5 None None] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:04:22.234662 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8190e75b-008b-49c4-8af0-7efc48bcefd5 None None] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:04:22.235198 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8190e75b-008b-49c4-8af0-7efc48bcefd5 None None] PATH_INFO: `/` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:04:22.237004 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 757/1514] 127.0.0.1 () {54 vars in 901 bytes} [Thu Jun 2 16:04:22 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 16:04:22.241758 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e8be8a9-f7b8-46ed-abab-f1a0933df880 None None] REQUEST_METHOD: `POST` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:04:22.242195 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e8be8a9-f7b8-46ed-abab-f1a0933df880 None None] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:04:22.242390 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e8be8a9-f7b8-46ed-abab-f1a0933df880 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:04:22.260741 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.auth.core [None req-0e8be8a9-f7b8-46ed-abab-f1a0933df880 None None] MFA Rules not processed for user `400d1f4db9de49638549e5db29a041e1`. Rule list: `[]` (Enabled: `True`). {{(pid=80396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 16:04:22.261946 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.fernet_utils [None req-0e8be8a9-f7b8-46ed-abab-f1a0933df880 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:04:22.270272 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 758/1515] 127.0.0.1 () {58 vars in 998 bytes} [Thu Jun 2 16:04:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 16:04:22.425089 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8190e75b-008b-49c4-8af0-7efc48bcefd5 None None] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:04:22.439039 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8190e75b-008b-49c4-8af0-7efc48bcefd5 None None] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:04:22.444256 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15949b85-8505-471b-85f8-0098dc974580 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52f9fe4b13574516bb0a8e2aa11a61e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c87c981909d4b8db02783421818c79b', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:04:22.444879 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15949b85-8505-471b-85f8-0098dc974580 service nova] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:04:22.445157 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15949b85-8505-471b-85f8-0098dc974580 service nova] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:04:22.445431 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15949b85-8505-471b-85f8-0098dc974580 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:04:22.453797 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15949b85-8505-471b-85f8-0098dc974580 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:04:22.455606 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15949b85-8505-471b-85f8-0098dc974580 service nova] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:04:22.465076 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 758/1516] 10.222.0.59 () {60 vars in 1365 bytes} [Thu Jun 2 16:04:22 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 16:04:22.684762 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d208600b-379b-43eb-832f-d1ec924a33e7 None None] REQUEST_METHOD: `GET` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:04:22.684972 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d208600b-379b-43eb-832f-d1ec924a33e7 None None] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:04:22.685238 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d208600b-379b-43eb-832f-d1ec924a33e7 None None] PATH_INFO: `/v3` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:04:22.686640 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 759/1517] 10.222.0.65 () {54 vars in 925 bytes} [Thu Jun 2 16:04:22 2022] GET /identity/v3 => generated 255 bytes in 3 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 16:04:22.693489 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0863340a-fc20-4bf9-88d7-0edc759578ac None None] REQUEST_METHOD: `POST` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:04:22.693779 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0863340a-fc20-4bf9-88d7-0edc759578ac None None] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:04:22.694053 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0863340a-fc20-4bf9-88d7-0edc759578ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:04:22.713215 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.auth.core [None req-0863340a-fc20-4bf9-88d7-0edc759578ac None None] MFA Rules not processed for user `2b700f6d94374ba4b362a8f0d5b35796`. Rule list: `[]` (Enabled: `True`). {{(pid=80395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 16:04:22.714788 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.fernet_utils [None req-0863340a-fc20-4bf9-88d7-0edc759578ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:04:22.776157 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 759/1518] 10.222.0.65 () {58 vars in 1015 bytes} [Thu Jun 2 16:04:22 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 16:04:32.255563 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG dbcounter [-] [80396] Writing DB stats keystone:SELECT=37 {{(pid=80396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 16:04:32.340038 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8132ef49-2907-4cd9-84be-0c69c1af47b3 None None] REQUEST_METHOD: `GET` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:04:32.340324 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8132ef49-2907-4cd9-84be-0c69c1af47b3 None None] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:04:32.340600 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8132ef49-2907-4cd9-84be-0c69c1af47b3 None None] PATH_INFO: `/` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:04:32.341988 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 760/1519] 10.222.0.59 () {54 vars in 960 bytes} [Thu Jun 2 16:04:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 16:04:32.347170 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf050e0a-9871-44ac-8bab-39607ed3c22c None None] REQUEST_METHOD: `POST` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:04:32.347647 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf050e0a-9871-44ac-8bab-39607ed3c22c None None] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:04:32.347754 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf050e0a-9871-44ac-8bab-39607ed3c22c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:04:32.365484 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.auth.core [None req-cf050e0a-9871-44ac-8bab-39607ed3c22c None None] MFA Rules not processed for user `2b700f6d94374ba4b362a8f0d5b35796`. Rule list: `[]` (Enabled: `True`). {{(pid=80395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 16:04:32.366692 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.fernet_utils [None req-cf050e0a-9871-44ac-8bab-39607ed3c22c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:04:32.375806 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 760/1520] 10.222.0.59 () {58 vars in 1057 bytes} [Thu Jun 2 16:04:32 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 16:04:32.383157 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8132ef49-2907-4cd9-84be-0c69c1af47b3 None None] Authenticating user token {{(pid=80396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:04:32.397511 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8132ef49-2907-4cd9-84be-0c69c1af47b3 None None] Validating token access rules against request {{(pid=80396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:04:32.402501 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20b28ea9-2081-418f-bbd4-d291eee2528a service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b700f6d94374ba4b362a8f0d5b35796', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c87c981909d4b8db02783421818c79b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:04:32.403129 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b28ea9-2081-418f-bbd4-d291eee2528a service placement] REQUEST_METHOD: `GET` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:04:32.403415 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b28ea9-2081-418f-bbd4-d291eee2528a service placement] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:04:32.403695 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b28ea9-2081-418f-bbd4-d291eee2528a service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:04:32.412543 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20b28ea9-2081-418f-bbd4-d291eee2528a service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:04:32.414169 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20b28ea9-2081-418f-bbd4-d291eee2528a service placement] RBAC: Authorization granted {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:04:32.424269 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 761/1521] 10.222.0.59 () {60 vars in 1365 bytes} [Thu Jun 2 16:04:32 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 16:04:33.780939 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a3c40cd-dab8-48b1-b16e-3195508769a8 None None] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:04:33.781650 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a3c40cd-dab8-48b1-b16e-3195508769a8 None None] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:04:33.781650 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a3c40cd-dab8-48b1-b16e-3195508769a8 None None] PATH_INFO: `/` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:04:33.783002 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 761/1522] 127.0.0.1 () {54 vars in 901 bytes} [Thu Jun 2 16:04:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 16:04:33.787786 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02da825c-0ede-4cc2-8ddf-8f332b74a63a None None] REQUEST_METHOD: `POST` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:04:33.788192 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02da825c-0ede-4cc2-8ddf-8f332b74a63a None None] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:04:33.788345 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02da825c-0ede-4cc2-8ddf-8f332b74a63a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:04:33.806480 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.auth.core [None req-02da825c-0ede-4cc2-8ddf-8f332b74a63a None None] MFA Rules not processed for user `400d1f4db9de49638549e5db29a041e1`. Rule list: `[]` (Enabled: `True`). {{(pid=80396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 16:04:33.807646 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.fernet_utils [None req-02da825c-0ede-4cc2-8ddf-8f332b74a63a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:04:33.816333 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 762/1523] 127.0.0.1 () {58 vars in 998 bytes} [Thu Jun 2 16:04:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 16:04:33.969397 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a3c40cd-dab8-48b1-b16e-3195508769a8 None None] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:04:33.983759 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a3c40cd-dab8-48b1-b16e-3195508769a8 None None] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:04:33.989703 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f439a82-52d8-4d05-8a74-f909cd3357d2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52f9fe4b13574516bb0a8e2aa11a61e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c87c981909d4b8db02783421818c79b', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:04:33.990356 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f439a82-52d8-4d05-8a74-f909cd3357d2 service nova] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:04:33.990637 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f439a82-52d8-4d05-8a74-f909cd3357d2 service nova] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:04:33.990907 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f439a82-52d8-4d05-8a74-f909cd3357d2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:04:33.998893 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f439a82-52d8-4d05-8a74-f909cd3357d2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:04:34.000529 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f439a82-52d8-4d05-8a74-f909cd3357d2 service nova] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:04:34.009716 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 762/1524] 10.222.0.59 () {60 vars in 1365 bytes} [Thu Jun 2 16:04:33 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 16:04:34.919845 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2f8fd6-051f-4228-814e-c522d38d56b6 None None] REQUEST_METHOD: `GET` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:04:34.920453 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2f8fd6-051f-4228-814e-c522d38d56b6 None None] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:04:34.920453 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2f8fd6-051f-4228-814e-c522d38d56b6 None None] PATH_INFO: `/` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:04:34.921811 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 763/1525] 127.0.0.1 () {54 vars in 901 bytes} [Thu Jun 2 16:04:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 16:04:34.927446 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751ee3f9-2241-447b-a963-da40dae164f0 None None] REQUEST_METHOD: `POST` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:04:34.927863 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751ee3f9-2241-447b-a963-da40dae164f0 None None] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:04:34.928009 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751ee3f9-2241-447b-a963-da40dae164f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:04:34.946122 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.auth.core [None req-751ee3f9-2241-447b-a963-da40dae164f0 None None] MFA Rules not processed for user `400d1f4db9de49638549e5db29a041e1`. Rule list: `[]` (Enabled: `True`). {{(pid=80395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 16:04:34.947319 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.fernet_utils [None req-751ee3f9-2241-447b-a963-da40dae164f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:04:34.955719 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 763/1526] 127.0.0.1 () {58 vars in 998 bytes} [Thu Jun 2 16:04:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 16:04:35.106195 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc2f8fd6-051f-4228-814e-c522d38d56b6 None None] Authenticating user token {{(pid=80396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:04:35.120265 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc2f8fd6-051f-4228-814e-c522d38d56b6 None None] Validating token access rules against request {{(pid=80396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:04:35.125879 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53d557e3-d5c6-46cb-8bf5-a0b835b329a1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52f9fe4b13574516bb0a8e2aa11a61e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c87c981909d4b8db02783421818c79b', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:04:35.126550 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d557e3-d5c6-46cb-8bf5-a0b835b329a1 service nova] REQUEST_METHOD: `GET` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:04:35.126834 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d557e3-d5c6-46cb-8bf5-a0b835b329a1 service nova] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:04:35.127112 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d557e3-d5c6-46cb-8bf5-a0b835b329a1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:04:35.135350 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53d557e3-d5c6-46cb-8bf5-a0b835b329a1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:04:35.136957 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53d557e3-d5c6-46cb-8bf5-a0b835b329a1 service nova] RBAC: Authorization granted {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:04:35.147512 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 764/1527] 10.222.0.59 () {60 vars in 1365 bytes} [Thu Jun 2 16:04:35 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 16:04:39.363782 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ab8d1b-82f0-4417-ab1f-23703b4f1e3b None None] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:04:39.364379 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ab8d1b-82f0-4417-ab1f-23703b4f1e3b None None] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:04:39.364379 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ab8d1b-82f0-4417-ab1f-23703b4f1e3b None None] PATH_INFO: `/` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:04:39.365715 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 764/1528] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jun 2 16:04:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 02 16:04:39.371065 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a52e7ad-8662-4afd-9dc7-16ca3070b4b1 None None] REQUEST_METHOD: `POST` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:04:39.371502 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a52e7ad-8662-4afd-9dc7-16ca3070b4b1 None None] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:04:39.371605 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a52e7ad-8662-4afd-9dc7-16ca3070b4b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:04:39.389572 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.auth.core [None req-5a52e7ad-8662-4afd-9dc7-16ca3070b4b1 None None] MFA Rules not processed for user `400d1f4db9de49638549e5db29a041e1`. Rule list: `[]` (Enabled: `True`). {{(pid=80396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 16:04:39.390787 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.fernet_utils [None req-5a52e7ad-8662-4afd-9dc7-16ca3070b4b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:04:39.398320 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 765/1529] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jun 2 16:04:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 16:04:39.434986 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02ab8d1b-82f0-4417-ab1f-23703b4f1e3b None None] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:04:39.436651 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.fernet_utils [None req-02ab8d1b-82f0-4417-ab1f-23703b4f1e3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:04:39.494532 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02ab8d1b-82f0-4417-ab1f-23703b4f1e3b None None] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:04:39.497965 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d12fe8df-fef2-4c0a-afd4-ec560f08e84b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9af40ddfe9ff4be3887b068f13a28dc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c87c981909d4b8db02783421818c79b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:04:39.502908 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12fe8df-fef2-4c0a-afd4-ec560f08e84b service neutron] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:04:39.502908 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12fe8df-fef2-4c0a-afd4-ec560f08e84b service neutron] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:04:39.502908 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12fe8df-fef2-4c0a-afd4-ec560f08e84b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:04:39.508114 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d12fe8df-fef2-4c0a-afd4-ec560f08e84b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:04:39.509553 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d12fe8df-fef2-4c0a-afd4-ec560f08e84b service neutron] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:04:39.514473 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writing DB stats keystone:SELECT=100 {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 16:04:39.519530 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 765/1530] 10.222.0.59 () {60 vars in 1365 bytes} [Thu Jun 2 16:04:39 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 16:04:41.738972 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2605d77-17d6-4728-9472-06025a4df312 None None] REQUEST_METHOD: `GET` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:04:41.739532 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2605d77-17d6-4728-9472-06025a4df312 None None] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:04:41.739532 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2605d77-17d6-4728-9472-06025a4df312 None None] PATH_INFO: `/` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:04:41.740978 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 766/1531] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jun 2 16:04:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 16:04:41.746050 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14308aeb-4771-477b-bda6-c832a1c7d57d None None] REQUEST_METHOD: `POST` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:04:41.746505 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14308aeb-4771-477b-bda6-c832a1c7d57d None None] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:04:41.746644 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14308aeb-4771-477b-bda6-c832a1c7d57d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:04:41.766012 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.auth.core [None req-14308aeb-4771-477b-bda6-c832a1c7d57d None None] MFA Rules not processed for user `400d1f4db9de49638549e5db29a041e1`. Rule list: `[]` (Enabled: `True`). {{(pid=80395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 16:04:41.767247 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.fernet_utils [None req-14308aeb-4771-477b-bda6-c832a1c7d57d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:04:41.775069 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 766/1532] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jun 2 16:04:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 16:04:41.810630 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2605d77-17d6-4728-9472-06025a4df312 None None] Authenticating user token {{(pid=80396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:04:41.822175 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2605d77-17d6-4728-9472-06025a4df312 None None] Validating token access rules against request {{(pid=80396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:04:41.825640 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-596f7275-c609-4157-aa9a-a6b3a7eafcd8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9af40ddfe9ff4be3887b068f13a28dc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c87c981909d4b8db02783421818c79b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:04:41.826321 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-596f7275-c609-4157-aa9a-a6b3a7eafcd8 service neutron] REQUEST_METHOD: `GET` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:04:41.826590 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-596f7275-c609-4157-aa9a-a6b3a7eafcd8 service neutron] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:04:41.826891 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-596f7275-c609-4157-aa9a-a6b3a7eafcd8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:04:41.836073 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-596f7275-c609-4157-aa9a-a6b3a7eafcd8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:04:41.837498 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-596f7275-c609-4157-aa9a-a6b3a7eafcd8 service neutron] RBAC: Authorization granted {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:04:41.846986 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 767/1533] 10.222.0.59 () {60 vars in 1365 bytes} [Thu Jun 2 16:04:41 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 16:04:45.658009 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a258b9f-68be-4bf2-891e-9858fe913100 None None] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:04:45.658573 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a258b9f-68be-4bf2-891e-9858fe913100 None None] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:04:45.658573 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a258b9f-68be-4bf2-891e-9858fe913100 None None] PATH_INFO: `/` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:04:45.660197 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 767/1534] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jun 2 16:04:45 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 16:04:45.665364 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f99fe5-e024-48aa-b5ab-2d6415cbafa2 None None] REQUEST_METHOD: `POST` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:04:45.665782 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f99fe5-e024-48aa-b5ab-2d6415cbafa2 None None] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:04:45.665935 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f99fe5-e024-48aa-b5ab-2d6415cbafa2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:04:45.683650 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.auth.core [None req-a2f99fe5-e024-48aa-b5ab-2d6415cbafa2 None None] MFA Rules not processed for user `400d1f4db9de49638549e5db29a041e1`. Rule list: `[]` (Enabled: `True`). {{(pid=80396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 16:04:45.684837 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.fernet_utils [None req-a2f99fe5-e024-48aa-b5ab-2d6415cbafa2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:04:45.692526 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 768/1535] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jun 2 16:04:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 02 16:04:45.963087 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a258b9f-68be-4bf2-891e-9858fe913100 None None] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:04:45.964761 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.fernet_utils [None req-6a258b9f-68be-4bf2-891e-9858fe913100 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:04:46.021761 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a258b9f-68be-4bf2-891e-9858fe913100 None None] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:04:46.025263 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfdb169b-31bd-40f2-9399-f05c817194dc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6534961c369940a5b88f310c6450250b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c87c981909d4b8db02783421818c79b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:04:46.025895 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfdb169b-31bd-40f2-9399-f05c817194dc service cinder] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:04:46.026206 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfdb169b-31bd-40f2-9399-f05c817194dc service cinder] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:04:46.026486 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfdb169b-31bd-40f2-9399-f05c817194dc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:04:46.035645 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfdb169b-31bd-40f2-9399-f05c817194dc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:04:46.037072 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfdb169b-31bd-40f2-9399-f05c817194dc service cinder] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:04:46.046457 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 768/1536] 10.222.0.59 () {60 vars in 1365 bytes} [Thu Jun 2 16:04:45 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 16:04:48.316554 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f17fca-d475-455b-816e-9d64403c418f None None] REQUEST_METHOD: `GET` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:04:48.317091 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f17fca-d475-455b-816e-9d64403c418f None None] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:04:48.317091 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f17fca-d475-455b-816e-9d64403c418f None None] PATH_INFO: `/` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:04:48.318533 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 769/1537] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jun 2 16:04:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 16:04:48.323910 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5eac883-0d66-4fe8-a850-d969ddd763d7 None None] REQUEST_METHOD: `POST` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:04:48.324442 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5eac883-0d66-4fe8-a850-d969ddd763d7 None None] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:04:48.324442 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5eac883-0d66-4fe8-a850-d969ddd763d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:04:48.343197 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.auth.core [None req-c5eac883-0d66-4fe8-a850-d969ddd763d7 None None] MFA Rules not processed for user `400d1f4db9de49638549e5db29a041e1`. Rule list: `[]` (Enabled: `True`). {{(pid=80395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 16:04:48.344469 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.fernet_utils [None req-c5eac883-0d66-4fe8-a850-d969ddd763d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:04:48.352174 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 769/1538] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jun 2 16:04:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 16:04:48.622665 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84f17fca-d475-455b-816e-9d64403c418f None None] Authenticating user token {{(pid=80396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:04:48.625094 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.fernet_utils [None req-84f17fca-d475-455b-816e-9d64403c418f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:04:48.638324 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84f17fca-d475-455b-816e-9d64403c418f None None] Validating token access rules against request {{(pid=80396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:04:48.643316 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3fb9c9a-e1a2-438d-b575-af8346a1db1f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6534961c369940a5b88f310c6450250b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c87c981909d4b8db02783421818c79b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:04:48.644685 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3fb9c9a-e1a2-438d-b575-af8346a1db1f service cinder] REQUEST_METHOD: `GET` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:04:48.644685 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3fb9c9a-e1a2-438d-b575-af8346a1db1f service cinder] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:04:48.644685 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3fb9c9a-e1a2-438d-b575-af8346a1db1f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:04:48.653544 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3fb9c9a-e1a2-438d-b575-af8346a1db1f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:04:48.654984 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3fb9c9a-e1a2-438d-b575-af8346a1db1f service cinder] RBAC: Authorization granted {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:04:48.664733 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 770/1539] 10.222.0.59 () {60 vars in 1365 bytes} [Thu Jun 2 16:04:48 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 02 16:04:58.338000 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writing DB stats keystone:SELECT=32 {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 16:04:58.660137 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG dbcounter [-] [80396] Writing DB stats keystone:SELECT=33 {{(pid=80396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 16:06:21.630509 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-096e1a71-d712-4845-a430-4e77e4601518 None None] REQUEST_METHOD: `POST` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:06:21.631135 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-096e1a71-d712-4845-a430-4e77e4601518 None None] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:06:21.631135 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-096e1a71-d712-4845-a430-4e77e4601518 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:06:21.667109 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.auth.core [None req-096e1a71-d712-4845-a430-4e77e4601518 None None] MFA Rules not processed for user `400d1f4db9de49638549e5db29a041e1`. Rule list: `[]` (Enabled: `True`). {{(pid=80395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 16:06:21.668514 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.fernet_utils [None req-096e1a71-d712-4845-a430-4e77e4601518 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:06:21.683519 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 770/1540] 10.222.0.59 () {58 vars in 957 bytes} [Thu Jun 2 16:06:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 54 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 16:06:21.692693 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73876019-248a-49e7-a35a-dd471c0ff0a5 None None] REQUEST_METHOD: `POST` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:06:21.693905 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73876019-248a-49e7-a35a-dd471c0ff0a5 None None] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:06:21.693905 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73876019-248a-49e7-a35a-dd471c0ff0a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:06:21.719806 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.auth.core [None req-73876019-248a-49e7-a35a-dd471c0ff0a5 None None] MFA Rules not processed for user `400d1f4db9de49638549e5db29a041e1`. Rule list: `[]` (Enabled: `True`). {{(pid=80396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 16:06:21.728980 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.fernet_utils [None req-73876019-248a-49e7-a35a-dd471c0ff0a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:06:21.737162 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 771/1541] 10.222.0.59 () {58 vars in 957 bytes} [Thu Jun 2 16:06:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 16:06:21.741846 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-096e1a71-d712-4845-a430-4e77e4601518 None None] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:06:21.753980 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-096e1a71-d712-4845-a430-4e77e4601518 None None] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:06:21.762842 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7672b439-22dd-4ed0-859b-205e04647f45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f73d5a98be74242b45222df39fb6213', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:06:21.763504 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7672b439-22dd-4ed0-859b-205e04647f45 admin admin] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:06:21.763784 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7672b439-22dd-4ed0-859b-205e04647f45 admin admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:06:21.764080 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7672b439-22dd-4ed0-859b-205e04647f45 admin admin] PATH_INFO: `/v3/domains` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:06:21.764842 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7672b439-22dd-4ed0-859b-205e04647f45 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80395) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 16:06:21.765182 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7672b439-22dd-4ed0-859b-205e04647f45 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:06:21.766911 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7672b439-22dd-4ed0-859b-205e04647f45 admin admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:06:21.791496 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 771/1542] 10.222.0.59 () {58 vars in 1152 bytes} [Thu Jun 2 16:06:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 16:06:21.800276 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73876019-248a-49e7-a35a-dd471c0ff0a5 None None] Authenticating user token {{(pid=80396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:06:21.816643 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73876019-248a-49e7-a35a-dd471c0ff0a5 None None] Validating token access rules against request {{(pid=80396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:06:21.822025 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a955baf-864d-4eff-ae5f-26673518c9ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f73d5a98be74242b45222df39fb6213', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:06:21.824221 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a955baf-864d-4eff-ae5f-26673518c9ab admin admin] REQUEST_METHOD: `POST` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:06:21.824515 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a955baf-864d-4eff-ae5f-26673518c9ab admin admin] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:06:21.824794 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a955baf-864d-4eff-ae5f-26673518c9ab admin admin] PATH_INFO: `/v3/projects` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:06:21.825605 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a955baf-864d-4eff-ae5f-26673518c9ab admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:06:21.827877 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a955baf-864d-4eff-ae5f-26673518c9ab admin admin] RBAC: Authorization granted {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:06:21.901504 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7483bf65-c416-4cbe-8156-c0ea978e332c None None] REQUEST_METHOD: `POST` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:06:21.901862 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7483bf65-c416-4cbe-8156-c0ea978e332c None None] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:06:21.902098 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7483bf65-c416-4cbe-8156-c0ea978e332c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:06:21.927084 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.auth.core [None req-7483bf65-c416-4cbe-8156-c0ea978e332c None None] MFA Rules not processed for user `400d1f4db9de49638549e5db29a041e1`. Rule list: `[]` (Enabled: `True`). {{(pid=80395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 16:06:21.928435 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.fernet_utils [None req-7483bf65-c416-4cbe-8156-c0ea978e332c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:06:21.940039 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 772/1543] 10.222.0.59 () {58 vars in 957 bytes} [Thu Jun 2 16:06:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 16:06:21.941322 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77402d9e-dbe2-4a22-a9a0-b00d387ad211 None None] REQUEST_METHOD: `POST` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:06:21.941612 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77402d9e-dbe2-4a22-a9a0-b00d387ad211 None None] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:06:21.941889 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77402d9e-dbe2-4a22-a9a0-b00d387ad211 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:06:21.964414 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.auth.core [None req-77402d9e-dbe2-4a22-a9a0-b00d387ad211 None None] MFA Rules not processed for user `400d1f4db9de49638549e5db29a041e1`. Rule list: `[]` (Enabled: `True`). {{(pid=80395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 16:06:21.965618 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.fernet_utils [None req-77402d9e-dbe2-4a22-a9a0-b00d387ad211 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:06:21.976856 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 773/1544] 10.222.0.59 () {58 vars in 957 bytes} [Thu Jun 2 16:06:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 16:06:21.978164 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b76573bd-e68a-4ae9-a5f1-e3410bb30404 None None] REQUEST_METHOD: `POST` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:06:21.986134 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b76573bd-e68a-4ae9-a5f1-e3410bb30404 None None] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:06:21.986134 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b76573bd-e68a-4ae9-a5f1-e3410bb30404 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:06:22.001213 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.auth.core [None req-b76573bd-e68a-4ae9-a5f1-e3410bb30404 None None] MFA Rules not processed for user `400d1f4db9de49638549e5db29a041e1`. Rule list: `[]` (Enabled: `True`). {{(pid=80395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 16:06:22.002434 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.fernet_utils [None req-b76573bd-e68a-4ae9-a5f1-e3410bb30404 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:06:22.011080 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 774/1545] 10.222.0.59 () {58 vars in 957 bytes} [Thu Jun 2 16:06:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 16:06:22.012206 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cad68d9-a723-4732-a5d4-54b203ed63b4 None None] REQUEST_METHOD: `POST` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:06:22.012499 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cad68d9-a723-4732-a5d4-54b203ed63b4 None None] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:06:22.012776 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cad68d9-a723-4732-a5d4-54b203ed63b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:06:22.030217 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 772/1546] 10.222.0.59 () {60 vars in 1152 bytes} [Thu Jun 2 16:06:21 2022] POST /identity/v3/projects => generated 373 bytes in 230 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 16:06:22.031996 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c36112b6-6a57-47b9-8e89-d90def9d5ce3 None None] REQUEST_METHOD: `POST` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:06:22.032294 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c36112b6-6a57-47b9-8e89-d90def9d5ce3 None None] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:06:22.032576 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c36112b6-6a57-47b9-8e89-d90def9d5ce3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:06:22.037487 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.auth.core [None req-5cad68d9-a723-4732-a5d4-54b203ed63b4 None None] MFA Rules not processed for user `400d1f4db9de49638549e5db29a041e1`. Rule list: `[]` (Enabled: `True`). {{(pid=80395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 16:06:22.039107 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.fernet_utils [None req-5cad68d9-a723-4732-a5d4-54b203ed63b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:06:22.061849 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.auth.core [None req-c36112b6-6a57-47b9-8e89-d90def9d5ce3 None None] MFA Rules not processed for user `400d1f4db9de49638549e5db29a041e1`. Rule list: `[]` (Enabled: `True`). {{(pid=80396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 16:06:22.063459 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.fernet_utils [None req-c36112b6-6a57-47b9-8e89-d90def9d5ce3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:06:22.118589 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 775/1547] 10.222.0.59 () {58 vars in 957 bytes} [Thu Jun 2 16:06:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 16:06:22.120428 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a01225-c7c9-4048-8665-f920a7afd2c7 None None] REQUEST_METHOD: `POST` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:06:22.121016 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a01225-c7c9-4048-8665-f920a7afd2c7 None None] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:06:22.121294 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a01225-c7c9-4048-8665-f920a7afd2c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:06:22.140875 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.auth.core [None req-21a01225-c7c9-4048-8665-f920a7afd2c7 None None] MFA Rules not processed for user `400d1f4db9de49638549e5db29a041e1`. Rule list: `[]` (Enabled: `True`). {{(pid=80395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 16:06:22.141936 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 773/1548] 10.222.0.59 () {58 vars in 957 bytes} [Thu Jun 2 16:06:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 16:06:22.142213 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.fernet_utils [None req-21a01225-c7c9-4048-8665-f920a7afd2c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:06:22.142914 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c36112b6-6a57-47b9-8e89-d90def9d5ce3 None None] Authenticating user token {{(pid=80396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:06:22.152391 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c36112b6-6a57-47b9-8e89-d90def9d5ce3 None None] Validating token access rules against request {{(pid=80396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:06:22.152933 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 776/1549] 10.222.0.59 () {58 vars in 957 bytes} [Thu Jun 2 16:06:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 16:06:22.153752 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21a01225-c7c9-4048-8665-f920a7afd2c7 None None] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:06:22.157225 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dbb300a-3cd9-4f6b-8d1f-8d43f2f2e7ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f73d5a98be74242b45222df39fb6213', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:06:22.157875 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dbb300a-3cd9-4f6b-8d1f-8d43f2f2e7ca admin admin] REQUEST_METHOD: `GET` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:06:22.158379 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dbb300a-3cd9-4f6b-8d1f-8d43f2f2e7ca admin admin] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:06:22.158663 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dbb300a-3cd9-4f6b-8d1f-8d43f2f2e7ca admin admin] PATH_INFO: `/v3/domains` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:06:22.159980 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dbb300a-3cd9-4f6b-8d1f-8d43f2f2e7ca admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80396) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 16:06:22.160309 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dbb300a-3cd9-4f6b-8d1f-8d43f2f2e7ca admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:06:22.161330 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: WARNING py.warnings [None req-6dbb300a-3cd9-4f6b-8d1f-8d43f2f2e7ca admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 02 16:06:22.161330 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: warnings.warn(msg) Jun 02 16:06:22.161330 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: Jun 02 16:06:22.162243 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dbb300a-3cd9-4f6b-8d1f-8d43f2f2e7ca admin admin] RBAC: Authorization granted {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:06:22.163390 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21a01225-c7c9-4048-8665-f920a7afd2c7 None None] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:06:22.168720 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aaacf45-092c-4df2-a62d-6c3059ecfea9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f73d5a98be74242b45222df39fb6213', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:06:22.169416 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aaacf45-092c-4df2-a62d-6c3059ecfea9 admin admin] REQUEST_METHOD: `POST` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:06:22.170116 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aaacf45-092c-4df2-a62d-6c3059ecfea9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:06:22.170116 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aaacf45-092c-4df2-a62d-6c3059ecfea9 admin admin] PATH_INFO: `/v3/users` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:06:22.170837 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aaacf45-092c-4df2-a62d-6c3059ecfea9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:06:22.172855 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aaacf45-092c-4df2-a62d-6c3059ecfea9 admin admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:06:22.175554 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 774/1550] 10.222.0.59 () {58 vars in 1152 bytes} [Thu Jun 2 16:06:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 16:06:22.176842 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619ebd01-9b2a-40b1-a0e8-269267e73840 None None] REQUEST_METHOD: `POST` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:06:22.177132 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619ebd01-9b2a-40b1-a0e8-269267e73840 None None] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:06:22.177407 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619ebd01-9b2a-40b1-a0e8-269267e73840 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:06:22.196719 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.auth.core [None req-619ebd01-9b2a-40b1-a0e8-269267e73840 None None] MFA Rules not processed for user `400d1f4db9de49638549e5db29a041e1`. Rule list: `[]` (Enabled: `True`). {{(pid=80396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 16:06:22.203670 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.fernet_utils [None req-619ebd01-9b2a-40b1-a0e8-269267e73840 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:06:22.205810 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 775/1551] 10.222.0.59 () {58 vars in 957 bytes} [Thu Jun 2 16:06:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 16:06:22.207282 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b3056f-4848-4112-847b-b834fdce529d None None] REQUEST_METHOD: `POST` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:06:22.207582 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b3056f-4848-4112-847b-b834fdce529d None None] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:06:22.207868 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b3056f-4848-4112-847b-b834fdce529d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:06:22.225223 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.auth.core [None req-c9b3056f-4848-4112-847b-b834fdce529d None None] MFA Rules not processed for user `400d1f4db9de49638549e5db29a041e1`. Rule list: `[]` (Enabled: `True`). {{(pid=80396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 16:06:22.226642 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.fernet_utils [None req-c9b3056f-4848-4112-847b-b834fdce529d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:06:22.236066 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 776/1552] 10.222.0.59 () {58 vars in 957 bytes} [Thu Jun 2 16:06:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 16:06:22.237377 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e305e7-3a68-4300-b4fb-d4ffaf1f2e56 None None] REQUEST_METHOD: `POST` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:06:22.237661 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e305e7-3a68-4300-b4fb-d4ffaf1f2e56 None None] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:06:22.237939 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e305e7-3a68-4300-b4fb-d4ffaf1f2e56 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:06:22.257214 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.auth.core [None req-83e305e7-3a68-4300-b4fb-d4ffaf1f2e56 None None] MFA Rules not processed for user `400d1f4db9de49638549e5db29a041e1`. Rule list: `[]` (Enabled: `True`). {{(pid=80396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 16:06:22.258474 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.fernet_utils [None req-83e305e7-3a68-4300-b4fb-d4ffaf1f2e56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:06:22.266772 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 777/1553] 10.222.0.59 () {58 vars in 957 bytes} [Thu Jun 2 16:06:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 16:06:22.267958 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e901b6d8-212b-4b98-ba50-aaf1a89cde2c None None] REQUEST_METHOD: `POST` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:06:22.268244 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e901b6d8-212b-4b98-ba50-aaf1a89cde2c None None] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:06:22.268542 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e901b6d8-212b-4b98-ba50-aaf1a89cde2c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:06:22.286466 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.auth.core [None req-e901b6d8-212b-4b98-ba50-aaf1a89cde2c None None] MFA Rules not processed for user `400d1f4db9de49638549e5db29a041e1`. Rule list: `[]` (Enabled: `True`). {{(pid=80396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 16:06:22.287569 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.fernet_utils [None req-e901b6d8-212b-4b98-ba50-aaf1a89cde2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:06:22.296290 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 778/1554] 10.222.0.59 () {58 vars in 957 bytes} [Thu Jun 2 16:06:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 16:06:22.297048 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e901b6d8-212b-4b98-ba50-aaf1a89cde2c None None] Authenticating user token {{(pid=80396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:06:22.306190 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e901b6d8-212b-4b98-ba50-aaf1a89cde2c None None] Validating token access rules against request {{(pid=80396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:06:22.313736 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 777/1555] 10.222.0.59 () {60 vars in 1143 bytes} [Thu Jun 2 16:06:22 2022] POST /identity/v3/users => generated 287 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 16:06:22.313906 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5db12a2f-25b4-44d2-b036-444a79a0a369 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f73d5a98be74242b45222df39fb6213', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:06:22.313906 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db12a2f-25b4-44d2-b036-444a79a0a369 admin admin] REQUEST_METHOD: `GET` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:06:22.314200 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16686e67-07dd-4c61-af53-d249a3320f42 None None] REQUEST_METHOD: `POST` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:06:22.314301 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db12a2f-25b4-44d2-b036-444a79a0a369 admin admin] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:06:22.314407 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16686e67-07dd-4c61-af53-d249a3320f42 None None] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:06:22.314407 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16686e67-07dd-4c61-af53-d249a3320f42 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:06:22.314588 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db12a2f-25b4-44d2-b036-444a79a0a369 admin admin] PATH_INFO: `/v3/domains` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:06:22.314588 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5db12a2f-25b4-44d2-b036-444a79a0a369 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80396) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 16:06:22.314588 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5db12a2f-25b4-44d2-b036-444a79a0a369 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:06:22.315724 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5db12a2f-25b4-44d2-b036-444a79a0a369 admin admin] RBAC: Authorization granted {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:06:22.335514 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 779/1556] 10.222.0.59 () {58 vars in 1152 bytes} [Thu Jun 2 16:06:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 16:06:22.335514 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5db12a2f-25b4-44d2-b036-444a79a0a369 admin admin] Authenticating user token {{(pid=80396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:06:22.335847 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.auth.core [None req-16686e67-07dd-4c61-af53-d249a3320f42 None None] MFA Rules not processed for user `400d1f4db9de49638549e5db29a041e1`. Rule list: `[]` (Enabled: `True`). {{(pid=80395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 16:06:22.335847 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.fernet_utils [None req-16686e67-07dd-4c61-af53-d249a3320f42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:06:22.341399 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5db12a2f-25b4-44d2-b036-444a79a0a369 admin admin] Validating token access rules against request {{(pid=80396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:06:22.342175 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 778/1557] 10.222.0.59 () {58 vars in 957 bytes} [Thu Jun 2 16:06:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 16:06:22.343437 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ab6c58-6249-47a9-9e72-5be9dbd2fe6f None None] REQUEST_METHOD: `POST` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:06:22.343741 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ab6c58-6249-47a9-9e72-5be9dbd2fe6f None None] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:06:22.343995 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ab6c58-6249-47a9-9e72-5be9dbd2fe6f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:06:22.346209 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25e1544f-2778-4874-9c42-b017d4d607d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f73d5a98be74242b45222df39fb6213', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:06:22.346853 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e1544f-2778-4874-9c42-b017d4d607d4 admin admin] REQUEST_METHOD: `POST` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:06:22.347138 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e1544f-2778-4874-9c42-b017d4d607d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:06:22.347413 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e1544f-2778-4874-9c42-b017d4d607d4 admin admin] PATH_INFO: `/v3/projects` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:06:22.348095 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25e1544f-2778-4874-9c42-b017d4d607d4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:06:22.349982 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25e1544f-2778-4874-9c42-b017d4d607d4 admin admin] RBAC: Authorization granted {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:06:22.362190 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.auth.core [None req-77ab6c58-6249-47a9-9e72-5be9dbd2fe6f None None] MFA Rules not processed for user `400d1f4db9de49638549e5db29a041e1`. Rule list: `[]` (Enabled: `True`). {{(pid=80395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 16:06:22.363359 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.fernet_utils [None req-77ab6c58-6249-47a9-9e72-5be9dbd2fe6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:06:22.371911 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 779/1558] 10.222.0.59 () {58 vars in 957 bytes} [Thu Jun 2 16:06:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 16:06:22.373246 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9268eeb-deaf-4c3b-96d3-eeb11e4107b4 None None] REQUEST_METHOD: `POST` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:06:22.373537 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9268eeb-deaf-4c3b-96d3-eeb11e4107b4 None None] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:06:22.373808 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9268eeb-deaf-4c3b-96d3-eeb11e4107b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:06:22.391550 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.auth.core [None req-b9268eeb-deaf-4c3b-96d3-eeb11e4107b4 None None] MFA Rules not processed for user `400d1f4db9de49638549e5db29a041e1`. Rule list: `[]` (Enabled: `True`). {{(pid=80395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 16:06:22.392741 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.fernet_utils [None req-b9268eeb-deaf-4c3b-96d3-eeb11e4107b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:06:22.400690 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 780/1559] 10.222.0.59 () {58 vars in 957 bytes} [Thu Jun 2 16:06:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 16:06:22.401533 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9268eeb-deaf-4c3b-96d3-eeb11e4107b4 None None] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:06:22.410788 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9268eeb-deaf-4c3b-96d3-eeb11e4107b4 None None] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:06:22.415522 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a6febd0-4a01-4456-aa35-55be0adfa0dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f73d5a98be74242b45222df39fb6213', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:06:22.416753 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6febd0-4a01-4456-aa35-55be0adfa0dd admin admin] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:06:22.417057 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6febd0-4a01-4456-aa35-55be0adfa0dd admin admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:06:22.417328 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6febd0-4a01-4456-aa35-55be0adfa0dd admin admin] PATH_INFO: `/v3/domains` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:06:22.418035 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a6febd0-4a01-4456-aa35-55be0adfa0dd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80395) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 16:06:22.418370 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a6febd0-4a01-4456-aa35-55be0adfa0dd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:06:22.419948 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a6febd0-4a01-4456-aa35-55be0adfa0dd admin admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:06:22.431432 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 781/1560] 10.222.0.59 () {58 vars in 1152 bytes} [Thu Jun 2 16:06:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 16:06:22.433246 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b17d90a-0b0d-4dc2-9951-9e5b098f8a65 None None] REQUEST_METHOD: `POST` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:06:22.433540 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b17d90a-0b0d-4dc2-9951-9e5b098f8a65 None None] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:06:22.433842 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b17d90a-0b0d-4dc2-9951-9e5b098f8a65 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:06:22.451038 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.auth.core [None req-9b17d90a-0b0d-4dc2-9951-9e5b098f8a65 None None] MFA Rules not processed for user `400d1f4db9de49638549e5db29a041e1`. Rule list: `[]` (Enabled: `True`). {{(pid=80395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 16:06:22.452231 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.fernet_utils [None req-9b17d90a-0b0d-4dc2-9951-9e5b098f8a65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:06:22.460292 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 782/1561] 10.222.0.59 () {58 vars in 957 bytes} [Thu Jun 2 16:06:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 16:06:22.461084 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b17d90a-0b0d-4dc2-9951-9e5b098f8a65 None None] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:06:22.470343 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 780/1562] 10.222.0.59 () {60 vars in 1152 bytes} [Thu Jun 2 16:06:22 2022] POST /identity/v3/projects => generated 391 bytes in 141 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 16:06:22.470663 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b17d90a-0b0d-4dc2-9951-9e5b098f8a65 None None] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:06:22.471295 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25e1544f-2778-4874-9c42-b017d4d607d4 admin admin] Authenticating user token {{(pid=80396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:06:22.525154 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 16:06:22.531665 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c0c6dac-f193-462e-af27-c94864bba9a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f73d5a98be74242b45222df39fb6213', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:06:22.532863 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0c6dac-f193-462e-af27-c94864bba9a0 admin admin] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:06:22.532981 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG dbcounter [-] [80396] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 16:06:22.533084 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0c6dac-f193-462e-af27-c94864bba9a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:06:22.533084 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0c6dac-f193-462e-af27-c94864bba9a0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:06:22.533654 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c0c6dac-f193-462e-af27-c94864bba9a0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:06:22.535310 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c0c6dac-f193-462e-af27-c94864bba9a0 admin admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:06:22.536257 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25e1544f-2778-4874-9c42-b017d4d607d4 admin admin] Validating token access rules against request {{(pid=80396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:06:22.541121 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e936bbaa-077d-4f03-8684-04a86da37aae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f73d5a98be74242b45222df39fb6213', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:06:22.542288 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e936bbaa-077d-4f03-8684-04a86da37aae admin admin] REQUEST_METHOD: `POST` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:06:22.542578 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e936bbaa-077d-4f03-8684-04a86da37aae admin admin] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:06:22.542864 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e936bbaa-077d-4f03-8684-04a86da37aae admin admin] PATH_INFO: `/v3/projects` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:06:22.543551 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e936bbaa-077d-4f03-8684-04a86da37aae admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:06:22.545435 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e936bbaa-077d-4f03-8684-04a86da37aae admin admin] RBAC: Authorization granted {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:06:22.546301 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 783/1563] 10.222.0.59 () {58 vars in 1121 bytes} [Thu Jun 2 16:06:22 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 16:06:22.547192 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c0c6dac-f193-462e-af27-c94864bba9a0 admin admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:06:22.556394 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c0c6dac-f193-462e-af27-c94864bba9a0 admin admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:06:22.561366 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1ffbc49-4d71-4d43-a04b-d56382297dbe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f73d5a98be74242b45222df39fb6213', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:06:22.562004 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ffbc49-4d71-4d43-a04b-d56382297dbe admin admin] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:06:22.562324 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ffbc49-4d71-4d43-a04b-d56382297dbe admin admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:06:22.562626 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ffbc49-4d71-4d43-a04b-d56382297dbe admin admin] PATH_INFO: `/v3/domains` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:06:22.563396 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1ffbc49-4d71-4d43-a04b-d56382297dbe admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80395) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 16:06:22.563705 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1ffbc49-4d71-4d43-a04b-d56382297dbe admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:06:22.565470 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1ffbc49-4d71-4d43-a04b-d56382297dbe admin admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:06:22.578597 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 784/1564] 10.222.0.59 () {58 vars in 1152 bytes} [Thu Jun 2 16:06:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 16:06:22.579400 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1ffbc49-4d71-4d43-a04b-d56382297dbe admin admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:06:22.590735 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1ffbc49-4d71-4d43-a04b-d56382297dbe admin admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:06:22.595670 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ca9e757-27b4-4cfd-a48a-0638ee6273b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f73d5a98be74242b45222df39fb6213', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:06:22.596308 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca9e757-27b4-4cfd-a48a-0638ee6273b4 admin admin] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:06:22.596595 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca9e757-27b4-4cfd-a48a-0638ee6273b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:06:22.596869 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca9e757-27b4-4cfd-a48a-0638ee6273b4 admin admin] PATH_INFO: `/v3/domains` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:06:22.597584 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ca9e757-27b4-4cfd-a48a-0638ee6273b4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80395) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 16:06:22.597922 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ca9e757-27b4-4cfd-a48a-0638ee6273b4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:06:22.599534 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ca9e757-27b4-4cfd-a48a-0638ee6273b4 admin admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:06:22.611690 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 785/1565] 10.222.0.59 () {58 vars in 1152 bytes} [Thu Jun 2 16:06:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 16:06:22.612462 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ca9e757-27b4-4cfd-a48a-0638ee6273b4 admin admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:06:22.622336 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ca9e757-27b4-4cfd-a48a-0638ee6273b4 admin admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:06:22.626879 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66281490-4d9f-4f01-95f7-0760dd882832 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f73d5a98be74242b45222df39fb6213', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:06:22.627498 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66281490-4d9f-4f01-95f7-0760dd882832 admin admin] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:06:22.627783 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66281490-4d9f-4f01-95f7-0760dd882832 admin admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:06:22.628062 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66281490-4d9f-4f01-95f7-0760dd882832 admin admin] PATH_INFO: `/v3/domains` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:06:22.628770 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66281490-4d9f-4f01-95f7-0760dd882832 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80395) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 16:06:22.629101 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66281490-4d9f-4f01-95f7-0760dd882832 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:06:22.630857 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66281490-4d9f-4f01-95f7-0760dd882832 admin admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:06:22.643114 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 786/1566] 10.222.0.59 () {58 vars in 1152 bytes} [Thu Jun 2 16:06:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 16:06:22.643920 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66281490-4d9f-4f01-95f7-0760dd882832 admin admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:06:22.654048 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66281490-4d9f-4f01-95f7-0760dd882832 admin admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:06:22.658857 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64097c93-db61-4ff8-9a32-50ad26a0d2de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f73d5a98be74242b45222df39fb6213', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:06:22.659254 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 781/1567] 10.222.0.59 () {60 vars in 1152 bytes} [Thu Jun 2 16:06:22 2022] POST /identity/v3/projects => generated 365 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 16:06:22.672984 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64097c93-db61-4ff8-9a32-50ad26a0d2de admin admin] REQUEST_METHOD: `POST` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:06:22.672984 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64097c93-db61-4ff8-9a32-50ad26a0d2de admin admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:06:22.673228 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e936bbaa-077d-4f03-8684-04a86da37aae admin admin] Authenticating user token {{(pid=80396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:06:22.673311 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64097c93-db61-4ff8-9a32-50ad26a0d2de admin admin] PATH_INFO: `/v3/projects` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:06:22.673311 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64097c93-db61-4ff8-9a32-50ad26a0d2de admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:06:22.673311 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: WARNING py.warnings [None req-64097c93-db61-4ff8-9a32-50ad26a0d2de admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 02 16:06:22.673311 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: warnings.warn(msg) Jun 02 16:06:22.673311 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: Jun 02 16:06:22.673311 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64097c93-db61-4ff8-9a32-50ad26a0d2de admin admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:06:22.724603 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e936bbaa-077d-4f03-8684-04a86da37aae admin admin] Validating token access rules against request {{(pid=80396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:06:22.729747 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e1c3b1a-d9b2-4a30-ae70-76e8518f8b73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f73d5a98be74242b45222df39fb6213', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:06:22.730432 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e1c3b1a-d9b2-4a30-ae70-76e8518f8b73 admin admin] REQUEST_METHOD: `GET` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:06:22.730715 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e1c3b1a-d9b2-4a30-ae70-76e8518f8b73 admin admin] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:06:22.730989 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e1c3b1a-d9b2-4a30-ae70-76e8518f8b73 admin admin] PATH_INFO: `/v3/domains` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:06:22.731705 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e1c3b1a-d9b2-4a30-ae70-76e8518f8b73 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80396) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 16:06:22.732017 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e1c3b1a-d9b2-4a30-ae70-76e8518f8b73 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:06:22.733607 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e1c3b1a-d9b2-4a30-ae70-76e8518f8b73 admin admin] RBAC: Authorization granted {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:06:22.745007 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 782/1568] 10.222.0.59 () {58 vars in 1152 bytes} [Thu Jun 2 16:06:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 16:06:22.745764 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e1c3b1a-d9b2-4a30-ae70-76e8518f8b73 admin admin] Authenticating user token {{(pid=80396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:06:22.755064 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e1c3b1a-d9b2-4a30-ae70-76e8518f8b73 admin admin] Validating token access rules against request {{(pid=80396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:06:22.760119 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce11a263-4360-49d8-b4ee-9b4fa38c97b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f73d5a98be74242b45222df39fb6213', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:06:22.760842 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce11a263-4360-49d8-b4ee-9b4fa38c97b1 admin admin] REQUEST_METHOD: `POST` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:06:22.761144 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce11a263-4360-49d8-b4ee-9b4fa38c97b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:06:22.761486 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce11a263-4360-49d8-b4ee-9b4fa38c97b1 admin admin] PATH_INFO: `/v3/users` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:06:22.762436 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce11a263-4360-49d8-b4ee-9b4fa38c97b1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:06:22.763547 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: WARNING py.warnings [None req-ce11a263-4360-49d8-b4ee-9b4fa38c97b1 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 02 16:06:22.763547 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: warnings.warn(msg) Jun 02 16:06:22.763547 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: Jun 02 16:06:22.764851 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce11a263-4360-49d8-b4ee-9b4fa38c97b1 admin admin] RBAC: Authorization granted {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:06:22.837056 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 787/1569] 10.222.0.59 () {60 vars in 1152 bytes} [Thu Jun 2 16:06:22 2022] POST /identity/v3/projects => generated 363 bytes in 193 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 16:06:22.838612 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64097c93-db61-4ff8-9a32-50ad26a0d2de admin admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:06:22.903984 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64097c93-db61-4ff8-9a32-50ad26a0d2de admin admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:06:22.908654 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3176dc1a-6492-40a1-9ba0-c168032dad59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f73d5a98be74242b45222df39fb6213', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:06:22.909313 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3176dc1a-6492-40a1-9ba0-c168032dad59 admin admin] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:06:22.909630 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3176dc1a-6492-40a1-9ba0-c168032dad59 admin admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:06:22.909875 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3176dc1a-6492-40a1-9ba0-c168032dad59 admin admin] PATH_INFO: `/v3/roles` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:06:22.910633 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3176dc1a-6492-40a1-9ba0-c168032dad59 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:06:22.912302 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3176dc1a-6492-40a1-9ba0-c168032dad59 admin admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:06:22.922429 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 788/1570] 10.222.0.59 () {58 vars in 1121 bytes} [Thu Jun 2 16:06:22 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 16:06:22.923195 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3176dc1a-6492-40a1-9ba0-c168032dad59 admin admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:06:22.932383 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3176dc1a-6492-40a1-9ba0-c168032dad59 admin admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:06:22.936955 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-662e52d4-3574-4506-b06b-725816516dc4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f73d5a98be74242b45222df39fb6213', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:06:22.937560 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-662e52d4-3574-4506-b06b-725816516dc4 admin admin] REQUEST_METHOD: `POST` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:06:22.937845 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-662e52d4-3574-4506-b06b-725816516dc4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:06:22.938148 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-662e52d4-3574-4506-b06b-725816516dc4 admin admin] PATH_INFO: `/v3/projects` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:06:22.938818 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-662e52d4-3574-4506-b06b-725816516dc4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:06:22.940650 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-662e52d4-3574-4506-b06b-725816516dc4 admin admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:06:22.950982 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 783/1571] 10.222.0.59 () {60 vars in 1143 bytes} [Thu Jun 2 16:06:22 2022] POST /identity/v3/users => generated 296 bytes in 204 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 16:06:22.950982 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce11a263-4360-49d8-b4ee-9b4fa38c97b1 admin admin] Authenticating user token {{(pid=80396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:06:22.960998 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce11a263-4360-49d8-b4ee-9b4fa38c97b1 admin admin] Validating token access rules against request {{(pid=80396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:06:22.966812 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-764328df-6044-40ad-b62f-027378dac627 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f73d5a98be74242b45222df39fb6213', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:06:22.967463 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-764328df-6044-40ad-b62f-027378dac627 admin admin] REQUEST_METHOD: `POST` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:06:22.967748 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-764328df-6044-40ad-b62f-027378dac627 admin admin] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:06:22.968026 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-764328df-6044-40ad-b62f-027378dac627 admin admin] PATH_INFO: `/v3/projects` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:06:22.968713 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-764328df-6044-40ad-b62f-027378dac627 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:06:22.970691 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-764328df-6044-40ad-b62f-027378dac627 admin admin] RBAC: Authorization granted {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:06:23.093986 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 789/1572] 10.222.0.59 () {60 vars in 1152 bytes} [Thu Jun 2 16:06:22 2022] POST /identity/v3/projects => generated 371 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 16:06:23.094967 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-662e52d4-3574-4506-b06b-725816516dc4 admin admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:06:23.120986 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 784/1573] 10.222.0.59 () {60 vars in 1152 bytes} [Thu Jun 2 16:06:22 2022] POST /identity/v3/projects => generated 377 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 16:06:23.121808 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-764328df-6044-40ad-b62f-027378dac627 admin admin] Authenticating user token {{(pid=80396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:06:23.158451 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-662e52d4-3574-4506-b06b-725816516dc4 admin admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:06:23.168284 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 16:06:23.186028 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-764328df-6044-40ad-b62f-027378dac627 admin admin] Validating token access rules against request {{(pid=80396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:06:23.191279 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b0ef523-f2c6-4f5b-acaf-8103ba18eb26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f73d5a98be74242b45222df39fb6213', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:06:23.192103 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b0ef523-f2c6-4f5b-acaf-8103ba18eb26 admin admin] REQUEST_METHOD: `POST` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:06:23.192393 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b0ef523-f2c6-4f5b-acaf-8103ba18eb26 admin admin] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:06:23.192679 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b0ef523-f2c6-4f5b-acaf-8103ba18eb26 admin admin] PATH_INFO: `/v3/users` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:06:23.193384 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b0ef523-f2c6-4f5b-acaf-8103ba18eb26 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:06:23.195587 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b0ef523-f2c6-4f5b-acaf-8103ba18eb26 admin admin] RBAC: Authorization granted {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:06:23.219526 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-492407df-5f94-439a-92c3-07be5647354f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f73d5a98be74242b45222df39fb6213', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:06:23.220267 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-492407df-5f94-439a-92c3-07be5647354f admin admin] REQUEST_METHOD: `POST` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:06:23.220596 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-492407df-5f94-439a-92c3-07be5647354f admin admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:06:23.220927 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-492407df-5f94-439a-92c3-07be5647354f admin admin] PATH_INFO: `/v3/projects` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:06:23.221895 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-492407df-5f94-439a-92c3-07be5647354f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:06:23.224121 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-492407df-5f94-439a-92c3-07be5647354f admin admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:06:23.302748 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 785/1574] 10.222.0.59 () {60 vars in 1143 bytes} [Thu Jun 2 16:06:23 2022] POST /identity/v3/users => generated 283 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 16:06:23.303595 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b0ef523-f2c6-4f5b-acaf-8103ba18eb26 admin admin] Authenticating user token {{(pid=80396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:06:23.313310 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b0ef523-f2c6-4f5b-acaf-8103ba18eb26 admin admin] Validating token access rules against request {{(pid=80396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:06:23.318871 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 790/1575] 10.222.0.59 () {60 vars in 1152 bytes} [Thu Jun 2 16:06:23 2022] POST /identity/v3/projects => generated 377 bytes in 221 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 16:06:23.318871 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-492407df-5f94-439a-92c3-07be5647354f admin admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:06:23.320735 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8b470ba-bf87-45b9-8dfe-40b38ae255f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f73d5a98be74242b45222df39fb6213', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:06:23.321389 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b470ba-bf87-45b9-8dfe-40b38ae255f8 admin admin] REQUEST_METHOD: `POST` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:06:23.321671 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b470ba-bf87-45b9-8dfe-40b38ae255f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:06:23.321966 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b470ba-bf87-45b9-8dfe-40b38ae255f8 admin admin] PATH_INFO: `/v3/projects` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:06:23.322898 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8b470ba-bf87-45b9-8dfe-40b38ae255f8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:06:23.324890 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8b470ba-bf87-45b9-8dfe-40b38ae255f8 admin admin] RBAC: Authorization granted {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:06:23.380009 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-492407df-5f94-439a-92c3-07be5647354f admin admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:06:23.384773 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a042a66b-89d0-4204-8a33-4f43811e9331 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f73d5a98be74242b45222df39fb6213', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:06:23.385496 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a042a66b-89d0-4204-8a33-4f43811e9331 admin admin] REQUEST_METHOD: `POST` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:06:23.385769 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a042a66b-89d0-4204-8a33-4f43811e9331 admin admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:06:23.386040 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a042a66b-89d0-4204-8a33-4f43811e9331 admin admin] PATH_INFO: `/v3/users` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:06:23.386749 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a042a66b-89d0-4204-8a33-4f43811e9331 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:06:23.388888 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a042a66b-89d0-4204-8a33-4f43811e9331 admin admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:06:23.429736 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 786/1576] 10.222.0.59 () {60 vars in 1152 bytes} [Thu Jun 2 16:06:23 2022] POST /identity/v3/projects => generated 373 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 16:06:23.430760 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8b470ba-bf87-45b9-8dfe-40b38ae255f8 admin admin] Authenticating user token {{(pid=80396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:06:23.436364 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG dbcounter [-] [80396] Writing DB stats keystone:SELECT=91,keystone:INSERT=9 {{(pid=80396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 16:06:23.498888 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8b470ba-bf87-45b9-8dfe-40b38ae255f8 admin admin] Validating token access rules against request {{(pid=80396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:06:23.503611 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-904ffb4f-7c64-4681-9103-ea319e755a36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f73d5a98be74242b45222df39fb6213', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:06:23.504488 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904ffb4f-7c64-4681-9103-ea319e755a36 admin admin] REQUEST_METHOD: `PUT` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:06:23.504773 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904ffb4f-7c64-4681-9103-ea319e755a36 admin admin] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:06:23.505051 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904ffb4f-7c64-4681-9103-ea319e755a36 admin admin] PATH_INFO: `/v3/projects/3f353ee1888c4536a8e043f3d489bfaa/users/ac18c28774db4af49a0f1860972b940e/roles/649e0f2b5a264c419ea6a1441f123a03` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:06:23.519307 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-904ffb4f-7c64-4681-9103-ea319e755a36 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3f353ee1888c4536a8e043f3d489bfaa, user_id=ac18c28774db4af49a0f1860972b940e, role_id=649e0f2b5a264c419ea6a1441f123a03)` {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:06:23.521959 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-904ffb4f-7c64-4681-9103-ea319e755a36 admin admin] RBAC: Authorization granted {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:06:23.526690 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 791/1577] 10.222.0.59 () {60 vars in 1143 bytes} [Thu Jun 2 16:06:23 2022] POST /identity/v3/users => generated 282 bytes in 210 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 16:06:23.532384 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a042a66b-89d0-4204-8a33-4f43811e9331 admin admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:06:23.537802 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a042a66b-89d0-4204-8a33-4f43811e9331 admin admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:06:23.543335 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5d5c023-368e-4bef-826f-18de2f9672d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f73d5a98be74242b45222df39fb6213', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:06:23.543990 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d5c023-368e-4bef-826f-18de2f9672d2 admin admin] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:06:23.544275 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d5c023-368e-4bef-826f-18de2f9672d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:06:23.544552 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d5c023-368e-4bef-826f-18de2f9672d2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:06:23.545276 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5d5c023-368e-4bef-826f-18de2f9672d2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:06:23.547010 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5d5c023-368e-4bef-826f-18de2f9672d2 admin admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:06:23.557442 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 792/1578] 10.222.0.59 () {58 vars in 1121 bytes} [Thu Jun 2 16:06:23 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 16:06:23.558277 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5d5c023-368e-4bef-826f-18de2f9672d2 admin admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:06:23.567543 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5d5c023-368e-4bef-826f-18de2f9672d2 admin admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:06:23.572128 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d633d7-0331-429c-be33-944ab3d1dc97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f73d5a98be74242b45222df39fb6213', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:06:23.572749 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d633d7-0331-429c-be33-944ab3d1dc97 admin admin] REQUEST_METHOD: `POST` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:06:23.573026 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d633d7-0331-429c-be33-944ab3d1dc97 admin admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:06:23.573325 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d633d7-0331-429c-be33-944ab3d1dc97 admin admin] PATH_INFO: `/v3/users` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:06:23.573993 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4d633d7-0331-429c-be33-944ab3d1dc97 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:06:23.575960 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4d633d7-0331-429c-be33-944ab3d1dc97 admin admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:06:23.623614 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 787/1579] 10.222.0.59 () {60 vars in 1482 bytes} [Thu Jun 2 16:06:23 2022] PUT /identity/v3/projects/3f353ee1888c4536a8e043f3d489bfaa/users/ac18c28774db4af49a0f1860972b940e/roles/649e0f2b5a264c419ea6a1441f123a03 => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 16:06:23.624505 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-904ffb4f-7c64-4681-9103-ea319e755a36 admin admin] Authenticating user token {{(pid=80396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:06:23.649958 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 793/1580] 10.222.0.59 () {60 vars in 1143 bytes} [Thu Jun 2 16:06:23 2022] POST /identity/v3/users => generated 286 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 16:06:23.651811 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d633d7-0331-429c-be33-944ab3d1dc97 admin admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:06:23.661709 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d633d7-0331-429c-be33-944ab3d1dc97 admin admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:06:23.691970 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-904ffb4f-7c64-4681-9103-ea319e755a36 admin admin] Validating token access rules against request {{(pid=80396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:06:23.696550 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c660360-2950-466f-9d6c-e3606774f6c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f73d5a98be74242b45222df39fb6213', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:06:23.697726 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c660360-2950-466f-9d6c-e3606774f6c2 admin admin] REQUEST_METHOD: `POST` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:06:23.698009 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c660360-2950-466f-9d6c-e3606774f6c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:06:23.698374 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c660360-2950-466f-9d6c-e3606774f6c2 admin admin] PATH_INFO: `/v3/users` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:06:23.699004 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c660360-2950-466f-9d6c-e3606774f6c2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:06:23.700938 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c660360-2950-466f-9d6c-e3606774f6c2 admin admin] RBAC: Authorization granted {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:06:23.727251 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc0e16da-a9b1-41f9-b620-b77fa3b88f7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f73d5a98be74242b45222df39fb6213', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:06:23.727922 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc0e16da-a9b1-41f9-b620-b77fa3b88f7c admin admin] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:06:23.728210 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc0e16da-a9b1-41f9-b620-b77fa3b88f7c admin admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:06:23.729070 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc0e16da-a9b1-41f9-b620-b77fa3b88f7c admin admin] PATH_INFO: `/v3/roles` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:06:23.729847 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc0e16da-a9b1-41f9-b620-b77fa3b88f7c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:06:23.731630 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc0e16da-a9b1-41f9-b620-b77fa3b88f7c admin admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:06:23.732879 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 16:06:23.743003 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 794/1581] 10.222.0.59 () {58 vars in 1121 bytes} [Thu Jun 2 16:06:23 2022] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 16:06:23.743669 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc0e16da-a9b1-41f9-b620-b77fa3b88f7c admin admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:06:23.753223 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc0e16da-a9b1-41f9-b620-b77fa3b88f7c admin admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:06:23.757833 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9218979-c6fe-4cf4-8eec-42f44df16263 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f73d5a98be74242b45222df39fb6213', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:06:23.758557 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9218979-c6fe-4cf4-8eec-42f44df16263 admin admin] REQUEST_METHOD: `POST` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:06:23.758869 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9218979-c6fe-4cf4-8eec-42f44df16263 admin admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:06:23.759145 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9218979-c6fe-4cf4-8eec-42f44df16263 admin admin] PATH_INFO: `/v3/users` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:06:23.760740 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9218979-c6fe-4cf4-8eec-42f44df16263 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:06:23.762344 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9218979-c6fe-4cf4-8eec-42f44df16263 admin admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:06:23.779316 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 788/1582] 10.222.0.59 () {60 vars in 1143 bytes} [Thu Jun 2 16:06:23 2022] POST /identity/v3/users => generated 289 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 16:06:23.779824 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c660360-2950-466f-9d6c-e3606774f6c2 admin admin] Authenticating user token {{(pid=80396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:06:23.789153 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c660360-2950-466f-9d6c-e3606774f6c2 admin admin] Validating token access rules against request {{(pid=80396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:06:23.793792 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60c98645-5431-4422-b6ef-21825ac27c2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f73d5a98be74242b45222df39fb6213', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:06:23.794460 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c98645-5431-4422-b6ef-21825ac27c2d admin admin] REQUEST_METHOD: `POST` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:06:23.794741 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c98645-5431-4422-b6ef-21825ac27c2d admin admin] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:06:23.795013 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c98645-5431-4422-b6ef-21825ac27c2d admin admin] PATH_INFO: `/v3/users` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:06:23.795688 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60c98645-5431-4422-b6ef-21825ac27c2d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:06:23.797600 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60c98645-5431-4422-b6ef-21825ac27c2d admin admin] RBAC: Authorization granted {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:06:23.886469 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 795/1583] 10.222.0.59 () {60 vars in 1143 bytes} [Thu Jun 2 16:06:23 2022] POST /identity/v3/users => generated 289 bytes in 143 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 16:06:23.887223 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9218979-c6fe-4cf4-8eec-42f44df16263 admin admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:06:23.896785 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 789/1584] 10.222.0.59 () {60 vars in 1143 bytes} [Thu Jun 2 16:06:23 2022] POST /identity/v3/users => generated 287 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 16:06:23.898021 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9218979-c6fe-4cf4-8eec-42f44df16263 admin admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:06:23.898256 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60c98645-5431-4422-b6ef-21825ac27c2d admin admin] Authenticating user token {{(pid=80396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:06:23.902662 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-114d12e8-c2ce-438b-b985-27aa85829bb1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f73d5a98be74242b45222df39fb6213', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:06:23.903324 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-114d12e8-c2ce-438b-b985-27aa85829bb1 admin admin] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:06:23.903606 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-114d12e8-c2ce-438b-b985-27aa85829bb1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:06:23.903926 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-114d12e8-c2ce-438b-b985-27aa85829bb1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:06:23.904656 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-114d12e8-c2ce-438b-b985-27aa85829bb1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:06:23.906283 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-114d12e8-c2ce-438b-b985-27aa85829bb1 admin admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:06:23.908258 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60c98645-5431-4422-b6ef-21825ac27c2d admin admin] Validating token access rules against request {{(pid=80396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:06:23.913021 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-416865b6-7168-41fb-9231-dd62897bbef1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f73d5a98be74242b45222df39fb6213', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:06:23.913685 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-416865b6-7168-41fb-9231-dd62897bbef1 admin admin] REQUEST_METHOD: `GET` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:06:23.913966 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-416865b6-7168-41fb-9231-dd62897bbef1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:06:23.914274 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-416865b6-7168-41fb-9231-dd62897bbef1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:06:23.914994 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-416865b6-7168-41fb-9231-dd62897bbef1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:06:23.916701 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-416865b6-7168-41fb-9231-dd62897bbef1 admin admin] RBAC: Authorization granted {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:06:23.917689 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 796/1585] 10.222.0.59 () {58 vars in 1121 bytes} [Thu Jun 2 16:06:23 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 16:06:23.919011 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575a35da-ab76-4ef3-932f-e0ac0c1892db None None] REQUEST_METHOD: `POST` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:06:23.919306 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575a35da-ab76-4ef3-932f-e0ac0c1892db None None] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:06:23.919588 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575a35da-ab76-4ef3-932f-e0ac0c1892db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:06:23.931638 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 790/1586] 10.222.0.59 () {58 vars in 1121 bytes} [Thu Jun 2 16:06:23 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 16:06:23.932589 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-416865b6-7168-41fb-9231-dd62897bbef1 admin admin] Authenticating user token {{(pid=80396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:06:23.943451 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-416865b6-7168-41fb-9231-dd62897bbef1 admin admin] Validating token access rules against request {{(pid=80396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:06:23.946372 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.auth.core [None req-575a35da-ab76-4ef3-932f-e0ac0c1892db None None] MFA Rules not processed for user `ac18c28774db4af49a0f1860972b940e`. Rule list: `[]` (Enabled: `True`). {{(pid=80395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 16:06:23.948078 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.fernet_utils [None req-575a35da-ab76-4ef3-932f-e0ac0c1892db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:06:23.948847 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c71ccb9a-6ec1-4302-ac9a-85b06cdeab10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f73d5a98be74242b45222df39fb6213', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:06:23.949486 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c71ccb9a-6ec1-4302-ac9a-85b06cdeab10 admin admin] REQUEST_METHOD: `GET` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:06:23.949767 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c71ccb9a-6ec1-4302-ac9a-85b06cdeab10 admin admin] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:06:23.950047 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c71ccb9a-6ec1-4302-ac9a-85b06cdeab10 admin admin] PATH_INFO: `/v3/roles` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:06:23.950802 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c71ccb9a-6ec1-4302-ac9a-85b06cdeab10 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:06:23.952361 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c71ccb9a-6ec1-4302-ac9a-85b06cdeab10 admin admin] RBAC: Authorization granted {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:06:23.962504 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 791/1587] 10.222.0.59 () {58 vars in 1121 bytes} [Thu Jun 2 16:06:23 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 16:06:23.963882 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c71ccb9a-6ec1-4302-ac9a-85b06cdeab10 admin admin] Authenticating user token {{(pid=80396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:06:23.973458 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c71ccb9a-6ec1-4302-ac9a-85b06cdeab10 admin admin] Validating token access rules against request {{(pid=80396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:06:23.978282 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-456bc452-7e64-405d-8990-982baa56af3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f73d5a98be74242b45222df39fb6213', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:06:23.979126 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456bc452-7e64-405d-8990-982baa56af3c admin admin] REQUEST_METHOD: `GET` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:06:23.979410 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456bc452-7e64-405d-8990-982baa56af3c admin admin] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:06:23.979687 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456bc452-7e64-405d-8990-982baa56af3c admin admin] PATH_INFO: `/v3/roles` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:06:23.980434 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-456bc452-7e64-405d-8990-982baa56af3c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:06:23.982095 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-456bc452-7e64-405d-8990-982baa56af3c admin admin] RBAC: Authorization granted {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:06:23.991992 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 792/1588] 10.222.0.59 () {58 vars in 1121 bytes} [Thu Jun 2 16:06:23 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 16:06:23.992825 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-456bc452-7e64-405d-8990-982baa56af3c admin admin] Authenticating user token {{(pid=80396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:06:24.002160 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-456bc452-7e64-405d-8990-982baa56af3c admin admin] Validating token access rules against request {{(pid=80396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:06:24.006784 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c04b2c34-285e-464c-9f3b-e0c4030bd34b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f73d5a98be74242b45222df39fb6213', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:06:24.007461 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04b2c34-285e-464c-9f3b-e0c4030bd34b admin admin] REQUEST_METHOD: `GET` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:06:24.007748 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04b2c34-285e-464c-9f3b-e0c4030bd34b admin admin] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:06:24.008013 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04b2c34-285e-464c-9f3b-e0c4030bd34b admin admin] PATH_INFO: `/v3/roles` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:06:24.008721 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c04b2c34-285e-464c-9f3b-e0c4030bd34b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:06:24.010874 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c04b2c34-285e-464c-9f3b-e0c4030bd34b admin admin] RBAC: Authorization granted {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:06:24.016555 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 797/1589] 10.222.0.59 () {58 vars in 957 bytes} [Thu Jun 2 16:06:23 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 16:06:24.017300 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-575a35da-ab76-4ef3-932f-e0ac0c1892db None None] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:06:24.020831 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 793/1590] 10.222.0.59 () {58 vars in 1121 bytes} [Thu Jun 2 16:06:23 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 16:06:24.021541 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c04b2c34-285e-464c-9f3b-e0c4030bd34b admin admin] Authenticating user token {{(pid=80396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:06:24.033653 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-575a35da-ab76-4ef3-932f-e0ac0c1892db None None] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:06:24.034365 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c04b2c34-285e-464c-9f3b-e0c4030bd34b admin admin] Validating token access rules against request {{(pid=80396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:06:24.038163 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1cf6c86-7d72-46c6-a9f2-7cd17758a238 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f73d5a98be74242b45222df39fb6213', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:06:24.038813 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1cf6c86-7d72-46c6-a9f2-7cd17758a238 admin admin] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:06:24.038977 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a0cd549-531d-4c4a-8299-32105921ba3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f73d5a98be74242b45222df39fb6213', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:06:24.039100 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1cf6c86-7d72-46c6-a9f2-7cd17758a238 admin admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:06:24.039349 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1cf6c86-7d72-46c6-a9f2-7cd17758a238 admin admin] PATH_INFO: `/v3/roles` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:06:24.039610 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a0cd549-531d-4c4a-8299-32105921ba3f admin admin] REQUEST_METHOD: `GET` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:06:24.039896 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a0cd549-531d-4c4a-8299-32105921ba3f admin admin] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:06:24.040073 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1cf6c86-7d72-46c6-a9f2-7cd17758a238 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:06:24.040172 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a0cd549-531d-4c4a-8299-32105921ba3f admin admin] PATH_INFO: `/v3/roles` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:06:24.041021 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a0cd549-531d-4c4a-8299-32105921ba3f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:06:24.041739 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1cf6c86-7d72-46c6-a9f2-7cd17758a238 admin admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:06:24.042630 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a0cd549-531d-4c4a-8299-32105921ba3f admin admin] RBAC: Authorization granted {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:06:24.052062 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 798/1591] 10.222.0.59 () {58 vars in 1121 bytes} [Thu Jun 2 16:06:24 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 16:06:24.052845 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1cf6c86-7d72-46c6-a9f2-7cd17758a238 admin admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:06:24.055017 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 794/1592] 10.222.0.59 () {58 vars in 1121 bytes} [Thu Jun 2 16:06:24 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 16:06:24.055834 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a0cd549-531d-4c4a-8299-32105921ba3f admin admin] Authenticating user token {{(pid=80396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:06:24.062544 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG dbcounter [-] [80396] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=80396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 16:06:24.063346 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1cf6c86-7d72-46c6-a9f2-7cd17758a238 admin admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:06:24.066439 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a0cd549-531d-4c4a-8299-32105921ba3f admin admin] Validating token access rules against request {{(pid=80396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:06:24.068147 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1762789c-1e2f-49c0-b314-8fd6a412dfa3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f73d5a98be74242b45222df39fb6213', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:06:24.068810 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1762789c-1e2f-49c0-b314-8fd6a412dfa3 admin admin] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:06:24.069098 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1762789c-1e2f-49c0-b314-8fd6a412dfa3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:06:24.069377 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1762789c-1e2f-49c0-b314-8fd6a412dfa3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:06:24.070250 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1762789c-1e2f-49c0-b314-8fd6a412dfa3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:06:24.071331 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f45998e-cb4a-443e-80ab-047d29c2a38a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f73d5a98be74242b45222df39fb6213', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:06:24.075125 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1762789c-1e2f-49c0-b314-8fd6a412dfa3 admin admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:06:24.075235 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f45998e-cb4a-443e-80ab-047d29c2a38a admin admin] REQUEST_METHOD: `PUT` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:06:24.075235 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f45998e-cb4a-443e-80ab-047d29c2a38a admin admin] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:06:24.075235 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f45998e-cb4a-443e-80ab-047d29c2a38a admin admin] PATH_INFO: `/v3/projects/629a7b91ffc64154a55a45415f739949/users/a8658730ea2a4a06b7b4070976c6397f/roles/649e0f2b5a264c419ea6a1441f123a03` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:06:24.083199 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 799/1593] 10.222.0.59 () {58 vars in 1121 bytes} [Thu Jun 2 16:06:24 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 16:06:24.083922 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1762789c-1e2f-49c0-b314-8fd6a412dfa3 admin admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:06:24.089362 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f45998e-cb4a-443e-80ab-047d29c2a38a admin admin] RBAC: Authorizing `identity:create_grant(project_id=629a7b91ffc64154a55a45415f739949, user_id=a8658730ea2a4a06b7b4070976c6397f, role_id=649e0f2b5a264c419ea6a1441f123a03)` {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:06:24.092161 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f45998e-cb4a-443e-80ab-047d29c2a38a admin admin] RBAC: Authorization granted {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:06:24.095340 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1762789c-1e2f-49c0-b314-8fd6a412dfa3 admin admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:06:24.100111 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ac42e0f-c207-43af-9005-3c9097031dc1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f73d5a98be74242b45222df39fb6213', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:06:24.106460 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac42e0f-c207-43af-9005-3c9097031dc1 admin admin] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:06:24.106460 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac42e0f-c207-43af-9005-3c9097031dc1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:06:24.106460 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac42e0f-c207-43af-9005-3c9097031dc1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:06:24.106460 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ac42e0f-c207-43af-9005-3c9097031dc1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:06:24.106460 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ac42e0f-c207-43af-9005-3c9097031dc1 admin admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:06:24.115248 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 800/1594] 10.222.0.59 () {58 vars in 1121 bytes} [Thu Jun 2 16:06:24 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 16:06:24.116027 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ac42e0f-c207-43af-9005-3c9097031dc1 admin admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:06:24.126097 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ac42e0f-c207-43af-9005-3c9097031dc1 admin admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:06:24.131288 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfd103af-0725-4d87-88b8-44382b362f84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f73d5a98be74242b45222df39fb6213', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:06:24.132771 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd103af-0725-4d87-88b8-44382b362f84 admin admin] REQUEST_METHOD: `PUT` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:06:24.132771 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd103af-0725-4d87-88b8-44382b362f84 admin admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:06:24.132978 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd103af-0725-4d87-88b8-44382b362f84 admin admin] PATH_INFO: `/v3/projects/104f0122d8f2464e8f1a9fd46043f9ac/users/61a035ccc83044f6b67196a3ece31815/roles/649e0f2b5a264c419ea6a1441f123a03` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:06:24.148713 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfd103af-0725-4d87-88b8-44382b362f84 admin admin] RBAC: Authorizing `identity:create_grant(project_id=104f0122d8f2464e8f1a9fd46043f9ac, user_id=61a035ccc83044f6b67196a3ece31815, role_id=649e0f2b5a264c419ea6a1441f123a03)` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:06:24.149712 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: WARNING py.warnings [None req-cfd103af-0725-4d87-88b8-44382b362f84 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 02 16:06:24.149712 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: warnings.warn(msg) Jun 02 16:06:24.149712 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: Jun 02 16:06:24.152521 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfd103af-0725-4d87-88b8-44382b362f84 admin admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:06:24.160052 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 795/1595] 10.222.0.59 () {60 vars in 1482 bytes} [Thu Jun 2 16:06:24 2022] PUT /identity/v3/projects/629a7b91ffc64154a55a45415f739949/users/a8658730ea2a4a06b7b4070976c6397f/roles/649e0f2b5a264c419ea6a1441f123a03 => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 16:06:24.160879 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f45998e-cb4a-443e-80ab-047d29c2a38a admin admin] Authenticating user token {{(pid=80396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:06:24.223861 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f45998e-cb4a-443e-80ab-047d29c2a38a admin admin] Validating token access rules against request {{(pid=80396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:06:24.228208 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 801/1596] 10.222.0.59 () {60 vars in 1482 bytes} [Thu Jun 2 16:06:24 2022] PUT /identity/v3/projects/104f0122d8f2464e8f1a9fd46043f9ac/users/61a035ccc83044f6b67196a3ece31815/roles/649e0f2b5a264c419ea6a1441f123a03 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 16:06:24.229558 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfd103af-0725-4d87-88b8-44382b362f84 admin admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:06:24.297502 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfd103af-0725-4d87-88b8-44382b362f84 admin admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:06:24.298185 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34996d46-7d44-40d4-9172-4e18d1589f3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f73d5a98be74242b45222df39fb6213', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:06:24.298858 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34996d46-7d44-40d4-9172-4e18d1589f3c admin admin] REQUEST_METHOD: `POST` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:06:24.299162 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34996d46-7d44-40d4-9172-4e18d1589f3c admin admin] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:06:24.299434 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34996d46-7d44-40d4-9172-4e18d1589f3c admin admin] PATH_INFO: `/v3/projects` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:06:24.300208 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34996d46-7d44-40d4-9172-4e18d1589f3c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:06:24.302301 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34996d46-7d44-40d4-9172-4e18d1589f3c admin admin] RBAC: Authorization granted {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:06:24.302612 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3caa264b-58fc-4d37-8c8b-058712e75d1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f73d5a98be74242b45222df39fb6213', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:06:24.303303 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3caa264b-58fc-4d37-8c8b-058712e75d1f admin admin] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:06:24.303583 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3caa264b-58fc-4d37-8c8b-058712e75d1f admin admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:06:24.303909 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3caa264b-58fc-4d37-8c8b-058712e75d1f admin admin] PATH_INFO: `/v3/roles` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:06:24.304628 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3caa264b-58fc-4d37-8c8b-058712e75d1f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:06:24.306239 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3caa264b-58fc-4d37-8c8b-058712e75d1f admin admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:06:24.307582 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 16:06:24.316402 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 802/1597] 10.222.0.59 () {58 vars in 1121 bytes} [Thu Jun 2 16:06:24 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 16:06:24.317206 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3caa264b-58fc-4d37-8c8b-058712e75d1f admin admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:06:24.326472 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3caa264b-58fc-4d37-8c8b-058712e75d1f admin admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:06:24.331108 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff388cf6-9bf0-4719-9865-25dcbc867209 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f73d5a98be74242b45222df39fb6213', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:06:24.331726 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff388cf6-9bf0-4719-9865-25dcbc867209 admin admin] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:06:24.332260 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff388cf6-9bf0-4719-9865-25dcbc867209 admin admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:06:24.332531 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff388cf6-9bf0-4719-9865-25dcbc867209 admin admin] PATH_INFO: `/v3/roles` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:06:24.333322 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff388cf6-9bf0-4719-9865-25dcbc867209 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:06:24.335047 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff388cf6-9bf0-4719-9865-25dcbc867209 admin admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:06:24.345436 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 803/1598] 10.222.0.59 () {58 vars in 1121 bytes} [Thu Jun 2 16:06:24 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 16:06:24.346221 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff388cf6-9bf0-4719-9865-25dcbc867209 admin admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:06:24.357910 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff388cf6-9bf0-4719-9865-25dcbc867209 admin admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:06:24.362966 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91b0ff13-0f09-4d24-8b8f-23ee8c9aff8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f73d5a98be74242b45222df39fb6213', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:06:24.363630 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b0ff13-0f09-4d24-8b8f-23ee8c9aff8a admin admin] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:06:24.363995 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b0ff13-0f09-4d24-8b8f-23ee8c9aff8a admin admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:06:24.364329 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b0ff13-0f09-4d24-8b8f-23ee8c9aff8a admin admin] PATH_INFO: `/v3/roles` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:06:24.365061 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91b0ff13-0f09-4d24-8b8f-23ee8c9aff8a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:06:24.366697 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91b0ff13-0f09-4d24-8b8f-23ee8c9aff8a admin admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:06:24.378964 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 804/1599] 10.222.0.59 () {58 vars in 1121 bytes} [Thu Jun 2 16:06:24 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 16:06:24.382930 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91b0ff13-0f09-4d24-8b8f-23ee8c9aff8a admin admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:06:24.389918 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91b0ff13-0f09-4d24-8b8f-23ee8c9aff8a admin admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:06:24.394646 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c80925dd-fe73-48cd-9a71-56dffeec60e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f73d5a98be74242b45222df39fb6213', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:06:24.395534 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80925dd-fe73-48cd-9a71-56dffeec60e5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:06:24.395814 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80925dd-fe73-48cd-9a71-56dffeec60e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:06:24.396085 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80925dd-fe73-48cd-9a71-56dffeec60e5 admin admin] PATH_INFO: `/v3/projects/846c3eb6fb0c4cd6b2332f63e6dfd47d/users/995a7b4998ed405da66ab855d16f138c/roles/649e0f2b5a264c419ea6a1441f123a03` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:06:24.411331 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c80925dd-fe73-48cd-9a71-56dffeec60e5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=846c3eb6fb0c4cd6b2332f63e6dfd47d, user_id=995a7b4998ed405da66ab855d16f138c, role_id=649e0f2b5a264c419ea6a1441f123a03)` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:06:24.414093 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c80925dd-fe73-48cd-9a71-56dffeec60e5 admin admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:06:24.441675 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 796/1600] 10.222.0.59 () {60 vars in 1152 bytes} [Thu Jun 2 16:06:24 2022] POST /identity/v3/projects => generated 373 bytes in 281 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 16:06:24.442597 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34996d46-7d44-40d4-9172-4e18d1589f3c admin admin] Authenticating user token {{(pid=80396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:06:24.507324 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34996d46-7d44-40d4-9172-4e18d1589f3c admin admin] Validating token access rules against request {{(pid=80396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:06:24.512651 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d77c249-52dc-4dca-b4e6-3a53067f43d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f73d5a98be74242b45222df39fb6213', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:06:24.513760 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d77c249-52dc-4dca-b4e6-3a53067f43d0 admin admin] REQUEST_METHOD: `PUT` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:06:24.514044 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d77c249-52dc-4dca-b4e6-3a53067f43d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:06:24.514371 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d77c249-52dc-4dca-b4e6-3a53067f43d0 admin admin] PATH_INFO: `/v3/projects/6721049c26e34cfbb1021c3832087d68/users/7f57f8293f6d43388c824a9bc5c57da9/roles/649e0f2b5a264c419ea6a1441f123a03` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:06:24.530967 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d77c249-52dc-4dca-b4e6-3a53067f43d0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6721049c26e34cfbb1021c3832087d68, user_id=7f57f8293f6d43388c824a9bc5c57da9, role_id=649e0f2b5a264c419ea6a1441f123a03)` {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:06:24.531174 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 805/1601] 10.222.0.59 () {60 vars in 1482 bytes} [Thu Jun 2 16:06:24 2022] PUT /identity/v3/projects/846c3eb6fb0c4cd6b2332f63e6dfd47d/users/995a7b4998ed405da66ab855d16f138c/roles/649e0f2b5a264c419ea6a1441f123a03 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 16:06:24.532556 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca6d52d-58d5-48ae-8842-d58754bf23ce None None] REQUEST_METHOD: `POST` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:06:24.532862 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca6d52d-58d5-48ae-8842-d58754bf23ce None None] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:06:24.533147 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca6d52d-58d5-48ae-8842-d58754bf23ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:06:24.533844 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d77c249-52dc-4dca-b4e6-3a53067f43d0 admin admin] RBAC: Authorization granted {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:06:24.544310 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG dbcounter [-] [80396] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 16:06:24.554736 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.auth.core [None req-6ca6d52d-58d5-48ae-8842-d58754bf23ce None None] MFA Rules not processed for user `400d1f4db9de49638549e5db29a041e1`. Rule list: `[]` (Enabled: `True`). {{(pid=80395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 16:06:24.555970 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.fernet_utils [None req-6ca6d52d-58d5-48ae-8842-d58754bf23ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:06:24.617391 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 806/1602] 10.222.0.59 () {58 vars in 957 bytes} [Thu Jun 2 16:06:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 16:06:24.619754 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-432c66c0-0b5c-468e-aaed-06e8ba86a6d0 None None] REQUEST_METHOD: `POST` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:06:24.620054 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-432c66c0-0b5c-468e-aaed-06e8ba86a6d0 None None] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:06:24.620559 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-432c66c0-0b5c-468e-aaed-06e8ba86a6d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:06:24.642796 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 797/1603] 10.222.0.59 () {60 vars in 1482 bytes} [Thu Jun 2 16:06:24 2022] PUT /identity/v3/projects/6721049c26e34cfbb1021c3832087d68/users/7f57f8293f6d43388c824a9bc5c57da9/roles/649e0f2b5a264c419ea6a1441f123a03 => generated 0 bytes in 200 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 16:06:24.643457 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d77c249-52dc-4dca-b4e6-3a53067f43d0 admin admin] Authenticating user token {{(pid=80396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:06:24.654517 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.auth.core [None req-432c66c0-0b5c-468e-aaed-06e8ba86a6d0 None None] MFA Rules not processed for user `61a035ccc83044f6b67196a3ece31815`. Rule list: `[]` (Enabled: `True`). {{(pid=80395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 16:06:24.655873 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.fernet_utils [None req-432c66c0-0b5c-468e-aaed-06e8ba86a6d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:06:24.713870 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d77c249-52dc-4dca-b4e6-3a53067f43d0 admin admin] Validating token access rules against request {{(pid=80396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:06:24.718753 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14ff868e-a352-489e-aec8-0f49025ac17b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f73d5a98be74242b45222df39fb6213', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:06:24.719634 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ff868e-a352-489e-aec8-0f49025ac17b admin admin] REQUEST_METHOD: `PUT` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:06:24.719777 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 807/1604] 10.222.0.59 () {58 vars in 957 bytes} [Thu Jun 2 16:06:24 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 16:06:24.719910 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ff868e-a352-489e-aec8-0f49025ac17b admin admin] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:06:24.720178 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ff868e-a352-489e-aec8-0f49025ac17b admin admin] PATH_INFO: `/v3/projects/8e72d608f9b243739572bf4fab56bd13/users/1400263107254337be69dc15e8d046d4/roles/649e0f2b5a264c419ea6a1441f123a03` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:06:24.720569 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-432c66c0-0b5c-468e-aaed-06e8ba86a6d0 None None] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:06:24.733479 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-432c66c0-0b5c-468e-aaed-06e8ba86a6d0 None None] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:06:24.738254 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bab8c44-2799-401c-a29b-f8dd315ceea6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f73d5a98be74242b45222df39fb6213', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:06:24.738886 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14ff868e-a352-489e-aec8-0f49025ac17b admin admin] RBAC: Authorizing `identity:create_grant(project_id=8e72d608f9b243739572bf4fab56bd13, user_id=1400263107254337be69dc15e8d046d4, role_id=649e0f2b5a264c419ea6a1441f123a03)` {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:06:24.739143 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bab8c44-2799-401c-a29b-f8dd315ceea6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:06:24.739448 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bab8c44-2799-401c-a29b-f8dd315ceea6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:06:24.739722 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bab8c44-2799-401c-a29b-f8dd315ceea6 admin admin] PATH_INFO: `/v3/projects/9598d078f4a1477babe0eaf804ef54a8/users/88bb3d2dbcdb45bb8baba424e5239e21/roles/649e0f2b5a264c419ea6a1441f123a03` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:06:24.741582 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14ff868e-a352-489e-aec8-0f49025ac17b admin admin] RBAC: Authorization granted {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:06:24.754940 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bab8c44-2799-401c-a29b-f8dd315ceea6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9598d078f4a1477babe0eaf804ef54a8, user_id=88bb3d2dbcdb45bb8baba424e5239e21, role_id=649e0f2b5a264c419ea6a1441f123a03)` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:06:24.758654 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bab8c44-2799-401c-a29b-f8dd315ceea6 admin admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:06:24.843720 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 798/1605] 10.222.0.59 () {60 vars in 1482 bytes} [Thu Jun 2 16:06:24 2022] PUT /identity/v3/projects/8e72d608f9b243739572bf4fab56bd13/users/1400263107254337be69dc15e8d046d4/roles/649e0f2b5a264c419ea6a1441f123a03 => generated 0 bytes in 201 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 16:06:24.844653 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14ff868e-a352-489e-aec8-0f49025ac17b admin admin] Authenticating user token {{(pid=80396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:06:24.886802 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 808/1606] 10.222.0.59 () {60 vars in 1482 bytes} [Thu Jun 2 16:06:24 2022] PUT /identity/v3/projects/9598d078f4a1477babe0eaf804ef54a8/users/88bb3d2dbcdb45bb8baba424e5239e21/roles/649e0f2b5a264c419ea6a1441f123a03 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 16:06:24.887628 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bab8c44-2799-401c-a29b-f8dd315ceea6 admin admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:06:24.905166 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 16:06:24.917192 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14ff868e-a352-489e-aec8-0f49025ac17b admin admin] Validating token access rules against request {{(pid=80396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:06:24.957843 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bab8c44-2799-401c-a29b-f8dd315ceea6 admin admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:06:24.963179 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d76c5a39-572c-40f7-b04d-25d7dadf438b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f73d5a98be74242b45222df39fb6213', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:06:24.963834 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76c5a39-572c-40f7-b04d-25d7dadf438b admin admin] REQUEST_METHOD: `POST` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:06:24.964199 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76c5a39-572c-40f7-b04d-25d7dadf438b admin admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:06:24.964411 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76c5a39-572c-40f7-b04d-25d7dadf438b admin admin] PATH_INFO: `/v3/users` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:06:24.965132 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d76c5a39-572c-40f7-b04d-25d7dadf438b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:06:24.967180 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d76c5a39-572c-40f7-b04d-25d7dadf438b admin admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:06:24.982702 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2e396c5-9305-4f26-92bf-b6cd47753bad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f73d5a98be74242b45222df39fb6213', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:06:24.986903 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e396c5-9305-4f26-92bf-b6cd47753bad admin admin] REQUEST_METHOD: `PUT` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:06:24.986903 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e396c5-9305-4f26-92bf-b6cd47753bad admin admin] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:06:24.986903 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e396c5-9305-4f26-92bf-b6cd47753bad admin admin] PATH_INFO: `/v3/projects/9cb3beab857d4900b872254c16ddab56/users/af0e4caac85b419590b35b3d0faf875e/roles/649e0f2b5a264c419ea6a1441f123a03` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:06:25.000715 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2e396c5-9305-4f26-92bf-b6cd47753bad admin admin] RBAC: Authorizing `identity:create_grant(project_id=9cb3beab857d4900b872254c16ddab56, user_id=af0e4caac85b419590b35b3d0faf875e, role_id=649e0f2b5a264c419ea6a1441f123a03)` {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:06:25.003455 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2e396c5-9305-4f26-92bf-b6cd47753bad admin admin] RBAC: Authorization granted {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:06:25.114215 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 809/1607] 10.222.0.59 () {60 vars in 1143 bytes} [Thu Jun 2 16:06:24 2022] POST /identity/v3/users => generated 293 bytes in 227 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 16:06:25.115342 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce39364-a39d-41c0-af4f-e012435d53d7 None None] REQUEST_METHOD: `POST` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:06:25.115644 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce39364-a39d-41c0-af4f-e012435d53d7 None None] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:06:25.115917 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce39364-a39d-41c0-af4f-e012435d53d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:06:25.138234 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 799/1608] 10.222.0.59 () {60 vars in 1482 bytes} [Thu Jun 2 16:06:24 2022] PUT /identity/v3/projects/9cb3beab857d4900b872254c16ddab56/users/af0e4caac85b419590b35b3d0faf875e/roles/649e0f2b5a264c419ea6a1441f123a03 => generated 0 bytes in 294 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 16:06:25.139193 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2e396c5-9305-4f26-92bf-b6cd47753bad admin admin] Authenticating user token {{(pid=80396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:06:25.145564 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.auth.core [None req-3ce39364-a39d-41c0-af4f-e012435d53d7 None None] MFA Rules not processed for user `995a7b4998ed405da66ab855d16f138c`. Rule list: `[]` (Enabled: `True`). {{(pid=80395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 16:06:25.147096 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.fernet_utils [None req-3ce39364-a39d-41c0-af4f-e012435d53d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:06:25.150566 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG dbcounter [-] [80396] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 16:06:25.200261 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2e396c5-9305-4f26-92bf-b6cd47753bad admin admin] Validating token access rules against request {{(pid=80396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:06:25.204221 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72926385-9ec1-4c6c-bc5c-18aa28b3bf1d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9af40ddfe9ff4be3887b068f13a28dc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c87c981909d4b8db02783421818c79b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:06:25.204931 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72926385-9ec1-4c6c-bc5c-18aa28b3bf1d service neutron] REQUEST_METHOD: `GET` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:06:25.205216 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72926385-9ec1-4c6c-bc5c-18aa28b3bf1d service neutron] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:06:25.205519 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72926385-9ec1-4c6c-bc5c-18aa28b3bf1d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:06:25.227310 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 810/1609] 10.222.0.59 () {58 vars in 957 bytes} [Thu Jun 2 16:06:25 2022] POST /identity/v3/auth/tokens => generated 3230 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 16:06:25.227310 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a77388-d189-40d8-aa56-140442c687b7 None None] REQUEST_METHOD: `POST` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:06:25.227310 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a77388-d189-40d8-aa56-140442c687b7 None None] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:06:25.227779 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a77388-d189-40d8-aa56-140442c687b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:06:25.256418 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.auth.core [None req-e5a77388-d189-40d8-aa56-140442c687b7 None None] MFA Rules not processed for user `7f57f8293f6d43388c824a9bc5c57da9`. Rule list: `[]` (Enabled: `True`). {{(pid=80395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 16:06:25.257614 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.fernet_utils [None req-e5a77388-d189-40d8-aa56-140442c687b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:06:25.273652 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72926385-9ec1-4c6c-bc5c-18aa28b3bf1d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:06:25.275205 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72926385-9ec1-4c6c-bc5c-18aa28b3bf1d service neutron] RBAC: Authorization granted {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:06:25.286387 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 800/1610] 10.222.0.59 () {60 vars in 1365 bytes} [Thu Jun 2 16:06:25 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 148 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 16:06:25.287189 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72926385-9ec1-4c6c-bc5c-18aa28b3bf1d service neutron] Authenticating user token {{(pid=80396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:06:25.325828 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 811/1611] 10.222.0.59 () {58 vars in 957 bytes} [Thu Jun 2 16:06:25 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 16:06:25.327153 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e934285-c5a4-4af1-bdcb-8d66bef75181 None None] REQUEST_METHOD: `POST` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:06:25.327444 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e934285-c5a4-4af1-bdcb-8d66bef75181 None None] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:06:25.327720 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e934285-c5a4-4af1-bdcb-8d66bef75181 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:06:25.351930 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.auth.core [None req-5e934285-c5a4-4af1-bdcb-8d66bef75181 None None] MFA Rules not processed for user `400d1f4db9de49638549e5db29a041e1`. Rule list: `[]` (Enabled: `True`). {{(pid=80395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 16:06:25.352538 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72926385-9ec1-4c6c-bc5c-18aa28b3bf1d service neutron] Validating token access rules against request {{(pid=80396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:06:25.354715 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.fernet_utils [None req-5e934285-c5a4-4af1-bdcb-8d66bef75181 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:06:25.358463 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11737d4a-0988-4031-97ad-b2918a7fd0fb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6534961c369940a5b88f310c6450250b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c87c981909d4b8db02783421818c79b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:06:25.359145 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11737d4a-0988-4031-97ad-b2918a7fd0fb service cinder] REQUEST_METHOD: `GET` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:06:25.359432 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11737d4a-0988-4031-97ad-b2918a7fd0fb service cinder] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:06:25.360294 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11737d4a-0988-4031-97ad-b2918a7fd0fb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:06:25.368254 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 812/1612] 10.222.0.59 () {58 vars in 957 bytes} [Thu Jun 2 16:06:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 16:06:25.368254 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58af2a59-6cc4-40bd-b133-870d70dc7dc1 None None] REQUEST_METHOD: `POST` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:06:25.368254 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58af2a59-6cc4-40bd-b133-870d70dc7dc1 None None] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:06:25.368254 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58af2a59-6cc4-40bd-b133-870d70dc7dc1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:06:25.392334 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.auth.core [None req-58af2a59-6cc4-40bd-b133-870d70dc7dc1 None None] MFA Rules not processed for user `400d1f4db9de49638549e5db29a041e1`. Rule list: `[]` (Enabled: `True`). {{(pid=80395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 16:06:25.393688 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.fernet_utils [None req-58af2a59-6cc4-40bd-b133-870d70dc7dc1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:06:25.401421 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 813/1613] 10.222.0.59 () {58 vars in 957 bytes} [Thu Jun 2 16:06:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 16:06:25.402255 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58af2a59-6cc4-40bd-b133-870d70dc7dc1 None None] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:06:25.412367 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58af2a59-6cc4-40bd-b133-870d70dc7dc1 None None] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:06:25.418410 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-766c9162-2179-4045-9f8b-72815df70c5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f73d5a98be74242b45222df39fb6213', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:06:25.419102 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766c9162-2179-4045-9f8b-72815df70c5f admin admin] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:06:25.420662 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766c9162-2179-4045-9f8b-72815df70c5f admin admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:06:25.420662 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766c9162-2179-4045-9f8b-72815df70c5f admin admin] PATH_INFO: `/v3/roles` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:06:25.420662 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-766c9162-2179-4045-9f8b-72815df70c5f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:06:25.422065 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-766c9162-2179-4045-9f8b-72815df70c5f admin admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:06:25.425860 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11737d4a-0988-4031-97ad-b2918a7fd0fb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:06:25.427377 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11737d4a-0988-4031-97ad-b2918a7fd0fb service cinder] RBAC: Authorization granted {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:06:25.428458 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 16:06:25.434279 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 814/1614] 10.222.0.59 () {58 vars in 1121 bytes} [Thu Jun 2 16:06:25 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 16:06:25.435887 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f534be3e-bb90-4fa9-af89-b63d4ac52a54 None None] REQUEST_METHOD: `POST` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:06:25.436218 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f534be3e-bb90-4fa9-af89-b63d4ac52a54 None None] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:06:25.436648 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f534be3e-bb90-4fa9-af89-b63d4ac52a54 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:06:25.442267 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 801/1615] 10.222.0.59 () {60 vars in 1365 bytes} [Thu Jun 2 16:06:25 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 155 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 16:06:25.443182 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11737d4a-0988-4031-97ad-b2918a7fd0fb service cinder] Authenticating user token {{(pid=80396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:06:25.459879 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11737d4a-0988-4031-97ad-b2918a7fd0fb service cinder] Validating token access rules against request {{(pid=80396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:06:25.465586 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05e75d60-95cf-4354-b094-c27cc3d5a8d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f73d5a98be74242b45222df39fb6213', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:06:25.466296 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e75d60-95cf-4354-b094-c27cc3d5a8d0 admin admin] REQUEST_METHOD: `POST` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:06:25.466863 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e75d60-95cf-4354-b094-c27cc3d5a8d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:06:25.466863 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e75d60-95cf-4354-b094-c27cc3d5a8d0 admin admin] PATH_INFO: `/v3/projects` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:06:25.467676 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05e75d60-95cf-4354-b094-c27cc3d5a8d0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:06:25.469606 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05e75d60-95cf-4354-b094-c27cc3d5a8d0 admin admin] RBAC: Authorization granted {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:06:25.470884 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.auth.core [None req-f534be3e-bb90-4fa9-af89-b63d4ac52a54 None None] MFA Rules not processed for user `af0e4caac85b419590b35b3d0faf875e`. Rule list: `[]` (Enabled: `True`). {{(pid=80395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 16:06:25.472589 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.fernet_utils [None req-f534be3e-bb90-4fa9-af89-b63d4ac52a54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:06:25.482231 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG dbcounter [-] [80396] Writing DB stats keystone:SELECT=100 {{(pid=80396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 16:06:25.544352 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 815/1616] 10.222.0.59 () {58 vars in 957 bytes} [Thu Jun 2 16:06:25 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 16:06:25.551209 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978ab107-1a95-43d7-907b-a0abf7751cf2 None None] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:06:25.551209 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978ab107-1a95-43d7-907b-a0abf7751cf2 None None] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:06:25.551209 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978ab107-1a95-43d7-907b-a0abf7751cf2 None None] PATH_INFO: `/` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:06:25.551209 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 816/1617] 10.222.0.59 () {54 vars in 961 bytes} [Thu Jun 2 16:06:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 16:06:25.553216 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-978ab107-1a95-43d7-907b-a0abf7751cf2 None None] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:06:25.566040 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-978ab107-1a95-43d7-907b-a0abf7751cf2 None None] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:06:25.571620 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddbf9c95-3d24-4270-ba33-10d6a60c59b0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9af40ddfe9ff4be3887b068f13a28dc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c87c981909d4b8db02783421818c79b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:06:25.572359 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddbf9c95-3d24-4270-ba33-10d6a60c59b0 service neutron] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:06:25.572641 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddbf9c95-3d24-4270-ba33-10d6a60c59b0 service neutron] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:06:25.572917 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddbf9c95-3d24-4270-ba33-10d6a60c59b0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:06:25.583620 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddbf9c95-3d24-4270-ba33-10d6a60c59b0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:06:25.585206 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddbf9c95-3d24-4270-ba33-10d6a60c59b0 service neutron] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:06:25.596668 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 817/1618] 10.222.0.59 () {60 vars in 1365 bytes} [Thu Jun 2 16:06:25 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 16:06:25.598285 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddbf9c95-3d24-4270-ba33-10d6a60c59b0 service neutron] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:06:25.606604 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddbf9c95-3d24-4270-ba33-10d6a60c59b0 service neutron] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:06:25.610551 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-428ccfd6-8be9-4d83-94ab-90be7c4106c9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9af40ddfe9ff4be3887b068f13a28dc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c87c981909d4b8db02783421818c79b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:06:25.611276 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-428ccfd6-8be9-4d83-94ab-90be7c4106c9 service neutron] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:06:25.611552 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-428ccfd6-8be9-4d83-94ab-90be7c4106c9 service neutron] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:06:25.611964 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-428ccfd6-8be9-4d83-94ab-90be7c4106c9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:06:25.621249 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-428ccfd6-8be9-4d83-94ab-90be7c4106c9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:06:25.625701 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-428ccfd6-8be9-4d83-94ab-90be7c4106c9 service neutron] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:06:25.633012 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 818/1619] 10.222.0.59 () {60 vars in 1365 bytes} [Thu Jun 2 16:06:25 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 16:06:25.633908 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-428ccfd6-8be9-4d83-94ab-90be7c4106c9 service neutron] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:06:25.643309 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-428ccfd6-8be9-4d83-94ab-90be7c4106c9 service neutron] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:06:25.648489 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1723cca4-44e3-424a-a320-c850d682a6a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f73d5a98be74242b45222df39fb6213', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:06:25.648973 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1723cca4-44e3-424a-a320-c850d682a6a8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:06:25.649247 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1723cca4-44e3-424a-a320-c850d682a6a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:06:25.649674 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1723cca4-44e3-424a-a320-c850d682a6a8 admin admin] PATH_INFO: `/v3/projects/9d27ff04715c4941bd75652098cc72a4/users/80eb5ec3ec6a47539e53341d5dedff30/roles/f1e0c25f6e9049e897cb7350c7e54ab3` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:06:25.666454 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 802/1620] 10.222.0.59 () {60 vars in 1152 bytes} [Thu Jun 2 16:06:25 2022] POST /identity/v3/projects => generated 365 bytes in 223 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 16:06:25.668644 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f99f84-f68e-4df1-915c-6e444b348a2a None None] REQUEST_METHOD: `POST` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:06:25.668972 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f99f84-f68e-4df1-915c-6e444b348a2a None None] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:06:25.669505 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f99f84-f68e-4df1-915c-6e444b348a2a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:06:25.669635 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1723cca4-44e3-424a-a320-c850d682a6a8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9d27ff04715c4941bd75652098cc72a4, user_id=80eb5ec3ec6a47539e53341d5dedff30, role_id=f1e0c25f6e9049e897cb7350c7e54ab3)` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:06:25.672306 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1723cca4-44e3-424a-a320-c850d682a6a8 admin admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:06:25.693713 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.auth.core [None req-a3f99f84-f68e-4df1-915c-6e444b348a2a None None] MFA Rules not processed for user `52f9fe4b13574516bb0a8e2aa11a61e8`. Rule list: `[]` (Enabled: `True`). {{(pid=80396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 16:06:25.695348 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.fernet_utils [None req-a3f99f84-f68e-4df1-915c-6e444b348a2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:06:25.773454 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 819/1621] 10.222.0.59 () {60 vars in 1482 bytes} [Thu Jun 2 16:06:25 2022] PUT /identity/v3/projects/9d27ff04715c4941bd75652098cc72a4/users/80eb5ec3ec6a47539e53341d5dedff30/roles/f1e0c25f6e9049e897cb7350c7e54ab3 => generated 0 bytes in 140 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 16:06:25.774841 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817bad9e-2a36-4619-93c1-427070aef721 None None] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:06:25.775958 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817bad9e-2a36-4619-93c1-427070aef721 None None] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:06:25.776445 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817bad9e-2a36-4619-93c1-427070aef721 None None] PATH_INFO: `/` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:06:25.777940 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 820/1622] 10.222.0.59 () {54 vars in 961 bytes} [Thu Jun 2 16:06:25 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 16:06:25.778677 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-817bad9e-2a36-4619-93c1-427070aef721 None None] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:06:25.779608 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 803/1623] 10.222.0.59 () {58 vars in 1058 bytes} [Thu Jun 2 16:06:25 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 16:06:25.780952 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f99f84-f68e-4df1-915c-6e444b348a2a None None] Authenticating user token {{(pid=80396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:06:25.868479 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f99f84-f68e-4df1-915c-6e444b348a2a None None] Validating token access rules against request {{(pid=80396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:06:25.881381 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-817bad9e-2a36-4619-93c1-427070aef721 None None] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:06:25.887152 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a86d82e-8982-4743-8b00-19c70e2fdd18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f73d5a98be74242b45222df39fb6213', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:06:25.887823 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a86d82e-8982-4743-8b00-19c70e2fdd18 admin admin] REQUEST_METHOD: `POST` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:06:25.888107 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a86d82e-8982-4743-8b00-19c70e2fdd18 admin admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:06:25.888388 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a86d82e-8982-4743-8b00-19c70e2fdd18 admin admin] PATH_INFO: `/v3/users` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:06:25.889081 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a86d82e-8982-4743-8b00-19c70e2fdd18 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:06:25.891163 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a86d82e-8982-4743-8b00-19c70e2fdd18 admin admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:06:25.931961 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf8764f5-3582-4613-9668-6761e9f5129d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f73d5a98be74242b45222df39fb6213', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:06:25.932748 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf8764f5-3582-4613-9668-6761e9f5129d admin admin] REQUEST_METHOD: `GET` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:06:25.933032 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf8764f5-3582-4613-9668-6761e9f5129d admin admin] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:06:25.933344 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf8764f5-3582-4613-9668-6761e9f5129d admin admin] PATH_INFO: `/v3/roles` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:06:25.934143 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf8764f5-3582-4613-9668-6761e9f5129d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:06:25.935839 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf8764f5-3582-4613-9668-6761e9f5129d admin admin] RBAC: Authorization granted {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:06:25.950120 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 804/1624] 10.222.0.59 () {58 vars in 1121 bytes} [Thu Jun 2 16:06:25 2022] GET /identity/v3/roles => generated 1420 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 16:06:25.950120 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edfc7358-d102-433b-94a3-42aee3cf6028 None None] REQUEST_METHOD: `POST` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:06:25.950120 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edfc7358-d102-433b-94a3-42aee3cf6028 None None] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:06:25.950120 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edfc7358-d102-433b-94a3-42aee3cf6028 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:06:25.967905 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.auth.core [None req-edfc7358-d102-433b-94a3-42aee3cf6028 None None] MFA Rules not processed for user `52f9fe4b13574516bb0a8e2aa11a61e8`. Rule list: `[]` (Enabled: `True`). {{(pid=80396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 16:06:25.969108 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.fernet_utils [None req-edfc7358-d102-433b-94a3-42aee3cf6028 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:06:25.998153 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG dbcounter [-] [80396] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 16:06:26.008679 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 821/1625] 10.222.0.59 () {60 vars in 1143 bytes} [Thu Jun 2 16:06:25 2022] POST /identity/v3/users => generated 289 bytes in 228 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 16:06:26.008679 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a86d82e-8982-4743-8b00-19c70e2fdd18 admin admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:06:26.053431 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 805/1626] 10.222.0.59 () {58 vars in 1058 bytes} [Thu Jun 2 16:06:25 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 16:06:26.054338 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edfc7358-d102-433b-94a3-42aee3cf6028 None None] Authenticating user token {{(pid=80396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:06:26.068346 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edfc7358-d102-433b-94a3-42aee3cf6028 None None] Validating token access rules against request {{(pid=80396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:06:26.073590 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da6d0fea-5d38-414c-8b2e-8d2c6cebe982 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f73d5a98be74242b45222df39fb6213', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:06:26.074559 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6d0fea-5d38-414c-8b2e-8d2c6cebe982 admin admin] REQUEST_METHOD: `PUT` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:06:26.075051 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6d0fea-5d38-414c-8b2e-8d2c6cebe982 admin admin] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:06:26.075163 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6d0fea-5d38-414c-8b2e-8d2c6cebe982 admin admin] PATH_INFO: `/v3/projects/9d27ff04715c4941bd75652098cc72a4/users/80eb5ec3ec6a47539e53341d5dedff30/roles/f1e0c25f6e9049e897cb7350c7e54ab3` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:06:26.077328 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da6d0fea-5d38-414c-8b2e-8d2c6cebe982 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9d27ff04715c4941bd75652098cc72a4, user_id=80eb5ec3ec6a47539e53341d5dedff30, role_id=f1e0c25f6e9049e897cb7350c7e54ab3)` {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:06:26.080088 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da6d0fea-5d38-414c-8b2e-8d2c6cebe982 admin admin] RBAC: Authorization granted {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:06:26.097006 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 806/1627] 10.222.0.59 () {60 vars in 1482 bytes} [Thu Jun 2 16:06:26 2022] PUT /identity/v3/projects/9d27ff04715c4941bd75652098cc72a4/users/80eb5ec3ec6a47539e53341d5dedff30/roles/f1e0c25f6e9049e897cb7350c7e54ab3 => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 16:06:26.097006 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da6d0fea-5d38-414c-8b2e-8d2c6cebe982 admin admin] Authenticating user token {{(pid=80396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:06:26.099662 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a86d82e-8982-4743-8b00-19c70e2fdd18 admin admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:06:26.174582 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da6d0fea-5d38-414c-8b2e-8d2c6cebe982 admin admin] Validating token access rules against request {{(pid=80396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:06:26.179115 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33c3cee3-5532-441e-b339-f241e24d4657 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52f9fe4b13574516bb0a8e2aa11a61e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c87c981909d4b8db02783421818c79b', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:06:26.179777 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c3cee3-5532-441e-b339-f241e24d4657 service nova] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:06:26.180062 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c3cee3-5532-441e-b339-f241e24d4657 service nova] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:06:26.180200 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8d6fd37-6f36-4729-b801-5c61d44143a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f73d5a98be74242b45222df39fb6213', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:06:26.180328 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c3cee3-5532-441e-b339-f241e24d4657 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:06:26.180986 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d6fd37-6f36-4729-b801-5c61d44143a9 admin admin] REQUEST_METHOD: `GET` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:06:26.181527 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d6fd37-6f36-4729-b801-5c61d44143a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:06:26.181968 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d6fd37-6f36-4729-b801-5c61d44143a9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:06:26.182796 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8d6fd37-6f36-4729-b801-5c61d44143a9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:06:26.184648 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8d6fd37-6f36-4729-b801-5c61d44143a9 admin admin] RBAC: Authorization granted {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:06:26.198463 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 807/1628] 10.222.0.59 () {58 vars in 1121 bytes} [Thu Jun 2 16:06:26 2022] GET /identity/v3/roles => generated 1420 bytes in 105 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 16:06:26.199746 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8d6fd37-6f36-4729-b801-5c61d44143a9 admin admin] Authenticating user token {{(pid=80396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:06:26.255317 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8d6fd37-6f36-4729-b801-5c61d44143a9 admin admin] Validating token access rules against request {{(pid=80396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:06:26.255317 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e681c58-0615-49ca-aa18-320ff750172f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52f9fe4b13574516bb0a8e2aa11a61e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c87c981909d4b8db02783421818c79b', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:06:26.255317 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e681c58-0615-49ca-aa18-320ff750172f service nova] REQUEST_METHOD: `GET` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:06:26.255317 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e681c58-0615-49ca-aa18-320ff750172f service nova] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:06:26.256280 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e681c58-0615-49ca-aa18-320ff750172f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:06:26.261939 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33c3cee3-5532-441e-b339-f241e24d4657 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:06:26.264106 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33c3cee3-5532-441e-b339-f241e24d4657 service nova] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:06:26.278235 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 822/1629] 10.222.0.59 () {60 vars in 1365 bytes} [Thu Jun 2 16:06:26 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 271 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 16:06:26.280699 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc5302d-6342-4e7e-802c-a659aba2eb73 None None] REQUEST_METHOD: `POST` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:06:26.281273 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc5302d-6342-4e7e-802c-a659aba2eb73 None None] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:06:26.281725 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc5302d-6342-4e7e-802c-a659aba2eb73 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:06:26.313866 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.auth.core [None req-2bc5302d-6342-4e7e-802c-a659aba2eb73 None None] MFA Rules not processed for user `80eb5ec3ec6a47539e53341d5dedff30`. Rule list: `[]` (Enabled: `True`). {{(pid=80395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 16:06:26.315214 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.fernet_utils [None req-2bc5302d-6342-4e7e-802c-a659aba2eb73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:06:26.371505 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e681c58-0615-49ca-aa18-320ff750172f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:06:26.394267 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e681c58-0615-49ca-aa18-320ff750172f service nova] RBAC: Authorization granted {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:06:26.432194 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 823/1630] 10.222.0.59 () {58 vars in 957 bytes} [Thu Jun 2 16:06:26 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 16:06:26.432194 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bc5302d-6342-4e7e-802c-a659aba2eb73 None None] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:06:26.432819 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 808/1631] 10.222.0.59 () {60 vars in 1365 bytes} [Thu Jun 2 16:06:26 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 234 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 16:06:26.447516 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e681c58-0615-49ca-aa18-320ff750172f service nova] Authenticating user token {{(pid=80396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:06:26.491110 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bc5302d-6342-4e7e-802c-a659aba2eb73 None None] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:06:26.507138 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1ff9a9d-af9b-42a9-88de-2e1f33a54dc9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f73d5a98be74242b45222df39fb6213', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:06:26.508298 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ff9a9d-af9b-42a9-88de-2e1f33a54dc9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:06:26.508599 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ff9a9d-af9b-42a9-88de-2e1f33a54dc9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:06:26.508902 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ff9a9d-af9b-42a9-88de-2e1f33a54dc9 admin admin] PATH_INFO: `/v3/projects/16f7452f60e4403296a89bfc279f30c5/users/3ecf10cbd56c47d7a81a9774b839245d/roles/f1e0c25f6e9049e897cb7350c7e54ab3` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:06:26.542883 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1ff9a9d-af9b-42a9-88de-2e1f33a54dc9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=16f7452f60e4403296a89bfc279f30c5, user_id=3ecf10cbd56c47d7a81a9774b839245d, role_id=f1e0c25f6e9049e897cb7350c7e54ab3)` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:06:26.546222 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1ff9a9d-af9b-42a9-88de-2e1f33a54dc9 admin admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:06:26.576726 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e681c58-0615-49ca-aa18-320ff750172f service nova] Validating token access rules against request {{(pid=80396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:06:26.581883 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-640ce170-d7f8-4b62-bb7a-7cc7fdc8be08 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6534961c369940a5b88f310c6450250b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c87c981909d4b8db02783421818c79b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:06:26.598518 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-640ce170-d7f8-4b62-bb7a-7cc7fdc8be08 service cinder] REQUEST_METHOD: `GET` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:06:26.598518 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-640ce170-d7f8-4b62-bb7a-7cc7fdc8be08 service cinder] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:06:26.598518 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-640ce170-d7f8-4b62-bb7a-7cc7fdc8be08 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:06:26.598518 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-640ce170-d7f8-4b62-bb7a-7cc7fdc8be08 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:06:26.598518 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-640ce170-d7f8-4b62-bb7a-7cc7fdc8be08 service cinder] RBAC: Authorization granted {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:06:26.610783 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 809/1632] 10.222.0.59 () {60 vars in 1365 bytes} [Thu Jun 2 16:06:26 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 164 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 16:06:26.639902 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39222248-2e98-4862-b836-a70f75459dcb None None] REQUEST_METHOD: `GET` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:06:26.640212 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39222248-2e98-4862-b836-a70f75459dcb None None] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:06:26.640485 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39222248-2e98-4862-b836-a70f75459dcb None None] PATH_INFO: `/` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:06:26.642207 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 810/1633] 10.222.0.59 () {54 vars in 912 bytes} [Thu Jun 2 16:06:26 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 02 16:06:26.647968 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a372ed1f-95a5-4f9f-8732-16bb2ccad2f8 None None] REQUEST_METHOD: `POST` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:06:26.648381 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a372ed1f-95a5-4f9f-8732-16bb2ccad2f8 None None] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:06:26.648768 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a372ed1f-95a5-4f9f-8732-16bb2ccad2f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:06:26.672198 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.auth.core [None req-a372ed1f-95a5-4f9f-8732-16bb2ccad2f8 None None] MFA Rules not processed for user `52f9fe4b13574516bb0a8e2aa11a61e8`. Rule list: `[]` (Enabled: `True`). {{(pid=80396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 16:06:26.673656 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.fernet_utils [None req-a372ed1f-95a5-4f9f-8732-16bb2ccad2f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:06:26.684959 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 811/1634] 10.222.0.59 () {58 vars in 1009 bytes} [Thu Jun 2 16:06:26 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 02 16:06:26.705655 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a372ed1f-95a5-4f9f-8732-16bb2ccad2f8 None None] Authenticating user token {{(pid=80396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:06:26.716745 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a372ed1f-95a5-4f9f-8732-16bb2ccad2f8 None None] Validating token access rules against request {{(pid=80396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:06:26.720685 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1d60e88-bea2-4b8c-b7a7-0970fd454925 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6534961c369940a5b88f310c6450250b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c87c981909d4b8db02783421818c79b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:06:26.721331 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d60e88-bea2-4b8c-b7a7-0970fd454925 service cinder] REQUEST_METHOD: `GET` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:06:26.721617 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d60e88-bea2-4b8c-b7a7-0970fd454925 service cinder] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:06:26.721893 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d60e88-bea2-4b8c-b7a7-0970fd454925 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:06:26.732471 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1d60e88-bea2-4b8c-b7a7-0970fd454925 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:06:26.734035 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1d60e88-bea2-4b8c-b7a7-0970fd454925 service cinder] RBAC: Authorization granted {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:06:26.746214 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 812/1635] 10.222.0.59 () {60 vars in 1365 bytes} [Thu Jun 2 16:06:26 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 02 16:06:26.797340 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 824/1636] 10.222.0.59 () {60 vars in 1482 bytes} [Thu Jun 2 16:06:26 2022] PUT /identity/v3/projects/16f7452f60e4403296a89bfc279f30c5/users/3ecf10cbd56c47d7a81a9774b839245d/roles/f1e0c25f6e9049e897cb7350c7e54ab3 => generated 0 bytes in 367 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 16:06:26.806443 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1d60e88-bea2-4b8c-b7a7-0970fd454925 service cinder] Authenticating user token {{(pid=80396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:06:26.813921 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1d60e88-bea2-4b8c-b7a7-0970fd454925 service cinder] Validating token access rules against request {{(pid=80396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:06:26.960026 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3217ac62-09a0-4ac3-91c3-5a90b0a1b975 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f73d5a98be74242b45222df39fb6213', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:06:26.960710 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d75a60-e6dc-41ec-8b99-a5640082e4e9 None None] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:06:26.960834 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d75a60-e6dc-41ec-8b99-a5640082e4e9 None None] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:06:26.961074 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d75a60-e6dc-41ec-8b99-a5640082e4e9 None None] PATH_INFO: `/` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:06:26.961184 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3217ac62-09a0-4ac3-91c3-5a90b0a1b975 admin admin] REQUEST_METHOD: `GET` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:06:26.961470 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3217ac62-09a0-4ac3-91c3-5a90b0a1b975 admin admin] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:06:26.962014 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3217ac62-09a0-4ac3-91c3-5a90b0a1b975 admin admin] PATH_INFO: `/v3/roles` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:06:26.963537 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 825/1637] 10.222.0.59 () {54 vars in 912 bytes} [Thu Jun 2 16:06:26 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 02 16:06:26.966059 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3217ac62-09a0-4ac3-91c3-5a90b0a1b975 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:06:26.970105 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3217ac62-09a0-4ac3-91c3-5a90b0a1b975 admin admin] RBAC: Authorization granted {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:06:26.970354 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-298913b9-14f5-4cf0-a33e-1379641f423d None None] REQUEST_METHOD: `POST` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:06:26.970722 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-298913b9-14f5-4cf0-a33e-1379641f423d None None] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:06:26.971028 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-298913b9-14f5-4cf0-a33e-1379641f423d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:06:26.994630 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 16:06:27.000095 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 813/1638] 10.222.0.59 () {58 vars in 1121 bytes} [Thu Jun 2 16:06:26 2022] GET /identity/v3/roles => generated 1420 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 16:06:27.010612 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3217ac62-09a0-4ac3-91c3-5a90b0a1b975 admin admin] Authenticating user token {{(pid=80396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:06:27.011022 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.auth.core [None req-298913b9-14f5-4cf0-a33e-1379641f423d None None] MFA Rules not processed for user `52f9fe4b13574516bb0a8e2aa11a61e8`. Rule list: `[]` (Enabled: `True`). {{(pid=80395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 16:06:27.012438 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.fernet_utils [None req-298913b9-14f5-4cf0-a33e-1379641f423d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:06:27.024088 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3217ac62-09a0-4ac3-91c3-5a90b0a1b975 admin admin] Validating token access rules against request {{(pid=80396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:06:27.033702 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2ebf6c5-d67e-4178-9628-39af8ac35ff3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f73d5a98be74242b45222df39fb6213', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:06:27.035864 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ebf6c5-d67e-4178-9628-39af8ac35ff3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:06:27.037021 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ebf6c5-d67e-4178-9628-39af8ac35ff3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:06:27.037624 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ebf6c5-d67e-4178-9628-39af8ac35ff3 admin admin] PATH_INFO: `/v3/projects/16f7452f60e4403296a89bfc279f30c5/users/3ecf10cbd56c47d7a81a9774b839245d/roles/f1e0c25f6e9049e897cb7350c7e54ab3` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:06:27.046610 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2ebf6c5-d67e-4178-9628-39af8ac35ff3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=16f7452f60e4403296a89bfc279f30c5, user_id=3ecf10cbd56c47d7a81a9774b839245d, role_id=f1e0c25f6e9049e897cb7350c7e54ab3)` {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:06:27.049225 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2ebf6c5-d67e-4178-9628-39af8ac35ff3 admin admin] RBAC: Authorization granted {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:06:27.061778 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 814/1639] 10.222.0.59 () {60 vars in 1482 bytes} [Thu Jun 2 16:06:27 2022] PUT /identity/v3/projects/16f7452f60e4403296a89bfc279f30c5/users/3ecf10cbd56c47d7a81a9774b839245d/roles/f1e0c25f6e9049e897cb7350c7e54ab3 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 02 16:06:27.073413 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197a539c-776b-4fe7-8ff2-b78fb3c8dd7d None None] REQUEST_METHOD: `POST` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:06:27.073769 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197a539c-776b-4fe7-8ff2-b78fb3c8dd7d None None] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:06:27.074256 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197a539c-776b-4fe7-8ff2-b78fb3c8dd7d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:06:27.129198 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.auth.core [None req-197a539c-776b-4fe7-8ff2-b78fb3c8dd7d None None] MFA Rules not processed for user `3ecf10cbd56c47d7a81a9774b839245d`. Rule list: `[]` (Enabled: `True`). {{(pid=80396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 16:06:27.130565 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.fernet_utils [None req-197a539c-776b-4fe7-8ff2-b78fb3c8dd7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:06:27.136243 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 826/1640] 10.222.0.59 () {58 vars in 1009 bytes} [Thu Jun 2 16:06:26 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 02 16:06:27.221563 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 815/1641] 10.222.0.59 () {58 vars in 957 bytes} [Thu Jun 2 16:06:27 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 16:06:27.227883 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-298913b9-14f5-4cf0-a33e-1379641f423d None None] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:06:27.302830 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-298913b9-14f5-4cf0-a33e-1379641f423d None None] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:06:27.359581 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27213eca-fb1f-44a2-a38c-8f89ca2fbd82 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6534961c369940a5b88f310c6450250b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c87c981909d4b8db02783421818c79b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:06:27.370284 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27213eca-fb1f-44a2-a38c-8f89ca2fbd82 service cinder] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:06:27.370284 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27213eca-fb1f-44a2-a38c-8f89ca2fbd82 service cinder] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:06:27.370284 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27213eca-fb1f-44a2-a38c-8f89ca2fbd82 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:06:27.429098 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27213eca-fb1f-44a2-a38c-8f89ca2fbd82 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:06:27.430597 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27213eca-fb1f-44a2-a38c-8f89ca2fbd82 service cinder] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:06:27.442551 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 827/1642] 10.222.0.59 () {60 vars in 1365 bytes} [Thu Jun 2 16:06:27 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 216 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 16:06:27.533953 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-197a539c-776b-4fe7-8ff2-b78fb3c8dd7d None None] Authenticating user token {{(pid=80396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:06:27.549240 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-197a539c-776b-4fe7-8ff2-b78fb3c8dd7d None None] Validating token access rules against request {{(pid=80396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:06:27.553124 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf6003a0-4cfc-4b98-840b-bb4e2d868893 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6534961c369940a5b88f310c6450250b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c87c981909d4b8db02783421818c79b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:06:27.554794 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf6003a0-4cfc-4b98-840b-bb4e2d868893 service cinder] REQUEST_METHOD: `GET` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:06:27.557879 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf6003a0-4cfc-4b98-840b-bb4e2d868893 service cinder] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:06:27.560940 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf6003a0-4cfc-4b98-840b-bb4e2d868893 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:06:27.578067 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf6003a0-4cfc-4b98-840b-bb4e2d868893 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:06:27.579842 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf6003a0-4cfc-4b98-840b-bb4e2d868893 service cinder] RBAC: Authorization granted {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:06:27.591865 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 816/1643] 10.222.0.59 () {60 vars in 1365 bytes} [Thu Jun 2 16:06:27 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 58 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 16:06:27.840356 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG dbcounter [-] [80396] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 16:06:28.200382 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27213eca-fb1f-44a2-a38c-8f89ca2fbd82 service cinder] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:06:28.200382 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27213eca-fb1f-44a2-a38c-8f89ca2fbd82 service cinder] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:06:28.200382 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-189d9a5f-be29-4a78-8194-5117ff70effe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f73d5a98be74242b45222df39fb6213', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:06:28.200382 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-189d9a5f-be29-4a78-8194-5117ff70effe admin admin] REQUEST_METHOD: `DELETE` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:06:28.222411 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-189d9a5f-be29-4a78-8194-5117ff70effe admin admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:06:28.222411 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-189d9a5f-be29-4a78-8194-5117ff70effe admin admin] PATH_INFO: `/v3/users/af0e4caac85b419590b35b3d0faf875e` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:06:28.222411 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-189d9a5f-be29-4a78-8194-5117ff70effe admin admin] RBAC: Authorizing `identity:delete_user(user_id=af0e4caac85b419590b35b3d0faf875e)` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:06:28.222411 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: WARNING py.warnings [None req-189d9a5f-be29-4a78-8194-5117ff70effe admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 02 16:06:28.222411 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: warnings.warn(msg) Jun 02 16:06:28.222411 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: Jun 02 16:06:28.222411 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-189d9a5f-be29-4a78-8194-5117ff70effe admin admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:06:28.344865 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ff47e6-d6a8-4abe-95a2-f7023874fbb1 None None] REQUEST_METHOD: `POST` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:06:28.345420 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ff47e6-d6a8-4abe-95a2-f7023874fbb1 None None] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:06:28.345420 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ff47e6-d6a8-4abe-95a2-f7023874fbb1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:06:28.375683 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.auth.core [None req-a1ff47e6-d6a8-4abe-95a2-f7023874fbb1 None None] MFA Rules not processed for user `1400263107254337be69dc15e8d046d4`. Rule list: `[]` (Enabled: `True`). {{(pid=80396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 16:06:28.377127 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.fernet_utils [None req-a1ff47e6-d6a8-4abe-95a2-f7023874fbb1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:06:28.453381 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 817/1644] 10.222.0.59 () {58 vars in 957 bytes} [Thu Jun 2 16:06:28 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 02 16:06:28.464043 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f6faf6d-ccfe-48bb-887e-ef2a201f06bc None None] REQUEST_METHOD: `POST` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:06:28.464413 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f6faf6d-ccfe-48bb-887e-ef2a201f06bc None None] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:06:28.464808 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f6faf6d-ccfe-48bb-887e-ef2a201f06bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:06:28.483070 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.auth.core [None req-3f6faf6d-ccfe-48bb-887e-ef2a201f06bc None None] MFA Rules not processed for user `1400263107254337be69dc15e8d046d4`. Rule list: `[]` (Enabled: `True`). {{(pid=80396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 16:06:28.484388 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.fernet_utils [None req-3f6faf6d-ccfe-48bb-887e-ef2a201f06bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:06:28.515954 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 818/1645] 10.222.0.59 () {58 vars in 957 bytes} [Thu Jun 2 16:06:28 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 02 16:06:28.544038 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.notifications [None req-189d9a5f-be29-4a78-8194-5117ff70effe admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'af0e4caac85b419590b35b3d0faf875e'} {{(pid=80395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:06:28.544177 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f6faf6d-ccfe-48bb-887e-ef2a201f06bc None None] Authenticating user token {{(pid=80396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:06:28.560903 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f6faf6d-ccfe-48bb-887e-ef2a201f06bc None None] Validating token access rules against request {{(pid=80396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:06:28.576054 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa6c5f74-1c18-47e4-bb06-6bbb073a01cf service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52f9fe4b13574516bb0a8e2aa11a61e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c87c981909d4b8db02783421818c79b', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:06:28.576864 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6c5f74-1c18-47e4-bb06-6bbb073a01cf service nova] REQUEST_METHOD: `GET` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:06:28.577154 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6c5f74-1c18-47e4-bb06-6bbb073a01cf service nova] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:06:28.577432 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6c5f74-1c18-47e4-bb06-6bbb073a01cf service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:06:28.595525 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa6c5f74-1c18-47e4-bb06-6bbb073a01cf service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:06:28.597400 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa6c5f74-1c18-47e4-bb06-6bbb073a01cf service nova] RBAC: Authorization granted {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:06:28.609962 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 819/1646] 10.222.0.59 () {60 vars in 1365 bytes} [Thu Jun 2 16:06:28 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 66 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 16:06:28.723635 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.notifications [None req-189d9a5f-be29-4a78-8194-5117ff70effe admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'af0e4caac85b419590b35b3d0faf875e'} {{(pid=80395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:06:28.738385 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writing DB stats keystone:SELECT=100 {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 16:06:28.776253 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.notifications [None req-189d9a5f-be29-4a78-8194-5117ff70effe admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'af0e4caac85b419590b35b3d0faf875e'} {{(pid=80395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:06:28.777129 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.notifications [None req-189d9a5f-be29-4a78-8194-5117ff70effe admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'af0e4caac85b419590b35b3d0faf875e'} {{(pid=80395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:06:28.812158 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.notifications [None req-189d9a5f-be29-4a78-8194-5117ff70effe admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'af0e4caac85b419590b35b3d0faf875e'} {{(pid=80395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:06:28.820481 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 828/1647] 10.222.0.59 () {58 vars in 1223 bytes} [Thu Jun 2 16:06:27 2022] DELETE /identity/v3/users/af0e4caac85b419590b35b3d0faf875e => generated 0 bytes in 861 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 16:06:28.826513 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29894c88-6fbf-4e19-b08d-861c7a853304 None None] REQUEST_METHOD: `POST` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:06:28.826877 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29894c88-6fbf-4e19-b08d-861c7a853304 None None] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:06:28.827230 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29894c88-6fbf-4e19-b08d-861c7a853304 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:06:28.859412 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.auth.core [None req-29894c88-6fbf-4e19-b08d-861c7a853304 None None] MFA Rules not processed for user `400d1f4db9de49638549e5db29a041e1`. Rule list: `[]` (Enabled: `True`). {{(pid=80396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 16:06:28.862841 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.fernet_utils [None req-29894c88-6fbf-4e19-b08d-861c7a853304 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:06:28.999213 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-189d9a5f-be29-4a78-8194-5117ff70effe admin admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:06:29.002844 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.fernet_utils [None req-189d9a5f-be29-4a78-8194-5117ff70effe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:06:29.015327 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 820/1648] 10.222.0.59 () {58 vars in 957 bytes} [Thu Jun 2 16:06:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 16:06:29.031440 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-189d9a5f-be29-4a78-8194-5117ff70effe admin admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:06:29.031926 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29894c88-6fbf-4e19-b08d-861c7a853304 None None] Authenticating user token {{(pid=80396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:06:29.034621 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.fernet_utils [None req-29894c88-6fbf-4e19-b08d-861c7a853304 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:06:29.044691 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37c3e6a1-37ca-4f3c-95e9-3fc021b5fb43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f73d5a98be74242b45222df39fb6213', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:06:29.045967 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c3e6a1-37ca-4f3c-95e9-3fc021b5fb43 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:06:29.049569 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c3e6a1-37ca-4f3c-95e9-3fc021b5fb43 admin admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:06:29.050039 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c3e6a1-37ca-4f3c-95e9-3fc021b5fb43 admin admin] PATH_INFO: `/v3/users/ac18c28774db4af49a0f1860972b940e` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:06:29.060729 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37c3e6a1-37ca-4f3c-95e9-3fc021b5fb43 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ac18c28774db4af49a0f1860972b940e)` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:06:29.060729 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37c3e6a1-37ca-4f3c-95e9-3fc021b5fb43 admin admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:06:29.158189 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29894c88-6fbf-4e19-b08d-861c7a853304 None None] Validating token access rules against request {{(pid=80396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:06:29.171647 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40cb5462-4f71-4d38-8cbf-e25c0870a650 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9af40ddfe9ff4be3887b068f13a28dc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c87c981909d4b8db02783421818c79b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:06:29.172428 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40cb5462-4f71-4d38-8cbf-e25c0870a650 service neutron] REQUEST_METHOD: `GET` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:06:29.172722 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40cb5462-4f71-4d38-8cbf-e25c0870a650 service neutron] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:06:29.176193 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40cb5462-4f71-4d38-8cbf-e25c0870a650 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:06:29.193140 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40cb5462-4f71-4d38-8cbf-e25c0870a650 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:06:29.194634 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40cb5462-4f71-4d38-8cbf-e25c0870a650 service neutron] RBAC: Authorization granted {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:06:29.217847 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 821/1649] 10.222.0.59 () {60 vars in 1365 bytes} [Thu Jun 2 16:06:29 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 186 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 16:06:29.410848 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.notifications [None req-37c3e6a1-37ca-4f3c-95e9-3fc021b5fb43 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ac18c28774db4af49a0f1860972b940e'} {{(pid=80395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:06:29.502724 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.notifications [None req-37c3e6a1-37ca-4f3c-95e9-3fc021b5fb43 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ac18c28774db4af49a0f1860972b940e'} {{(pid=80395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:06:29.544953 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78501215-d73b-4dd9-846d-9ffbad4a6bbe None None] REQUEST_METHOD: `GET` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:06:29.544953 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78501215-d73b-4dd9-846d-9ffbad4a6bbe None None] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:06:29.544953 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78501215-d73b-4dd9-846d-9ffbad4a6bbe None None] PATH_INFO: `/` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:06:29.545529 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 822/1650] 10.222.0.59 () {54 vars in 912 bytes} [Thu Jun 2 16:06:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 16:06:29.546372 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.notifications [None req-37c3e6a1-37ca-4f3c-95e9-3fc021b5fb43 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ac18c28774db4af49a0f1860972b940e'} {{(pid=80395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:06:29.547242 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.notifications [None req-37c3e6a1-37ca-4f3c-95e9-3fc021b5fb43 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ac18c28774db4af49a0f1860972b940e'} {{(pid=80395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:06:29.551586 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a465c5ac-6271-4c4c-b7c9-5d4a740aa63f None None] REQUEST_METHOD: `POST` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:06:29.551900 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a465c5ac-6271-4c4c-b7c9-5d4a740aa63f None None] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:06:29.552192 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a465c5ac-6271-4c4c-b7c9-5d4a740aa63f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:06:29.560920 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.notifications [None req-37c3e6a1-37ca-4f3c-95e9-3fc021b5fb43 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ac18c28774db4af49a0f1860972b940e'} {{(pid=80395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:06:29.568404 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 829/1651] 10.222.0.59 () {58 vars in 1223 bytes} [Thu Jun 2 16:06:28 2022] DELETE /identity/v3/users/ac18c28774db4af49a0f1860972b940e => generated 0 bytes in 570 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 02 16:06:29.573084 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-826bc81e-3f6f-4d66-af33-11853e223165 None None] REQUEST_METHOD: `POST` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:06:29.573424 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-826bc81e-3f6f-4d66-af33-11853e223165 None None] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:06:29.573701 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-826bc81e-3f6f-4d66-af33-11853e223165 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:06:29.605823 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.auth.core [None req-826bc81e-3f6f-4d66-af33-11853e223165 None None] MFA Rules not processed for user `400d1f4db9de49638549e5db29a041e1`. Rule list: `[]` (Enabled: `True`). {{(pid=80395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 16:06:29.605823 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.fernet_utils [None req-826bc81e-3f6f-4d66-af33-11853e223165 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:06:29.628730 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.auth.core [None req-a465c5ac-6271-4c4c-b7c9-5d4a740aa63f None None] MFA Rules not processed for user `9af40ddfe9ff4be3887b068f13a28dc0`. Rule list: `[]` (Enabled: `True`). {{(pid=80396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 16:06:29.629826 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.fernet_utils [None req-a465c5ac-6271-4c4c-b7c9-5d4a740aa63f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:06:29.699498 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 823/1652] 10.222.0.59 () {58 vars in 1009 bytes} [Thu Jun 2 16:06:29 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 16:06:29.700397 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a465c5ac-6271-4c4c-b7c9-5d4a740aa63f None None] Authenticating user token {{(pid=80396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:06:29.701858 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.fernet_utils [None req-a465c5ac-6271-4c4c-b7c9-5d4a740aa63f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:06:29.706829 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 830/1653] 10.222.0.59 () {58 vars in 957 bytes} [Thu Jun 2 16:06:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 16:06:29.711731 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-826bc81e-3f6f-4d66-af33-11853e223165 None None] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:06:29.713602 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.fernet_utils [None req-826bc81e-3f6f-4d66-af33-11853e223165 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:06:29.729230 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a465c5ac-6271-4c4c-b7c9-5d4a740aa63f None None] Validating token access rules against request {{(pid=80396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:06:29.730254 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-826bc81e-3f6f-4d66-af33-11853e223165 None None] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:06:29.734621 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73380b3e-ec77-4048-b4d1-e773ce375996 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f73d5a98be74242b45222df39fb6213', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:06:29.735114 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b2a9bc4-5cf6-4759-927b-42ee2726d6d8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9af40ddfe9ff4be3887b068f13a28dc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c87c981909d4b8db02783421818c79b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:06:29.735731 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73380b3e-ec77-4048-b4d1-e773ce375996 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:06:29.735964 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2a9bc4-5cf6-4759-927b-42ee2726d6d8 service neutron] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:06:29.736063 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73380b3e-ec77-4048-b4d1-e773ce375996 admin admin] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:06:29.736263 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73380b3e-ec77-4048-b4d1-e773ce375996 admin admin] PATH_INFO: `/v3/users/995a7b4998ed405da66ab855d16f138c` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:06:29.736537 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2a9bc4-5cf6-4759-927b-42ee2726d6d8 service neutron] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:06:29.737013 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2a9bc4-5cf6-4759-927b-42ee2726d6d8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:06:29.737624 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73380b3e-ec77-4048-b4d1-e773ce375996 admin admin] RBAC: Authorizing `identity:delete_user(user_id=995a7b4998ed405da66ab855d16f138c)` {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:06:29.739606 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73380b3e-ec77-4048-b4d1-e773ce375996 admin admin] RBAC: Authorization granted {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:06:29.753924 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b2a9bc4-5cf6-4759-927b-42ee2726d6d8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:06:29.755706 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b2a9bc4-5cf6-4759-927b-42ee2726d6d8 service neutron] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:06:29.772539 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 831/1654] 10.222.0.59 () {60 vars in 1365 bytes} [Thu Jun 2 16:06:29 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 61 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 02 16:06:29.773660 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b2a9bc4-5cf6-4759-927b-42ee2726d6d8 service neutron] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:06:29.781637 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 16:06:29.785924 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b2a9bc4-5cf6-4759-927b-42ee2726d6d8 service neutron] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:06:29.799123 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0a26898-eb62-4678-a198-c7770295c5cf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9af40ddfe9ff4be3887b068f13a28dc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c87c981909d4b8db02783421818c79b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:06:29.799831 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a26898-eb62-4678-a198-c7770295c5cf service neutron] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:06:29.800120 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a26898-eb62-4678-a198-c7770295c5cf service neutron] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:06:29.800400 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a26898-eb62-4678-a198-c7770295c5cf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:06:29.813060 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0a26898-eb62-4678-a198-c7770295c5cf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:06:29.815035 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0a26898-eb62-4678-a198-c7770295c5cf service neutron] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:06:29.836762 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 832/1655] 10.222.0.59 () {60 vars in 1365 bytes} [Thu Jun 2 16:06:29 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 63 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 16:06:29.876186 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG dbcounter [-] [80396] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 16:06:30.110838 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.notifications [None req-73380b3e-ec77-4048-b4d1-e773ce375996 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '995a7b4998ed405da66ab855d16f138c'} {{(pid=80396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:06:30.112188 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.notifications [None req-73380b3e-ec77-4048-b4d1-e773ce375996 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '995a7b4998ed405da66ab855d16f138c'} {{(pid=80396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:06:30.261766 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.notifications [None req-73380b3e-ec77-4048-b4d1-e773ce375996 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '995a7b4998ed405da66ab855d16f138c'} {{(pid=80396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:06:30.289536 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.notifications [None req-73380b3e-ec77-4048-b4d1-e773ce375996 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '995a7b4998ed405da66ab855d16f138c'} {{(pid=80396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:06:30.299339 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.notifications [None req-73380b3e-ec77-4048-b4d1-e773ce375996 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '995a7b4998ed405da66ab855d16f138c'} {{(pid=80396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:06:30.308431 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 824/1656] 10.222.0.59 () {58 vars in 1223 bytes} [Thu Jun 2 16:06:29 2022] DELETE /identity/v3/users/995a7b4998ed405da66ab855d16f138c => generated 0 bytes in 608 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 16:06:30.314344 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-550f8fc9-1622-477c-aa2e-ba32d52dc790 None None] REQUEST_METHOD: `POST` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:06:30.316083 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-550f8fc9-1622-477c-aa2e-ba32d52dc790 None None] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:06:30.316083 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-550f8fc9-1622-477c-aa2e-ba32d52dc790 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:06:30.352654 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.auth.core [None req-550f8fc9-1622-477c-aa2e-ba32d52dc790 None None] MFA Rules not processed for user `400d1f4db9de49638549e5db29a041e1`. Rule list: `[]` (Enabled: `True`). {{(pid=80395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 16:06:30.354545 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.fernet_utils [None req-550f8fc9-1622-477c-aa2e-ba32d52dc790 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:06:30.502723 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 833/1657] 10.222.0.59 () {58 vars in 957 bytes} [Thu Jun 2 16:06:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 16:06:30.535863 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73380b3e-ec77-4048-b4d1-e773ce375996 admin admin] Authenticating user token {{(pid=80396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:06:30.537516 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.fernet_utils [None req-73380b3e-ec77-4048-b4d1-e773ce375996 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:06:30.628992 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73380b3e-ec77-4048-b4d1-e773ce375996 admin admin] Validating token access rules against request {{(pid=80396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:06:30.635392 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06634b86-07fd-4fb2-873e-c4f976e8b9b7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9af40ddfe9ff4be3887b068f13a28dc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c87c981909d4b8db02783421818c79b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:06:30.636479 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06634b86-07fd-4fb2-873e-c4f976e8b9b7 service neutron] REQUEST_METHOD: `GET` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:06:30.636758 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06634b86-07fd-4fb2-873e-c4f976e8b9b7 service neutron] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:06:30.637031 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06634b86-07fd-4fb2-873e-c4f976e8b9b7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:06:30.654294 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-550f8fc9-1622-477c-aa2e-ba32d52dc790 None None] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:06:30.655791 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.fernet_utils [None req-550f8fc9-1622-477c-aa2e-ba32d52dc790 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:06:30.670735 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06634b86-07fd-4fb2-873e-c4f976e8b9b7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:06:30.675333 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06634b86-07fd-4fb2-873e-c4f976e8b9b7 service neutron] RBAC: Authorization granted {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:06:30.678297 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-550f8fc9-1622-477c-aa2e-ba32d52dc790 None None] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:06:30.691919 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44fa99ac-d59c-45c3-98c9-bade0cca1ab1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f73d5a98be74242b45222df39fb6213', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:06:30.692793 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44fa99ac-d59c-45c3-98c9-bade0cca1ab1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:06:30.693073 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44fa99ac-d59c-45c3-98c9-bade0cca1ab1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:06:30.693349 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44fa99ac-d59c-45c3-98c9-bade0cca1ab1 admin admin] PATH_INFO: `/v3/projects/9cb3beab857d4900b872254c16ddab56` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:06:30.694701 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44fa99ac-d59c-45c3-98c9-bade0cca1ab1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9cb3beab857d4900b872254c16ddab56)` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:06:30.697828 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44fa99ac-d59c-45c3-98c9-bade0cca1ab1 admin admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:06:30.700291 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 825/1658] 10.222.0.59 () {60 vars in 1365 bytes} [Thu Jun 2 16:06:30 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 165 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 16:06:30.918585 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.notifications [None req-44fa99ac-d59c-45c3-98c9-bade0cca1ab1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9cb3beab857d4900b872254c16ddab56', 'request_id': 'req-44fa99ac-d59c-45c3-98c9-bade0cca1ab1'} {{(pid=80395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:06:30.942437 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.notifications [None req-44fa99ac-d59c-45c3-98c9-bade0cca1ab1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9cb3beab857d4900b872254c16ddab56', 'request_id': 'req-44fa99ac-d59c-45c3-98c9-bade0cca1ab1'} {{(pid=80395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:06:31.013867 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9240fea6-4154-4e6d-9ab0-da9a51ae698f None None] REQUEST_METHOD: `GET` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:06:31.014179 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9240fea6-4154-4e6d-9ab0-da9a51ae698f None None] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:06:31.014788 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9240fea6-4154-4e6d-9ab0-da9a51ae698f None None] PATH_INFO: `/` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:06:31.017469 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 826/1659] 10.222.0.59 () {54 vars in 960 bytes} [Thu Jun 2 16:06:31 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 02 16:06:31.023338 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f68d620c-07bc-4ae5-a3b8-71dbf554435a None None] REQUEST_METHOD: `POST` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:06:31.027489 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f68d620c-07bc-4ae5-a3b8-71dbf554435a None None] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:06:31.027489 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f68d620c-07bc-4ae5-a3b8-71dbf554435a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:06:31.045225 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.notifications [None req-44fa99ac-d59c-45c3-98c9-bade0cca1ab1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9cb3beab857d4900b872254c16ddab56', 'request_id': 'req-44fa99ac-d59c-45c3-98c9-bade0cca1ab1'} {{(pid=80395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:06:31.056872 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.auth.core [None req-f68d620c-07bc-4ae5-a3b8-71dbf554435a None None] MFA Rules not processed for user `2b700f6d94374ba4b362a8f0d5b35796`. Rule list: `[]` (Enabled: `True`). {{(pid=80396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 16:06:31.063074 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.notifications [None req-44fa99ac-d59c-45c3-98c9-bade0cca1ab1 admin admin] The token cache is being invalidate because project 9cb3beab857d4900b872254c16ddab56 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80395) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 02 16:06:31.063362 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.notifications [None req-44fa99ac-d59c-45c3-98c9-bade0cca1ab1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:06:31.064235 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.notifications [None req-44fa99ac-d59c-45c3-98c9-bade0cca1ab1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:06:31.065990 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 834/1660] 10.222.0.59 () {58 vars in 1232 bytes} [Thu Jun 2 16:06:30 2022] DELETE /identity/v3/projects/9cb3beab857d4900b872254c16ddab56 => generated 0 bytes in 412 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 16:06:31.069386 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.fernet_utils [None req-f68d620c-07bc-4ae5-a3b8-71dbf554435a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:06:31.071066 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-660d1698-60c2-4d84-a761-7f44578cc037 None None] REQUEST_METHOD: `POST` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:06:31.071578 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-660d1698-60c2-4d84-a761-7f44578cc037 None None] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:06:31.072044 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-660d1698-60c2-4d84-a761-7f44578cc037 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:06:31.139519 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.auth.core [None req-660d1698-60c2-4d84-a761-7f44578cc037 None None] MFA Rules not processed for user `400d1f4db9de49638549e5db29a041e1`. Rule list: `[]` (Enabled: `True`). {{(pid=80395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 16:06:31.143146 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.fernet_utils [None req-660d1698-60c2-4d84-a761-7f44578cc037 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:06:31.277249 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 835/1661] 10.222.0.59 () {58 vars in 957 bytes} [Thu Jun 2 16:06:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 206 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 16:06:31.279364 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45761a8c-9fbf-4809-9c78-32074b73624d None None] REQUEST_METHOD: `POST` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:06:31.279659 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45761a8c-9fbf-4809-9c78-32074b73624d None None] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:06:31.279938 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45761a8c-9fbf-4809-9c78-32074b73624d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:06:31.296562 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 827/1662] 10.222.0.59 () {58 vars in 1057 bytes} [Thu Jun 2 16:06:31 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 274 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 02 16:06:31.308449 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f68d620c-07bc-4ae5-a3b8-71dbf554435a None None] Authenticating user token {{(pid=80396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:06:31.316863 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.auth.core [None req-45761a8c-9fbf-4809-9c78-32074b73624d None None] MFA Rules not processed for user `400d1f4db9de49638549e5db29a041e1`. Rule list: `[]` (Enabled: `True`). {{(pid=80395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 16:06:31.319542 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.fernet_utils [None req-45761a8c-9fbf-4809-9c78-32074b73624d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:06:31.321100 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f68d620c-07bc-4ae5-a3b8-71dbf554435a None None] Validating token access rules against request {{(pid=80396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:06:31.332730 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-417d5917-0d8b-4804-acaa-2fd1a60f7aea service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b700f6d94374ba4b362a8f0d5b35796', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c87c981909d4b8db02783421818c79b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:06:31.333449 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417d5917-0d8b-4804-acaa-2fd1a60f7aea service placement] REQUEST_METHOD: `GET` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:06:31.333823 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417d5917-0d8b-4804-acaa-2fd1a60f7aea service placement] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:06:31.333991 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417d5917-0d8b-4804-acaa-2fd1a60f7aea service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:06:31.338490 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.fernet_utils [None req-417d5917-0d8b-4804-acaa-2fd1a60f7aea service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:06:31.345501 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 836/1663] 10.222.0.59 () {58 vars in 957 bytes} [Thu Jun 2 16:06:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 68 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 16:06:31.349872 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45761a8c-9fbf-4809-9c78-32074b73624d None None] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:06:31.354497 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-417d5917-0d8b-4804-acaa-2fd1a60f7aea service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:06:31.356548 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-417d5917-0d8b-4804-acaa-2fd1a60f7aea service placement] RBAC: Authorization granted {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:06:31.380223 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 828/1664] 10.222.0.59 () {60 vars in 1365 bytes} [Thu Jun 2 16:06:31 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 74 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 16:06:31.401039 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45761a8c-9fbf-4809-9c78-32074b73624d None None] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:06:31.427313 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bedc879f-c3f2-4eea-8286-4d490641ab55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f73d5a98be74242b45222df39fb6213', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:06:31.432626 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bedc879f-c3f2-4eea-8286-4d490641ab55 admin admin] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:06:31.433154 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bedc879f-c3f2-4eea-8286-4d490641ab55 admin admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:06:31.433574 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bedc879f-c3f2-4eea-8286-4d490641ab55 admin admin] PATH_INFO: `/v3/domains` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:06:31.437234 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bedc879f-c3f2-4eea-8286-4d490641ab55 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80395) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 16:06:31.437692 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bedc879f-c3f2-4eea-8286-4d490641ab55 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:06:31.445904 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bedc879f-c3f2-4eea-8286-4d490641ab55 admin admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:06:31.477057 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-417d5917-0d8b-4804-acaa-2fd1a60f7aea service placement] Authenticating user token {{(pid=80396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:06:31.478563 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 837/1665] 10.222.0.59 () {58 vars in 1152 bytes} [Thu Jun 2 16:06:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 129 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 16:06:31.505020 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-417d5917-0d8b-4804-acaa-2fd1a60f7aea service placement] Validating token access rules against request {{(pid=80396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:06:31.505352 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bedc879f-c3f2-4eea-8286-4d490641ab55 admin admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:06:31.507290 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.fernet_utils [None req-bedc879f-c3f2-4eea-8286-4d490641ab55 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:06:31.518232 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee44156c-25e9-4a37-a353-5a76e0de8069 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f73d5a98be74242b45222df39fb6213', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:06:31.518928 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee44156c-25e9-4a37-a353-5a76e0de8069 admin admin] REQUEST_METHOD: `POST` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:06:31.519220 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee44156c-25e9-4a37-a353-5a76e0de8069 admin admin] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:06:31.519504 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee44156c-25e9-4a37-a353-5a76e0de8069 admin admin] PATH_INFO: `/v3/projects` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:06:31.520240 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee44156c-25e9-4a37-a353-5a76e0de8069 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:06:31.522316 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee44156c-25e9-4a37-a353-5a76e0de8069 admin admin] RBAC: Authorization granted {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:06:31.538945 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bedc879f-c3f2-4eea-8286-4d490641ab55 admin admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:06:31.553836 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b27ae91a-c2ee-4933-b9f9-ad7cb7becf70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f73d5a98be74242b45222df39fb6213', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:06:31.554742 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27ae91a-c2ee-4933-b9f9-ad7cb7becf70 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:06:31.555020 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27ae91a-c2ee-4933-b9f9-ad7cb7becf70 admin admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:06:31.555289 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27ae91a-c2ee-4933-b9f9-ad7cb7becf70 admin admin] PATH_INFO: `/v3/projects/3f353ee1888c4536a8e043f3d489bfaa` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:06:31.560834 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b27ae91a-c2ee-4933-b9f9-ad7cb7becf70 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3f353ee1888c4536a8e043f3d489bfaa)` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:06:31.563096 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b27ae91a-c2ee-4933-b9f9-ad7cb7becf70 admin admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:06:31.615565 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writing DB stats keystone:SELECT=84,keystone:DELETE=15,keystone:INSERT=1 {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 16:06:31.648965 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 829/1666] 10.222.0.59 () {60 vars in 1152 bytes} [Thu Jun 2 16:06:31 2022] POST /identity/v3/projects => generated 405 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 16:06:31.654452 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee44156c-25e9-4a37-a353-5a76e0de8069 admin admin] Authenticating user token {{(pid=80396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:06:31.753066 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee44156c-25e9-4a37-a353-5a76e0de8069 admin admin] Validating token access rules against request {{(pid=80396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:06:31.765517 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG dbcounter [-] [80396] Writing DB stats keystone:SELECT=100 {{(pid=80396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 16:06:31.765878 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.notifications [None req-b27ae91a-c2ee-4933-b9f9-ad7cb7becf70 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3f353ee1888c4536a8e043f3d489bfaa', 'request_id': 'req-b27ae91a-c2ee-4933-b9f9-ad7cb7becf70'} {{(pid=80395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:06:31.776352 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.notifications [None req-b27ae91a-c2ee-4933-b9f9-ad7cb7becf70 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3f353ee1888c4536a8e043f3d489bfaa', 'request_id': 'req-b27ae91a-c2ee-4933-b9f9-ad7cb7becf70'} {{(pid=80395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:06:31.842196 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca5253ff-d330-42db-b249-dbf9371038a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f73d5a98be74242b45222df39fb6213', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:06:31.843021 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5253ff-d330-42db-b249-dbf9371038a3 admin admin] REQUEST_METHOD: `POST` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:06:31.843329 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5253ff-d330-42db-b249-dbf9371038a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:06:31.843606 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5253ff-d330-42db-b249-dbf9371038a3 admin admin] PATH_INFO: `/v3/users` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:06:31.844317 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca5253ff-d330-42db-b249-dbf9371038a3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:06:31.846293 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca5253ff-d330-42db-b249-dbf9371038a3 admin admin] RBAC: Authorization granted {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:06:31.891960 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.notifications [None req-b27ae91a-c2ee-4933-b9f9-ad7cb7becf70 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3f353ee1888c4536a8e043f3d489bfaa', 'request_id': 'req-b27ae91a-c2ee-4933-b9f9-ad7cb7becf70'} {{(pid=80395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:06:31.912287 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.notifications [None req-b27ae91a-c2ee-4933-b9f9-ad7cb7becf70 admin admin] The token cache is being invalidate because project 3f353ee1888c4536a8e043f3d489bfaa was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80395) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 02 16:06:31.912602 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.notifications [None req-b27ae91a-c2ee-4933-b9f9-ad7cb7becf70 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:06:31.919417 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.notifications [None req-b27ae91a-c2ee-4933-b9f9-ad7cb7becf70 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:06:31.926768 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 838/1667] 10.222.0.59 () {58 vars in 1232 bytes} [Thu Jun 2 16:06:31 2022] DELETE /identity/v3/projects/3f353ee1888c4536a8e043f3d489bfaa => generated 0 bytes in 422 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 02 16:06:31.930518 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b27ae91a-c2ee-4933-b9f9-ad7cb7becf70 admin admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:06:31.933158 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.fernet_utils [None req-b27ae91a-c2ee-4933-b9f9-ad7cb7becf70 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:06:31.970564 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b27ae91a-c2ee-4933-b9f9-ad7cb7becf70 admin admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:06:31.976689 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f02366c3-755f-4436-8eed-718ce305e485 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f73d5a98be74242b45222df39fb6213', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:06:31.978427 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02366c3-755f-4436-8eed-718ce305e485 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:06:31.978973 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02366c3-755f-4436-8eed-718ce305e485 admin admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:06:31.979571 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02366c3-755f-4436-8eed-718ce305e485 admin admin] PATH_INFO: `/v3/users/80eb5ec3ec6a47539e53341d5dedff30` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:06:31.981247 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f02366c3-755f-4436-8eed-718ce305e485 admin admin] RBAC: Authorizing `identity:delete_user(user_id=80eb5ec3ec6a47539e53341d5dedff30)` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:06:31.983477 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f02366c3-755f-4436-8eed-718ce305e485 admin admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:06:32.006471 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 830/1668] 10.222.0.59 () {60 vars in 1143 bytes} [Thu Jun 2 16:06:31 2022] POST /identity/v3/users => generated 303 bytes in 350 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 16:06:32.006471 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca5253ff-d330-42db-b249-dbf9371038a3 admin admin] Authenticating user token {{(pid=80396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:06:32.006814 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.fernet_utils [None req-ca5253ff-d330-42db-b249-dbf9371038a3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:06:32.020140 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca5253ff-d330-42db-b249-dbf9371038a3 admin admin] Validating token access rules against request {{(pid=80396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:06:32.029621 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32037272-5f83-4a76-96b9-53618bfd6f0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f73d5a98be74242b45222df39fb6213', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:06:32.029621 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32037272-5f83-4a76-96b9-53618bfd6f0a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:06:32.029621 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32037272-5f83-4a76-96b9-53618bfd6f0a admin admin] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:06:32.029621 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32037272-5f83-4a76-96b9-53618bfd6f0a admin admin] PATH_INFO: `/v3/users/7f57f8293f6d43388c824a9bc5c57da9` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:06:32.030295 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32037272-5f83-4a76-96b9-53618bfd6f0a admin admin] RBAC: Authorizing `identity:delete_user(user_id=7f57f8293f6d43388c824a9bc5c57da9)` {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:06:32.032540 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32037272-5f83-4a76-96b9-53618bfd6f0a admin admin] RBAC: Authorization granted {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:06:32.291831 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.notifications [None req-f02366c3-755f-4436-8eed-718ce305e485 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '80eb5ec3ec6a47539e53341d5dedff30'} {{(pid=80395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:06:32.426378 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.notifications [None req-f02366c3-755f-4436-8eed-718ce305e485 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '80eb5ec3ec6a47539e53341d5dedff30'} {{(pid=80395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:06:32.443650 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.notifications [None req-f02366c3-755f-4436-8eed-718ce305e485 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '80eb5ec3ec6a47539e53341d5dedff30'} {{(pid=80395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:06:32.445641 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.notifications [None req-f02366c3-755f-4436-8eed-718ce305e485 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '80eb5ec3ec6a47539e53341d5dedff30'} {{(pid=80395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:06:32.453992 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.notifications [None req-32037272-5f83-4a76-96b9-53618bfd6f0a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7f57f8293f6d43388c824a9bc5c57da9'} {{(pid=80396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:06:32.455517 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.notifications [None req-32037272-5f83-4a76-96b9-53618bfd6f0a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7f57f8293f6d43388c824a9bc5c57da9'} {{(pid=80396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:06:32.463898 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.notifications [None req-f02366c3-755f-4436-8eed-718ce305e485 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '80eb5ec3ec6a47539e53341d5dedff30'} {{(pid=80395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:06:32.480696 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 839/1669] 10.222.0.59 () {58 vars in 1223 bytes} [Thu Jun 2 16:06:31 2022] DELETE /identity/v3/users/80eb5ec3ec6a47539e53341d5dedff30 => generated 0 bytes in 551 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 16:06:32.481569 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f02366c3-755f-4436-8eed-718ce305e485 admin admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:06:32.491190 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.fernet_utils [None req-f02366c3-755f-4436-8eed-718ce305e485 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:06:32.576803 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f02366c3-755f-4436-8eed-718ce305e485 admin admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:06:32.582755 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efc9c4e3-fbce-43b6-b4db-90e45634f745 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f73d5a98be74242b45222df39fb6213', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:06:32.583627 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc9c4e3-fbce-43b6-b4db-90e45634f745 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:06:32.583958 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc9c4e3-fbce-43b6-b4db-90e45634f745 admin admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:06:32.584231 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc9c4e3-fbce-43b6-b4db-90e45634f745 admin admin] PATH_INFO: `/v3/projects/846c3eb6fb0c4cd6b2332f63e6dfd47d` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:06:32.585460 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efc9c4e3-fbce-43b6-b4db-90e45634f745 admin admin] RBAC: Authorizing `identity:delete_project(project_id=846c3eb6fb0c4cd6b2332f63e6dfd47d)` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:06:32.588472 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efc9c4e3-fbce-43b6-b4db-90e45634f745 admin admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:06:32.641746 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.notifications [None req-32037272-5f83-4a76-96b9-53618bfd6f0a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7f57f8293f6d43388c824a9bc5c57da9'} {{(pid=80396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:06:32.690536 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.notifications [None req-32037272-5f83-4a76-96b9-53618bfd6f0a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7f57f8293f6d43388c824a9bc5c57da9'} {{(pid=80396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:06:32.703002 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.notifications [None req-32037272-5f83-4a76-96b9-53618bfd6f0a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7f57f8293f6d43388c824a9bc5c57da9'} {{(pid=80396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:06:32.713292 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 831/1670] 10.222.0.59 () {58 vars in 1223 bytes} [Thu Jun 2 16:06:32 2022] DELETE /identity/v3/users/7f57f8293f6d43388c824a9bc5c57da9 => generated 0 bytes in 709 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 16:06:32.714909 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32037272-5f83-4a76-96b9-53618bfd6f0a admin admin] Authenticating user token {{(pid=80396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:06:32.716592 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.fernet_utils [None req-32037272-5f83-4a76-96b9-53618bfd6f0a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:06:32.812403 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32037272-5f83-4a76-96b9-53618bfd6f0a admin admin] Validating token access rules against request {{(pid=80396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:06:32.819954 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-988c3468-d5e7-4afd-ace3-5fecf7384995 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f73d5a98be74242b45222df39fb6213', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:06:32.822181 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-988c3468-d5e7-4afd-ace3-5fecf7384995 admin admin] REQUEST_METHOD: `GET` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:06:32.822778 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-988c3468-d5e7-4afd-ace3-5fecf7384995 admin admin] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:06:32.823336 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-988c3468-d5e7-4afd-ace3-5fecf7384995 admin admin] PATH_INFO: `/v3/roles` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:06:32.824219 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-988c3468-d5e7-4afd-ace3-5fecf7384995 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:06:32.826874 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-988c3468-d5e7-4afd-ace3-5fecf7384995 admin admin] RBAC: Authorization granted {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:06:32.842247 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 832/1671] 10.222.0.59 () {58 vars in 1121 bytes} [Thu Jun 2 16:06:32 2022] GET /identity/v3/roles => generated 1420 bytes in 128 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 16:06:32.843945 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d4218f-a535-45b5-b776-534bab899745 None None] REQUEST_METHOD: `POST` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:06:32.846550 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d4218f-a535-45b5-b776-534bab899745 None None] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:06:32.848417 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d4218f-a535-45b5-b776-534bab899745 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:06:32.884117 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.auth.core [None req-52d4218f-a535-45b5-b776-534bab899745 None None] MFA Rules not processed for user `400d1f4db9de49638549e5db29a041e1`. Rule list: `[]` (Enabled: `True`). {{(pid=80396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 16:06:32.885706 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.fernet_utils [None req-52d4218f-a535-45b5-b776-534bab899745 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:06:32.900867 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 833/1672] 10.222.0.59 () {58 vars in 957 bytes} [Thu Jun 2 16:06:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 58 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 16:06:32.901905 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52d4218f-a535-45b5-b776-534bab899745 None None] Authenticating user token {{(pid=80396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:06:32.914739 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52d4218f-a535-45b5-b776-534bab899745 None None] Validating token access rules against request {{(pid=80396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:06:32.921283 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6029e38-28d1-4891-a241-084b4f0c180e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f73d5a98be74242b45222df39fb6213', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:06:32.922990 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6029e38-28d1-4891-a241-084b4f0c180e admin admin] REQUEST_METHOD: `GET` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:06:32.930842 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6029e38-28d1-4891-a241-084b4f0c180e admin admin] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:06:32.930842 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6029e38-28d1-4891-a241-084b4f0c180e admin admin] PATH_INFO: `/v3/roles` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:06:32.930842 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6029e38-28d1-4891-a241-084b4f0c180e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:06:32.930842 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6029e38-28d1-4891-a241-084b4f0c180e admin admin] RBAC: Authorization granted {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:06:32.953254 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 834/1673] 10.222.0.59 () {58 vars in 1121 bytes} [Thu Jun 2 16:06:32 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 16:06:32.954286 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6029e38-28d1-4891-a241-084b4f0c180e admin admin] Authenticating user token {{(pid=80396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:06:32.956043 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.fernet_utils [None req-c6029e38-28d1-4891-a241-084b4f0c180e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:06:32.958352 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.notifications [None req-efc9c4e3-fbce-43b6-b4db-90e45634f745 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '846c3eb6fb0c4cd6b2332f63e6dfd47d', 'request_id': 'req-efc9c4e3-fbce-43b6-b4db-90e45634f745'} {{(pid=80395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:06:32.969331 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.notifications [None req-efc9c4e3-fbce-43b6-b4db-90e45634f745 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '846c3eb6fb0c4cd6b2332f63e6dfd47d', 'request_id': 'req-efc9c4e3-fbce-43b6-b4db-90e45634f745'} {{(pid=80395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:06:33.052284 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.notifications [None req-efc9c4e3-fbce-43b6-b4db-90e45634f745 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '846c3eb6fb0c4cd6b2332f63e6dfd47d', 'request_id': 'req-efc9c4e3-fbce-43b6-b4db-90e45634f745'} {{(pid=80395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:06:33.057293 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6029e38-28d1-4891-a241-084b4f0c180e admin admin] Validating token access rules against request {{(pid=80396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:06:33.069892 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.notifications [None req-efc9c4e3-fbce-43b6-b4db-90e45634f745 admin admin] The token cache is being invalidate because project 846c3eb6fb0c4cd6b2332f63e6dfd47d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80395) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 02 16:06:33.070243 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.notifications [None req-efc9c4e3-fbce-43b6-b4db-90e45634f745 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:06:33.072054 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.notifications [None req-efc9c4e3-fbce-43b6-b4db-90e45634f745 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:06:33.074939 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 840/1674] 10.222.0.59 () {58 vars in 1232 bytes} [Thu Jun 2 16:06:32 2022] DELETE /identity/v3/projects/846c3eb6fb0c4cd6b2332f63e6dfd47d => generated 0 bytes in 593 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 16:06:33.079998 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efc9c4e3-fbce-43b6-b4db-90e45634f745 admin admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:06:33.082200 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.fernet_utils [None req-efc9c4e3-fbce-43b6-b4db-90e45634f745 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:06:33.145965 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12c7606b-1a5c-4241-8937-50ab3de99aa7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9af40ddfe9ff4be3887b068f13a28dc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c87c981909d4b8db02783421818c79b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:06:33.146709 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c7606b-1a5c-4241-8937-50ab3de99aa7 service neutron] REQUEST_METHOD: `GET` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:06:33.146996 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c7606b-1a5c-4241-8937-50ab3de99aa7 service neutron] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:06:33.147278 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c7606b-1a5c-4241-8937-50ab3de99aa7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:06:33.151148 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.fernet_utils [None req-12c7606b-1a5c-4241-8937-50ab3de99aa7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:06:33.285055 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG dbcounter [-] [80396] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 16:06:33.292722 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efc9c4e3-fbce-43b6-b4db-90e45634f745 admin admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:06:33.311878 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12c7606b-1a5c-4241-8937-50ab3de99aa7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:06:33.312964 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-504f0af7-4be5-432c-bafa-bca4cee2d4ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f73d5a98be74242b45222df39fb6213', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:06:33.314306 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504f0af7-4be5-432c-bafa-bca4cee2d4ff admin admin] REQUEST_METHOD: `PUT` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:06:33.315017 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504f0af7-4be5-432c-bafa-bca4cee2d4ff admin admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:06:33.316637 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12c7606b-1a5c-4241-8937-50ab3de99aa7 service neutron] RBAC: Authorization granted {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:06:33.316765 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504f0af7-4be5-432c-bafa-bca4cee2d4ff admin admin] PATH_INFO: `/v3/projects/16ceb171629040cd90b8738ea2d9e1a3/users/26e030ed76e642839bee01f76e36cecc/roles/649e0f2b5a264c419ea6a1441f123a03` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:06:33.350684 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 835/1675] 10.222.0.59 () {60 vars in 1365 bytes} [Thu Jun 2 16:06:32 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 397 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 16:06:33.357364 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12c7606b-1a5c-4241-8937-50ab3de99aa7 service neutron] Authenticating user token {{(pid=80396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:06:33.362313 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.fernet_utils [None req-12c7606b-1a5c-4241-8937-50ab3de99aa7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:06:33.377419 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-504f0af7-4be5-432c-bafa-bca4cee2d4ff admin admin] RBAC: Authorizing `identity:create_grant(project_id=16ceb171629040cd90b8738ea2d9e1a3, user_id=26e030ed76e642839bee01f76e36cecc, role_id=649e0f2b5a264c419ea6a1441f123a03)` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:06:33.388310 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-504f0af7-4be5-432c-bafa-bca4cee2d4ff admin admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:06:33.421808 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12c7606b-1a5c-4241-8937-50ab3de99aa7 service neutron] Validating token access rules against request {{(pid=80396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:06:33.434102 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07d580c9-5a7a-43eb-a86a-4f41c9c86f2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f73d5a98be74242b45222df39fb6213', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:06:33.434814 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d580c9-5a7a-43eb-a86a-4f41c9c86f2a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:06:33.435101 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d580c9-5a7a-43eb-a86a-4f41c9c86f2a admin admin] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:06:33.441852 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d580c9-5a7a-43eb-a86a-4f41c9c86f2a admin admin] PATH_INFO: `/v3/users/3ecf10cbd56c47d7a81a9774b839245d` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:06:33.441852 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07d580c9-5a7a-43eb-a86a-4f41c9c86f2a admin admin] RBAC: Authorizing `identity:delete_user(user_id=3ecf10cbd56c47d7a81a9774b839245d)` {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:06:33.443407 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07d580c9-5a7a-43eb-a86a-4f41c9c86f2a admin admin] RBAC: Authorization granted {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:06:33.523446 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 841/1676] 10.222.0.59 () {60 vars in 1482 bytes} [Thu Jun 2 16:06:33 2022] PUT /identity/v3/projects/16ceb171629040cd90b8738ea2d9e1a3/users/26e030ed76e642839bee01f76e36cecc/roles/649e0f2b5a264c419ea6a1441f123a03 => generated 0 bytes in 448 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 16:06:33.525007 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-504f0af7-4be5-432c-bafa-bca4cee2d4ff admin admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:06:33.527110 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.fernet_utils [None req-504f0af7-4be5-432c-bafa-bca4cee2d4ff admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:06:33.693614 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-504f0af7-4be5-432c-bafa-bca4cee2d4ff admin admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:06:33.703261 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-056d082e-34f1-4226-94b5-53dc01dda0d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f73d5a98be74242b45222df39fb6213', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:06:33.704224 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-056d082e-34f1-4226-94b5-53dc01dda0d3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:06:33.704502 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-056d082e-34f1-4226-94b5-53dc01dda0d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:06:33.704831 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-056d082e-34f1-4226-94b5-53dc01dda0d3 admin admin] PATH_INFO: `/v3/projects/9d27ff04715c4941bd75652098cc72a4` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:06:33.706740 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-056d082e-34f1-4226-94b5-53dc01dda0d3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9d27ff04715c4941bd75652098cc72a4)` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:06:33.709195 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-056d082e-34f1-4226-94b5-53dc01dda0d3 admin admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:06:33.801007 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.notifications [None req-07d580c9-5a7a-43eb-a86a-4f41c9c86f2a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3ecf10cbd56c47d7a81a9774b839245d'} {{(pid=80396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:06:33.801713 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.notifications [None req-07d580c9-5a7a-43eb-a86a-4f41c9c86f2a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3ecf10cbd56c47d7a81a9774b839245d'} {{(pid=80396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:06:33.877353 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.notifications [None req-056d082e-34f1-4226-94b5-53dc01dda0d3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9d27ff04715c4941bd75652098cc72a4', 'request_id': 'req-056d082e-34f1-4226-94b5-53dc01dda0d3'} {{(pid=80395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:06:33.877650 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.notifications [None req-07d580c9-5a7a-43eb-a86a-4f41c9c86f2a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3ecf10cbd56c47d7a81a9774b839245d'} {{(pid=80396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:06:33.891682 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.notifications [None req-056d082e-34f1-4226-94b5-53dc01dda0d3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9d27ff04715c4941bd75652098cc72a4', 'request_id': 'req-056d082e-34f1-4226-94b5-53dc01dda0d3'} {{(pid=80395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:06:33.905739 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.notifications [None req-07d580c9-5a7a-43eb-a86a-4f41c9c86f2a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3ecf10cbd56c47d7a81a9774b839245d'} {{(pid=80396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:06:33.917677 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.notifications [None req-07d580c9-5a7a-43eb-a86a-4f41c9c86f2a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3ecf10cbd56c47d7a81a9774b839245d'} {{(pid=80396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:06:33.927810 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 836/1677] 10.222.0.59 () {58 vars in 1223 bytes} [Thu Jun 2 16:06:33 2022] DELETE /identity/v3/users/3ecf10cbd56c47d7a81a9774b839245d => generated 0 bytes in 574 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 16:06:33.927810 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85ed844-fd6c-4e36-a686-e42967e90c0b None None] REQUEST_METHOD: `POST` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:06:33.928077 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85ed844-fd6c-4e36-a686-e42967e90c0b None None] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:06:33.928388 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85ed844-fd6c-4e36-a686-e42967e90c0b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:06:33.979476 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.auth.core [None req-a85ed844-fd6c-4e36-a686-e42967e90c0b None None] MFA Rules not processed for user `400d1f4db9de49638549e5db29a041e1`. Rule list: `[]` (Enabled: `True`). {{(pid=80396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 16:06:33.980503 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.notifications [None req-056d082e-34f1-4226-94b5-53dc01dda0d3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9d27ff04715c4941bd75652098cc72a4', 'request_id': 'req-056d082e-34f1-4226-94b5-53dc01dda0d3'} {{(pid=80395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:06:33.983379 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.fernet_utils [None req-a85ed844-fd6c-4e36-a686-e42967e90c0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:06:34.000126 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.notifications [None req-056d082e-34f1-4226-94b5-53dc01dda0d3 admin admin] The token cache is being invalidate because project 9d27ff04715c4941bd75652098cc72a4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80395) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 02 16:06:34.000507 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.notifications [None req-056d082e-34f1-4226-94b5-53dc01dda0d3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:06:34.002994 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.notifications [None req-056d082e-34f1-4226-94b5-53dc01dda0d3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:06:34.009225 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 842/1678] 10.222.0.59 () {58 vars in 1232 bytes} [Thu Jun 2 16:06:33 2022] DELETE /identity/v3/projects/9d27ff04715c4941bd75652098cc72a4 => generated 0 bytes in 482 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 16:06:34.014553 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-180898e9-3481-4401-b2b0-803d6c8409ac None None] REQUEST_METHOD: `POST` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:06:34.015496 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-180898e9-3481-4401-b2b0-803d6c8409ac None None] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:06:34.015496 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-180898e9-3481-4401-b2b0-803d6c8409ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:06:34.055305 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.auth.core [None req-180898e9-3481-4401-b2b0-803d6c8409ac None None] MFA Rules not processed for user `400d1f4db9de49638549e5db29a041e1`. Rule list: `[]` (Enabled: `True`). {{(pid=80395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 16:06:34.056620 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.fernet_utils [None req-180898e9-3481-4401-b2b0-803d6c8409ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:06:34.117569 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 837/1679] 10.222.0.59 () {58 vars in 957 bytes} [Thu Jun 2 16:06:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 16:06:34.119069 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a85ed844-fd6c-4e36-a686-e42967e90c0b None None] Authenticating user token {{(pid=80396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:06:34.122801 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.fernet_utils [None req-a85ed844-fd6c-4e36-a686-e42967e90c0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:06:34.151496 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a85ed844-fd6c-4e36-a686-e42967e90c0b None None] Validating token access rules against request {{(pid=80396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:06:34.169260 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d77a8aa8-11f2-405b-b785-d4742a3660e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f73d5a98be74242b45222df39fb6213', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:06:34.170157 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d77a8aa8-11f2-405b-b785-d4742a3660e8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:06:34.170440 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d77a8aa8-11f2-405b-b785-d4742a3660e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:06:34.170713 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d77a8aa8-11f2-405b-b785-d4742a3660e8 admin admin] PATH_INFO: `/v3/projects/6721049c26e34cfbb1021c3832087d68` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:06:34.173910 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d77a8aa8-11f2-405b-b785-d4742a3660e8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6721049c26e34cfbb1021c3832087d68)` {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:06:34.175557 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: WARNING py.warnings [None req-d77a8aa8-11f2-405b-b785-d4742a3660e8 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 02 16:06:34.175557 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: warnings.warn(msg) Jun 02 16:06:34.175557 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: Jun 02 16:06:34.176754 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d77a8aa8-11f2-405b-b785-d4742a3660e8 admin admin] RBAC: Authorization granted {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:06:34.220048 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 843/1680] 10.222.0.59 () {58 vars in 957 bytes} [Thu Jun 2 16:06:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 207 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 16:06:34.220928 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-180898e9-3481-4401-b2b0-803d6c8409ac None None] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:06:34.223473 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.fernet_utils [None req-180898e9-3481-4401-b2b0-803d6c8409ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:06:34.355280 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-180898e9-3481-4401-b2b0-803d6c8409ac None None] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:06:34.369895 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43b537ea-9d1d-40a0-a12d-d551d4fb5406 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9af40ddfe9ff4be3887b068f13a28dc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c87c981909d4b8db02783421818c79b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:06:34.370745 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b537ea-9d1d-40a0-a12d-d551d4fb5406 service neutron] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:06:34.371298 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b537ea-9d1d-40a0-a12d-d551d4fb5406 service neutron] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:06:34.371681 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b537ea-9d1d-40a0-a12d-d551d4fb5406 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:06:34.391937 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43b537ea-9d1d-40a0-a12d-d551d4fb5406 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:06:34.393591 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43b537ea-9d1d-40a0-a12d-d551d4fb5406 service neutron] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:06:34.406065 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 844/1681] 10.222.0.59 () {60 vars in 1365 bytes} [Thu Jun 2 16:06:34 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 185 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 16:06:34.417854 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a152c63-6f21-467e-89fb-9a8e6f59c6a0 None None] REQUEST_METHOD: `POST` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:06:34.418025 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a152c63-6f21-467e-89fb-9a8e6f59c6a0 None None] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:06:34.422385 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a152c63-6f21-467e-89fb-9a8e6f59c6a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:06:34.456663 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.auth.core [None req-3a152c63-6f21-467e-89fb-9a8e6f59c6a0 None None] MFA Rules not processed for user `400d1f4db9de49638549e5db29a041e1`. Rule list: `[]` (Enabled: `True`). {{(pid=80395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 16:06:34.458971 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.fernet_utils [None req-3a152c63-6f21-467e-89fb-9a8e6f59c6a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:06:34.478835 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.notifications [None req-d77a8aa8-11f2-405b-b785-d4742a3660e8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6721049c26e34cfbb1021c3832087d68', 'request_id': 'req-d77a8aa8-11f2-405b-b785-d4742a3660e8'} {{(pid=80396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:06:34.518606 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.notifications [None req-d77a8aa8-11f2-405b-b785-d4742a3660e8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6721049c26e34cfbb1021c3832087d68', 'request_id': 'req-d77a8aa8-11f2-405b-b785-d4742a3660e8'} {{(pid=80396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:06:34.579548 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 845/1682] 10.222.0.59 () {58 vars in 957 bytes} [Thu Jun 2 16:06:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 16:06:34.596482 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.notifications [None req-d77a8aa8-11f2-405b-b785-d4742a3660e8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6721049c26e34cfbb1021c3832087d68', 'request_id': 'req-d77a8aa8-11f2-405b-b785-d4742a3660e8'} {{(pid=80396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:06:34.614249 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a152c63-6f21-467e-89fb-9a8e6f59c6a0 None None] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:06:34.633696 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.notifications [None req-d77a8aa8-11f2-405b-b785-d4742a3660e8 admin admin] The token cache is being invalidate because project 6721049c26e34cfbb1021c3832087d68 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80396) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 02 16:06:34.636482 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.notifications [None req-d77a8aa8-11f2-405b-b785-d4742a3660e8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:06:34.643573 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.notifications [None req-d77a8aa8-11f2-405b-b785-d4742a3660e8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:06:34.659819 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 838/1683] 10.222.0.59 () {58 vars in 1232 bytes} [Thu Jun 2 16:06:34 2022] DELETE /identity/v3/projects/6721049c26e34cfbb1021c3832087d68 => generated 0 bytes in 536 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 16:06:34.670002 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a152c63-6f21-467e-89fb-9a8e6f59c6a0 None None] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:06:34.670334 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0841c0dd-cadd-4298-b497-8d8fe955770f None None] REQUEST_METHOD: `POST` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:06:34.670334 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0841c0dd-cadd-4298-b497-8d8fe955770f None None] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:06:34.670334 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0841c0dd-cadd-4298-b497-8d8fe955770f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:06:34.682110 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5197296-295e-4e5c-a3a4-2f6714b5d6d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f73d5a98be74242b45222df39fb6213', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:06:34.682945 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5197296-295e-4e5c-a3a4-2f6714b5d6d9 admin admin] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:06:34.684067 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5197296-295e-4e5c-a3a4-2f6714b5d6d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:06:34.684353 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5197296-295e-4e5c-a3a4-2f6714b5d6d9 admin admin] PATH_INFO: `/v3/domains` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:06:34.685113 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5197296-295e-4e5c-a3a4-2f6714b5d6d9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80395) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 16:06:34.690950 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5197296-295e-4e5c-a3a4-2f6714b5d6d9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:06:34.694508 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5197296-295e-4e5c-a3a4-2f6714b5d6d9 admin admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:06:34.723157 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.auth.core [None req-0841c0dd-cadd-4298-b497-8d8fe955770f None None] MFA Rules not processed for user `400d1f4db9de49638549e5db29a041e1`. Rule list: `[]` (Enabled: `True`). {{(pid=80396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 16:06:34.724405 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.fernet_utils [None req-0841c0dd-cadd-4298-b497-8d8fe955770f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:06:34.725985 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 846/1684] 10.222.0.59 () {58 vars in 1152 bytes} [Thu Jun 2 16:06:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 16:06:34.731110 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5197296-295e-4e5c-a3a4-2f6714b5d6d9 admin admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:06:34.743569 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.fernet_utils [None req-f5197296-295e-4e5c-a3a4-2f6714b5d6d9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:06:34.766570 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5197296-295e-4e5c-a3a4-2f6714b5d6d9 admin admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:06:34.770363 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 839/1685] 10.222.0.59 () {58 vars in 957 bytes} [Thu Jun 2 16:06:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 16:06:34.771780 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7787fbc-e378-4390-a655-7fa3aec6b3fe None None] REQUEST_METHOD: `POST` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:06:34.772065 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7787fbc-e378-4390-a655-7fa3aec6b3fe None None] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:06:34.772347 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7787fbc-e378-4390-a655-7fa3aec6b3fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:06:34.777339 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d6f625c-2069-4630-bf8f-c976641c73cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f73d5a98be74242b45222df39fb6213', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:06:34.778172 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d6f625c-2069-4630-bf8f-c976641c73cf admin admin] REQUEST_METHOD: `POST` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:06:34.778496 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d6f625c-2069-4630-bf8f-c976641c73cf admin admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:06:34.778785 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d6f625c-2069-4630-bf8f-c976641c73cf admin admin] PATH_INFO: `/v3/projects` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:06:34.779491 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d6f625c-2069-4630-bf8f-c976641c73cf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:06:34.799653 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d6f625c-2069-4630-bf8f-c976641c73cf admin admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:06:34.815189 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 16:06:34.867454 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.auth.core [None req-d7787fbc-e378-4390-a655-7fa3aec6b3fe None None] MFA Rules not processed for user `400d1f4db9de49638549e5db29a041e1`. Rule list: `[]` (Enabled: `True`). {{(pid=80396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 16:06:34.869740 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.fernet_utils [None req-d7787fbc-e378-4390-a655-7fa3aec6b3fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:06:34.888621 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 840/1686] 10.222.0.59 () {58 vars in 957 bytes} [Thu Jun 2 16:06:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 16:06:34.893032 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7787fbc-e378-4390-a655-7fa3aec6b3fe None None] Authenticating user token {{(pid=80396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:06:34.909986 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7787fbc-e378-4390-a655-7fa3aec6b3fe None None] Validating token access rules against request {{(pid=80396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:06:34.924081 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0e4574d-b3d2-48d0-be8d-ef53f7506134 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f73d5a98be74242b45222df39fb6213', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:06:34.924762 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e4574d-b3d2-48d0-be8d-ef53f7506134 admin admin] REQUEST_METHOD: `GET` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:06:34.925043 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e4574d-b3d2-48d0-be8d-ef53f7506134 admin admin] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:06:34.925312 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e4574d-b3d2-48d0-be8d-ef53f7506134 admin admin] PATH_INFO: `/v3/domains` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:06:34.926043 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0e4574d-b3d2-48d0-be8d-ef53f7506134 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80396) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 16:06:34.926476 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0e4574d-b3d2-48d0-be8d-ef53f7506134 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:06:34.932820 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0e4574d-b3d2-48d0-be8d-ef53f7506134 admin admin] RBAC: Authorization granted {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:06:34.964279 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 841/1687] 10.222.0.59 () {58 vars in 1152 bytes} [Thu Jun 2 16:06:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 16:06:34.973355 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0e4574d-b3d2-48d0-be8d-ef53f7506134 admin admin] Authenticating user token {{(pid=80396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:06:34.978097 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 847/1688] 10.222.0.59 () {60 vars in 1152 bytes} [Thu Jun 2 16:06:34 2022] POST /identity/v3/projects => generated 355 bytes in 247 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 16:06:34.979044 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d6f625c-2069-4630-bf8f-c976641c73cf admin admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:06:34.991289 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0e4574d-b3d2-48d0-be8d-ef53f7506134 admin admin] Validating token access rules against request {{(pid=80396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:06:35.149954 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5d41824-49fc-44bb-a95e-943b146edc77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f73d5a98be74242b45222df39fb6213', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:06:35.151095 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d41824-49fc-44bb-a95e-943b146edc77 admin admin] REQUEST_METHOD: `POST` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:06:35.157053 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d41824-49fc-44bb-a95e-943b146edc77 admin admin] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:06:35.157053 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d41824-49fc-44bb-a95e-943b146edc77 admin admin] PATH_INFO: `/v3/projects` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:06:35.157053 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5d41824-49fc-44bb-a95e-943b146edc77 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:06:35.157675 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5d41824-49fc-44bb-a95e-943b146edc77 admin admin] RBAC: Authorization granted {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:06:35.208447 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d6f625c-2069-4630-bf8f-c976641c73cf admin admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:06:35.224774 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a75a1c2e-b8c9-442c-9f38-5a10cfbc2f20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f73d5a98be74242b45222df39fb6213', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:06:35.225466 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a75a1c2e-b8c9-442c-9f38-5a10cfbc2f20 admin admin] REQUEST_METHOD: `POST` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:06:35.225763 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a75a1c2e-b8c9-442c-9f38-5a10cfbc2f20 admin admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:06:35.226356 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a75a1c2e-b8c9-442c-9f38-5a10cfbc2f20 admin admin] PATH_INFO: `/v3/users` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:06:35.227116 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a75a1c2e-b8c9-442c-9f38-5a10cfbc2f20 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:06:35.235296 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a75a1c2e-b8c9-442c-9f38-5a10cfbc2f20 admin admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:06:35.285345 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 842/1689] 10.222.0.59 () {60 vars in 1152 bytes} [Thu Jun 2 16:06:34 2022] POST /identity/v3/projects => generated 381 bytes in 317 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 16:06:35.285345 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5d41824-49fc-44bb-a95e-943b146edc77 admin admin] Authenticating user token {{(pid=80396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:06:35.285839 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.fernet_utils [None req-d5d41824-49fc-44bb-a95e-943b146edc77 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:06:35.395508 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 848/1690] 10.222.0.59 () {60 vars in 1143 bytes} [Thu Jun 2 16:06:34 2022] POST /identity/v3/users => generated 278 bytes in 415 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 16:06:35.395508 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a75a1c2e-b8c9-442c-9f38-5a10cfbc2f20 admin admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:06:35.414984 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a75a1c2e-b8c9-442c-9f38-5a10cfbc2f20 admin admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:06:35.465591 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5d41824-49fc-44bb-a95e-943b146edc77 admin admin] Validating token access rules against request {{(pid=80396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:06:35.481723 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff4c8caa-2ec8-4808-8f3e-a9a9b01518d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f73d5a98be74242b45222df39fb6213', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:06:35.482636 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4c8caa-2ec8-4808-8f3e-a9a9b01518d9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:06:35.484844 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4c8caa-2ec8-4808-8f3e-a9a9b01518d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:06:35.489812 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4c8caa-2ec8-4808-8f3e-a9a9b01518d9 admin admin] PATH_INFO: `/v3/projects/16f7452f60e4403296a89bfc279f30c5` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:06:35.491943 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff4c8caa-2ec8-4808-8f3e-a9a9b01518d9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=16f7452f60e4403296a89bfc279f30c5)` {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:06:35.503526 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff4c8caa-2ec8-4808-8f3e-a9a9b01518d9 admin admin] RBAC: Authorization granted {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:06:35.514416 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f35111a0-2034-495a-8c32-e0ecf6b5b9ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f73d5a98be74242b45222df39fb6213', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:06:35.517483 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f35111a0-2034-495a-8c32-e0ecf6b5b9ff admin admin] REQUEST_METHOD: `POST` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:06:35.518874 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f35111a0-2034-495a-8c32-e0ecf6b5b9ff admin admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:06:35.519430 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f35111a0-2034-495a-8c32-e0ecf6b5b9ff admin admin] PATH_INFO: `/v3/users` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:06:35.522634 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f35111a0-2034-495a-8c32-e0ecf6b5b9ff admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:06:35.526996 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f35111a0-2034-495a-8c32-e0ecf6b5b9ff admin admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:06:35.626429 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 849/1691] 10.222.0.59 () {60 vars in 1143 bytes} [Thu Jun 2 16:06:35 2022] POST /identity/v3/users => generated 291 bytes in 229 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 16:06:35.626429 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f35111a0-2034-495a-8c32-e0ecf6b5b9ff admin admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:06:35.659642 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f35111a0-2034-495a-8c32-e0ecf6b5b9ff admin admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:06:35.691095 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.notifications [None req-ff4c8caa-2ec8-4808-8f3e-a9a9b01518d9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '16f7452f60e4403296a89bfc279f30c5', 'request_id': 'req-ff4c8caa-2ec8-4808-8f3e-a9a9b01518d9'} {{(pid=80396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:06:35.722283 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.notifications [None req-ff4c8caa-2ec8-4808-8f3e-a9a9b01518d9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '16f7452f60e4403296a89bfc279f30c5', 'request_id': 'req-ff4c8caa-2ec8-4808-8f3e-a9a9b01518d9'} {{(pid=80396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:06:35.748484 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG dbcounter [-] [80396] Writing DB stats keystone:SELECT=91,keystone:INSERT=4,keystone:DELETE=5 {{(pid=80396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 16:06:35.840603 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.notifications [None req-ff4c8caa-2ec8-4808-8f3e-a9a9b01518d9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '16f7452f60e4403296a89bfc279f30c5', 'request_id': 'req-ff4c8caa-2ec8-4808-8f3e-a9a9b01518d9'} {{(pid=80396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:06:35.863372 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.notifications [None req-ff4c8caa-2ec8-4808-8f3e-a9a9b01518d9 admin admin] The token cache is being invalidate because project 16f7452f60e4403296a89bfc279f30c5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80396) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 02 16:06:35.864846 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.notifications [None req-ff4c8caa-2ec8-4808-8f3e-a9a9b01518d9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:06:35.869726 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24064150-a537-43b9-8daa-ccb36d39cc89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f73d5a98be74242b45222df39fb6213', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:06:35.870272 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.notifications [None req-ff4c8caa-2ec8-4808-8f3e-a9a9b01518d9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:06:35.870646 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24064150-a537-43b9-8daa-ccb36d39cc89 admin admin] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:06:35.870853 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24064150-a537-43b9-8daa-ccb36d39cc89 admin admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:06:35.871130 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24064150-a537-43b9-8daa-ccb36d39cc89 admin admin] PATH_INFO: `/v3/roles` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:06:35.874457 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 843/1692] 10.222.0.59 () {58 vars in 1232 bytes} [Thu Jun 2 16:06:35 2022] DELETE /identity/v3/projects/16f7452f60e4403296a89bfc279f30c5 => generated 0 bytes in 591 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 16:06:35.878228 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24064150-a537-43b9-8daa-ccb36d39cc89 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:06:35.880818 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff4c8caa-2ec8-4808-8f3e-a9a9b01518d9 admin admin] Authenticating user token {{(pid=80396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:06:35.881717 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24064150-a537-43b9-8daa-ccb36d39cc89 admin admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:06:35.882797 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.fernet_utils [None req-ff4c8caa-2ec8-4808-8f3e-a9a9b01518d9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:06:35.911638 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 850/1693] 10.222.0.59 () {58 vars in 1121 bytes} [Thu Jun 2 16:06:35 2022] GET /identity/v3/roles => generated 1420 bytes in 285 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 16:06:35.911638 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2830539-0e25-4a17-8471-bdf2b05cc77d None None] REQUEST_METHOD: `POST` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:06:35.912283 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2830539-0e25-4a17-8471-bdf2b05cc77d None None] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:06:35.912570 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2830539-0e25-4a17-8471-bdf2b05cc77d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:06:35.928415 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff4c8caa-2ec8-4808-8f3e-a9a9b01518d9 admin admin] Validating token access rules against request {{(pid=80396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:06:35.958984 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aa235aa-8f2a-48e2-9b8f-c00a0e2d2250 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f73d5a98be74242b45222df39fb6213', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:06:35.959829 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa235aa-8f2a-48e2-9b8f-c00a0e2d2250 admin admin] REQUEST_METHOD: `GET` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:06:35.960809 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa235aa-8f2a-48e2-9b8f-c00a0e2d2250 admin admin] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:06:35.961200 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa235aa-8f2a-48e2-9b8f-c00a0e2d2250 admin admin] PATH_INFO: `/v3/roles` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:06:35.964748 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aa235aa-8f2a-48e2-9b8f-c00a0e2d2250 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:06:35.971702 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aa235aa-8f2a-48e2-9b8f-c00a0e2d2250 admin admin] RBAC: Authorization granted {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:06:35.986550 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.auth.core [None req-c2830539-0e25-4a17-8471-bdf2b05cc77d None None] MFA Rules not processed for user `400d1f4db9de49638549e5db29a041e1`. Rule list: `[]` (Enabled: `True`). {{(pid=80395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 16:06:35.990645 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.fernet_utils [None req-c2830539-0e25-4a17-8471-bdf2b05cc77d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:06:36.018362 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 844/1694] 10.222.0.59 () {58 vars in 1121 bytes} [Thu Jun 2 16:06:35 2022] GET /identity/v3/roles => generated 1420 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 16:06:36.018362 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aa235aa-8f2a-48e2-9b8f-c00a0e2d2250 admin admin] Authenticating user token {{(pid=80396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:06:36.024210 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.fernet_utils [None req-2aa235aa-8f2a-48e2-9b8f-c00a0e2d2250 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:06:36.032240 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 851/1695] 10.222.0.59 () {58 vars in 957 bytes} [Thu Jun 2 16:06:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 16:06:36.044301 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2830539-0e25-4a17-8471-bdf2b05cc77d None None] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:06:36.068153 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2830539-0e25-4a17-8471-bdf2b05cc77d None None] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:06:36.079896 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aa235aa-8f2a-48e2-9b8f-c00a0e2d2250 admin admin] Validating token access rules against request {{(pid=80396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:06:36.090935 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4f6518d-c014-4f8f-868b-c92e288eb9aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f73d5a98be74242b45222df39fb6213', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:06:36.091794 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f6518d-c014-4f8f-868b-c92e288eb9aa admin admin] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:06:36.092082 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f6518d-c014-4f8f-868b-c92e288eb9aa admin admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:06:36.092362 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f6518d-c014-4f8f-868b-c92e288eb9aa admin admin] PATH_INFO: `/v3/roles` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:06:36.094904 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4f6518d-c014-4f8f-868b-c92e288eb9aa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:06:36.096581 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4f6518d-c014-4f8f-868b-c92e288eb9aa admin admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:06:36.106233 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b8717f5-d277-49cb-aa6f-efbefd5ee2a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f73d5a98be74242b45222df39fb6213', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:06:36.106950 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8717f5-d277-49cb-aa6f-efbefd5ee2a1 admin admin] REQUEST_METHOD: `GET` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:06:36.107353 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8717f5-d277-49cb-aa6f-efbefd5ee2a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:06:36.107743 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8717f5-d277-49cb-aa6f-efbefd5ee2a1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:06:36.112180 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b8717f5-d277-49cb-aa6f-efbefd5ee2a1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:06:36.115073 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b8717f5-d277-49cb-aa6f-efbefd5ee2a1 admin admin] RBAC: Authorization granted {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:06:36.141456 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 845/1696] 10.222.0.59 () {58 vars in 1121 bytes} [Thu Jun 2 16:06:36 2022] GET /identity/v3/roles => generated 1420 bytes in 127 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 16:06:36.144933 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1e24b8-e7c2-49bc-9f98-6fd4bed66844 None None] REQUEST_METHOD: `POST` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:06:36.145545 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1e24b8-e7c2-49bc-9f98-6fd4bed66844 None None] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:06:36.146298 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1e24b8-e7c2-49bc-9f98-6fd4bed66844 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:06:36.150239 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 852/1697] 10.222.0.59 () {58 vars in 1121 bytes} [Thu Jun 2 16:06:36 2022] GET /identity/v3/roles => generated 1420 bytes in 117 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 16:06:36.153432 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4f6518d-c014-4f8f-868b-c92e288eb9aa admin admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:06:36.176513 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.auth.core [None req-df1e24b8-e7c2-49bc-9f98-6fd4bed66844 None None] MFA Rules not processed for user `400d1f4db9de49638549e5db29a041e1`. Rule list: `[]` (Enabled: `True`). {{(pid=80396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 16:06:36.177826 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.fernet_utils [None req-df1e24b8-e7c2-49bc-9f98-6fd4bed66844 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:06:36.194818 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4f6518d-c014-4f8f-868b-c92e288eb9aa admin admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:06:36.203513 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 846/1698] 10.222.0.59 () {58 vars in 957 bytes} [Thu Jun 2 16:06:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 61 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 16:06:36.204523 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df1e24b8-e7c2-49bc-9f98-6fd4bed66844 None None] Authenticating user token {{(pid=80396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:06:36.218135 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ec2780-4156-4772-8cf0-b8331a18d099 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f73d5a98be74242b45222df39fb6213', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:06:36.219229 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ec2780-4156-4772-8cf0-b8331a18d099 admin admin] REQUEST_METHOD: `PUT` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:06:36.219512 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ec2780-4156-4772-8cf0-b8331a18d099 admin admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:06:36.219785 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ec2780-4156-4772-8cf0-b8331a18d099 admin admin] PATH_INFO: `/v3/projects/55330393dc9b4a919d7ccd7cec9be7a2/users/5977780e274849ee8a2471738f5336be/roles/649e0f2b5a264c419ea6a1441f123a03` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:06:36.236282 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df1e24b8-e7c2-49bc-9f98-6fd4bed66844 None None] Validating token access rules against request {{(pid=80396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:06:36.254956 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15f7d59d-3a98-4e89-824e-c3cf056e0cc4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f73d5a98be74242b45222df39fb6213', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:06:36.257428 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f7d59d-3a98-4e89-824e-c3cf056e0cc4 admin admin] REQUEST_METHOD: `PUT` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:06:36.257834 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f7d59d-3a98-4e89-824e-c3cf056e0cc4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:06:36.261735 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f7d59d-3a98-4e89-824e-c3cf056e0cc4 admin admin] PATH_INFO: `/v3/projects/bcbf991d931946138cfa385d149af8c3/users/c0d551674d6a420d996dae5fc6e6df94/roles/649e0f2b5a264c419ea6a1441f123a03` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:06:36.286996 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15f7d59d-3a98-4e89-824e-c3cf056e0cc4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bcbf991d931946138cfa385d149af8c3, user_id=c0d551674d6a420d996dae5fc6e6df94, role_id=649e0f2b5a264c419ea6a1441f123a03)` {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:06:36.292163 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73ec2780-4156-4772-8cf0-b8331a18d099 admin admin] RBAC: Authorizing `identity:create_grant(project_id=55330393dc9b4a919d7ccd7cec9be7a2, user_id=5977780e274849ee8a2471738f5336be, role_id=649e0f2b5a264c419ea6a1441f123a03)` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:06:36.293672 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15f7d59d-3a98-4e89-824e-c3cf056e0cc4 admin admin] RBAC: Authorization granted {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:06:36.296160 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73ec2780-4156-4772-8cf0-b8331a18d099 admin admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:06:36.435369 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 847/1699] 10.222.0.59 () {60 vars in 1482 bytes} [Thu Jun 2 16:06:36 2022] PUT /identity/v3/projects/bcbf991d931946138cfa385d149af8c3/users/c0d551674d6a420d996dae5fc6e6df94/roles/649e0f2b5a264c419ea6a1441f123a03 => generated 0 bytes in 231 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 16:06:36.444446 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15f7d59d-3a98-4e89-824e-c3cf056e0cc4 admin admin] Authenticating user token {{(pid=80396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:06:36.453170 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 853/1700] 10.222.0.59 () {60 vars in 1482 bytes} [Thu Jun 2 16:06:36 2022] PUT /identity/v3/projects/55330393dc9b4a919d7ccd7cec9be7a2/users/5977780e274849ee8a2471738f5336be/roles/649e0f2b5a264c419ea6a1441f123a03 => generated 0 bytes in 302 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 16:06:36.461713 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd9dd0b-f6d4-4356-b853-fe86fbfbf351 None None] REQUEST_METHOD: `POST` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:06:36.461713 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd9dd0b-f6d4-4356-b853-fe86fbfbf351 None None] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:06:36.461713 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd9dd0b-f6d4-4356-b853-fe86fbfbf351 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:06:36.496733 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.auth.core [None req-4cd9dd0b-f6d4-4356-b853-fe86fbfbf351 None None] MFA Rules not processed for user `c0d551674d6a420d996dae5fc6e6df94`. Rule list: `[]` (Enabled: `True`). {{(pid=80395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 16:06:36.498018 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.fernet_utils [None req-4cd9dd0b-f6d4-4356-b853-fe86fbfbf351 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:06:36.638865 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15f7d59d-3a98-4e89-824e-c3cf056e0cc4 admin admin] Validating token access rules against request {{(pid=80396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:06:36.670689 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 854/1701] 10.222.0.59 () {58 vars in 957 bytes} [Thu Jun 2 16:06:36 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 213 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 16:06:36.670689 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8348380f-800e-4294-b70a-ba848dc66ff3 None None] REQUEST_METHOD: `POST` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:06:36.670689 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8348380f-800e-4294-b70a-ba848dc66ff3 None None] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:06:36.670689 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8348380f-800e-4294-b70a-ba848dc66ff3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:06:36.728527 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.auth.core [None req-8348380f-800e-4294-b70a-ba848dc66ff3 None None] MFA Rules not processed for user `5977780e274849ee8a2471738f5336be`. Rule list: `[]` (Enabled: `True`). {{(pid=80395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 16:06:36.729151 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.fernet_utils [None req-8348380f-800e-4294-b70a-ba848dc66ff3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:06:36.763641 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86fd8b36-03b0-4bf5-a68d-3ea28eb7c791 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f73d5a98be74242b45222df39fb6213', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:06:36.764859 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86fd8b36-03b0-4bf5-a68d-3ea28eb7c791 admin admin] REQUEST_METHOD: `GET` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:06:36.765344 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86fd8b36-03b0-4bf5-a68d-3ea28eb7c791 admin admin] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:06:36.766169 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86fd8b36-03b0-4bf5-a68d-3ea28eb7c791 admin admin] PATH_INFO: `/v3/domains` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:06:36.767385 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86fd8b36-03b0-4bf5-a68d-3ea28eb7c791 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80396) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 16:06:36.767787 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86fd8b36-03b0-4bf5-a68d-3ea28eb7c791 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:06:36.769923 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86fd8b36-03b0-4bf5-a68d-3ea28eb7c791 admin admin] RBAC: Authorization granted {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:06:36.810614 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 848/1702] 10.222.0.59 () {58 vars in 1152 bytes} [Thu Jun 2 16:06:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 372 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 16:06:36.810614 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86fd8b36-03b0-4bf5-a68d-3ea28eb7c791 admin admin] Authenticating user token {{(pid=80396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:06:36.829636 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 16:06:36.830654 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86fd8b36-03b0-4bf5-a68d-3ea28eb7c791 admin admin] Validating token access rules against request {{(pid=80396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:06:36.839502 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3233920-f3b2-44ec-896d-58026eaaa955 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f73d5a98be74242b45222df39fb6213', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:06:36.840360 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3233920-f3b2-44ec-896d-58026eaaa955 admin admin] REQUEST_METHOD: `POST` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:06:36.840820 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3233920-f3b2-44ec-896d-58026eaaa955 admin admin] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:06:36.841269 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3233920-f3b2-44ec-896d-58026eaaa955 admin admin] PATH_INFO: `/v3/projects` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:06:36.846420 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3233920-f3b2-44ec-896d-58026eaaa955 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:06:36.849199 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3233920-f3b2-44ec-896d-58026eaaa955 admin admin] RBAC: Authorization granted {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:06:36.929527 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 855/1703] 10.222.0.59 () {58 vars in 957 bytes} [Thu Jun 2 16:06:36 2022] POST /identity/v3/auth/tokens => generated 3222 bytes in 262 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 16:06:36.933620 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8348380f-800e-4294-b70a-ba848dc66ff3 None None] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:06:36.956382 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8348380f-800e-4294-b70a-ba848dc66ff3 None None] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:06:36.967361 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e692fe36-62ec-4f4e-94a2-341a3b465af7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f73d5a98be74242b45222df39fb6213', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:06:36.968028 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e692fe36-62ec-4f4e-94a2-341a3b465af7 admin admin] REQUEST_METHOD: `POST` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:06:36.968315 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e692fe36-62ec-4f4e-94a2-341a3b465af7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:06:36.968588 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e692fe36-62ec-4f4e-94a2-341a3b465af7 admin admin] PATH_INFO: `/v3/projects` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:06:36.969294 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e692fe36-62ec-4f4e-94a2-341a3b465af7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:06:36.971383 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e692fe36-62ec-4f4e-94a2-341a3b465af7 admin admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:06:37.004617 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 849/1704] 10.222.0.59 () {60 vars in 1152 bytes} [Thu Jun 2 16:06:36 2022] POST /identity/v3/projects => generated 381 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 16:06:37.007429 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb3074c1-ce1a-4fa0-8eab-7c33f8523805 None None] REQUEST_METHOD: `POST` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:06:37.010754 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb3074c1-ce1a-4fa0-8eab-7c33f8523805 None None] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:06:37.010754 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb3074c1-ce1a-4fa0-8eab-7c33f8523805 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:06:37.034150 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.auth.core [None req-bb3074c1-ce1a-4fa0-8eab-7c33f8523805 None None] MFA Rules not processed for user `11b714eb2dda4460a8ff52215e671bfa`. Rule list: `[]` (Enabled: `True`). {{(pid=80396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 16:06:37.035742 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.fernet_utils [None req-bb3074c1-ce1a-4fa0-8eab-7c33f8523805 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:06:37.127994 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 856/1705] 10.222.0.59 () {60 vars in 1152 bytes} [Thu Jun 2 16:06:36 2022] POST /identity/v3/projects => generated 381 bytes in 197 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 16:06:37.128826 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e692fe36-62ec-4f4e-94a2-341a3b465af7 admin admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:06:37.160617 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 850/1706] 10.222.0.59 () {58 vars in 1009 bytes} [Thu Jun 2 16:06:37 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 16:06:37.161717 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb3074c1-ce1a-4fa0-8eab-7c33f8523805 None None] Authenticating user token {{(pid=80396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:06:37.264860 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb3074c1-ce1a-4fa0-8eab-7c33f8523805 None None] Validating token access rules against request {{(pid=80396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:06:37.316332 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e692fe36-62ec-4f4e-94a2-341a3b465af7 admin admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:06:37.352949 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37e2ff61-64b4-4a10-bb9f-72c0f038caf1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f73d5a98be74242b45222df39fb6213', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:06:37.358776 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e2ff61-64b4-4a10-bb9f-72c0f038caf1 admin admin] REQUEST_METHOD: `POST` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:06:37.359212 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e2ff61-64b4-4a10-bb9f-72c0f038caf1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:06:37.359607 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e2ff61-64b4-4a10-bb9f-72c0f038caf1 admin admin] PATH_INFO: `/v3/projects` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:06:37.360810 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37e2ff61-64b4-4a10-bb9f-72c0f038caf1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:06:37.363627 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37e2ff61-64b4-4a10-bb9f-72c0f038caf1 admin admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:06:37.395038 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG dbcounter [-] [80396] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=80396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 16:06:37.426909 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ad4dce-bb1e-4e30-b41b-91433cd95f46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f73d5a98be74242b45222df39fb6213', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:06:37.427609 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ad4dce-bb1e-4e30-b41b-91433cd95f46 admin admin] REQUEST_METHOD: `POST` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:06:37.427899 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ad4dce-bb1e-4e30-b41b-91433cd95f46 admin admin] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:06:37.428185 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ad4dce-bb1e-4e30-b41b-91433cd95f46 admin admin] PATH_INFO: `/v3/users` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:06:37.428901 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9ad4dce-bb1e-4e30-b41b-91433cd95f46 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:06:37.433246 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9ad4dce-bb1e-4e30-b41b-91433cd95f46 admin admin] RBAC: Authorization granted {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:06:37.568127 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 857/1707] 10.222.0.59 () {60 vars in 1152 bytes} [Thu Jun 2 16:06:37 2022] POST /identity/v3/projects => generated 357 bytes in 440 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 16:06:37.573466 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37e2ff61-64b4-4a10-bb9f-72c0f038caf1 admin admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:06:37.625622 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 851/1708] 10.222.0.59 () {60 vars in 1143 bytes} [Thu Jun 2 16:06:37 2022] POST /identity/v3/users => generated 297 bytes in 462 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 16:06:37.625622 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ad4dce-bb1e-4e30-b41b-91433cd95f46 admin admin] Authenticating user token {{(pid=80396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:06:37.652668 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ad4dce-bb1e-4e30-b41b-91433cd95f46 admin admin] Validating token access rules against request {{(pid=80396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:06:37.765928 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37e2ff61-64b4-4a10-bb9f-72c0f038caf1 admin admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:06:37.781771 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2e1ff9c-66ae-4b2f-b7ba-2cf400583373 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f73d5a98be74242b45222df39fb6213', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:06:37.783786 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e1ff9c-66ae-4b2f-b7ba-2cf400583373 admin admin] REQUEST_METHOD: `POST` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:06:37.785199 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e1ff9c-66ae-4b2f-b7ba-2cf400583373 admin admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:06:37.785743 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e1ff9c-66ae-4b2f-b7ba-2cf400583373 admin admin] PATH_INFO: `/v3/users` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:06:37.787937 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2e1ff9c-66ae-4b2f-b7ba-2cf400583373 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:06:37.788276 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33f14020-ba65-4e6b-8152-f91c9487e2e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f73d5a98be74242b45222df39fb6213', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:06:37.789243 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f14020-ba65-4e6b-8152-f91c9487e2e3 admin admin] REQUEST_METHOD: `POST` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:06:37.789651 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f14020-ba65-4e6b-8152-f91c9487e2e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:06:37.790129 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f14020-ba65-4e6b-8152-f91c9487e2e3 admin admin] PATH_INFO: `/v3/users` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:06:37.790992 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33f14020-ba65-4e6b-8152-f91c9487e2e3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:06:37.792591 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2e1ff9c-66ae-4b2f-b7ba-2cf400583373 admin admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:06:37.793496 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33f14020-ba65-4e6b-8152-f91c9487e2e3 admin admin] RBAC: Authorization granted {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:06:37.892706 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 852/1709] 10.222.0.59 () {60 vars in 1143 bytes} [Thu Jun 2 16:06:37 2022] POST /identity/v3/users => generated 285 bytes in 269 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 16:06:37.893860 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33f14020-ba65-4e6b-8152-f91c9487e2e3 admin admin] Authenticating user token {{(pid=80396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:06:37.918874 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33f14020-ba65-4e6b-8152-f91c9487e2e3 admin admin] Validating token access rules against request {{(pid=80396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:06:37.927833 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e34b2ee-453c-404f-85a3-a165f64da471 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f73d5a98be74242b45222df39fb6213', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:06:37.928576 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e34b2ee-453c-404f-85a3-a165f64da471 admin admin] REQUEST_METHOD: `GET` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:06:37.929062 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e34b2ee-453c-404f-85a3-a165f64da471 admin admin] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:06:37.929319 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e34b2ee-453c-404f-85a3-a165f64da471 admin admin] PATH_INFO: `/v3/roles` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:06:37.930146 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e34b2ee-453c-404f-85a3-a165f64da471 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:06:37.952889 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 858/1710] 10.222.0.59 () {60 vars in 1143 bytes} [Thu Jun 2 16:06:37 2022] POST /identity/v3/users => generated 291 bytes in 381 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 16:06:37.957267 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2e1ff9c-66ae-4b2f-b7ba-2cf400583373 admin admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:06:37.958649 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e34b2ee-453c-404f-85a3-a165f64da471 admin admin] RBAC: Authorization granted {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:06:37.961259 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.fernet_utils [None req-c2e1ff9c-66ae-4b2f-b7ba-2cf400583373 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:06:37.990689 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 853/1711] 10.222.0.59 () {58 vars in 1121 bytes} [Thu Jun 2 16:06:37 2022] GET /identity/v3/roles => generated 1420 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 16:06:37.993245 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e34b2ee-453c-404f-85a3-a165f64da471 admin admin] Authenticating user token {{(pid=80396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:06:38.013100 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e34b2ee-453c-404f-85a3-a165f64da471 admin admin] Validating token access rules against request {{(pid=80396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:06:38.029152 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb556495-beb1-4568-802b-dfe42b89b1d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f73d5a98be74242b45222df39fb6213', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:06:38.030197 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb556495-beb1-4568-802b-dfe42b89b1d3 admin admin] REQUEST_METHOD: `GET` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:06:38.030623 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb556495-beb1-4568-802b-dfe42b89b1d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:06:38.031042 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb556495-beb1-4568-802b-dfe42b89b1d3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:06:38.032095 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb556495-beb1-4568-802b-dfe42b89b1d3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:06:38.040748 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb556495-beb1-4568-802b-dfe42b89b1d3 admin admin] RBAC: Authorization granted {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:06:38.084857 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 854/1712] 10.222.0.59 () {58 vars in 1121 bytes} [Thu Jun 2 16:06:37 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 16:06:38.084857 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb556495-beb1-4568-802b-dfe42b89b1d3 admin admin] Authenticating user token {{(pid=80396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:06:38.105793 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb556495-beb1-4568-802b-dfe42b89b1d3 admin admin] Validating token access rules against request {{(pid=80396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:06:38.129301 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2ab1a76-2c21-4a0e-9bb5-d697731e97f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f73d5a98be74242b45222df39fb6213', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:06:38.131043 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ab1a76-2c21-4a0e-9bb5-d697731e97f4 admin admin] REQUEST_METHOD: `GET` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:06:38.131330 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ab1a76-2c21-4a0e-9bb5-d697731e97f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:06:38.131610 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ab1a76-2c21-4a0e-9bb5-d697731e97f4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:06:38.134579 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2ab1a76-2c21-4a0e-9bb5-d697731e97f4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:06:38.136305 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2ab1a76-2c21-4a0e-9bb5-d697731e97f4 admin admin] RBAC: Authorization granted {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:06:38.153554 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 16:06:38.167096 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 855/1713] 10.222.0.59 () {58 vars in 1121 bytes} [Thu Jun 2 16:06:38 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 16:06:38.173837 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2ab1a76-2c21-4a0e-9bb5-d697731e97f4 admin admin] Authenticating user token {{(pid=80396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:06:38.213615 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2ab1a76-2c21-4a0e-9bb5-d697731e97f4 admin admin] Validating token access rules against request {{(pid=80396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:06:38.218592 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2e1ff9c-66ae-4b2f-b7ba-2cf400583373 admin admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:06:38.235138 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4b855e5-5d5b-4ee8-b2b2-32da4012b00e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f73d5a98be74242b45222df39fb6213', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:06:38.237719 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b855e5-5d5b-4ee8-b2b2-32da4012b00e admin admin] REQUEST_METHOD: `PUT` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:06:38.237719 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b855e5-5d5b-4ee8-b2b2-32da4012b00e admin admin] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:06:38.237719 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b855e5-5d5b-4ee8-b2b2-32da4012b00e admin admin] PATH_INFO: `/v3/projects/54888e6d059a44198834d00d62020eba/users/9e28ca53978e401a8b1a39099e574f22/roles/f1e0c25f6e9049e897cb7350c7e54ab3` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:06:38.239668 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-640029a5-0c32-40d5-85cf-818411dd9bf3 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31bd858bf7674f43a99b77d11bc3c1a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c87c981909d4b8db02783421818c79b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:06:38.240401 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-640029a5-0c32-40d5-85cf-818411dd9bf3 service swift] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:06:38.241033 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-640029a5-0c32-40d5-85cf-818411dd9bf3 service swift] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:06:38.242534 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-640029a5-0c32-40d5-85cf-818411dd9bf3 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:06:38.308543 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4b855e5-5d5b-4ee8-b2b2-32da4012b00e admin admin] RBAC: Authorizing `identity:create_grant(project_id=54888e6d059a44198834d00d62020eba, user_id=9e28ca53978e401a8b1a39099e574f22, role_id=f1e0c25f6e9049e897cb7350c7e54ab3)` {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:06:38.319783 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4b855e5-5d5b-4ee8-b2b2-32da4012b00e admin admin] RBAC: Authorization granted {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:06:38.394123 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-640029a5-0c32-40d5-85cf-818411dd9bf3 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:06:38.396399 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-640029a5-0c32-40d5-85cf-818411dd9bf3 service swift] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:06:38.426882 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 859/1714] 10.222.0.59 () {60 vars in 1384 bytes} [Thu Jun 2 16:06:37 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 462 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 02 16:06:38.426882 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-640029a5-0c32-40d5-85cf-818411dd9bf3 service swift] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:06:38.455633 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-640029a5-0c32-40d5-85cf-818411dd9bf3 service swift] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:06:38.474864 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1640815f-1246-4219-988e-1a18509b40d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f73d5a98be74242b45222df39fb6213', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:06:38.476635 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1640815f-1246-4219-988e-1a18509b40d6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:06:38.476923 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1640815f-1246-4219-988e-1a18509b40d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:06:38.477202 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1640815f-1246-4219-988e-1a18509b40d6 admin admin] PATH_INFO: `/v3/projects/4c1134ebfa714939b0847cdfaf2ac9cc/users/2c8a89c960f242bb95583c887b3406b2/roles/f1e0c25f6e9049e897cb7350c7e54ab3` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:06:38.504860 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 856/1715] 10.222.0.59 () {60 vars in 1482 bytes} [Thu Jun 2 16:06:38 2022] PUT /identity/v3/projects/54888e6d059a44198834d00d62020eba/users/9e28ca53978e401a8b1a39099e574f22/roles/f1e0c25f6e9049e897cb7350c7e54ab3 => generated 0 bytes in 338 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 16:06:38.505678 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4b855e5-5d5b-4ee8-b2b2-32da4012b00e admin admin] Authenticating user token {{(pid=80396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:06:38.522169 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1640815f-1246-4219-988e-1a18509b40d6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4c1134ebfa714939b0847cdfaf2ac9cc, user_id=2c8a89c960f242bb95583c887b3406b2, role_id=f1e0c25f6e9049e897cb7350c7e54ab3)` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:06:38.530028 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1640815f-1246-4219-988e-1a18509b40d6 admin admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:06:38.669172 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 860/1716] 10.222.0.59 () {60 vars in 1482 bytes} [Thu Jun 2 16:06:38 2022] PUT /identity/v3/projects/4c1134ebfa714939b0847cdfaf2ac9cc/users/2c8a89c960f242bb95583c887b3406b2/roles/f1e0c25f6e9049e897cb7350c7e54ab3 => generated 0 bytes in 250 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 16:06:38.672226 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f5ceda-127d-4de3-bf93-3d2987dc6d69 None None] REQUEST_METHOD: `POST` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:06:38.673464 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f5ceda-127d-4de3-bf93-3d2987dc6d69 None None] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:06:38.679721 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f5ceda-127d-4de3-bf93-3d2987dc6d69 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:06:38.702906 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4b855e5-5d5b-4ee8-b2b2-32da4012b00e admin admin] Validating token access rules against request {{(pid=80396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:06:38.776116 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.auth.core [None req-46f5ceda-127d-4de3-bf93-3d2987dc6d69 None None] MFA Rules not processed for user `a8658730ea2a4a06b7b4070976c6397f`. Rule list: `[]` (Enabled: `True`). {{(pid=80395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 16:06:38.777237 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.fernet_utils [None req-46f5ceda-127d-4de3-bf93-3d2987dc6d69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:06:38.846691 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1630dfc6-4f3e-4b82-9b3c-cdec7084000e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f73d5a98be74242b45222df39fb6213', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:06:38.848865 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1630dfc6-4f3e-4b82-9b3c-cdec7084000e admin admin] REQUEST_METHOD: `GET` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:06:38.850409 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1630dfc6-4f3e-4b82-9b3c-cdec7084000e admin admin] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:06:38.851385 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1630dfc6-4f3e-4b82-9b3c-cdec7084000e admin admin] PATH_INFO: `/v3/roles` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:06:38.855292 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1630dfc6-4f3e-4b82-9b3c-cdec7084000e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:06:38.860526 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1630dfc6-4f3e-4b82-9b3c-cdec7084000e admin admin] RBAC: Authorization granted {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:06:38.876710 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 861/1717] 10.222.0.59 () {58 vars in 957 bytes} [Thu Jun 2 16:06:38 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 16:06:38.877872 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46f5ceda-127d-4de3-bf93-3d2987dc6d69 None None] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:06:38.893650 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 857/1718] 10.222.0.59 () {58 vars in 1121 bytes} [Thu Jun 2 16:06:38 2022] GET /identity/v3/roles => generated 1420 bytes in 388 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 16:06:38.896530 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bbcf113-47ef-48f5-805a-c36f7fc88987 None None] REQUEST_METHOD: `POST` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:06:38.896848 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bbcf113-47ef-48f5-805a-c36f7fc88987 None None] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:06:38.901908 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bbcf113-47ef-48f5-805a-c36f7fc88987 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:06:38.913200 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46f5ceda-127d-4de3-bf93-3d2987dc6d69 None None] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:06:38.925626 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa12539e-69b6-4f42-8a49-6806b0fbd404 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f73d5a98be74242b45222df39fb6213', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:06:38.926459 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa12539e-69b6-4f42-8a49-6806b0fbd404 admin admin] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:06:38.930585 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa12539e-69b6-4f42-8a49-6806b0fbd404 admin admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:06:38.930585 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa12539e-69b6-4f42-8a49-6806b0fbd404 admin admin] PATH_INFO: `/v3/roles` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:06:38.930585 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa12539e-69b6-4f42-8a49-6806b0fbd404 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:06:38.932179 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa12539e-69b6-4f42-8a49-6806b0fbd404 admin admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:06:38.966387 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 862/1719] 10.222.0.59 () {58 vars in 1121 bytes} [Thu Jun 2 16:06:38 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 16:06:38.967242 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa12539e-69b6-4f42-8a49-6806b0fbd404 admin admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:06:38.970637 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.auth.core [None req-5bbcf113-47ef-48f5-805a-c36f7fc88987 None None] MFA Rules not processed for user `88bb3d2dbcdb45bb8baba424e5239e21`. Rule list: `[]` (Enabled: `True`). {{(pid=80396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 16:06:38.972557 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.fernet_utils [None req-5bbcf113-47ef-48f5-805a-c36f7fc88987 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:06:38.981170 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa12539e-69b6-4f42-8a49-6806b0fbd404 admin admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:06:38.987543 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-409646b0-5711-4933-857f-02cc925621ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f73d5a98be74242b45222df39fb6213', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:06:38.988586 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409646b0-5711-4933-857f-02cc925621ad admin admin] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:06:38.989223 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409646b0-5711-4933-857f-02cc925621ad admin admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:06:38.989708 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409646b0-5711-4933-857f-02cc925621ad admin admin] PATH_INFO: `/v3/roles` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:06:38.991140 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-409646b0-5711-4933-857f-02cc925621ad admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:06:38.993120 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-409646b0-5711-4933-857f-02cc925621ad admin admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:06:39.005706 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG dbcounter [-] [80396] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 16:06:39.034293 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 863/1720] 10.222.0.59 () {58 vars in 1121 bytes} [Thu Jun 2 16:06:38 2022] GET /identity/v3/roles => generated 1420 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 16:06:39.036046 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d99cc84-16af-4397-9300-9b4625d54e17 None None] REQUEST_METHOD: `POST` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:06:39.036724 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d99cc84-16af-4397-9300-9b4625d54e17 None None] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:06:39.037291 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d99cc84-16af-4397-9300-9b4625d54e17 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:06:39.088376 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.auth.core [None req-5d99cc84-16af-4397-9300-9b4625d54e17 None None] MFA Rules not processed for user `a8658730ea2a4a06b7b4070976c6397f`. Rule list: `[]` (Enabled: `True`). {{(pid=80395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 16:06:39.092830 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.fernet_utils [None req-5d99cc84-16af-4397-9300-9b4625d54e17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:06:39.110445 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 864/1721] 10.222.0.59 () {58 vars in 957 bytes} [Thu Jun 2 16:06:39 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 16:06:39.111794 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d99cc84-16af-4397-9300-9b4625d54e17 None None] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:06:39.163799 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 858/1722] 10.222.0.59 () {58 vars in 957 bytes} [Thu Jun 2 16:06:38 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 270 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 16:06:39.165369 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d99cc84-16af-4397-9300-9b4625d54e17 None None] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:06:39.175988 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c8bf96-9b08-4435-9d84-f26126cdcfd2 None None] REQUEST_METHOD: `POST` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:06:39.176282 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c8bf96-9b08-4435-9d84-f26126cdcfd2 None None] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:06:39.176593 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c8bf96-9b08-4435-9d84-f26126cdcfd2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:06:39.183772 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64586708-ed09-42c9-84e0-f8760c1cb564 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f73d5a98be74242b45222df39fb6213', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:06:39.185072 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64586708-ed09-42c9-84e0-f8760c1cb564 admin admin] REQUEST_METHOD: `PUT` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:06:39.185535 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64586708-ed09-42c9-84e0-f8760c1cb564 admin admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:06:39.185967 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64586708-ed09-42c9-84e0-f8760c1cb564 admin admin] PATH_INFO: `/v3/projects/559f027c4cfe4a6085e7aaa68b040462/users/c60b6152437f44d9b00adacab6b1b71a/roles/649e0f2b5a264c419ea6a1441f123a03` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:06:39.223956 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64586708-ed09-42c9-84e0-f8760c1cb564 admin admin] RBAC: Authorizing `identity:create_grant(project_id=559f027c4cfe4a6085e7aaa68b040462, user_id=c60b6152437f44d9b00adacab6b1b71a, role_id=649e0f2b5a264c419ea6a1441f123a03)` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:06:39.229789 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64586708-ed09-42c9-84e0-f8760c1cb564 admin admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:06:39.244524 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.auth.core [None req-e6c8bf96-9b08-4435-9d84-f26126cdcfd2 None None] MFA Rules not processed for user `26e030ed76e642839bee01f76e36cecc`. Rule list: `[]` (Enabled: `True`). {{(pid=80396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 16:06:39.246586 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.fernet_utils [None req-e6c8bf96-9b08-4435-9d84-f26126cdcfd2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:06:39.371295 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 865/1723] 10.222.0.59 () {60 vars in 1482 bytes} [Thu Jun 2 16:06:39 2022] PUT /identity/v3/projects/559f027c4cfe4a6085e7aaa68b040462/users/c60b6152437f44d9b00adacab6b1b71a/roles/649e0f2b5a264c419ea6a1441f123a03 => generated 0 bytes in 260 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 16:06:39.372605 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64586708-ed09-42c9-84e0-f8760c1cb564 admin admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:06:39.446255 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 859/1724] 10.222.0.59 () {58 vars in 957 bytes} [Thu Jun 2 16:06:39 2022] POST /identity/v3/auth/tokens => generated 3272 bytes in 281 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 16:06:39.447637 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6c8bf96-9b08-4435-9d84-f26126cdcfd2 None None] Authenticating user token {{(pid=80396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:06:39.495389 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6c8bf96-9b08-4435-9d84-f26126cdcfd2 None None] Validating token access rules against request {{(pid=80396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:06:39.495874 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64586708-ed09-42c9-84e0-f8760c1cb564 admin admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:06:39.520133 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc355057-48a8-4867-8f3b-c94d9cb91089 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f73d5a98be74242b45222df39fb6213', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:06:39.520826 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b72ddca8-8b77-43c3-9e5c-d4aa62414d85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f73d5a98be74242b45222df39fb6213', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:06:39.521095 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc355057-48a8-4867-8f3b-c94d9cb91089 admin admin] REQUEST_METHOD: `PUT` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:06:39.521488 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc355057-48a8-4867-8f3b-c94d9cb91089 admin admin] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:06:39.523008 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc355057-48a8-4867-8f3b-c94d9cb91089 admin admin] PATH_INFO: `/v3/projects/4c1134ebfa714939b0847cdfaf2ac9cc/users/2c8a89c960f242bb95583c887b3406b2/roles/f1e0c25f6e9049e897cb7350c7e54ab3` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:06:39.523197 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b72ddca8-8b77-43c3-9e5c-d4aa62414d85 admin admin] REQUEST_METHOD: `PUT` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:06:39.523630 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b72ddca8-8b77-43c3-9e5c-d4aa62414d85 admin admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:06:39.524108 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b72ddca8-8b77-43c3-9e5c-d4aa62414d85 admin admin] PATH_INFO: `/v3/projects/54888e6d059a44198834d00d62020eba/users/9e28ca53978e401a8b1a39099e574f22/roles/f1e0c25f6e9049e897cb7350c7e54ab3` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:06:39.525350 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc355057-48a8-4867-8f3b-c94d9cb91089 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4c1134ebfa714939b0847cdfaf2ac9cc, user_id=2c8a89c960f242bb95583c887b3406b2, role_id=f1e0c25f6e9049e897cb7350c7e54ab3)` {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:06:39.528307 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b72ddca8-8b77-43c3-9e5c-d4aa62414d85 admin admin] RBAC: Authorizing `identity:create_grant(project_id=54888e6d059a44198834d00d62020eba, user_id=9e28ca53978e401a8b1a39099e574f22, role_id=f1e0c25f6e9049e897cb7350c7e54ab3)` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:06:39.534772 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc355057-48a8-4867-8f3b-c94d9cb91089 admin admin] RBAC: Authorization granted {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:06:39.535334 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b72ddca8-8b77-43c3-9e5c-d4aa62414d85 admin admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:06:39.569511 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 866/1725] 10.222.0.59 () {60 vars in 1482 bytes} [Thu Jun 2 16:06:39 2022] PUT /identity/v3/projects/54888e6d059a44198834d00d62020eba/users/9e28ca53978e401a8b1a39099e574f22/roles/f1e0c25f6e9049e897cb7350c7e54ab3 => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 16:06:39.569511 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b72ddca8-8b77-43c3-9e5c-d4aa62414d85 admin admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:06:39.569511 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.fernet_utils [None req-b72ddca8-8b77-43c3-9e5c-d4aa62414d85 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:06:39.586129 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 860/1726] 10.222.0.59 () {60 vars in 1482 bytes} [Thu Jun 2 16:06:39 2022] PUT /identity/v3/projects/4c1134ebfa714939b0847cdfaf2ac9cc/users/2c8a89c960f242bb95583c887b3406b2/roles/f1e0c25f6e9049e897cb7350c7e54ab3 => generated 0 bytes in 139 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 16:06:39.587056 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc355057-48a8-4867-8f3b-c94d9cb91089 admin admin] Authenticating user token {{(pid=80396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:06:39.593443 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.fernet_utils [None req-cc355057-48a8-4867-8f3b-c94d9cb91089 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:06:39.760052 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b72ddca8-8b77-43c3-9e5c-d4aa62414d85 admin admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:06:39.760052 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5135389-57fb-4179-827f-dc5920c8b244 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52f9fe4b13574516bb0a8e2aa11a61e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c87c981909d4b8db02783421818c79b', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:06:39.760052 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5135389-57fb-4179-827f-dc5920c8b244 service nova] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:06:39.760052 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5135389-57fb-4179-827f-dc5920c8b244 service nova] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:06:39.760480 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5135389-57fb-4179-827f-dc5920c8b244 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:06:39.760555 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc355057-48a8-4867-8f3b-c94d9cb91089 admin admin] Validating token access rules against request {{(pid=80396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:06:39.760555 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-802d5007-ab4e-4e91-a2d0-c7903c9c1525 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52f9fe4b13574516bb0a8e2aa11a61e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c87c981909d4b8db02783421818c79b', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:06:39.760555 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-802d5007-ab4e-4e91-a2d0-c7903c9c1525 service nova] REQUEST_METHOD: `GET` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:06:39.760555 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-802d5007-ab4e-4e91-a2d0-c7903c9c1525 service nova] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:06:39.760829 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-802d5007-ab4e-4e91-a2d0-c7903c9c1525 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:06:39.829554 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-802d5007-ab4e-4e91-a2d0-c7903c9c1525 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:06:39.831517 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-802d5007-ab4e-4e91-a2d0-c7903c9c1525 service nova] RBAC: Authorization granted {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:06:39.854942 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5135389-57fb-4179-827f-dc5920c8b244 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:06:39.856706 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5135389-57fb-4179-827f-dc5920c8b244 service nova] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:06:39.857223 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 861/1727] 10.222.0.59 () {60 vars in 1365 bytes} [Thu Jun 2 16:06:39 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 271 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 16:06:39.862353 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e2b425-de45-4290-8b99-d7214bd57ea8 None None] REQUEST_METHOD: `POST` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:06:39.863028 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e2b425-de45-4290-8b99-d7214bd57ea8 None None] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:06:39.863470 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e2b425-de45-4290-8b99-d7214bd57ea8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:06:39.889230 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 867/1728] 10.222.0.59 () {60 vars in 1365 bytes} [Thu Jun 2 16:06:39 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 339 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 16:06:39.890970 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5135389-57fb-4179-827f-dc5920c8b244 service nova] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:06:39.902582 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.fernet_utils [None req-a5135389-57fb-4179-827f-dc5920c8b244 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:06:39.923240 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.auth.core [None req-15e2b425-de45-4290-8b99-d7214bd57ea8 None None] MFA Rules not processed for user `c60b6152437f44d9b00adacab6b1b71a`. Rule list: `[]` (Enabled: `True`). {{(pid=80396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 16:06:39.931458 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.fernet_utils [None req-15e2b425-de45-4290-8b99-d7214bd57ea8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:06:40.071310 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 862/1729] 10.222.0.59 () {58 vars in 957 bytes} [Thu Jun 2 16:06:39 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 213 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 16:06:40.072693 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-754c3f78-a3f4-425b-8c98-5a3159d3b560 None None] REQUEST_METHOD: `POST` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:06:40.072953 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-754c3f78-a3f4-425b-8c98-5a3159d3b560 None None] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:06:40.073339 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-754c3f78-a3f4-425b-8c98-5a3159d3b560 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:06:40.101433 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.auth.core [None req-754c3f78-a3f4-425b-8c98-5a3159d3b560 None None] MFA Rules not processed for user `9af40ddfe9ff4be3887b068f13a28dc0`. Rule list: `[]` (Enabled: `True`). {{(pid=80396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 16:06:40.103582 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.fernet_utils [None req-754c3f78-a3f4-425b-8c98-5a3159d3b560 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:06:40.136888 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5135389-57fb-4179-827f-dc5920c8b244 service nova] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:06:40.146750 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65743ead-a6f6-4009-9bca-831d3d5b1d2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f73d5a98be74242b45222df39fb6213', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:06:40.148058 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65743ead-a6f6-4009-9bca-831d3d5b1d2d admin admin] REQUEST_METHOD: `POST` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:06:40.149095 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65743ead-a6f6-4009-9bca-831d3d5b1d2d admin admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:06:40.150597 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65743ead-a6f6-4009-9bca-831d3d5b1d2d admin admin] PATH_INFO: `/v3/projects` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:06:40.151661 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65743ead-a6f6-4009-9bca-831d3d5b1d2d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:06:40.154235 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65743ead-a6f6-4009-9bca-831d3d5b1d2d admin admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:06:40.235466 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 863/1730] 10.222.0.65 () {58 vars in 1015 bytes} [Thu Jun 2 16:06:40 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 16:06:40.239044 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d0ae6e4-0e17-4ad7-8ff0-f58ada2df2f3 None None] REQUEST_METHOD: `POST` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:06:40.239337 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d0ae6e4-0e17-4ad7-8ff0-f58ada2df2f3 None None] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:06:40.239816 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d0ae6e4-0e17-4ad7-8ff0-f58ada2df2f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:06:40.322618 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.auth.core [None req-2d0ae6e4-0e17-4ad7-8ff0-f58ada2df2f3 None None] MFA Rules not processed for user `9e28ca53978e401a8b1a39099e574f22`. Rule list: `[]` (Enabled: `True`). {{(pid=80396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 16:06:40.324791 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.fernet_utils [None req-2d0ae6e4-0e17-4ad7-8ff0-f58ada2df2f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:06:40.338714 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 868/1731] 10.222.0.59 () {60 vars in 1152 bytes} [Thu Jun 2 16:06:39 2022] POST /identity/v3/projects => generated 403 bytes in 449 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 16:06:40.340754 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35885259-cc0f-4c63-8839-e8d6ddab6eaa None None] REQUEST_METHOD: `POST` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:06:40.341047 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35885259-cc0f-4c63-8839-e8d6ddab6eaa None None] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:06:40.341523 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35885259-cc0f-4c63-8839-e8d6ddab6eaa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:06:40.402338 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.auth.core [None req-35885259-cc0f-4c63-8839-e8d6ddab6eaa None None] MFA Rules not processed for user `2c8a89c960f242bb95583c887b3406b2`. Rule list: `[]` (Enabled: `True`). {{(pid=80395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 16:06:40.404441 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.fernet_utils [None req-35885259-cc0f-4c63-8839-e8d6ddab6eaa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:06:40.521427 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 864/1732] 10.222.0.59 () {58 vars in 957 bytes} [Thu Jun 2 16:06:40 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 284 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 16:06:40.522382 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d0ae6e4-0e17-4ad7-8ff0-f58ada2df2f3 None None] Authenticating user token {{(pid=80396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:06:40.558784 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d0ae6e4-0e17-4ad7-8ff0-f58ada2df2f3 None None] Validating token access rules against request {{(pid=80396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:06:40.596822 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 869/1733] 10.222.0.59 () {58 vars in 957 bytes} [Thu Jun 2 16:06:40 2022] POST /identity/v3/auth/tokens => generated 3291 bytes in 258 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 16:06:40.597926 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35885259-cc0f-4c63-8839-e8d6ddab6eaa None None] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:06:40.602026 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.fernet_utils [None req-35885259-cc0f-4c63-8839-e8d6ddab6eaa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:06:40.639528 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 16:06:40.750779 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35885259-cc0f-4c63-8839-e8d6ddab6eaa None None] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:06:40.773839 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b43d9b35-049f-412d-9141-4765dc34641b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9af40ddfe9ff4be3887b068f13a28dc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c87c981909d4b8db02783421818c79b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:06:40.775541 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b43d9b35-049f-412d-9141-4765dc34641b service neutron] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:06:40.776002 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b43d9b35-049f-412d-9141-4765dc34641b service neutron] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:06:40.776356 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b43d9b35-049f-412d-9141-4765dc34641b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:06:40.792563 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b43d9b35-049f-412d-9141-4765dc34641b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:06:40.794211 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b43d9b35-049f-412d-9141-4765dc34641b service neutron] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:06:40.819133 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 870/1734] 10.222.0.59 () {60 vars in 1365 bytes} [Thu Jun 2 16:06:40 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 221 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 16:06:40.819884 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b43d9b35-049f-412d-9141-4765dc34641b service neutron] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:06:40.873527 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87d5559d-e12a-40d6-9daa-444ee3ce0697 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f73d5a98be74242b45222df39fb6213', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:06:40.875223 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d5559d-e12a-40d6-9daa-444ee3ce0697 admin admin] REQUEST_METHOD: `POST` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:06:40.875566 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d5559d-e12a-40d6-9daa-444ee3ce0697 admin admin] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:06:40.875833 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d5559d-e12a-40d6-9daa-444ee3ce0697 admin admin] PATH_INFO: `/v3/projects` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:06:40.876550 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87d5559d-e12a-40d6-9daa-444ee3ce0697 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:06:40.890189 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87d5559d-e12a-40d6-9daa-444ee3ce0697 admin admin] RBAC: Authorization granted {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:06:40.967126 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b43d9b35-049f-412d-9141-4765dc34641b service neutron] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:06:40.978840 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89b33b24-d80f-4038-9f18-6e79c9f08fe2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f73d5a98be74242b45222df39fb6213', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:06:40.979624 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b33b24-d80f-4038-9f18-6e79c9f08fe2 admin admin] REQUEST_METHOD: `POST` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:06:40.979915 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b33b24-d80f-4038-9f18-6e79c9f08fe2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:06:40.980268 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b33b24-d80f-4038-9f18-6e79c9f08fe2 admin admin] PATH_INFO: `/v3/users` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:06:40.981060 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89b33b24-d80f-4038-9f18-6e79c9f08fe2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:06:40.983801 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89b33b24-d80f-4038-9f18-6e79c9f08fe2 admin admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:06:41.062379 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 865/1735] 10.222.0.59 () {60 vars in 1152 bytes} [Thu Jun 2 16:06:40 2022] POST /identity/v3/projects => generated 383 bytes in 540 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 16:06:41.068729 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87d5559d-e12a-40d6-9daa-444ee3ce0697 admin admin] Authenticating user token {{(pid=80396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:06:41.075064 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.fernet_utils [None req-87d5559d-e12a-40d6-9daa-444ee3ce0697 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:06:41.198628 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87d5559d-e12a-40d6-9daa-444ee3ce0697 admin admin] Validating token access rules against request {{(pid=80396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:06:41.202954 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfb2ff13-1cef-45b0-81a8-21790f523405 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6534961c369940a5b88f310c6450250b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c87c981909d4b8db02783421818c79b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:06:41.208414 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb2ff13-1cef-45b0-81a8-21790f523405 service cinder] REQUEST_METHOD: `GET` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:06:41.208414 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb2ff13-1cef-45b0-81a8-21790f523405 service cinder] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:06:41.208414 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb2ff13-1cef-45b0-81a8-21790f523405 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:06:41.208669 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 871/1736] 10.222.0.59 () {60 vars in 1143 bytes} [Thu Jun 2 16:06:40 2022] POST /identity/v3/users => generated 308 bytes in 388 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 16:06:41.208669 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89b33b24-d80f-4038-9f18-6e79c9f08fe2 admin admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:06:41.213497 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.fernet_utils [None req-89b33b24-d80f-4038-9f18-6e79c9f08fe2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:06:41.408390 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89b33b24-d80f-4038-9f18-6e79c9f08fe2 admin admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:06:41.412208 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfb2ff13-1cef-45b0-81a8-21790f523405 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:06:41.412996 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de31fc1d-ff7c-46f2-83e3-c9a050ea52a6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6534961c369940a5b88f310c6450250b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c87c981909d4b8db02783421818c79b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:06:41.413810 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de31fc1d-ff7c-46f2-83e3-c9a050ea52a6 service cinder] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:06:41.413937 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de31fc1d-ff7c-46f2-83e3-c9a050ea52a6 service cinder] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:06:41.414224 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de31fc1d-ff7c-46f2-83e3-c9a050ea52a6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:06:41.417999 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfb2ff13-1cef-45b0-81a8-21790f523405 service cinder] RBAC: Authorization granted {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:06:41.455114 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 866/1737] 10.222.0.59 () {60 vars in 1365 bytes} [Thu Jun 2 16:06:41 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 392 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 16:06:41.456257 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfb2ff13-1cef-45b0-81a8-21790f523405 service cinder] Authenticating user token {{(pid=80396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:06:41.582190 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de31fc1d-ff7c-46f2-83e3-c9a050ea52a6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:06:41.583700 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de31fc1d-ff7c-46f2-83e3-c9a050ea52a6 service cinder] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:06:41.610871 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 872/1738] 10.222.0.59 () {60 vars in 1365 bytes} [Thu Jun 2 16:06:41 2022] GET /identity/v3/auth/tokens => generated 3291 bytes in 403 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 16:06:41.611821 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de31fc1d-ff7c-46f2-83e3-c9a050ea52a6 service cinder] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:06:41.672000 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG dbcounter [-] [80396] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 16:06:41.732703 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfb2ff13-1cef-45b0-81a8-21790f523405 service cinder] Validating token access rules against request {{(pid=80396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:06:41.749964 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f37df02-c524-435b-a1c3-59b98bd38aff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f73d5a98be74242b45222df39fb6213', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:06:41.757219 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f37df02-c524-435b-a1c3-59b98bd38aff admin admin] REQUEST_METHOD: `POST` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:06:41.757219 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f37df02-c524-435b-a1c3-59b98bd38aff admin admin] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:06:41.757219 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f37df02-c524-435b-a1c3-59b98bd38aff admin admin] PATH_INFO: `/v3/users` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:06:41.757219 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f37df02-c524-435b-a1c3-59b98bd38aff admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:06:41.757219 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f37df02-c524-435b-a1c3-59b98bd38aff admin admin] RBAC: Authorization granted {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:06:41.783766 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de31fc1d-ff7c-46f2-83e3-c9a050ea52a6 service cinder] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:06:41.794659 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58a66d02-a41e-434e-b919-431398f13982 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f73d5a98be74242b45222df39fb6213', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:06:41.795349 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a66d02-a41e-434e-b919-431398f13982 admin admin] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:06:41.795635 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a66d02-a41e-434e-b919-431398f13982 admin admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:06:41.795913 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a66d02-a41e-434e-b919-431398f13982 admin admin] PATH_INFO: `/v3/roles` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:06:41.796650 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58a66d02-a41e-434e-b919-431398f13982 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:06:41.798337 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58a66d02-a41e-434e-b919-431398f13982 admin admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:06:41.833317 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 873/1739] 10.222.0.59 () {58 vars in 1121 bytes} [Thu Jun 2 16:06:41 2022] GET /identity/v3/roles => generated 1420 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 16:06:41.834539 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58a66d02-a41e-434e-b919-431398f13982 admin admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:06:41.849844 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58a66d02-a41e-434e-b919-431398f13982 admin admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:06:41.873149 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9c0afc4-e5a3-4809-98a1-9bd613ac821d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f73d5a98be74242b45222df39fb6213', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:06:41.873955 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c0afc4-e5a3-4809-98a1-9bd613ac821d admin admin] REQUEST_METHOD: `PUT` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:06:41.874272 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c0afc4-e5a3-4809-98a1-9bd613ac821d admin admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:06:41.874548 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c0afc4-e5a3-4809-98a1-9bd613ac821d admin admin] PATH_INFO: `/v3/projects/42024bff72a341a2b531ead930dbca90/users/a5c3e3d8482b4c5b80bc6c64d4b91da4/roles/f1e0c25f6e9049e897cb7350c7e54ab3` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:06:41.922312 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9c0afc4-e5a3-4809-98a1-9bd613ac821d admin admin] RBAC: Authorizing `identity:create_grant(project_id=42024bff72a341a2b531ead930dbca90, user_id=a5c3e3d8482b4c5b80bc6c64d4b91da4, role_id=f1e0c25f6e9049e897cb7350c7e54ab3)` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:06:41.924354 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 867/1740] 10.222.0.59 () {60 vars in 1143 bytes} [Thu Jun 2 16:06:41 2022] POST /identity/v3/users => generated 298 bytes in 469 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 16:06:41.925014 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9c0afc4-e5a3-4809-98a1-9bd613ac821d admin admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:06:41.926397 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f52c64-62f1-452f-baaa-24c3ceabadcf None None] REQUEST_METHOD: `POST` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:06:41.928952 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f52c64-62f1-452f-baaa-24c3ceabadcf None None] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:06:41.929564 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f52c64-62f1-452f-baaa-24c3ceabadcf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:06:42.030678 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.auth.core [None req-57f52c64-62f1-452f-baaa-24c3ceabadcf None None] MFA Rules not processed for user `a8658730ea2a4a06b7b4070976c6397f`. Rule list: `[]` (Enabled: `True`). {{(pid=80396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 16:06:42.038808 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.fernet_utils [None req-57f52c64-62f1-452f-baaa-24c3ceabadcf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:06:42.076083 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 874/1741] 10.222.0.59 () {60 vars in 1482 bytes} [Thu Jun 2 16:06:41 2022] PUT /identity/v3/projects/42024bff72a341a2b531ead930dbca90/users/a5c3e3d8482b4c5b80bc6c64d4b91da4/roles/f1e0c25f6e9049e897cb7350c7e54ab3 => generated 0 bytes in 242 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 02 16:06:42.077039 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9c0afc4-e5a3-4809-98a1-9bd613ac821d admin admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:06:42.226929 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9c0afc4-e5a3-4809-98a1-9bd613ac821d admin admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:06:42.243194 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29326a40-688f-4a84-a16c-beb850c2d6b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f73d5a98be74242b45222df39fb6213', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:06:42.248740 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29326a40-688f-4a84-a16c-beb850c2d6b9 admin admin] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:06:42.248740 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29326a40-688f-4a84-a16c-beb850c2d6b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:06:42.248740 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29326a40-688f-4a84-a16c-beb850c2d6b9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:06:42.248740 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29326a40-688f-4a84-a16c-beb850c2d6b9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:06:42.249990 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29326a40-688f-4a84-a16c-beb850c2d6b9 admin admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:06:42.273148 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 875/1742] 10.222.0.59 () {58 vars in 1121 bytes} [Thu Jun 2 16:06:42 2022] GET /identity/v3/roles => generated 1420 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 16:06:42.277461 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29326a40-688f-4a84-a16c-beb850c2d6b9 admin admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:06:42.284458 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 868/1743] 10.222.0.59 () {58 vars in 957 bytes} [Thu Jun 2 16:06:41 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 359 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 16:06:42.290430 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57f52c64-62f1-452f-baaa-24c3ceabadcf None None] Authenticating user token {{(pid=80396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:06:42.301621 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29326a40-688f-4a84-a16c-beb850c2d6b9 admin admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:06:42.322963 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27094fbc-3ded-4281-b071-d8866a77a6cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f73d5a98be74242b45222df39fb6213', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:06:42.334287 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27094fbc-3ded-4281-b071-d8866a77a6cc admin admin] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:06:42.334287 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27094fbc-3ded-4281-b071-d8866a77a6cc admin admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:06:42.334287 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27094fbc-3ded-4281-b071-d8866a77a6cc admin admin] PATH_INFO: `/v3/roles` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:06:42.334287 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27094fbc-3ded-4281-b071-d8866a77a6cc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:06:42.334287 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27094fbc-3ded-4281-b071-d8866a77a6cc admin admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:06:42.334964 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57f52c64-62f1-452f-baaa-24c3ceabadcf None None] Validating token access rules against request {{(pid=80396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:06:42.387289 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 876/1744] 10.222.0.59 () {58 vars in 1121 bytes} [Thu Jun 2 16:06:42 2022] GET /identity/v3/roles => generated 1420 bytes in 113 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 16:06:42.395232 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27094fbc-3ded-4281-b071-d8866a77a6cc admin admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:06:42.537948 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdd3a7f3-3e18-4eba-8709-8214852b158e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6534961c369940a5b88f310c6450250b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c87c981909d4b8db02783421818c79b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:06:42.539642 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd3a7f3-3e18-4eba-8709-8214852b158e service cinder] REQUEST_METHOD: `GET` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:06:42.540269 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd3a7f3-3e18-4eba-8709-8214852b158e service cinder] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:06:42.540681 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd3a7f3-3e18-4eba-8709-8214852b158e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:06:42.616918 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27094fbc-3ded-4281-b071-d8866a77a6cc admin admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:06:42.633190 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b48e5ee0-4a53-4ac0-99de-b8e0defe17ea service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6534961c369940a5b88f310c6450250b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c87c981909d4b8db02783421818c79b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:06:42.636787 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48e5ee0-4a53-4ac0-99de-b8e0defe17ea service cinder] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:06:42.638105 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48e5ee0-4a53-4ac0-99de-b8e0defe17ea service cinder] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:06:42.638105 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48e5ee0-4a53-4ac0-99de-b8e0defe17ea service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:06:42.770419 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdd3a7f3-3e18-4eba-8709-8214852b158e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:06:42.772331 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdd3a7f3-3e18-4eba-8709-8214852b158e service cinder] RBAC: Authorization granted {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:06:42.797208 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 869/1745] 10.222.0.59 () {60 vars in 1365 bytes} [Thu Jun 2 16:06:42 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 512 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 16:06:42.810517 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdd3a7f3-3e18-4eba-8709-8214852b158e service cinder] Authenticating user token {{(pid=80396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:06:42.824425 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdd3a7f3-3e18-4eba-8709-8214852b158e service cinder] Validating token access rules against request {{(pid=80396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:06:42.831452 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09a226f9-40bd-40d4-8d08-f4a969b4d5d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f73d5a98be74242b45222df39fb6213', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:06:42.833038 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a226f9-40bd-40d4-8d08-f4a969b4d5d1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:06:42.833531 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a226f9-40bd-40d4-8d08-f4a969b4d5d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:06:42.833971 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a226f9-40bd-40d4-8d08-f4a969b4d5d1 admin admin] PATH_INFO: `/v3/projects/11230dad2b654704bdfe6e1ef6113f37/users/abebefa74f9b4db2afad35349483aaf8/roles/f1e0c25f6e9049e897cb7350c7e54ab3` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:06:42.860419 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09a226f9-40bd-40d4-8d08-f4a969b4d5d1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=11230dad2b654704bdfe6e1ef6113f37, user_id=abebefa74f9b4db2afad35349483aaf8, role_id=f1e0c25f6e9049e897cb7350c7e54ab3)` {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:06:42.864049 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09a226f9-40bd-40d4-8d08-f4a969b4d5d1 admin admin] RBAC: Authorization granted {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:06:43.002461 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 870/1746] 10.222.0.59 () {60 vars in 1482 bytes} [Thu Jun 2 16:06:42 2022] PUT /identity/v3/projects/11230dad2b654704bdfe6e1ef6113f37/users/abebefa74f9b4db2afad35349483aaf8/roles/f1e0c25f6e9049e897cb7350c7e54ab3 => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 16:06:43.003486 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09a226f9-40bd-40d4-8d08-f4a969b4d5d1 admin admin] Authenticating user token {{(pid=80396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:06:43.015242 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b48e5ee0-4a53-4ac0-99de-b8e0defe17ea service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:06:43.024956 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b48e5ee0-4a53-4ac0-99de-b8e0defe17ea service cinder] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:06:43.067382 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 877/1747] 10.222.0.59 () {60 vars in 1365 bytes} [Thu Jun 2 16:06:42 2022] GET /identity/v3/auth/tokens => generated 3222 bytes in 678 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 16:06:43.074940 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b48e5ee0-4a53-4ac0-99de-b8e0defe17ea service cinder] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:06:43.132191 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b48e5ee0-4a53-4ac0-99de-b8e0defe17ea service cinder] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:06:43.245996 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09a226f9-40bd-40d4-8d08-f4a969b4d5d1 admin admin] Validating token access rules against request {{(pid=80396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:06:43.265217 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae3f2d12-13ea-446e-942e-989534025663 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f73d5a98be74242b45222df39fb6213', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:06:43.266250 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae3f2d12-13ea-446e-942e-989534025663 admin admin] REQUEST_METHOD: `PUT` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:06:43.266544 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae3f2d12-13ea-446e-942e-989534025663 admin admin] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:06:43.266825 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae3f2d12-13ea-446e-942e-989534025663 admin admin] PATH_INFO: `/v3/projects/42024bff72a341a2b531ead930dbca90/users/a5c3e3d8482b4c5b80bc6c64d4b91da4/roles/f1e0c25f6e9049e897cb7350c7e54ab3` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:06:43.275117 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae3f2d12-13ea-446e-942e-989534025663 admin admin] RBAC: Authorizing `identity:create_grant(project_id=42024bff72a341a2b531ead930dbca90, user_id=a5c3e3d8482b4c5b80bc6c64d4b91da4, role_id=f1e0c25f6e9049e897cb7350c7e54ab3)` {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:06:43.282376 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae3f2d12-13ea-446e-942e-989534025663 admin admin] RBAC: Authorization granted {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:06:43.313520 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 871/1748] 10.222.0.59 () {60 vars in 1482 bytes} [Thu Jun 2 16:06:43 2022] PUT /identity/v3/projects/42024bff72a341a2b531ead930dbca90/users/a5c3e3d8482b4c5b80bc6c64d4b91da4/roles/f1e0c25f6e9049e897cb7350c7e54ab3 => generated 0 bytes in 307 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 16:06:43.322278 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90ef70f9-74b8-4c83-bde6-4514943f1dbb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f73d5a98be74242b45222df39fb6213', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:06:43.323398 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ef70f9-74b8-4c83-bde6-4514943f1dbb admin admin] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:06:43.323782 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ef70f9-74b8-4c83-bde6-4514943f1dbb admin admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:06:43.324235 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ef70f9-74b8-4c83-bde6-4514943f1dbb admin admin] PATH_INFO: `/v3/roles` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:06:43.325078 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90ef70f9-74b8-4c83-bde6-4514943f1dbb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:06:43.327487 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90ef70f9-74b8-4c83-bde6-4514943f1dbb admin admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:06:43.341260 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-640a5101-f454-4969-b055-061fdf092873 None None] REQUEST_METHOD: `GET` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:06:43.344747 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-640a5101-f454-4969-b055-061fdf092873 None None] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:06:43.344747 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-640a5101-f454-4969-b055-061fdf092873 None None] PATH_INFO: `/` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:06:43.344747 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 872/1749] 10.222.0.59 () {54 vars in 912 bytes} [Thu Jun 2 16:06:43 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 16:06:43.356623 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b76042fb-24f6-4b8e-84f2-f918abbf1287 None None] REQUEST_METHOD: `POST` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:06:43.357154 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b76042fb-24f6-4b8e-84f2-f918abbf1287 None None] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:06:43.357662 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b76042fb-24f6-4b8e-84f2-f918abbf1287 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:06:43.365393 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 878/1750] 10.222.0.59 () {58 vars in 1121 bytes} [Thu Jun 2 16:06:43 2022] GET /identity/v3/roles => generated 1420 bytes in 296 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 16:06:43.367104 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90ef70f9-74b8-4c83-bde6-4514943f1dbb admin admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:06:43.401405 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90ef70f9-74b8-4c83-bde6-4514943f1dbb admin admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:06:43.404667 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.auth.core [None req-b76042fb-24f6-4b8e-84f2-f918abbf1287 None None] MFA Rules not processed for user `9af40ddfe9ff4be3887b068f13a28dc0`. Rule list: `[]` (Enabled: `True`). {{(pid=80396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 16:06:43.408114 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.fernet_utils [None req-b76042fb-24f6-4b8e-84f2-f918abbf1287 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:06:43.524070 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 873/1751] 10.222.0.59 () {58 vars in 1009 bytes} [Thu Jun 2 16:06:43 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 02 16:06:43.558452 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13c521c2-26be-439b-b7b2-a9b2cef64521 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f73d5a98be74242b45222df39fb6213', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:06:43.559467 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c521c2-26be-439b-b7b2-a9b2cef64521 admin admin] REQUEST_METHOD: `PUT` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:06:43.559759 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c521c2-26be-439b-b7b2-a9b2cef64521 admin admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:06:43.560155 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c521c2-26be-439b-b7b2-a9b2cef64521 admin admin] PATH_INFO: `/v3/projects/11230dad2b654704bdfe6e1ef6113f37/users/abebefa74f9b4db2afad35349483aaf8/roles/f1e0c25f6e9049e897cb7350c7e54ab3` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:06:43.568876 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13c521c2-26be-439b-b7b2-a9b2cef64521 admin admin] RBAC: Authorizing `identity:create_grant(project_id=11230dad2b654704bdfe6e1ef6113f37, user_id=abebefa74f9b4db2afad35349483aaf8, role_id=f1e0c25f6e9049e897cb7350c7e54ab3)` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:06:43.580565 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13c521c2-26be-439b-b7b2-a9b2cef64521 admin admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:06:43.621884 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b76042fb-24f6-4b8e-84f2-f918abbf1287 None None] Authenticating user token {{(pid=80396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:06:43.629020 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 879/1752] 10.222.0.59 () {60 vars in 1482 bytes} [Thu Jun 2 16:06:43 2022] PUT /identity/v3/projects/11230dad2b654704bdfe6e1ef6113f37/users/abebefa74f9b4db2afad35349483aaf8/roles/f1e0c25f6e9049e897cb7350c7e54ab3 => generated 0 bytes in 251 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 16:06:43.629720 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.fernet_utils [None req-b76042fb-24f6-4b8e-84f2-f918abbf1287 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:06:43.630673 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa85520c-a6de-43f1-89dd-559f6f65d7ba None None] REQUEST_METHOD: `POST` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:06:43.630970 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa85520c-a6de-43f1-89dd-559f6f65d7ba None None] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:06:43.632706 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa85520c-a6de-43f1-89dd-559f6f65d7ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:06:43.665872 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b76042fb-24f6-4b8e-84f2-f918abbf1287 None None] Validating token access rules against request {{(pid=80396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:06:43.767104 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.auth.core [None req-aa85520c-a6de-43f1-89dd-559f6f65d7ba None None] MFA Rules not processed for user `abebefa74f9b4db2afad35349483aaf8`. Rule list: `[]` (Enabled: `True`). {{(pid=80395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 16:06:43.768362 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.fernet_utils [None req-aa85520c-a6de-43f1-89dd-559f6f65d7ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:06:43.901969 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38ae1dce-6649-4508-bf52-0ec898f2da8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f73d5a98be74242b45222df39fb6213', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:06:43.912524 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ae1dce-6649-4508-bf52-0ec898f2da8f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:06:43.912524 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ae1dce-6649-4508-bf52-0ec898f2da8f admin admin] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:06:43.912524 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ae1dce-6649-4508-bf52-0ec898f2da8f admin admin] PATH_INFO: `/v3/users/61a035ccc83044f6b67196a3ece31815` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:06:43.912524 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38ae1dce-6649-4508-bf52-0ec898f2da8f admin admin] RBAC: Authorizing `identity:delete_user(user_id=61a035ccc83044f6b67196a3ece31815)` {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:06:43.912524 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38ae1dce-6649-4508-bf52-0ec898f2da8f admin admin] RBAC: Authorization granted {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:06:44.060536 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 880/1753] 10.222.0.59 () {58 vars in 957 bytes} [Thu Jun 2 16:06:43 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 431 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 16:06:44.061685 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa85520c-a6de-43f1-89dd-559f6f65d7ba None None] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:06:44.267569 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 16:06:44.307563 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa85520c-a6de-43f1-89dd-559f6f65d7ba None None] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:06:44.321100 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31141539-57da-43d1-aa95-f6df5106b62e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9af40ddfe9ff4be3887b068f13a28dc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c87c981909d4b8db02783421818c79b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:06:44.322059 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31141539-57da-43d1-aa95-f6df5106b62e service neutron] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:06:44.322714 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31141539-57da-43d1-aa95-f6df5106b62e service neutron] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:06:44.323363 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31141539-57da-43d1-aa95-f6df5106b62e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:06:44.354520 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31141539-57da-43d1-aa95-f6df5106b62e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:06:44.354520 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31141539-57da-43d1-aa95-f6df5106b62e service neutron] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:06:44.380409 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 881/1754] 10.222.0.59 () {60 vars in 1365 bytes} [Thu Jun 2 16:06:44 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 319 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 16:06:44.389136 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31141539-57da-43d1-aa95-f6df5106b62e service neutron] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:06:44.505578 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.notifications [None req-38ae1dce-6649-4508-bf52-0ec898f2da8f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '61a035ccc83044f6b67196a3ece31815'} {{(pid=80396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:06:44.513622 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.notifications [None req-38ae1dce-6649-4508-bf52-0ec898f2da8f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '61a035ccc83044f6b67196a3ece31815'} {{(pid=80396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:06:44.586027 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31141539-57da-43d1-aa95-f6df5106b62e service neutron] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:06:44.592786 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f18f08c-1e78-465d-8e5d-c68094622861 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6534961c369940a5b88f310c6450250b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c87c981909d4b8db02783421818c79b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:06:44.593451 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f18f08c-1e78-465d-8e5d-c68094622861 service cinder] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:06:44.593736 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f18f08c-1e78-465d-8e5d-c68094622861 service cinder] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:06:44.594017 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f18f08c-1e78-465d-8e5d-c68094622861 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:06:44.599673 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.fernet_utils [None req-6f18f08c-1e78-465d-8e5d-c68094622861 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:06:44.638605 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f18f08c-1e78-465d-8e5d-c68094622861 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:06:44.640083 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f18f08c-1e78-465d-8e5d-c68094622861 service cinder] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:06:44.645170 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.notifications [None req-38ae1dce-6649-4508-bf52-0ec898f2da8f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '61a035ccc83044f6b67196a3ece31815'} {{(pid=80396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:06:44.667743 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 882/1755] 10.222.0.59 () {60 vars in 1365 bytes} [Thu Jun 2 16:06:44 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 287 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 16:06:44.674582 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.notifications [None req-38ae1dce-6649-4508-bf52-0ec898f2da8f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '61a035ccc83044f6b67196a3ece31815'} {{(pid=80396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:06:44.704344 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.notifications [None req-38ae1dce-6649-4508-bf52-0ec898f2da8f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '61a035ccc83044f6b67196a3ece31815'} {{(pid=80396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:06:44.712831 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 874/1756] 10.222.0.59 () {58 vars in 1223 bytes} [Thu Jun 2 16:06:43 2022] DELETE /identity/v3/users/61a035ccc83044f6b67196a3ece31815 => generated 0 bytes in 1091 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 16:06:44.717195 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be10f89e-6b72-4451-a9d6-4530237fa29b None None] REQUEST_METHOD: `POST` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:06:44.717614 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be10f89e-6b72-4451-a9d6-4530237fa29b None None] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:06:44.717720 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be10f89e-6b72-4451-a9d6-4530237fa29b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:06:44.760275 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.auth.core [None req-be10f89e-6b72-4451-a9d6-4530237fa29b None None] MFA Rules not processed for user `400d1f4db9de49638549e5db29a041e1`. Rule list: `[]` (Enabled: `True`). {{(pid=80395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 16:06:44.761570 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.fernet_utils [None req-be10f89e-6b72-4451-a9d6-4530237fa29b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:06:44.974837 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38ae1dce-6649-4508-bf52-0ec898f2da8f admin admin] Authenticating user token {{(pid=80396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:06:44.976478 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.fernet_utils [None req-38ae1dce-6649-4508-bf52-0ec898f2da8f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:06:44.996894 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 883/1757] 10.222.0.59 () {58 vars in 957 bytes} [Thu Jun 2 16:06:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 281 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 16:06:45.011798 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-defd3afc-4a7e-402f-aa8b-38a8c0c30be0 None None] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:06:45.012093 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-defd3afc-4a7e-402f-aa8b-38a8c0c30be0 None None] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:06:45.012373 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-defd3afc-4a7e-402f-aa8b-38a8c0c30be0 None None] PATH_INFO: `/` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:06:45.013780 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 884/1758] 10.222.0.59 () {54 vars in 921 bytes} [Thu Jun 2 16:06:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 16:06:45.026728 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-defd3afc-4a7e-402f-aa8b-38a8c0c30be0 None None] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:06:45.033357 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.fernet_utils [None req-defd3afc-4a7e-402f-aa8b-38a8c0c30be0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:06:45.153372 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38ae1dce-6649-4508-bf52-0ec898f2da8f admin admin] Validating token access rules against request {{(pid=80396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:06:45.165424 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bc6046d-012a-4fbd-bec2-388422496e9f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6534961c369940a5b88f310c6450250b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c87c981909d4b8db02783421818c79b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:06:45.169346 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc6046d-012a-4fbd-bec2-388422496e9f service cinder] REQUEST_METHOD: `GET` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:06:45.169874 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc6046d-012a-4fbd-bec2-388422496e9f service cinder] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:06:45.171676 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc6046d-012a-4fbd-bec2-388422496e9f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:06:45.175117 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.fernet_utils [None req-8bc6046d-012a-4fbd-bec2-388422496e9f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:06:45.288869 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-defd3afc-4a7e-402f-aa8b-38a8c0c30be0 None None] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:06:45.303112 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acf4d359-c02f-468e-a757-0f99bd7e5c84 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9af40ddfe9ff4be3887b068f13a28dc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c87c981909d4b8db02783421818c79b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:06:45.304190 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf4d359-c02f-468e-a757-0f99bd7e5c84 service neutron] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:06:45.304702 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf4d359-c02f-468e-a757-0f99bd7e5c84 service neutron] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:06:45.305170 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf4d359-c02f-468e-a757-0f99bd7e5c84 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:06:45.317747 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bc6046d-012a-4fbd-bec2-388422496e9f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:06:45.335955 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bc6046d-012a-4fbd-bec2-388422496e9f service cinder] RBAC: Authorization granted {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:06:45.371807 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acf4d359-c02f-468e-a757-0f99bd7e5c84 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:06:45.375979 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acf4d359-c02f-468e-a757-0f99bd7e5c84 service neutron] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:06:45.397671 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 875/1759] 10.222.0.59 () {60 vars in 1365 bytes} [Thu Jun 2 16:06:44 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 422 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 02 16:06:45.401250 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b7b6ee-f422-4689-92d8-a497492e465f None None] REQUEST_METHOD: `POST` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:06:45.403277 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b7b6ee-f422-4689-92d8-a497492e465f None None] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:06:45.404007 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b7b6ee-f422-4689-92d8-a497492e465f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:06:45.465144 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG dbcounter [-] [80396] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 16:06:45.473636 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 885/1760] 10.222.0.59 () {60 vars in 1365 bytes} [Thu Jun 2 16:06:45 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 454 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 16:06:45.534261 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.auth.core [None req-64b7b6ee-f422-4689-92d8-a497492e465f None None] MFA Rules not processed for user `52f9fe4b13574516bb0a8e2aa11a61e8`. Rule list: `[]` (Enabled: `True`). {{(pid=80396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 16:06:45.536798 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.fernet_utils [None req-64b7b6ee-f422-4689-92d8-a497492e465f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:06:45.873122 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 876/1761] 10.222.0.59 () {58 vars in 1018 bytes} [Thu Jun 2 16:06:45 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 475 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 16:06:46.156016 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acf4d359-c02f-468e-a757-0f99bd7e5c84 service neutron] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:06:46.158526 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.fernet_utils [None req-acf4d359-c02f-468e-a757-0f99bd7e5c84 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:06:46.204877 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acf4d359-c02f-468e-a757-0f99bd7e5c84 service neutron] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:06:46.236320 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d0e48ec-ee25-41c7-9fe6-85753771c733 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52f9fe4b13574516bb0a8e2aa11a61e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c87c981909d4b8db02783421818c79b', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:06:46.237044 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0e48ec-ee25-41c7-9fe6-85753771c733 service nova] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:06:46.237534 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0e48ec-ee25-41c7-9fe6-85753771c733 service nova] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:06:46.237754 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0e48ec-ee25-41c7-9fe6-85753771c733 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:06:46.256304 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d0e48ec-ee25-41c7-9fe6-85753771c733 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:06:46.257936 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d0e48ec-ee25-41c7-9fe6-85753771c733 service nova] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:06:46.265807 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 16:06:46.305470 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 886/1762] 10.222.0.59 () {60 vars in 1365 bytes} [Thu Jun 2 16:06:46 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 146 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 16:06:47.512131 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64b7b6ee-f422-4689-92d8-a497492e465f None None] Authenticating user token {{(pid=80396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:06:47.518110 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.fernet_utils [None req-64b7b6ee-f422-4689-92d8-a497492e465f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:06:47.548436 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64b7b6ee-f422-4689-92d8-a497492e465f None None] Validating token access rules against request {{(pid=80396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:06:47.564065 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d9ae1ac-76df-4f5b-b11d-d7e0b1df852c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f73d5a98be74242b45222df39fb6213', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:06:47.565187 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d9ae1ac-76df-4f5b-b11d-d7e0b1df852c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:06:47.565573 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d9ae1ac-76df-4f5b-b11d-d7e0b1df852c admin admin] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:06:47.566271 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d9ae1ac-76df-4f5b-b11d-d7e0b1df852c admin admin] PATH_INFO: `/v3/projects/104f0122d8f2464e8f1a9fd46043f9ac` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:06:47.568605 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d9ae1ac-76df-4f5b-b11d-d7e0b1df852c admin admin] RBAC: Authorizing `identity:delete_project(project_id=104f0122d8f2464e8f1a9fd46043f9ac)` {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:06:47.572438 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d9ae1ac-76df-4f5b-b11d-d7e0b1df852c admin admin] RBAC: Authorization granted {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:06:47.752598 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.notifications [None req-0d9ae1ac-76df-4f5b-b11d-d7e0b1df852c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '104f0122d8f2464e8f1a9fd46043f9ac', 'request_id': 'req-0d9ae1ac-76df-4f5b-b11d-d7e0b1df852c'} {{(pid=80396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:06:47.760496 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.notifications [None req-0d9ae1ac-76df-4f5b-b11d-d7e0b1df852c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '104f0122d8f2464e8f1a9fd46043f9ac', 'request_id': 'req-0d9ae1ac-76df-4f5b-b11d-d7e0b1df852c'} {{(pid=80396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:06:47.864407 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.notifications [None req-0d9ae1ac-76df-4f5b-b11d-d7e0b1df852c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '104f0122d8f2464e8f1a9fd46043f9ac', 'request_id': 'req-0d9ae1ac-76df-4f5b-b11d-d7e0b1df852c'} {{(pid=80396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:06:47.913296 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.notifications [None req-0d9ae1ac-76df-4f5b-b11d-d7e0b1df852c admin admin] The token cache is being invalidate because project 104f0122d8f2464e8f1a9fd46043f9ac was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80396) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 02 16:06:47.913733 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.notifications [None req-0d9ae1ac-76df-4f5b-b11d-d7e0b1df852c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:06:47.915169 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.notifications [None req-0d9ae1ac-76df-4f5b-b11d-d7e0b1df852c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:06:47.919179 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 877/1763] 10.222.0.59 () {58 vars in 1232 bytes} [Thu Jun 2 16:06:47 2022] DELETE /identity/v3/projects/104f0122d8f2464e8f1a9fd46043f9ac => generated 0 bytes in 408 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 16:06:47.924346 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb37163-e7f4-451d-8d61-9388926d5c2c None None] REQUEST_METHOD: `POST` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:06:47.929962 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb37163-e7f4-451d-8d61-9388926d5c2c None None] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:06:47.929962 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb37163-e7f4-451d-8d61-9388926d5c2c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:06:47.949059 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.auth.core [None req-efb37163-e7f4-451d-8d61-9388926d5c2c None None] MFA Rules not processed for user `400d1f4db9de49638549e5db29a041e1`. Rule list: `[]` (Enabled: `True`). {{(pid=80395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 16:06:47.952949 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.fernet_utils [None req-efb37163-e7f4-451d-8d61-9388926d5c2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:06:47.980642 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6acb991-2428-4f64-9f23-b8e1b919285e None None] REQUEST_METHOD: `POST` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:06:47.981516 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6acb991-2428-4f64-9f23-b8e1b919285e None None] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:06:47.981943 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6acb991-2428-4f64-9f23-b8e1b919285e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:06:48.006048 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.auth.core [None req-f6acb991-2428-4f64-9f23-b8e1b919285e None None] MFA Rules not processed for user `88bb3d2dbcdb45bb8baba424e5239e21`. Rule list: `[]` (Enabled: `True`). {{(pid=80396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 16:06:48.007566 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.fernet_utils [None req-f6acb991-2428-4f64-9f23-b8e1b919285e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:06:48.088152 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 887/1764] 10.222.0.59 () {58 vars in 957 bytes} [Thu Jun 2 16:06:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 16:06:48.100325 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dafe421-b92f-4943-9ff1-4d6b811ba21a None None] REQUEST_METHOD: `POST` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:06:48.101111 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dafe421-b92f-4943-9ff1-4d6b811ba21a None None] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:06:48.104563 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dafe421-b92f-4943-9ff1-4d6b811ba21a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:06:48.140942 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.auth.core [None req-9dafe421-b92f-4943-9ff1-4d6b811ba21a None None] MFA Rules not processed for user `400d1f4db9de49638549e5db29a041e1`. Rule list: `[]` (Enabled: `True`). {{(pid=80395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 16:06:48.146620 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.fernet_utils [None req-9dafe421-b92f-4943-9ff1-4d6b811ba21a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:06:48.220307 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 888/1765] 10.222.0.59 () {58 vars in 957 bytes} [Thu Jun 2 16:06:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 16:06:48.222038 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647393cd-d098-4ae0-ae3b-8c8f461aab4a None None] REQUEST_METHOD: `POST` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:06:48.223910 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647393cd-d098-4ae0-ae3b-8c8f461aab4a None None] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:06:48.225923 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647393cd-d098-4ae0-ae3b-8c8f461aab4a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:06:48.231773 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 878/1766] 10.222.0.59 () {58 vars in 957 bytes} [Thu Jun 2 16:06:47 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 253 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 16:06:48.232560 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6acb991-2428-4f64-9f23-b8e1b919285e None None] Authenticating user token {{(pid=80396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:06:48.292739 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6acb991-2428-4f64-9f23-b8e1b919285e None None] Validating token access rules against request {{(pid=80396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:06:48.317371 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9165e9d8-fcda-4c41-8b54-f99d3c3e4481 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f73d5a98be74242b45222df39fb6213', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:06:48.318133 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9165e9d8-fcda-4c41-8b54-f99d3c3e4481 admin admin] REQUEST_METHOD: `GET` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:06:48.318432 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9165e9d8-fcda-4c41-8b54-f99d3c3e4481 admin admin] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:06:48.323745 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9165e9d8-fcda-4c41-8b54-f99d3c3e4481 admin admin] PATH_INFO: `/v3/domains` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:06:48.323745 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9165e9d8-fcda-4c41-8b54-f99d3c3e4481 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80396) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 16:06:48.323745 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9165e9d8-fcda-4c41-8b54-f99d3c3e4481 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:06:48.323745 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9165e9d8-fcda-4c41-8b54-f99d3c3e4481 admin admin] RBAC: Authorization granted {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:06:48.361427 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.auth.core [None req-647393cd-d098-4ae0-ae3b-8c8f461aab4a None None] MFA Rules not processed for user `a5c3e3d8482b4c5b80bc6c64d4b91da4`. Rule list: `[]` (Enabled: `True`). {{(pid=80395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 16:06:48.370952 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.fernet_utils [None req-647393cd-d098-4ae0-ae3b-8c8f461aab4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:06:48.378058 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 879/1767] 10.222.0.59 () {58 vars in 1152 bytes} [Thu Jun 2 16:06:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 16:06:48.381748 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9165e9d8-fcda-4c41-8b54-f99d3c3e4481 admin admin] Authenticating user token {{(pid=80396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:06:48.409437 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9165e9d8-fcda-4c41-8b54-f99d3c3e4481 admin admin] Validating token access rules against request {{(pid=80396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:06:48.424636 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab56aef0-b350-4407-a692-4d0d8ee16ce3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f73d5a98be74242b45222df39fb6213', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:06:48.425636 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab56aef0-b350-4407-a692-4d0d8ee16ce3 admin admin] REQUEST_METHOD: `POST` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:06:48.426015 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab56aef0-b350-4407-a692-4d0d8ee16ce3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:06:48.426509 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab56aef0-b350-4407-a692-4d0d8ee16ce3 admin admin] PATH_INFO: `/v3/projects` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:06:48.432143 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab56aef0-b350-4407-a692-4d0d8ee16ce3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:06:48.435187 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab56aef0-b350-4407-a692-4d0d8ee16ce3 admin admin] RBAC: Authorization granted {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:06:48.549349 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 889/1768] 10.222.0.59 () {58 vars in 957 bytes} [Thu Jun 2 16:06:48 2022] POST /identity/v3/auth/tokens => generated 3337 bytes in 331 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 16:06:48.582396 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 880/1769] 10.222.0.59 () {60 vars in 1152 bytes} [Thu Jun 2 16:06:48 2022] POST /identity/v3/projects => generated 403 bytes in 200 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 16:06:48.585564 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-647393cd-d098-4ae0-ae3b-8c8f461aab4a None None] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:06:48.637143 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-647393cd-d098-4ae0-ae3b-8c8f461aab4a None None] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:06:48.801153 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-577498dd-3d27-4580-ada8-0a4ddea08203 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f73d5a98be74242b45222df39fb6213', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:06:48.801153 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-577498dd-3d27-4580-ada8-0a4ddea08203 admin admin] REQUEST_METHOD: `POST` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:06:48.801643 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-577498dd-3d27-4580-ada8-0a4ddea08203 admin admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:06:48.802097 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-577498dd-3d27-4580-ada8-0a4ddea08203 admin admin] PATH_INFO: `/v3/users` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:06:48.803172 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-577498dd-3d27-4580-ada8-0a4ddea08203 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:06:48.809261 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-577498dd-3d27-4580-ada8-0a4ddea08203 admin admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:06:48.978245 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 16:06:48.987485 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 890/1770] 10.222.0.59 () {60 vars in 1143 bytes} [Thu Jun 2 16:06:48 2022] POST /identity/v3/users => generated 302 bytes in 402 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 16:06:48.991367 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab56aef0-b350-4407-a692-4d0d8ee16ce3 admin admin] Authenticating user token {{(pid=80396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:06:49.007607 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab56aef0-b350-4407-a692-4d0d8ee16ce3 admin admin] Validating token access rules against request {{(pid=80396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:06:49.023106 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e67dd59-d515-4155-a7ef-e8c3ae8e133b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f73d5a98be74242b45222df39fb6213', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:06:49.024665 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e67dd59-d515-4155-a7ef-e8c3ae8e133b admin admin] REQUEST_METHOD: `GET` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:06:49.024952 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e67dd59-d515-4155-a7ef-e8c3ae8e133b admin admin] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:06:49.025230 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e67dd59-d515-4155-a7ef-e8c3ae8e133b admin admin] PATH_INFO: `/v3/roles` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:06:49.026279 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e67dd59-d515-4155-a7ef-e8c3ae8e133b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:06:49.028229 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e67dd59-d515-4155-a7ef-e8c3ae8e133b admin admin] RBAC: Authorization granted {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:06:49.067820 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-577498dd-3d27-4580-ada8-0a4ddea08203 admin admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:06:49.078340 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 881/1771] 10.222.0.59 () {58 vars in 1121 bytes} [Thu Jun 2 16:06:48 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 16:06:49.094446 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-577498dd-3d27-4580-ada8-0a4ddea08203 admin admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:06:49.118852 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38bd79e5-a594-4425-8ca4-25d374b9e42d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f73d5a98be74242b45222df39fb6213', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:06:49.119656 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38bd79e5-a594-4425-8ca4-25d374b9e42d admin admin] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:06:49.119947 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38bd79e5-a594-4425-8ca4-25d374b9e42d admin admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:06:49.120223 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38bd79e5-a594-4425-8ca4-25d374b9e42d admin admin] PATH_INFO: `/v3/roles` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:06:49.121072 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38bd79e5-a594-4425-8ca4-25d374b9e42d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:06:49.124536 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38bd79e5-a594-4425-8ca4-25d374b9e42d admin admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:06:49.141384 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 891/1772] 10.222.0.59 () {58 vars in 1121 bytes} [Thu Jun 2 16:06:49 2022] GET /identity/v3/roles => generated 1420 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 16:06:49.147589 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e67dd59-d515-4155-a7ef-e8c3ae8e133b admin admin] Authenticating user token {{(pid=80396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:06:49.157267 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG dbcounter [-] [80396] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 16:06:49.166343 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e67dd59-d515-4155-a7ef-e8c3ae8e133b admin admin] Validating token access rules against request {{(pid=80396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:06:49.181677 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac1ac699-1a9e-44f6-b14c-f9445f0ad449 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f73d5a98be74242b45222df39fb6213', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:06:49.182623 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1ac699-1a9e-44f6-b14c-f9445f0ad449 admin admin] REQUEST_METHOD: `PUT` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:06:49.184236 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1ac699-1a9e-44f6-b14c-f9445f0ad449 admin admin] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:06:49.184531 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1ac699-1a9e-44f6-b14c-f9445f0ad449 admin admin] PATH_INFO: `/v3/projects/c68287df2e0a4382be098ea6668cc870/users/02510bdbf3fd4b669c2fd9165fcbcb06/roles/649e0f2b5a264c419ea6a1441f123a03` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:06:49.245536 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac1ac699-1a9e-44f6-b14c-f9445f0ad449 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c68287df2e0a4382be098ea6668cc870, user_id=02510bdbf3fd4b669c2fd9165fcbcb06, role_id=649e0f2b5a264c419ea6a1441f123a03)` {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:06:49.259707 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac1ac699-1a9e-44f6-b14c-f9445f0ad449 admin admin] RBAC: Authorization granted {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:06:49.350480 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 882/1773] 10.222.0.59 () {60 vars in 1482 bytes} [Thu Jun 2 16:06:49 2022] PUT /identity/v3/projects/c68287df2e0a4382be098ea6668cc870/users/02510bdbf3fd4b669c2fd9165fcbcb06/roles/649e0f2b5a264c419ea6a1441f123a03 => generated 0 bytes in 203 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 16:06:49.361385 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e066430b-2c78-4ac2-a1c5-7c0a0afd5eb9 None None] REQUEST_METHOD: `POST` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:06:49.361885 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e066430b-2c78-4ac2-a1c5-7c0a0afd5eb9 None None] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:06:49.362370 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e066430b-2c78-4ac2-a1c5-7c0a0afd5eb9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:06:49.416298 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.auth.core [None req-e066430b-2c78-4ac2-a1c5-7c0a0afd5eb9 None None] MFA Rules not processed for user `02510bdbf3fd4b669c2fd9165fcbcb06`. Rule list: `[]` (Enabled: `True`). {{(pid=80395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 16:06:49.417513 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.fernet_utils [None req-e066430b-2c78-4ac2-a1c5-7c0a0afd5eb9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:06:49.606786 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 892/1774] 10.222.0.59 () {58 vars in 957 bytes} [Thu Jun 2 16:06:49 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 246 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 16:06:49.611224 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac1ac699-1a9e-44f6-b14c-f9445f0ad449 admin admin] Authenticating user token {{(pid=80396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:06:49.739656 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac1ac699-1a9e-44f6-b14c-f9445f0ad449 admin admin] Validating token access rules against request {{(pid=80396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:06:49.754728 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7118f41-5eac-4378-8515-20122c4fe339 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f73d5a98be74242b45222df39fb6213', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:06:49.756168 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7118f41-5eac-4378-8515-20122c4fe339 admin admin] REQUEST_METHOD: `POST` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:06:49.756168 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7118f41-5eac-4378-8515-20122c4fe339 admin admin] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:06:49.756168 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7118f41-5eac-4378-8515-20122c4fe339 admin admin] PATH_INFO: `/v3/projects` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:06:49.757047 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7118f41-5eac-4378-8515-20122c4fe339 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:06:49.761098 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7118f41-5eac-4378-8515-20122c4fe339 admin admin] RBAC: Authorization granted {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:06:49.859698 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 883/1775] 10.222.0.59 () {60 vars in 1152 bytes} [Thu Jun 2 16:06:49 2022] POST /identity/v3/projects => generated 405 bytes in 249 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 16:06:49.866136 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e066430b-2c78-4ac2-a1c5-7c0a0afd5eb9 None None] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:06:49.905297 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e066430b-2c78-4ac2-a1c5-7c0a0afd5eb9 None None] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:06:50.033344 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f00090e8-cc00-40b2-91d3-2e42d86873aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f73d5a98be74242b45222df39fb6213', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:06:50.034918 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00090e8-cc00-40b2-91d3-2e42d86873aa admin admin] REQUEST_METHOD: `POST` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:06:50.035383 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00090e8-cc00-40b2-91d3-2e42d86873aa admin admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:06:50.035814 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00090e8-cc00-40b2-91d3-2e42d86873aa admin admin] PATH_INFO: `/v3/users` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:06:50.036526 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f00090e8-cc00-40b2-91d3-2e42d86873aa admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:06:50.038516 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f00090e8-cc00-40b2-91d3-2e42d86873aa admin admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:06:50.160792 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 893/1776] 10.222.0.59 () {60 vars in 1143 bytes} [Thu Jun 2 16:06:49 2022] POST /identity/v3/users => generated 309 bytes in 297 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 16:06:50.163952 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7118f41-5eac-4378-8515-20122c4fe339 admin admin] Authenticating user token {{(pid=80396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:06:50.227350 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7118f41-5eac-4378-8515-20122c4fe339 admin admin] Validating token access rules against request {{(pid=80396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:06:50.259436 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-755fc961-15b4-4a4b-9731-25e639f1f561 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f73d5a98be74242b45222df39fb6213', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:06:50.260857 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-755fc961-15b4-4a4b-9731-25e639f1f561 admin admin] REQUEST_METHOD: `GET` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:06:50.261380 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-755fc961-15b4-4a4b-9731-25e639f1f561 admin admin] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:06:50.262224 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-755fc961-15b4-4a4b-9731-25e639f1f561 admin admin] PATH_INFO: `/v3/roles` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:06:50.263255 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-755fc961-15b4-4a4b-9731-25e639f1f561 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:06:50.265510 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-755fc961-15b4-4a4b-9731-25e639f1f561 admin admin] RBAC: Authorization granted {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:06:50.290034 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 884/1777] 10.222.0.59 () {58 vars in 1121 bytes} [Thu Jun 2 16:06:50 2022] GET /identity/v3/roles => generated 1420 bytes in 126 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 16:06:50.293682 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f00090e8-cc00-40b2-91d3-2e42d86873aa admin admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:06:50.310422 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f00090e8-cc00-40b2-91d3-2e42d86873aa admin admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:06:50.323148 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13cf2462-fac1-485f-baa9-6962471a64d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f73d5a98be74242b45222df39fb6213', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:06:50.324649 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13cf2462-fac1-485f-baa9-6962471a64d2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:06:50.325230 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13cf2462-fac1-485f-baa9-6962471a64d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:06:50.325648 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13cf2462-fac1-485f-baa9-6962471a64d2 admin admin] PATH_INFO: `/v3/projects/89fce3390f1542579eeecaca9bc9c859/users/9ba888f052d949e4a5bb6c058f73fc1c/roles/f1e0c25f6e9049e897cb7350c7e54ab3` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:06:50.386231 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13cf2462-fac1-485f-baa9-6962471a64d2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=89fce3390f1542579eeecaca9bc9c859, user_id=9ba888f052d949e4a5bb6c058f73fc1c, role_id=f1e0c25f6e9049e897cb7350c7e54ab3)` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:06:50.389184 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13cf2462-fac1-485f-baa9-6962471a64d2 admin admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:06:50.443382 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f608349d-07bf-420f-bdbb-00816c424250 None None] REQUEST_METHOD: `GET` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:06:50.445459 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f608349d-07bf-420f-bdbb-00816c424250 None None] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:06:50.445459 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f608349d-07bf-420f-bdbb-00816c424250 None None] PATH_INFO: `/` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:06:50.446925 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 885/1778] 10.222.0.59 () {54 vars in 921 bytes} [Thu Jun 2 16:06:50 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 02 16:06:50.488715 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e2afdb-d349-450e-968f-c9dae285c727 None None] REQUEST_METHOD: `POST` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:06:50.489336 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e2afdb-d349-450e-968f-c9dae285c727 None None] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:06:50.489831 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e2afdb-d349-450e-968f-c9dae285c727 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:06:50.521866 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 894/1779] 10.222.0.59 () {60 vars in 1482 bytes} [Thu Jun 2 16:06:50 2022] PUT /identity/v3/projects/89fce3390f1542579eeecaca9bc9c859/users/9ba888f052d949e4a5bb6c058f73fc1c/roles/f1e0c25f6e9049e897cb7350c7e54ab3 => generated 0 bytes in 223 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 16:06:50.524999 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13cf2462-fac1-485f-baa9-6962471a64d2 admin admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:06:50.568159 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.auth.core [None req-c3e2afdb-d349-450e-968f-c9dae285c727 None None] MFA Rules not processed for user `2b700f6d94374ba4b362a8f0d5b35796`. Rule list: `[]` (Enabled: `True`). {{(pid=80396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 16:06:50.577488 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.fernet_utils [None req-c3e2afdb-d349-450e-968f-c9dae285c727 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:06:50.701467 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13cf2462-fac1-485f-baa9-6962471a64d2 admin admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:06:50.711660 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a840b945-4b25-4db0-a795-d21b7963a35f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f73d5a98be74242b45222df39fb6213', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:06:50.713454 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a840b945-4b25-4db0-a795-d21b7963a35f admin admin] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:06:50.713791 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a840b945-4b25-4db0-a795-d21b7963a35f admin admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:06:50.718751 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a840b945-4b25-4db0-a795-d21b7963a35f admin admin] PATH_INFO: `/v3/roles` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:06:50.718751 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a840b945-4b25-4db0-a795-d21b7963a35f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:06:50.718751 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a840b945-4b25-4db0-a795-d21b7963a35f admin admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:06:50.751051 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 895/1780] 10.222.0.59 () {58 vars in 1121 bytes} [Thu Jun 2 16:06:50 2022] GET /identity/v3/roles => generated 1420 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 16:06:50.753566 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a840b945-4b25-4db0-a795-d21b7963a35f admin admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:06:50.767560 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 16:06:50.786158 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 886/1781] 10.222.0.59 () {58 vars in 1018 bytes} [Thu Jun 2 16:06:50 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 298 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 02 16:06:50.787156 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3e2afdb-d349-450e-968f-c9dae285c727 None None] Authenticating user token {{(pid=80396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:06:50.787945 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a840b945-4b25-4db0-a795-d21b7963a35f admin admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:06:50.790423 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.fernet_utils [None req-c3e2afdb-d349-450e-968f-c9dae285c727 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:06:50.797813 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db048d01-faeb-4dd9-8c01-73ef5ac4b9b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f73d5a98be74242b45222df39fb6213', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:06:50.799060 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db048d01-faeb-4dd9-8c01-73ef5ac4b9b0 admin admin] REQUEST_METHOD: `PUT` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:06:50.799465 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db048d01-faeb-4dd9-8c01-73ef5ac4b9b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:06:50.799743 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db048d01-faeb-4dd9-8c01-73ef5ac4b9b0 admin admin] PATH_INFO: `/v3/projects/89fce3390f1542579eeecaca9bc9c859/users/9ba888f052d949e4a5bb6c058f73fc1c/roles/f1e0c25f6e9049e897cb7350c7e54ab3` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:06:50.801980 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db048d01-faeb-4dd9-8c01-73ef5ac4b9b0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=89fce3390f1542579eeecaca9bc9c859, user_id=9ba888f052d949e4a5bb6c058f73fc1c, role_id=f1e0c25f6e9049e897cb7350c7e54ab3)` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:06:50.807968 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db048d01-faeb-4dd9-8c01-73ef5ac4b9b0 admin admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:06:50.825094 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3e2afdb-d349-450e-968f-c9dae285c727 None None] Validating token access rules against request {{(pid=80396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:06:50.827880 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG dbcounter [-] [80396] Writing DB stats keystone:INSERT=7,keystone:SELECT=93 {{(pid=80396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 16:06:50.841309 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 896/1782] 10.222.0.59 () {60 vars in 1482 bytes} [Thu Jun 2 16:06:50 2022] PUT /identity/v3/projects/89fce3390f1542579eeecaca9bc9c859/users/9ba888f052d949e4a5bb6c058f73fc1c/roles/f1e0c25f6e9049e897cb7350c7e54ab3 => generated 0 bytes in 88 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 16:06:50.853806 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b800d1d-0ad9-4049-ab12-9e1378124ee1 None None] REQUEST_METHOD: `POST` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:06:50.854110 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b800d1d-0ad9-4049-ab12-9e1378124ee1 None None] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:06:50.854357 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b800d1d-0ad9-4049-ab12-9e1378124ee1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:06:50.897582 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.auth.core [None req-2b800d1d-0ad9-4049-ab12-9e1378124ee1 None None] MFA Rules not processed for user `9ba888f052d949e4a5bb6c058f73fc1c`. Rule list: `[]` (Enabled: `True`). {{(pid=80395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 16:06:50.906972 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.fernet_utils [None req-2b800d1d-0ad9-4049-ab12-9e1378124ee1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:06:50.931943 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66cfb35e-4709-420d-8937-d4b782a0a86f service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b700f6d94374ba4b362a8f0d5b35796', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c87c981909d4b8db02783421818c79b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:06:50.933966 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66cfb35e-4709-420d-8937-d4b782a0a86f service placement] REQUEST_METHOD: `GET` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:06:50.936689 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66cfb35e-4709-420d-8937-d4b782a0a86f service placement] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:06:50.937152 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66cfb35e-4709-420d-8937-d4b782a0a86f service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:06:50.962727 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66cfb35e-4709-420d-8937-d4b782a0a86f service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:06:50.966990 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66cfb35e-4709-420d-8937-d4b782a0a86f service placement] RBAC: Authorization granted {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:06:50.981239 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 887/1783] 10.222.0.59 () {60 vars in 1365 bytes} [Thu Jun 2 16:06:50 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 194 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 16:06:51.040165 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 897/1784] 10.222.0.59 () {58 vars in 957 bytes} [Thu Jun 2 16:06:50 2022] POST /identity/v3/auth/tokens => generated 3339 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 02 16:06:51.052159 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66cfb35e-4709-420d-8937-d4b782a0a86f service placement] Authenticating user token {{(pid=80396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:06:51.053600 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.fernet_utils [None req-66cfb35e-4709-420d-8937-d4b782a0a86f service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:06:51.152060 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66cfb35e-4709-420d-8937-d4b782a0a86f service placement] Validating token access rules against request {{(pid=80396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:06:51.160121 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d38695a-18b6-4bef-99b8-8d054edc3b3d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6534961c369940a5b88f310c6450250b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c87c981909d4b8db02783421818c79b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:06:51.160815 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d38695a-18b6-4bef-99b8-8d054edc3b3d service cinder] REQUEST_METHOD: `GET` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:06:51.161100 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d38695a-18b6-4bef-99b8-8d054edc3b3d service cinder] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:06:51.161383 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d38695a-18b6-4bef-99b8-8d054edc3b3d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:06:51.176776 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d38695a-18b6-4bef-99b8-8d054edc3b3d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:06:51.178397 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d38695a-18b6-4bef-99b8-8d054edc3b3d service cinder] RBAC: Authorization granted {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:06:51.204213 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 888/1785] 10.222.0.59 () {60 vars in 1365 bytes} [Thu Jun 2 16:06:51 2022] GET /identity/v3/auth/tokens => generated 3339 bytes in 152 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 16:06:51.564576 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b800d1d-0ad9-4049-ab12-9e1378124ee1 None None] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:06:51.567971 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.fernet_utils [None req-2b800d1d-0ad9-4049-ab12-9e1378124ee1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:06:51.701819 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b800d1d-0ad9-4049-ab12-9e1378124ee1 None None] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:06:51.716249 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec083f04-ebf0-4761-81bd-9ffbe824cc52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f73d5a98be74242b45222df39fb6213', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:06:51.717243 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec083f04-ebf0-4761-81bd-9ffbe824cc52 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:06:51.717607 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec083f04-ebf0-4761-81bd-9ffbe824cc52 admin admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:06:51.717952 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec083f04-ebf0-4761-81bd-9ffbe824cc52 admin admin] PATH_INFO: `/v3/users/26e030ed76e642839bee01f76e36cecc` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:06:51.719612 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec083f04-ebf0-4761-81bd-9ffbe824cc52 admin admin] RBAC: Authorizing `identity:delete_user(user_id=26e030ed76e642839bee01f76e36cecc)` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:06:51.722697 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec083f04-ebf0-4761-81bd-9ffbe824cc52 admin admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:06:52.234145 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writing DB stats keystone:INSERT=3,keystone:SELECT=97 {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 16:06:52.687961 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.notifications [None req-ec083f04-ebf0-4761-81bd-9ffbe824cc52 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '26e030ed76e642839bee01f76e36cecc'} {{(pid=80395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:06:53.273581 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.notifications [None req-ec083f04-ebf0-4761-81bd-9ffbe824cc52 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '26e030ed76e642839bee01f76e36cecc'} {{(pid=80395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:06:53.292604 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.notifications [None req-ec083f04-ebf0-4761-81bd-9ffbe824cc52 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '26e030ed76e642839bee01f76e36cecc'} {{(pid=80395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:06:53.293632 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.notifications [None req-ec083f04-ebf0-4761-81bd-9ffbe824cc52 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '26e030ed76e642839bee01f76e36cecc'} {{(pid=80395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:06:53.301547 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.notifications [None req-ec083f04-ebf0-4761-81bd-9ffbe824cc52 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '26e030ed76e642839bee01f76e36cecc'} {{(pid=80395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:06:53.311892 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 898/1786] 10.222.0.59 () {58 vars in 1223 bytes} [Thu Jun 2 16:06:51 2022] DELETE /identity/v3/users/26e030ed76e642839bee01f76e36cecc => generated 0 bytes in 1747 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 16:06:53.354955 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG dbcounter [-] [80396] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 16:06:53.601481 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d38695a-18b6-4bef-99b8-8d054edc3b3d service cinder] Authenticating user token {{(pid=80396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:06:53.612059 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d38695a-18b6-4bef-99b8-8d054edc3b3d service cinder] Validating token access rules against request {{(pid=80396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:06:53.685387 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-713befe6-fe08-45d0-980b-446df2d64fc9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f73d5a98be74242b45222df39fb6213', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:06:53.686362 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713befe6-fe08-45d0-980b-446df2d64fc9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:06:53.691829 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713befe6-fe08-45d0-980b-446df2d64fc9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:06:53.691829 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713befe6-fe08-45d0-980b-446df2d64fc9 admin admin] PATH_INFO: `/v3/projects/16ceb171629040cd90b8738ea2d9e1a3` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:06:53.691829 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-713befe6-fe08-45d0-980b-446df2d64fc9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=16ceb171629040cd90b8738ea2d9e1a3)` {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:06:53.691829 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-713befe6-fe08-45d0-980b-446df2d64fc9 admin admin] RBAC: Authorization granted {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:06:53.828704 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.notifications [None req-713befe6-fe08-45d0-980b-446df2d64fc9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '16ceb171629040cd90b8738ea2d9e1a3', 'request_id': 'req-713befe6-fe08-45d0-980b-446df2d64fc9'} {{(pid=80396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:06:53.835795 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.notifications [None req-713befe6-fe08-45d0-980b-446df2d64fc9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '16ceb171629040cd90b8738ea2d9e1a3', 'request_id': 'req-713befe6-fe08-45d0-980b-446df2d64fc9'} {{(pid=80396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:06:53.931228 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.notifications [None req-713befe6-fe08-45d0-980b-446df2d64fc9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '16ceb171629040cd90b8738ea2d9e1a3', 'request_id': 'req-713befe6-fe08-45d0-980b-446df2d64fc9'} {{(pid=80396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:06:53.947107 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.notifications [None req-713befe6-fe08-45d0-980b-446df2d64fc9 admin admin] The token cache is being invalidate because project 16ceb171629040cd90b8738ea2d9e1a3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80396) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 02 16:06:53.947407 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.notifications [None req-713befe6-fe08-45d0-980b-446df2d64fc9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:06:53.948061 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.notifications [None req-713befe6-fe08-45d0-980b-446df2d64fc9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:06:53.949785 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 889/1787] 10.222.0.59 () {58 vars in 1232 bytes} [Thu Jun 2 16:06:53 2022] DELETE /identity/v3/projects/16ceb171629040cd90b8738ea2d9e1a3 => generated 0 bytes in 349 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 16:06:53.954300 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec083f04-ebf0-4761-81bd-9ffbe824cc52 admin admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:06:53.955827 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.fernet_utils [None req-ec083f04-ebf0-4761-81bd-9ffbe824cc52 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:06:53.970522 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec083f04-ebf0-4761-81bd-9ffbe824cc52 admin admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:06:54.036263 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b8e1ba5-5a00-4186-8792-c08db68ff523 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f73d5a98be74242b45222df39fb6213', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:06:54.037615 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b8e1ba5-5a00-4186-8792-c08db68ff523 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:06:54.038153 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b8e1ba5-5a00-4186-8792-c08db68ff523 admin admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:06:54.038449 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b8e1ba5-5a00-4186-8792-c08db68ff523 admin admin] PATH_INFO: `/v3/users/a5c3e3d8482b4c5b80bc6c64d4b91da4` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:06:54.039934 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b8e1ba5-5a00-4186-8792-c08db68ff523 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a5c3e3d8482b4c5b80bc6c64d4b91da4)` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:06:54.042292 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b8e1ba5-5a00-4186-8792-c08db68ff523 admin admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:06:54.247194 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.notifications [None req-9b8e1ba5-5a00-4186-8792-c08db68ff523 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a5c3e3d8482b4c5b80bc6c64d4b91da4'} {{(pid=80395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:06:54.347974 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.notifications [None req-9b8e1ba5-5a00-4186-8792-c08db68ff523 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a5c3e3d8482b4c5b80bc6c64d4b91da4'} {{(pid=80395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:06:54.361454 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.notifications [None req-9b8e1ba5-5a00-4186-8792-c08db68ff523 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a5c3e3d8482b4c5b80bc6c64d4b91da4'} {{(pid=80395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:06:54.362241 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.notifications [None req-9b8e1ba5-5a00-4186-8792-c08db68ff523 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a5c3e3d8482b4c5b80bc6c64d4b91da4'} {{(pid=80395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:06:54.371388 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.notifications [None req-9b8e1ba5-5a00-4186-8792-c08db68ff523 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a5c3e3d8482b4c5b80bc6c64d4b91da4'} {{(pid=80395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:06:54.376003 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 899/1788] 10.222.0.59 () {58 vars in 1223 bytes} [Thu Jun 2 16:06:53 2022] DELETE /identity/v3/users/a5c3e3d8482b4c5b80bc6c64d4b91da4 => generated 0 bytes in 422 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 16:06:54.422532 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 16:06:54.650091 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG dbcounter [-] [80396] Writing DB stats keystone:SELECT=100 {{(pid=80396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 16:06:54.690449 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-713befe6-fe08-45d0-980b-446df2d64fc9 admin admin] Authenticating user token {{(pid=80396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:06:54.696706 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.fernet_utils [None req-713befe6-fe08-45d0-980b-446df2d64fc9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:06:54.707847 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-713befe6-fe08-45d0-980b-446df2d64fc9 admin admin] Validating token access rules against request {{(pid=80396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:06:54.766857 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9401d5a-c57b-4420-8a14-704ca03ae600 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f73d5a98be74242b45222df39fb6213', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:06:54.767717 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9401d5a-c57b-4420-8a14-704ca03ae600 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:06:54.767992 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9401d5a-c57b-4420-8a14-704ca03ae600 admin admin] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:06:54.768263 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9401d5a-c57b-4420-8a14-704ca03ae600 admin admin] PATH_INFO: `/v3/projects/42024bff72a341a2b531ead930dbca90` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:06:54.769452 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9401d5a-c57b-4420-8a14-704ca03ae600 admin admin] RBAC: Authorizing `identity:delete_project(project_id=42024bff72a341a2b531ead930dbca90)` {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:06:54.771377 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9401d5a-c57b-4420-8a14-704ca03ae600 admin admin] RBAC: Authorization granted {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:06:54.929570 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.notifications [None req-d9401d5a-c57b-4420-8a14-704ca03ae600 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '42024bff72a341a2b531ead930dbca90', 'request_id': 'req-d9401d5a-c57b-4420-8a14-704ca03ae600'} {{(pid=80396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:06:54.936461 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.notifications [None req-d9401d5a-c57b-4420-8a14-704ca03ae600 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '42024bff72a341a2b531ead930dbca90', 'request_id': 'req-d9401d5a-c57b-4420-8a14-704ca03ae600'} {{(pid=80396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:06:55.038384 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.notifications [None req-d9401d5a-c57b-4420-8a14-704ca03ae600 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '42024bff72a341a2b531ead930dbca90', 'request_id': 'req-d9401d5a-c57b-4420-8a14-704ca03ae600'} {{(pid=80396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:06:55.049725 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.notifications [None req-d9401d5a-c57b-4420-8a14-704ca03ae600 admin admin] The token cache is being invalidate because project 42024bff72a341a2b531ead930dbca90 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80396) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 02 16:06:55.050018 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.notifications [None req-d9401d5a-c57b-4420-8a14-704ca03ae600 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:06:55.050802 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.notifications [None req-d9401d5a-c57b-4420-8a14-704ca03ae600 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:06:55.052369 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 890/1789] 10.222.0.59 () {58 vars in 1232 bytes} [Thu Jun 2 16:06:54 2022] DELETE /identity/v3/projects/42024bff72a341a2b531ead930dbca90 => generated 0 bytes in 362 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 02 16:06:55.059651 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-422a2771-479b-471e-9d81-975e79f1a392 None None] REQUEST_METHOD: `POST` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:06:55.059948 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-422a2771-479b-471e-9d81-975e79f1a392 None None] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:06:55.060287 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-422a2771-479b-471e-9d81-975e79f1a392 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:06:55.080618 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.auth.core [None req-422a2771-479b-471e-9d81-975e79f1a392 None None] MFA Rules not processed for user `400d1f4db9de49638549e5db29a041e1`. Rule list: `[]` (Enabled: `True`). {{(pid=80395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 16:06:55.081853 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.fernet_utils [None req-422a2771-479b-471e-9d81-975e79f1a392 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:06:55.120205 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG dbcounter [-] [80396] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 16:06:55.143398 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 900/1790] 10.222.0.59 () {58 vars in 957 bytes} [Thu Jun 2 16:06:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 16:06:55.151219 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b65d77-89d2-4d80-a8fb-7aa045e4bf7c None None] REQUEST_METHOD: `POST` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:06:55.151506 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b65d77-89d2-4d80-a8fb-7aa045e4bf7c None None] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:06:55.151777 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b65d77-89d2-4d80-a8fb-7aa045e4bf7c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:06:55.171989 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.auth.core [None req-e1b65d77-89d2-4d80-a8fb-7aa045e4bf7c None None] MFA Rules not processed for user `400d1f4db9de49638549e5db29a041e1`. Rule list: `[]` (Enabled: `True`). {{(pid=80396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 16:06:55.174289 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.fernet_utils [None req-e1b65d77-89d2-4d80-a8fb-7aa045e4bf7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:06:55.182982 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 891/1791] 10.222.0.59 () {58 vars in 957 bytes} [Thu Jun 2 16:06:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 02 16:06:55.187632 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-422a2771-479b-471e-9d81-975e79f1a392 None None] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:06:55.198012 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-422a2771-479b-471e-9d81-975e79f1a392 None None] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:06:55.202975 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3345c922-96be-42cf-b27c-ac4b15fb1971 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f73d5a98be74242b45222df39fb6213', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:06:55.203637 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3345c922-96be-42cf-b27c-ac4b15fb1971 admin admin] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:06:55.203910 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3345c922-96be-42cf-b27c-ac4b15fb1971 admin admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:06:55.204349 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3345c922-96be-42cf-b27c-ac4b15fb1971 admin admin] PATH_INFO: `/v3/domains` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:06:55.205080 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3345c922-96be-42cf-b27c-ac4b15fb1971 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80395) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 16:06:55.205385 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3345c922-96be-42cf-b27c-ac4b15fb1971 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:06:55.207003 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3345c922-96be-42cf-b27c-ac4b15fb1971 admin admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:06:55.237324 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 901/1792] 10.222.0.59 () {58 vars in 1152 bytes} [Thu Jun 2 16:06:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 16:06:55.238737 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1b65d77-89d2-4d80-a8fb-7aa045e4bf7c None None] Authenticating user token {{(pid=80396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:06:55.254793 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1b65d77-89d2-4d80-a8fb-7aa045e4bf7c None None] Validating token access rules against request {{(pid=80396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:06:55.256688 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 16:06:55.270356 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b3ae88a-02d9-4d41-b7a6-db13523a6a43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f73d5a98be74242b45222df39fb6213', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:06:55.271034 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3ae88a-02d9-4d41-b7a6-db13523a6a43 admin admin] REQUEST_METHOD: `POST` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:06:55.271335 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3ae88a-02d9-4d41-b7a6-db13523a6a43 admin admin] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:06:55.271609 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3ae88a-02d9-4d41-b7a6-db13523a6a43 admin admin] PATH_INFO: `/v3/projects` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:06:55.272313 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b3ae88a-02d9-4d41-b7a6-db13523a6a43 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:06:55.274416 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b3ae88a-02d9-4d41-b7a6-db13523a6a43 admin admin] RBAC: Authorization granted {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:06:55.398625 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 892/1793] 10.222.0.59 () {60 vars in 1152 bytes} [Thu Jun 2 16:06:55 2022] POST /identity/v3/projects => generated 379 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 16:06:55.403533 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3345c922-96be-42cf-b27c-ac4b15fb1971 admin admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:06:55.413456 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3345c922-96be-42cf-b27c-ac4b15fb1971 admin admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:06:55.469978 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beba248c-cd64-435f-a4ce-7afb3e699d99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f73d5a98be74242b45222df39fb6213', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:06:55.470671 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beba248c-cd64-435f-a4ce-7afb3e699d99 admin admin] REQUEST_METHOD: `POST` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:06:55.470954 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beba248c-cd64-435f-a4ce-7afb3e699d99 admin admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:06:55.471229 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beba248c-cd64-435f-a4ce-7afb3e699d99 admin admin] PATH_INFO: `/v3/users` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:06:55.471936 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beba248c-cd64-435f-a4ce-7afb3e699d99 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:06:55.474365 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beba248c-cd64-435f-a4ce-7afb3e699d99 admin admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:06:55.594808 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 902/1794] 10.222.0.59 () {60 vars in 1143 bytes} [Thu Jun 2 16:06:55 2022] POST /identity/v3/users => generated 290 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 16:06:55.596456 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b3ae88a-02d9-4d41-b7a6-db13523a6a43 admin admin] Authenticating user token {{(pid=80396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:06:55.608167 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b3ae88a-02d9-4d41-b7a6-db13523a6a43 admin admin] Validating token access rules against request {{(pid=80396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:06:55.612921 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bff53b67-5f2f-4e0e-8c8a-c549af1d67fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f73d5a98be74242b45222df39fb6213', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:06:55.613589 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff53b67-5f2f-4e0e-8c8a-c549af1d67fa admin admin] REQUEST_METHOD: `GET` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:06:55.613873 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff53b67-5f2f-4e0e-8c8a-c549af1d67fa admin admin] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:06:55.614180 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff53b67-5f2f-4e0e-8c8a-c549af1d67fa admin admin] PATH_INFO: `/v3/roles` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:06:55.614913 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bff53b67-5f2f-4e0e-8c8a-c549af1d67fa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:06:55.616575 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bff53b67-5f2f-4e0e-8c8a-c549af1d67fa admin admin] RBAC: Authorization granted {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:06:55.628035 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 893/1795] 10.222.0.59 () {58 vars in 1121 bytes} [Thu Jun 2 16:06:55 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 16:06:55.632167 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beba248c-cd64-435f-a4ce-7afb3e699d99 admin admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:06:55.643475 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beba248c-cd64-435f-a4ce-7afb3e699d99 admin admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:06:55.648078 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03ea12c5-bb26-4eb6-8b18-b3083737fc22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f73d5a98be74242b45222df39fb6213', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:06:55.648779 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ea12c5-bb26-4eb6-8b18-b3083737fc22 admin admin] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:06:55.649256 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ea12c5-bb26-4eb6-8b18-b3083737fc22 admin admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:06:55.649773 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ea12c5-bb26-4eb6-8b18-b3083737fc22 admin admin] PATH_INFO: `/v3/roles` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:06:55.650581 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03ea12c5-bb26-4eb6-8b18-b3083737fc22 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:06:55.652236 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03ea12c5-bb26-4eb6-8b18-b3083737fc22 admin admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:06:55.661977 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 903/1796] 10.222.0.59 () {58 vars in 1121 bytes} [Thu Jun 2 16:06:55 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 16:06:55.666128 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bff53b67-5f2f-4e0e-8c8a-c549af1d67fa admin admin] Authenticating user token {{(pid=80396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:06:55.676001 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bff53b67-5f2f-4e0e-8c8a-c549af1d67fa admin admin] Validating token access rules against request {{(pid=80396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:06:55.681156 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd9a9085-e919-47f6-a69b-ecc51b2e876b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f73d5a98be74242b45222df39fb6213', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:06:55.682025 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9a9085-e919-47f6-a69b-ecc51b2e876b admin admin] REQUEST_METHOD: `PUT` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:06:55.682373 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9a9085-e919-47f6-a69b-ecc51b2e876b admin admin] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:06:55.682660 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9a9085-e919-47f6-a69b-ecc51b2e876b admin admin] PATH_INFO: `/v3/projects/316964edcf214913a1a97233baf85663/users/b5d9178fba8949e3b0a0123dc4551c2b/roles/649e0f2b5a264c419ea6a1441f123a03` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:06:55.697619 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd9a9085-e919-47f6-a69b-ecc51b2e876b admin admin] RBAC: Authorizing `identity:create_grant(project_id=316964edcf214913a1a97233baf85663, user_id=b5d9178fba8949e3b0a0123dc4551c2b, role_id=649e0f2b5a264c419ea6a1441f123a03)` {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:06:55.699146 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG dbcounter [-] [80396] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 16:06:55.707127 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd9a9085-e919-47f6-a69b-ecc51b2e876b admin admin] RBAC: Authorization granted {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:06:55.829332 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 894/1797] 10.222.0.59 () {60 vars in 1482 bytes} [Thu Jun 2 16:06:55 2022] PUT /identity/v3/projects/316964edcf214913a1a97233baf85663/users/b5d9178fba8949e3b0a0123dc4551c2b/roles/649e0f2b5a264c419ea6a1441f123a03 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 02 16:06:55.840368 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f913ae65-be0e-42d9-949a-08096b246719 None None] REQUEST_METHOD: `POST` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:06:55.841349 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f913ae65-be0e-42d9-949a-08096b246719 None None] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:06:55.841349 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f913ae65-be0e-42d9-949a-08096b246719 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:06:55.866923 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.auth.core [None req-f913ae65-be0e-42d9-949a-08096b246719 None None] MFA Rules not processed for user `b5d9178fba8949e3b0a0123dc4551c2b`. Rule list: `[]` (Enabled: `True`). {{(pid=80395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 16:06:55.868677 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.fernet_utils [None req-f913ae65-be0e-42d9-949a-08096b246719 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:06:55.934201 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 904/1798] 10.222.0.59 () {58 vars in 957 bytes} [Thu Jun 2 16:06:55 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 16:06:55.938790 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd9a9085-e919-47f6-a69b-ecc51b2e876b admin admin] Authenticating user token {{(pid=80396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:06:55.947354 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 16:06:56.003757 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd9a9085-e919-47f6-a69b-ecc51b2e876b admin admin] Validating token access rules against request {{(pid=80396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:06:56.008482 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70037597-2251-4c3d-b23a-1e1a2974e420 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f73d5a98be74242b45222df39fb6213', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:06:56.011326 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70037597-2251-4c3d-b23a-1e1a2974e420 admin admin] REQUEST_METHOD: `POST` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:06:56.011326 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70037597-2251-4c3d-b23a-1e1a2974e420 admin admin] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:06:56.011326 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70037597-2251-4c3d-b23a-1e1a2974e420 admin admin] PATH_INFO: `/v3/projects` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:06:56.011326 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70037597-2251-4c3d-b23a-1e1a2974e420 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:06:56.012408 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70037597-2251-4c3d-b23a-1e1a2974e420 admin admin] RBAC: Authorization granted {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:06:56.035639 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f913ae65-be0e-42d9-949a-08096b246719 None None] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:06:56.037124 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.fernet_utils [None req-f913ae65-be0e-42d9-949a-08096b246719 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:06:56.051195 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f913ae65-be0e-42d9-949a-08096b246719 None None] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:06:56.056516 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c78b1dc-9c58-409a-8c90-42f911fb0d2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f73d5a98be74242b45222df39fb6213', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:06:56.057413 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c78b1dc-9c58-409a-8c90-42f911fb0d2d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:06:56.057700 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c78b1dc-9c58-409a-8c90-42f911fb0d2d admin admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:06:56.057979 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c78b1dc-9c58-409a-8c90-42f911fb0d2d admin admin] PATH_INFO: `/v3/users/02510bdbf3fd4b669c2fd9165fcbcb06` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:06:56.059191 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c78b1dc-9c58-409a-8c90-42f911fb0d2d admin admin] RBAC: Authorizing `identity:delete_user(user_id=02510bdbf3fd4b669c2fd9165fcbcb06)` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:06:56.061177 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c78b1dc-9c58-409a-8c90-42f911fb0d2d admin admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:06:56.138102 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 895/1799] 10.222.0.59 () {60 vars in 1152 bytes} [Thu Jun 2 16:06:55 2022] POST /identity/v3/projects => generated 379 bytes in 200 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 16:06:56.142162 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70037597-2251-4c3d-b23a-1e1a2974e420 admin admin] Authenticating user token {{(pid=80396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:06:56.212164 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70037597-2251-4c3d-b23a-1e1a2974e420 admin admin] Validating token access rules against request {{(pid=80396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:06:56.216857 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3c19da1-ecf3-4a3a-bf03-875de49535f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f73d5a98be74242b45222df39fb6213', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:06:56.217470 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c19da1-ecf3-4a3a-bf03-875de49535f9 admin admin] REQUEST_METHOD: `POST` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:06:56.217786 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c19da1-ecf3-4a3a-bf03-875de49535f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:06:56.218110 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c19da1-ecf3-4a3a-bf03-875de49535f9 admin admin] PATH_INFO: `/v3/users` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:06:56.218801 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3c19da1-ecf3-4a3a-bf03-875de49535f9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:06:56.220724 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3c19da1-ecf3-4a3a-bf03-875de49535f9 admin admin] RBAC: Authorization granted {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:06:56.241659 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.notifications [None req-5c78b1dc-9c58-409a-8c90-42f911fb0d2d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '02510bdbf3fd4b669c2fd9165fcbcb06'} {{(pid=80395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:06:56.323425 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.notifications [None req-5c78b1dc-9c58-409a-8c90-42f911fb0d2d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '02510bdbf3fd4b669c2fd9165fcbcb06'} {{(pid=80395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:06:56.334605 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 896/1800] 10.222.0.59 () {60 vars in 1143 bytes} [Thu Jun 2 16:06:56 2022] POST /identity/v3/users => generated 290 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 02 16:06:56.335341 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3c19da1-ecf3-4a3a-bf03-875de49535f9 admin admin] Authenticating user token {{(pid=80396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:06:56.338271 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.notifications [None req-5c78b1dc-9c58-409a-8c90-42f911fb0d2d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '02510bdbf3fd4b669c2fd9165fcbcb06'} {{(pid=80395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:06:56.339113 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.notifications [None req-5c78b1dc-9c58-409a-8c90-42f911fb0d2d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '02510bdbf3fd4b669c2fd9165fcbcb06'} {{(pid=80395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:06:56.346236 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3c19da1-ecf3-4a3a-bf03-875de49535f9 admin admin] Validating token access rules against request {{(pid=80396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:06:56.347456 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.notifications [None req-5c78b1dc-9c58-409a-8c90-42f911fb0d2d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '02510bdbf3fd4b669c2fd9165fcbcb06'} {{(pid=80395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:06:56.351186 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77e705b0-824f-4d9e-b018-a8b49f26b3aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f73d5a98be74242b45222df39fb6213', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:06:56.351876 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e705b0-824f-4d9e-b018-a8b49f26b3aa admin admin] REQUEST_METHOD: `GET` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:06:56.352765 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e705b0-824f-4d9e-b018-a8b49f26b3aa admin admin] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:06:56.353202 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e705b0-824f-4d9e-b018-a8b49f26b3aa admin admin] PATH_INFO: `/v3/roles` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:06:56.353920 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77e705b0-824f-4d9e-b018-a8b49f26b3aa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:06:56.355575 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77e705b0-824f-4d9e-b018-a8b49f26b3aa admin admin] RBAC: Authorization granted {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:06:56.356254 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 905/1801] 10.222.0.59 () {58 vars in 1223 bytes} [Thu Jun 2 16:06:56 2022] DELETE /identity/v3/users/02510bdbf3fd4b669c2fd9165fcbcb06 => generated 0 bytes in 321 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 02 16:06:56.361597 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b868bd-616b-455d-9350-61a8ac9df4b7 None None] REQUEST_METHOD: `POST` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:06:56.362051 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b868bd-616b-455d-9350-61a8ac9df4b7 None None] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:06:56.362425 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b868bd-616b-455d-9350-61a8ac9df4b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:06:56.369308 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 897/1802] 10.222.0.59 () {58 vars in 1121 bytes} [Thu Jun 2 16:06:56 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 16:06:56.375842 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77e705b0-824f-4d9e-b018-a8b49f26b3aa admin admin] Authenticating user token {{(pid=80396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:06:56.377623 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.fernet_utils [None req-77e705b0-824f-4d9e-b018-a8b49f26b3aa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:06:56.381846 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.auth.core [None req-16b868bd-616b-455d-9350-61a8ac9df4b7 None None] MFA Rules not processed for user `400d1f4db9de49638549e5db29a041e1`. Rule list: `[]` (Enabled: `True`). {{(pid=80395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 16:06:56.383704 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.fernet_utils [None req-16b868bd-616b-455d-9350-61a8ac9df4b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:06:56.391501 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77e705b0-824f-4d9e-b018-a8b49f26b3aa admin admin] Validating token access rules against request {{(pid=80396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:06:56.396559 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG dbcounter [-] [80396] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 16:06:56.449996 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 906/1803] 10.222.0.59 () {58 vars in 957 bytes} [Thu Jun 2 16:06:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 16:06:56.459967 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16b868bd-616b-455d-9350-61a8ac9df4b7 None None] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:06:56.462064 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.fernet_utils [None req-16b868bd-616b-455d-9350-61a8ac9df4b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:06:56.465730 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5b56668-2929-4f9b-bc61-eb3a6e717743 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f73d5a98be74242b45222df39fb6213', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:06:56.466561 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b56668-2929-4f9b-bc61-eb3a6e717743 admin admin] REQUEST_METHOD: `GET` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:06:56.466974 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b56668-2929-4f9b-bc61-eb3a6e717743 admin admin] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:06:56.467273 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b56668-2929-4f9b-bc61-eb3a6e717743 admin admin] PATH_INFO: `/v3/roles` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:06:56.468016 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5b56668-2929-4f9b-bc61-eb3a6e717743 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:06:56.469638 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5b56668-2929-4f9b-bc61-eb3a6e717743 admin admin] RBAC: Authorization granted {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:06:56.483939 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 898/1804] 10.222.0.59 () {58 vars in 1121 bytes} [Thu Jun 2 16:06:56 2022] GET /identity/v3/roles => generated 1420 bytes in 105 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 02 16:06:56.485258 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5b56668-2929-4f9b-bc61-eb3a6e717743 admin admin] Authenticating user token {{(pid=80396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:06:56.499856 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5b56668-2929-4f9b-bc61-eb3a6e717743 admin admin] Validating token access rules against request {{(pid=80396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:06:56.504648 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee351497-6989-4fb8-a4dc-8d55bdb933f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f73d5a98be74242b45222df39fb6213', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:06:56.505746 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee351497-6989-4fb8-a4dc-8d55bdb933f9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:06:56.505953 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee351497-6989-4fb8-a4dc-8d55bdb933f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:06:56.506470 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee351497-6989-4fb8-a4dc-8d55bdb933f9 admin admin] PATH_INFO: `/v3/projects/9fc7c1ceea434df3a17b67ee101d89b4/users/f5ba157550304933843facc749046dcc/roles/649e0f2b5a264c419ea6a1441f123a03` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:06:56.522380 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee351497-6989-4fb8-a4dc-8d55bdb933f9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9fc7c1ceea434df3a17b67ee101d89b4, user_id=f5ba157550304933843facc749046dcc, role_id=649e0f2b5a264c419ea6a1441f123a03)` {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:06:56.525358 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee351497-6989-4fb8-a4dc-8d55bdb933f9 admin admin] RBAC: Authorization granted {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:06:56.525483 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16b868bd-616b-455d-9350-61a8ac9df4b7 None None] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:06:56.528978 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bce6e07-7805-46d6-aea9-dd838eaaddb2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9af40ddfe9ff4be3887b068f13a28dc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c87c981909d4b8db02783421818c79b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:06:56.529790 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bce6e07-7805-46d6-aea9-dd838eaaddb2 service neutron] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:06:56.530114 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bce6e07-7805-46d6-aea9-dd838eaaddb2 service neutron] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:06:56.530379 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bce6e07-7805-46d6-aea9-dd838eaaddb2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:06:56.540299 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bce6e07-7805-46d6-aea9-dd838eaaddb2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:06:56.542051 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bce6e07-7805-46d6-aea9-dd838eaaddb2 service neutron] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:06:56.548753 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 16:06:56.553806 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 907/1805] 10.222.0.59 () {60 vars in 1365 bytes} [Thu Jun 2 16:06:56 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 02 16:06:56.646219 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 899/1806] 10.222.0.59 () {60 vars in 1482 bytes} [Thu Jun 2 16:06:56 2022] PUT /identity/v3/projects/9fc7c1ceea434df3a17b67ee101d89b4/users/f5ba157550304933843facc749046dcc/roles/649e0f2b5a264c419ea6a1441f123a03 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 02 16:06:56.658354 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce8ddb0-33d3-4ce8-b951-6520f808e033 None None] REQUEST_METHOD: `POST` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:06:56.658563 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce8ddb0-33d3-4ce8-b951-6520f808e033 None None] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:06:56.658843 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce8ddb0-33d3-4ce8-b951-6520f808e033 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:06:56.685055 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.auth.core [None req-0ce8ddb0-33d3-4ce8-b951-6520f808e033 None None] MFA Rules not processed for user `f5ba157550304933843facc749046dcc`. Rule list: `[]` (Enabled: `True`). {{(pid=80395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 16:06:56.686291 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.fernet_utils [None req-0ce8ddb0-33d3-4ce8-b951-6520f808e033 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:06:56.749583 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 908/1807] 10.222.0.59 () {58 vars in 957 bytes} [Thu Jun 2 16:06:56 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 16:06:56.753980 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee351497-6989-4fb8-a4dc-8d55bdb933f9 admin admin] Authenticating user token {{(pid=80396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:06:56.828393 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee351497-6989-4fb8-a4dc-8d55bdb933f9 admin admin] Validating token access rules against request {{(pid=80396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:06:56.833311 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c5630d-897f-425b-9940-0bd4add76047 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f73d5a98be74242b45222df39fb6213', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:06:56.836250 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c5630d-897f-425b-9940-0bd4add76047 admin admin] REQUEST_METHOD: `POST` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:06:56.836250 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c5630d-897f-425b-9940-0bd4add76047 admin admin] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:06:56.836250 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c5630d-897f-425b-9940-0bd4add76047 admin admin] PATH_INFO: `/v3/projects` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:06:56.836250 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44c5630d-897f-425b-9940-0bd4add76047 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:06:56.837852 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44c5630d-897f-425b-9940-0bd4add76047 admin admin] RBAC: Authorization granted {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:06:56.931086 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 900/1808] 10.222.0.59 () {60 vars in 1152 bytes} [Thu Jun 2 16:06:56 2022] POST /identity/v3/projects => generated 379 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 02 16:06:56.935062 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ce8ddb0-33d3-4ce8-b951-6520f808e033 None None] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:06:56.946460 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ce8ddb0-33d3-4ce8-b951-6520f808e033 None None] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:06:57.008797 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b90389e-2ddf-4015-8b13-2bb2c6f397ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f73d5a98be74242b45222df39fb6213', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:06:57.008797 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b90389e-2ddf-4015-8b13-2bb2c6f397ac admin admin] REQUEST_METHOD: `POST` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:06:57.009506 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b90389e-2ddf-4015-8b13-2bb2c6f397ac admin admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:06:57.009506 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b90389e-2ddf-4015-8b13-2bb2c6f397ac admin admin] PATH_INFO: `/v3/users` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:06:57.010039 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b90389e-2ddf-4015-8b13-2bb2c6f397ac admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:06:57.012163 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b90389e-2ddf-4015-8b13-2bb2c6f397ac admin admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:06:57.041289 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c5630d-897f-425b-9940-0bd4add76047 admin admin] Authenticating user token {{(pid=80396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:06:57.043131 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.fernet_utils [None req-44c5630d-897f-425b-9940-0bd4add76047 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:06:57.059158 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c5630d-897f-425b-9940-0bd4add76047 admin admin] Validating token access rules against request {{(pid=80396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:06:57.064591 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17cecbe7-da85-466f-b05d-2abe11aac980 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f73d5a98be74242b45222df39fb6213', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:06:57.065569 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17cecbe7-da85-466f-b05d-2abe11aac980 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:06:57.065869 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17cecbe7-da85-466f-b05d-2abe11aac980 admin admin] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:06:57.069655 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17cecbe7-da85-466f-b05d-2abe11aac980 admin admin] PATH_INFO: `/v3/projects/c68287df2e0a4382be098ea6668cc870` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:06:57.069655 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17cecbe7-da85-466f-b05d-2abe11aac980 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c68287df2e0a4382be098ea6668cc870)` {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:06:57.069655 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17cecbe7-da85-466f-b05d-2abe11aac980 admin admin] RBAC: Authorization granted {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:06:57.131773 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 909/1809] 10.222.0.59 () {60 vars in 1143 bytes} [Thu Jun 2 16:06:56 2022] POST /identity/v3/users => generated 296 bytes in 197 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 16:06:57.136102 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b90389e-2ddf-4015-8b13-2bb2c6f397ac admin admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:06:57.145439 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b90389e-2ddf-4015-8b13-2bb2c6f397ac admin admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:06:57.150045 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-420529d6-9817-433f-bded-233079184cd2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f73d5a98be74242b45222df39fb6213', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:06:57.150710 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-420529d6-9817-433f-bded-233079184cd2 admin admin] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:06:57.150996 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-420529d6-9817-433f-bded-233079184cd2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:06:57.151273 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-420529d6-9817-433f-bded-233079184cd2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:06:57.151988 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-420529d6-9817-433f-bded-233079184cd2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:06:57.153624 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-420529d6-9817-433f-bded-233079184cd2 admin admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:06:57.163189 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 910/1810] 10.222.0.59 () {58 vars in 1121 bytes} [Thu Jun 2 16:06:57 2022] GET /identity/v3/roles => generated 1420 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 02 16:06:57.167040 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-420529d6-9817-433f-bded-233079184cd2 admin admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:06:57.176603 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-420529d6-9817-433f-bded-233079184cd2 admin admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:06:57.181822 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d6ba7e7-76df-487d-99fa-2a94910067b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f73d5a98be74242b45222df39fb6213', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:06:57.182711 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6ba7e7-76df-487d-99fa-2a94910067b1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:06:57.183000 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6ba7e7-76df-487d-99fa-2a94910067b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:06:57.183382 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6ba7e7-76df-487d-99fa-2a94910067b1 admin admin] PATH_INFO: `/v3/projects/bac3263c1e08491bbc5a34d75e8bab7c/users/6e774faea506495c9c58c326e6b169d1/roles/f1e0c25f6e9049e897cb7350c7e54ab3` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:06:57.198845 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d6ba7e7-76df-487d-99fa-2a94910067b1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bac3263c1e08491bbc5a34d75e8bab7c, user_id=6e774faea506495c9c58c326e6b169d1, role_id=f1e0c25f6e9049e897cb7350c7e54ab3)` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:06:57.201496 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d6ba7e7-76df-487d-99fa-2a94910067b1 admin admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:06:57.301899 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 911/1811] 10.222.0.59 () {60 vars in 1482 bytes} [Thu Jun 2 16:06:57 2022] PUT /identity/v3/projects/bac3263c1e08491bbc5a34d75e8bab7c/users/6e774faea506495c9c58c326e6b169d1/roles/f1e0c25f6e9049e897cb7350c7e54ab3 => generated 0 bytes in 135 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 02 16:06:57.307738 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d6ba7e7-76df-487d-99fa-2a94910067b1 admin admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:06:57.310635 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.notifications [None req-17cecbe7-da85-466f-b05d-2abe11aac980 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c68287df2e0a4382be098ea6668cc870', 'request_id': 'req-17cecbe7-da85-466f-b05d-2abe11aac980'} {{(pid=80396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:06:57.317589 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.notifications [None req-17cecbe7-da85-466f-b05d-2abe11aac980 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c68287df2e0a4382be098ea6668cc870', 'request_id': 'req-17cecbe7-da85-466f-b05d-2abe11aac980'} {{(pid=80396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:06:57.379099 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d6ba7e7-76df-487d-99fa-2a94910067b1 admin admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:06:57.399497 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.notifications [None req-17cecbe7-da85-466f-b05d-2abe11aac980 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c68287df2e0a4382be098ea6668cc870', 'request_id': 'req-17cecbe7-da85-466f-b05d-2abe11aac980'} {{(pid=80396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:06:57.411541 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.notifications [None req-17cecbe7-da85-466f-b05d-2abe11aac980 admin admin] The token cache is being invalidate because project c68287df2e0a4382be098ea6668cc870 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80396) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 02 16:06:57.411959 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.notifications [None req-17cecbe7-da85-466f-b05d-2abe11aac980 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:06:57.412670 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.notifications [None req-17cecbe7-da85-466f-b05d-2abe11aac980 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:06:57.415325 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 901/1812] 10.222.0.59 () {58 vars in 1232 bytes} [Thu Jun 2 16:06:57 2022] DELETE /identity/v3/projects/c68287df2e0a4382be098ea6668cc870 => generated 0 bytes in 374 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 16:06:57.418913 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17cecbe7-da85-466f-b05d-2abe11aac980 admin admin] Authenticating user token {{(pid=80396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:06:57.420293 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.fernet_utils [None req-17cecbe7-da85-466f-b05d-2abe11aac980 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:06:57.452046 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90ab0cf3-aecb-4887-b0bd-7884b623dafe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f73d5a98be74242b45222df39fb6213', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:06:57.453466 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ab0cf3-aecb-4887-b0bd-7884b623dafe admin admin] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:06:57.459676 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ab0cf3-aecb-4887-b0bd-7884b623dafe admin admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:06:57.459676 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ab0cf3-aecb-4887-b0bd-7884b623dafe admin admin] PATH_INFO: `/v3/roles` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:06:57.459676 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90ab0cf3-aecb-4887-b0bd-7884b623dafe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:06:57.459676 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90ab0cf3-aecb-4887-b0bd-7884b623dafe admin admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:06:57.468272 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 912/1813] 10.222.0.59 () {58 vars in 1121 bytes} [Thu Jun 2 16:06:57 2022] GET /identity/v3/roles => generated 1420 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 02 16:06:57.472205 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90ab0cf3-aecb-4887-b0bd-7884b623dafe admin admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:06:57.474136 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.fernet_utils [None req-90ab0cf3-aecb-4887-b0bd-7884b623dafe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:06:57.488359 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90ab0cf3-aecb-4887-b0bd-7884b623dafe admin admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:06:57.494634 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abfbf52e-3b47-4e26-a78b-83cd1f0113ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f73d5a98be74242b45222df39fb6213', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:06:57.495534 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abfbf52e-3b47-4e26-a78b-83cd1f0113ef admin admin] REQUEST_METHOD: `PUT` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:06:57.495978 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abfbf52e-3b47-4e26-a78b-83cd1f0113ef admin admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:06:57.496254 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abfbf52e-3b47-4e26-a78b-83cd1f0113ef admin admin] PATH_INFO: `/v3/projects/bac3263c1e08491bbc5a34d75e8bab7c/users/6e774faea506495c9c58c326e6b169d1/roles/f1e0c25f6e9049e897cb7350c7e54ab3` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:06:57.498860 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abfbf52e-3b47-4e26-a78b-83cd1f0113ef admin admin] RBAC: Authorizing `identity:create_grant(project_id=bac3263c1e08491bbc5a34d75e8bab7c, user_id=6e774faea506495c9c58c326e6b169d1, role_id=f1e0c25f6e9049e897cb7350c7e54ab3)` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:06:57.501633 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abfbf52e-3b47-4e26-a78b-83cd1f0113ef admin admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:06:57.512199 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17cecbe7-da85-466f-b05d-2abe11aac980 admin admin] Validating token access rules against request {{(pid=80396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:06:57.520931 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 913/1814] 10.222.0.59 () {60 vars in 1482 bytes} [Thu Jun 2 16:06:57 2022] PUT /identity/v3/projects/bac3263c1e08491bbc5a34d75e8bab7c/users/6e774faea506495c9c58c326e6b169d1/roles/f1e0c25f6e9049e897cb7350c7e54ab3 => generated 0 bytes in 41 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 16:06:57.525436 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1456224e-6f6b-4a48-a541-d5a981113af1 None None] REQUEST_METHOD: `POST` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:06:57.525611 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1456224e-6f6b-4a48-a541-d5a981113af1 None None] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:06:57.525919 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1456224e-6f6b-4a48-a541-d5a981113af1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:06:57.566298 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.auth.core [None req-1456224e-6f6b-4a48-a541-d5a981113af1 None None] MFA Rules not processed for user `6e774faea506495c9c58c326e6b169d1`. Rule list: `[]` (Enabled: `True`). {{(pid=80395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 16:06:57.567313 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.fernet_utils [None req-1456224e-6f6b-4a48-a541-d5a981113af1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:06:57.588129 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-784a5ef1-d85b-42d3-93e7-f247e63318b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f73d5a98be74242b45222df39fb6213', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:06:57.589000 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784a5ef1-d85b-42d3-93e7-f247e63318b2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:06:57.589276 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784a5ef1-d85b-42d3-93e7-f247e63318b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:06:57.589549 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784a5ef1-d85b-42d3-93e7-f247e63318b2 admin admin] PATH_INFO: `/v3/users/9ba888f052d949e4a5bb6c058f73fc1c` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:06:57.590984 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-784a5ef1-d85b-42d3-93e7-f247e63318b2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9ba888f052d949e4a5bb6c058f73fc1c)` {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:06:57.597104 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-784a5ef1-d85b-42d3-93e7-f247e63318b2 admin admin] RBAC: Authorization granted {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:06:57.663169 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 914/1815] 10.222.0.59 () {58 vars in 957 bytes} [Thu Jun 2 16:06:57 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 16:06:57.676818 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1456224e-6f6b-4a48-a541-d5a981113af1 None None] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:06:57.678697 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.fernet_utils [None req-1456224e-6f6b-4a48-a541-d5a981113af1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:06:57.768368 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1456224e-6f6b-4a48-a541-d5a981113af1 None None] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:06:57.780801 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12a9ca99-23c6-422a-80a4-e314cd1e1170 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6534961c369940a5b88f310c6450250b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c87c981909d4b8db02783421818c79b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:06:57.781544 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a9ca99-23c6-422a-80a4-e314cd1e1170 service cinder] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:06:57.781826 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a9ca99-23c6-422a-80a4-e314cd1e1170 service cinder] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:06:57.782130 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a9ca99-23c6-422a-80a4-e314cd1e1170 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:06:57.792979 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12a9ca99-23c6-422a-80a4-e314cd1e1170 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:06:57.794458 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12a9ca99-23c6-422a-80a4-e314cd1e1170 service cinder] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:06:57.804085 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.notifications [None req-784a5ef1-d85b-42d3-93e7-f247e63318b2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9ba888f052d949e4a5bb6c058f73fc1c'} {{(pid=80396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:06:57.804664 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 915/1816] 10.222.0.59 () {60 vars in 1365 bytes} [Thu Jun 2 16:06:57 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 128 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 02 16:06:57.804765 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.notifications [None req-784a5ef1-d85b-42d3-93e7-f247e63318b2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9ba888f052d949e4a5bb6c058f73fc1c'} {{(pid=80396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:06:57.873498 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.notifications [None req-784a5ef1-d85b-42d3-93e7-f247e63318b2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9ba888f052d949e4a5bb6c058f73fc1c'} {{(pid=80396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:06:57.886339 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.notifications [None req-784a5ef1-d85b-42d3-93e7-f247e63318b2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9ba888f052d949e4a5bb6c058f73fc1c'} {{(pid=80396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:06:57.893603 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.notifications [None req-784a5ef1-d85b-42d3-93e7-f247e63318b2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9ba888f052d949e4a5bb6c058f73fc1c'} {{(pid=80396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:06:57.903656 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 902/1817] 10.222.0.59 () {58 vars in 1223 bytes} [Thu Jun 2 16:06:57 2022] DELETE /identity/v3/users/9ba888f052d949e4a5bb6c058f73fc1c => generated 0 bytes in 485 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 02 16:06:57.912186 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG dbcounter [-] [80396] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 16:06:57.933292 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12a9ca99-23c6-422a-80a4-e314cd1e1170 service cinder] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:06:57.934892 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.fernet_utils [None req-12a9ca99-23c6-422a-80a4-e314cd1e1170 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:06:57.947331 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12a9ca99-23c6-422a-80a4-e314cd1e1170 service cinder] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:06:58.012156 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dcc5959-fa13-494c-afb7-16059f466469 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6534961c369940a5b88f310c6450250b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c87c981909d4b8db02783421818c79b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:06:58.013108 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dcc5959-fa13-494c-afb7-16059f466469 service cinder] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:06:58.013581 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dcc5959-fa13-494c-afb7-16059f466469 service cinder] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:06:58.013870 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dcc5959-fa13-494c-afb7-16059f466469 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:06:58.015772 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.fernet_utils [None req-8dcc5959-fa13-494c-afb7-16059f466469 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:06:58.096520 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dcc5959-fa13-494c-afb7-16059f466469 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:06:58.099926 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dcc5959-fa13-494c-afb7-16059f466469 service cinder] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:06:58.108534 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 916/1818] 10.222.0.59 () {60 vars in 1365 bytes} [Thu Jun 2 16:06:57 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 176 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 16:06:58.476803 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-784a5ef1-d85b-42d3-93e7-f247e63318b2 admin admin] Authenticating user token {{(pid=80396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:06:58.479303 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.fernet_utils [None req-784a5ef1-d85b-42d3-93e7-f247e63318b2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:06:58.556442 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-784a5ef1-d85b-42d3-93e7-f247e63318b2 admin admin] Validating token access rules against request {{(pid=80396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:06:58.561296 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f3d13af-b44a-4cb9-9d7d-545712916e1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f73d5a98be74242b45222df39fb6213', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:06:58.567051 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f3d13af-b44a-4cb9-9d7d-545712916e1e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:06:58.567051 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f3d13af-b44a-4cb9-9d7d-545712916e1e admin admin] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:06:58.567051 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f3d13af-b44a-4cb9-9d7d-545712916e1e admin admin] PATH_INFO: `/v3/projects/89fce3390f1542579eeecaca9bc9c859` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:06:58.567051 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f3d13af-b44a-4cb9-9d7d-545712916e1e admin admin] RBAC: Authorizing `identity:delete_project(project_id=89fce3390f1542579eeecaca9bc9c859)` {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:06:58.567051 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f3d13af-b44a-4cb9-9d7d-545712916e1e admin admin] RBAC: Authorization granted {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:06:58.723693 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.notifications [None req-4f3d13af-b44a-4cb9-9d7d-545712916e1e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '89fce3390f1542579eeecaca9bc9c859', 'request_id': 'req-4f3d13af-b44a-4cb9-9d7d-545712916e1e'} {{(pid=80396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:06:58.723693 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.notifications [None req-4f3d13af-b44a-4cb9-9d7d-545712916e1e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '89fce3390f1542579eeecaca9bc9c859', 'request_id': 'req-4f3d13af-b44a-4cb9-9d7d-545712916e1e'} {{(pid=80396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:06:58.811436 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.notifications [None req-4f3d13af-b44a-4cb9-9d7d-545712916e1e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '89fce3390f1542579eeecaca9bc9c859', 'request_id': 'req-4f3d13af-b44a-4cb9-9d7d-545712916e1e'} {{(pid=80396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:06:58.827257 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.notifications [None req-4f3d13af-b44a-4cb9-9d7d-545712916e1e admin admin] The token cache is being invalidate because project 89fce3390f1542579eeecaca9bc9c859 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80396) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 02 16:06:58.827257 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.notifications [None req-4f3d13af-b44a-4cb9-9d7d-545712916e1e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:06:58.827257 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.notifications [None req-4f3d13af-b44a-4cb9-9d7d-545712916e1e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:06:58.831580 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 903/1819] 10.222.0.59 () {58 vars in 1232 bytes} [Thu Jun 2 16:06:58 2022] DELETE /identity/v3/projects/89fce3390f1542579eeecaca9bc9c859 => generated 0 bytes in 355 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 16:06:58.836533 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24f069a-91a2-418e-962c-0ce5c38625cf None None] REQUEST_METHOD: `POST` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:06:58.837261 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24f069a-91a2-418e-962c-0ce5c38625cf None None] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:06:58.837261 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24f069a-91a2-418e-962c-0ce5c38625cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:06:58.845863 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writing DB stats keystone:SELECT=100 {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 16:06:58.857833 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.auth.core [None req-c24f069a-91a2-418e-962c-0ce5c38625cf None None] MFA Rules not processed for user `400d1f4db9de49638549e5db29a041e1`. Rule list: `[]` (Enabled: `True`). {{(pid=80395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 16:06:58.859091 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.fernet_utils [None req-c24f069a-91a2-418e-962c-0ce5c38625cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:06:58.937914 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 917/1820] 10.222.0.59 () {58 vars in 957 bytes} [Thu Jun 2 16:06:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 16:06:58.945369 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b4c796e-bb9c-488e-9eb0-34b783f3cddf None None] REQUEST_METHOD: `POST` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:06:58.947332 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b4c796e-bb9c-488e-9eb0-34b783f3cddf None None] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:06:58.947332 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b4c796e-bb9c-488e-9eb0-34b783f3cddf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:06:58.974941 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.auth.core [None req-6b4c796e-bb9c-488e-9eb0-34b783f3cddf None None] MFA Rules not processed for user `400d1f4db9de49638549e5db29a041e1`. Rule list: `[]` (Enabled: `True`). {{(pid=80396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 16:06:58.976326 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.fernet_utils [None req-6b4c796e-bb9c-488e-9eb0-34b783f3cddf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:06:58.989647 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 904/1821] 10.222.0.59 () {58 vars in 957 bytes} [Thu Jun 2 16:06:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 16:06:58.994963 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c24f069a-91a2-418e-962c-0ce5c38625cf None None] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:06:59.008189 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c24f069a-91a2-418e-962c-0ce5c38625cf None None] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:06:59.018385 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd1ea459-f71d-447e-bb6b-ecdc518c7e65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f73d5a98be74242b45222df39fb6213', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:06:59.027539 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1ea459-f71d-447e-bb6b-ecdc518c7e65 admin admin] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:06:59.027539 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1ea459-f71d-447e-bb6b-ecdc518c7e65 admin admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:06:59.027539 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1ea459-f71d-447e-bb6b-ecdc518c7e65 admin admin] PATH_INFO: `/v3/domains` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:06:59.027539 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd1ea459-f71d-447e-bb6b-ecdc518c7e65 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80395) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 16:06:59.027539 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd1ea459-f71d-447e-bb6b-ecdc518c7e65 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:06:59.027539 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd1ea459-f71d-447e-bb6b-ecdc518c7e65 admin admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:06:59.042122 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 918/1822] 10.222.0.59 () {58 vars in 1152 bytes} [Thu Jun 2 16:06:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 16:06:59.045918 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b4c796e-bb9c-488e-9eb0-34b783f3cddf None None] Authenticating user token {{(pid=80396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:06:59.057735 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b4c796e-bb9c-488e-9eb0-34b783f3cddf None None] Validating token access rules against request {{(pid=80396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:06:59.069830 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac45f270-6c38-423b-8181-c4581dc16c7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f73d5a98be74242b45222df39fb6213', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:06:59.073399 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac45f270-6c38-423b-8181-c4581dc16c7a admin admin] REQUEST_METHOD: `POST` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:06:59.073399 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac45f270-6c38-423b-8181-c4581dc16c7a admin admin] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:06:59.073399 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac45f270-6c38-423b-8181-c4581dc16c7a admin admin] PATH_INFO: `/v3/projects` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:06:59.073399 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac45f270-6c38-423b-8181-c4581dc16c7a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:06:59.074652 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac45f270-6c38-423b-8181-c4581dc16c7a admin admin] RBAC: Authorization granted {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:06:59.201494 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 905/1823] 10.222.0.59 () {60 vars in 1152 bytes} [Thu Jun 2 16:06:59 2022] POST /identity/v3/projects => generated 361 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 16:06:59.205799 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd1ea459-f71d-447e-bb6b-ecdc518c7e65 admin admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:06:59.229633 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd1ea459-f71d-447e-bb6b-ecdc518c7e65 admin admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:06:59.305683 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e42c69ec-f021-46a5-b92f-ba45d167a3a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f73d5a98be74242b45222df39fb6213', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:06:59.306866 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42c69ec-f021-46a5-b92f-ba45d167a3a1 admin admin] REQUEST_METHOD: `POST` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:06:59.307268 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42c69ec-f021-46a5-b92f-ba45d167a3a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:06:59.307621 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42c69ec-f021-46a5-b92f-ba45d167a3a1 admin admin] PATH_INFO: `/v3/users` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:06:59.308421 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e42c69ec-f021-46a5-b92f-ba45d167a3a1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:06:59.310791 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e42c69ec-f021-46a5-b92f-ba45d167a3a1 admin admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:06:59.440950 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 919/1824] 10.222.0.59 () {60 vars in 1143 bytes} [Thu Jun 2 16:06:59 2022] POST /identity/v3/users => generated 281 bytes in 235 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 16:06:59.445017 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac45f270-6c38-423b-8181-c4581dc16c7a admin admin] Authenticating user token {{(pid=80396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:06:59.468827 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac45f270-6c38-423b-8181-c4581dc16c7a admin admin] Validating token access rules against request {{(pid=80396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:06:59.487874 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f18dca1-861b-452a-9795-9be3455d6402 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f73d5a98be74242b45222df39fb6213', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:06:59.488843 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f18dca1-861b-452a-9795-9be3455d6402 admin admin] REQUEST_METHOD: `GET` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:06:59.489503 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f18dca1-861b-452a-9795-9be3455d6402 admin admin] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:06:59.491346 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f18dca1-861b-452a-9795-9be3455d6402 admin admin] PATH_INFO: `/v3/roles` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:06:59.492348 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f18dca1-861b-452a-9795-9be3455d6402 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:06:59.497500 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f18dca1-861b-452a-9795-9be3455d6402 admin admin] RBAC: Authorization granted {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:06:59.535025 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 906/1825] 10.222.0.59 () {58 vars in 1121 bytes} [Thu Jun 2 16:06:59 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 16:06:59.539051 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e42c69ec-f021-46a5-b92f-ba45d167a3a1 admin admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:06:59.556918 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e42c69ec-f021-46a5-b92f-ba45d167a3a1 admin admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:06:59.568812 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1a69a1d-1400-4be8-97ec-25f30e153af7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f73d5a98be74242b45222df39fb6213', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:06:59.569495 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a69a1d-1400-4be8-97ec-25f30e153af7 admin admin] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:06:59.569775 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a69a1d-1400-4be8-97ec-25f30e153af7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:06:59.570050 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a69a1d-1400-4be8-97ec-25f30e153af7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:06:59.571626 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1a69a1d-1400-4be8-97ec-25f30e153af7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:06:59.572954 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1a69a1d-1400-4be8-97ec-25f30e153af7 admin admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:06:59.585857 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 920/1826] 10.222.0.59 () {58 vars in 1121 bytes} [Thu Jun 2 16:06:59 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 16:06:59.590926 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f18dca1-861b-452a-9795-9be3455d6402 admin admin] Authenticating user token {{(pid=80396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:06:59.619146 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f18dca1-861b-452a-9795-9be3455d6402 admin admin] Validating token access rules against request {{(pid=80396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:06:59.625713 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4298f20b-cd92-467a-933f-b7a064be3ef0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f73d5a98be74242b45222df39fb6213', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:06:59.626659 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4298f20b-cd92-467a-933f-b7a064be3ef0 admin admin] REQUEST_METHOD: `PUT` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:06:59.626944 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4298f20b-cd92-467a-933f-b7a064be3ef0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:06:59.627218 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4298f20b-cd92-467a-933f-b7a064be3ef0 admin admin] PATH_INFO: `/v3/projects/b098d8d6d04e4c1d917eb5413041d2d8/users/4d5b7e18b655438f94156d4cc432fc32/roles/649e0f2b5a264c419ea6a1441f123a03` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:06:59.652339 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4298f20b-cd92-467a-933f-b7a064be3ef0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b098d8d6d04e4c1d917eb5413041d2d8, user_id=4d5b7e18b655438f94156d4cc432fc32, role_id=649e0f2b5a264c419ea6a1441f123a03)` {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:06:59.662375 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4298f20b-cd92-467a-933f-b7a064be3ef0 admin admin] RBAC: Authorization granted {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:06:59.754626 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 907/1827] 10.222.0.59 () {60 vars in 1482 bytes} [Thu Jun 2 16:06:59 2022] PUT /identity/v3/projects/b098d8d6d04e4c1d917eb5413041d2d8/users/4d5b7e18b655438f94156d4cc432fc32/roles/649e0f2b5a264c419ea6a1441f123a03 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 16:06:59.767610 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e477e8c2-38ca-4106-ab37-0a13773d50bc None None] REQUEST_METHOD: `POST` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:06:59.768054 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e477e8c2-38ca-4106-ab37-0a13773d50bc None None] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:06:59.768407 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e477e8c2-38ca-4106-ab37-0a13773d50bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:06:59.813243 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.auth.core [None req-e477e8c2-38ca-4106-ab37-0a13773d50bc None None] MFA Rules not processed for user `4d5b7e18b655438f94156d4cc432fc32`. Rule list: `[]` (Enabled: `True`). {{(pid=80395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 16:06:59.814567 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.fernet_utils [None req-e477e8c2-38ca-4106-ab37-0a13773d50bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:06:59.875301 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4298f20b-cd92-467a-933f-b7a064be3ef0 admin admin] Authenticating user token {{(pid=80396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:06:59.876957 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writing DB stats keystone:SELECT=100 {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 16:06:59.877345 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.fernet_utils [None req-4298f20b-cd92-467a-933f-b7a064be3ef0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:06:59.955325 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 921/1828] 10.222.0.59 () {58 vars in 957 bytes} [Thu Jun 2 16:06:59 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 16:06:59.959864 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e477e8c2-38ca-4106-ab37-0a13773d50bc None None] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:06:59.999235 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4298f20b-cd92-467a-933f-b7a064be3ef0 admin admin] Validating token access rules against request {{(pid=80396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:07:00.003847 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebae85a4-0b0d-4032-b9ea-88f3ab111690 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f73d5a98be74242b45222df39fb6213', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:07:00.004995 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebae85a4-0b0d-4032-b9ea-88f3ab111690 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:07:00.005468 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebae85a4-0b0d-4032-b9ea-88f3ab111690 admin admin] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:07:00.005971 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebae85a4-0b0d-4032-b9ea-88f3ab111690 admin admin] PATH_INFO: `/v3/users/c60b6152437f44d9b00adacab6b1b71a` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:07:00.007476 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebae85a4-0b0d-4032-b9ea-88f3ab111690 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c60b6152437f44d9b00adacab6b1b71a)` {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:07:00.009716 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebae85a4-0b0d-4032-b9ea-88f3ab111690 admin admin] RBAC: Authorization granted {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:07:00.061091 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e477e8c2-38ca-4106-ab37-0a13773d50bc None None] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:07:00.065810 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad0e1477-a59b-4861-ac79-aae5747d94af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f73d5a98be74242b45222df39fb6213', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:07:00.066549 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0e1477-a59b-4861-ac79-aae5747d94af admin admin] REQUEST_METHOD: `POST` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:07:00.066877 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0e1477-a59b-4861-ac79-aae5747d94af admin admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:07:00.067076 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0e1477-a59b-4861-ac79-aae5747d94af admin admin] PATH_INFO: `/v3/projects` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:07:00.067770 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad0e1477-a59b-4861-ac79-aae5747d94af admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:07:00.069971 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad0e1477-a59b-4861-ac79-aae5747d94af admin admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:07:00.208101 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 922/1829] 10.222.0.59 () {60 vars in 1152 bytes} [Thu Jun 2 16:06:59 2022] POST /identity/v3/projects => generated 365 bytes in 249 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 02 16:07:00.212431 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad0e1477-a59b-4861-ac79-aae5747d94af admin admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:07:00.244311 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.notifications [None req-ebae85a4-0b0d-4032-b9ea-88f3ab111690 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c60b6152437f44d9b00adacab6b1b71a'} {{(pid=80396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:07:00.245812 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.notifications [None req-ebae85a4-0b0d-4032-b9ea-88f3ab111690 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c60b6152437f44d9b00adacab6b1b71a'} {{(pid=80396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:07:00.309299 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad0e1477-a59b-4861-ac79-aae5747d94af admin admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:07:00.314198 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0de2b4e8-eb12-41cc-8fbf-ad6aa72f07cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f73d5a98be74242b45222df39fb6213', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:07:00.314973 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de2b4e8-eb12-41cc-8fbf-ad6aa72f07cf admin admin] REQUEST_METHOD: `POST` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:07:00.315259 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de2b4e8-eb12-41cc-8fbf-ad6aa72f07cf admin admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:07:00.315531 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de2b4e8-eb12-41cc-8fbf-ad6aa72f07cf admin admin] PATH_INFO: `/v3/users` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:07:00.316347 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0de2b4e8-eb12-41cc-8fbf-ad6aa72f07cf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:07:00.318169 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0de2b4e8-eb12-41cc-8fbf-ad6aa72f07cf admin admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:07:00.428234 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.notifications [None req-ebae85a4-0b0d-4032-b9ea-88f3ab111690 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c60b6152437f44d9b00adacab6b1b71a'} {{(pid=80396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:07:00.441615 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.notifications [None req-ebae85a4-0b0d-4032-b9ea-88f3ab111690 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c60b6152437f44d9b00adacab6b1b71a'} {{(pid=80396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:07:00.448890 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.notifications [None req-ebae85a4-0b0d-4032-b9ea-88f3ab111690 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c60b6152437f44d9b00adacab6b1b71a'} {{(pid=80396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:07:00.455010 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 908/1830] 10.222.0.59 () {58 vars in 1223 bytes} [Thu Jun 2 16:06:59 2022] DELETE /identity/v3/users/c60b6152437f44d9b00adacab6b1b71a => generated 0 bytes in 580 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 02 16:07:00.459707 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7595dc29-703f-4c48-9bb7-0afd6f198974 None None] REQUEST_METHOD: `POST` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:07:00.459989 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7595dc29-703f-4c48-9bb7-0afd6f198974 None None] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:07:00.460273 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7595dc29-703f-4c48-9bb7-0afd6f198974 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:07:00.469668 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 923/1831] 10.222.0.59 () {60 vars in 1143 bytes} [Thu Jun 2 16:07:00 2022] POST /identity/v3/users => generated 289 bytes in 255 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 02 16:07:00.470824 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0de2b4e8-eb12-41cc-8fbf-ad6aa72f07cf admin admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:07:00.472476 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.fernet_utils [None req-0de2b4e8-eb12-41cc-8fbf-ad6aa72f07cf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:07:00.478354 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.auth.core [None req-7595dc29-703f-4c48-9bb7-0afd6f198974 None None] MFA Rules not processed for user `400d1f4db9de49638549e5db29a041e1`. Rule list: `[]` (Enabled: `True`). {{(pid=80396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 16:07:00.479510 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.fernet_utils [None req-7595dc29-703f-4c48-9bb7-0afd6f198974 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:07:00.485070 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0de2b4e8-eb12-41cc-8fbf-ad6aa72f07cf admin admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:07:00.537875 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 909/1832] 10.222.0.59 () {58 vars in 957 bytes} [Thu Jun 2 16:07:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 02 16:07:00.543103 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71fdc0f4-b7ce-4b77-ab53-22c8b140bf74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f73d5a98be74242b45222df39fb6213', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:07:00.543780 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71fdc0f4-b7ce-4b77-ab53-22c8b140bf74 admin admin] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:07:00.544067 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71fdc0f4-b7ce-4b77-ab53-22c8b140bf74 admin admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:07:00.544346 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71fdc0f4-b7ce-4b77-ab53-22c8b140bf74 admin admin] PATH_INFO: `/v3/roles` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:07:00.545081 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71fdc0f4-b7ce-4b77-ab53-22c8b140bf74 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:07:00.546845 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71fdc0f4-b7ce-4b77-ab53-22c8b140bf74 admin admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:07:00.548209 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7595dc29-703f-4c48-9bb7-0afd6f198974 None None] Authenticating user token {{(pid=80396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:07:00.549549 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.fernet_utils [None req-7595dc29-703f-4c48-9bb7-0afd6f198974 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:07:00.560419 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 924/1833] 10.222.0.59 () {58 vars in 1121 bytes} [Thu Jun 2 16:07:00 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 16:07:00.564561 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71fdc0f4-b7ce-4b77-ab53-22c8b140bf74 admin admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:07:00.575171 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71fdc0f4-b7ce-4b77-ab53-22c8b140bf74 admin admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:07:00.580475 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-752b3bbb-0792-4ecc-9b9c-f51950a73b37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f73d5a98be74242b45222df39fb6213', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:07:00.581545 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-752b3bbb-0792-4ecc-9b9c-f51950a73b37 admin admin] REQUEST_METHOD: `PUT` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:07:00.582146 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-752b3bbb-0792-4ecc-9b9c-f51950a73b37 admin admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:07:00.582826 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-752b3bbb-0792-4ecc-9b9c-f51950a73b37 admin admin] PATH_INFO: `/v3/projects/a0a183f3387e493cb36461d91fbac245/users/b16c63eaf0384c4f9fe6fbdf3de557e5/roles/f1e0c25f6e9049e897cb7350c7e54ab3` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:07:00.603470 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-752b3bbb-0792-4ecc-9b9c-f51950a73b37 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a0a183f3387e493cb36461d91fbac245, user_id=b16c63eaf0384c4f9fe6fbdf3de557e5, role_id=f1e0c25f6e9049e897cb7350c7e54ab3)` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:07:00.606338 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-752b3bbb-0792-4ecc-9b9c-f51950a73b37 admin admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:07:00.619020 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7595dc29-703f-4c48-9bb7-0afd6f198974 None None] Validating token access rules against request {{(pid=80396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:07:00.622587 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e6f182c-4e8b-4631-a906-6f215ed6c691 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9af40ddfe9ff4be3887b068f13a28dc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c87c981909d4b8db02783421818c79b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:07:00.623317 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6f182c-4e8b-4631-a906-6f215ed6c691 service neutron] REQUEST_METHOD: `GET` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:07:00.623665 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6f182c-4e8b-4631-a906-6f215ed6c691 service neutron] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:07:00.624014 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6f182c-4e8b-4631-a906-6f215ed6c691 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:07:00.642809 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e6f182c-4e8b-4631-a906-6f215ed6c691 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:07:00.642809 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e6f182c-4e8b-4631-a906-6f215ed6c691 service neutron] RBAC: Authorization granted {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:07:00.646633 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 910/1834] 10.222.0.59 () {60 vars in 1365 bytes} [Thu Jun 2 16:07:00 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 16:07:00.704747 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 925/1835] 10.222.0.59 () {60 vars in 1482 bytes} [Thu Jun 2 16:07:00 2022] PUT /identity/v3/projects/a0a183f3387e493cb36461d91fbac245/users/b16c63eaf0384c4f9fe6fbdf3de557e5/roles/f1e0c25f6e9049e897cb7350c7e54ab3 => generated 0 bytes in 141 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 16:07:00.709192 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e6f182c-4e8b-4631-a906-6f215ed6c691 service neutron] Authenticating user token {{(pid=80396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:07:00.720189 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e6f182c-4e8b-4631-a906-6f215ed6c691 service neutron] Validating token access rules against request {{(pid=80396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:07:00.783627 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10678023-c07c-4678-a79a-666d25dff604 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f73d5a98be74242b45222df39fb6213', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:07:00.784288 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10678023-c07c-4678-a79a-666d25dff604 admin admin] REQUEST_METHOD: `GET` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:07:00.784571 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10678023-c07c-4678-a79a-666d25dff604 admin admin] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:07:00.784848 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10678023-c07c-4678-a79a-666d25dff604 admin admin] PATH_INFO: `/v3/roles` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:07:00.785564 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10678023-c07c-4678-a79a-666d25dff604 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:07:00.787324 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10678023-c07c-4678-a79a-666d25dff604 admin admin] RBAC: Authorization granted {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:07:00.797088 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 911/1836] 10.222.0.59 () {58 vars in 1121 bytes} [Thu Jun 2 16:07:00 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 16:07:00.801528 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-752b3bbb-0792-4ecc-9b9c-f51950a73b37 admin admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:07:00.812754 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-752b3bbb-0792-4ecc-9b9c-f51950a73b37 admin admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:07:00.817344 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ff4c399-36dd-45ce-90b5-69e31f502d2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f73d5a98be74242b45222df39fb6213', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:07:00.818250 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff4c399-36dd-45ce-90b5-69e31f502d2e admin admin] REQUEST_METHOD: `PUT` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:07:00.818536 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff4c399-36dd-45ce-90b5-69e31f502d2e admin admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:07:00.818815 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff4c399-36dd-45ce-90b5-69e31f502d2e admin admin] PATH_INFO: `/v3/projects/a0a183f3387e493cb36461d91fbac245/users/b16c63eaf0384c4f9fe6fbdf3de557e5/roles/f1e0c25f6e9049e897cb7350c7e54ab3` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:07:00.820854 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ff4c399-36dd-45ce-90b5-69e31f502d2e admin admin] RBAC: Authorizing `identity:create_grant(project_id=a0a183f3387e493cb36461d91fbac245, user_id=b16c63eaf0384c4f9fe6fbdf3de557e5, role_id=f1e0c25f6e9049e897cb7350c7e54ab3)` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:07:00.824276 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ff4c399-36dd-45ce-90b5-69e31f502d2e admin admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:07:00.835469 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 926/1837] 10.222.0.59 () {60 vars in 1482 bytes} [Thu Jun 2 16:07:00 2022] PUT /identity/v3/projects/a0a183f3387e493cb36461d91fbac245/users/b16c63eaf0384c4f9fe6fbdf3de557e5/roles/f1e0c25f6e9049e897cb7350c7e54ab3 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 16:07:00.845958 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e302b92-f98d-42a0-ae50-75285cc78ec4 None None] REQUEST_METHOD: `POST` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:07:00.849178 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e302b92-f98d-42a0-ae50-75285cc78ec4 None None] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:07:00.849178 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e302b92-f98d-42a0-ae50-75285cc78ec4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:07:00.878201 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.auth.core [None req-7e302b92-f98d-42a0-ae50-75285cc78ec4 None None] MFA Rules not processed for user `b16c63eaf0384c4f9fe6fbdf3de557e5`. Rule list: `[]` (Enabled: `True`). {{(pid=80396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 16:07:00.879104 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.fernet_utils [None req-7e302b92-f98d-42a0-ae50-75285cc78ec4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:07:00.936966 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 16:07:00.948644 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 912/1838] 10.222.0.59 () {58 vars in 957 bytes} [Thu Jun 2 16:07:00 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 16:07:00.961388 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ff4c399-36dd-45ce-90b5-69e31f502d2e admin admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:07:00.963665 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.fernet_utils [None req-1ff4c399-36dd-45ce-90b5-69e31f502d2e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:07:01.022097 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ff4c399-36dd-45ce-90b5-69e31f502d2e admin admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:07:01.026045 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b16eb850-2f60-4080-8467-ab3b69d02e37 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6534961c369940a5b88f310c6450250b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c87c981909d4b8db02783421818c79b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:07:01.026751 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b16eb850-2f60-4080-8467-ab3b69d02e37 service cinder] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:07:01.027036 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b16eb850-2f60-4080-8467-ab3b69d02e37 service cinder] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:07:01.027320 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b16eb850-2f60-4080-8467-ab3b69d02e37 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:07:01.036623 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b16eb850-2f60-4080-8467-ab3b69d02e37 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:07:01.038047 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b16eb850-2f60-4080-8467-ab3b69d02e37 service cinder] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:07:01.048342 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 927/1839] 10.222.0.59 () {60 vars in 1365 bytes} [Thu Jun 2 16:07:00 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 16:07:01.087819 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e302b92-f98d-42a0-ae50-75285cc78ec4 None None] Authenticating user token {{(pid=80396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:07:01.089274 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.fernet_utils [None req-7e302b92-f98d-42a0-ae50-75285cc78ec4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:07:01.168165 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e302b92-f98d-42a0-ae50-75285cc78ec4 None None] Validating token access rules against request {{(pid=80396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:07:01.173993 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fefd11e-b210-4f6b-911b-6c3af6376bda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f73d5a98be74242b45222df39fb6213', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:07:01.175163 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fefd11e-b210-4f6b-911b-6c3af6376bda admin admin] REQUEST_METHOD: `DELETE` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:07:01.175245 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fefd11e-b210-4f6b-911b-6c3af6376bda admin admin] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:07:01.175772 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fefd11e-b210-4f6b-911b-6c3af6376bda admin admin] PATH_INFO: `/v3/projects/559f027c4cfe4a6085e7aaa68b040462` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:07:01.177262 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fefd11e-b210-4f6b-911b-6c3af6376bda admin admin] RBAC: Authorizing `identity:delete_project(project_id=559f027c4cfe4a6085e7aaa68b040462)` {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:07:01.184118 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fefd11e-b210-4f6b-911b-6c3af6376bda admin admin] RBAC: Authorization granted {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:07:01.354643 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b16eb850-2f60-4080-8467-ab3b69d02e37 service cinder] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:07:01.364343 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b16eb850-2f60-4080-8467-ab3b69d02e37 service cinder] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:07:01.366800 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.notifications [None req-7fefd11e-b210-4f6b-911b-6c3af6376bda admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '559f027c4cfe4a6085e7aaa68b040462', 'request_id': 'req-7fefd11e-b210-4f6b-911b-6c3af6376bda'} {{(pid=80396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:07:01.377203 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.notifications [None req-7fefd11e-b210-4f6b-911b-6c3af6376bda admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '559f027c4cfe4a6085e7aaa68b040462', 'request_id': 'req-7fefd11e-b210-4f6b-911b-6c3af6376bda'} {{(pid=80396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:07:01.445320 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a0c1a7-8311-4c15-83db-c6d911af0549 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6534961c369940a5b88f310c6450250b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c87c981909d4b8db02783421818c79b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:07:01.446614 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a0c1a7-8311-4c15-83db-c6d911af0549 service cinder] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:07:01.446614 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a0c1a7-8311-4c15-83db-c6d911af0549 service cinder] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:07:01.446614 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a0c1a7-8311-4c15-83db-c6d911af0549 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:07:01.449215 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.fernet_utils [None req-d7a0c1a7-8311-4c15-83db-c6d911af0549 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:07:01.497140 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.notifications [None req-7fefd11e-b210-4f6b-911b-6c3af6376bda admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '559f027c4cfe4a6085e7aaa68b040462', 'request_id': 'req-7fefd11e-b210-4f6b-911b-6c3af6376bda'} {{(pid=80396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:07:01.500946 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG dbcounter [-] [80396] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 16:07:01.517601 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.notifications [None req-7fefd11e-b210-4f6b-911b-6c3af6376bda admin admin] The token cache is being invalidate because project 559f027c4cfe4a6085e7aaa68b040462 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80396) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 02 16:07:01.518523 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.notifications [None req-7fefd11e-b210-4f6b-911b-6c3af6376bda admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:07:01.519746 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.notifications [None req-7fefd11e-b210-4f6b-911b-6c3af6376bda admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:07:01.525860 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 913/1840] 10.222.0.59 () {58 vars in 1232 bytes} [Thu Jun 2 16:07:01 2022] DELETE /identity/v3/projects/559f027c4cfe4a6085e7aaa68b040462 => generated 0 bytes in 435 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 02 16:07:01.526886 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fefd11e-b210-4f6b-911b-6c3af6376bda admin admin] Authenticating user token {{(pid=80396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:07:01.530522 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.fernet_utils [None req-7fefd11e-b210-4f6b-911b-6c3af6376bda admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:07:01.536292 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7a0c1a7-8311-4c15-83db-c6d911af0549 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:07:01.537913 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7a0c1a7-8311-4c15-83db-c6d911af0549 service cinder] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:07:01.549922 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 928/1841] 10.222.0.59 () {60 vars in 1365 bytes} [Thu Jun 2 16:07:01 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 196 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 16:07:01.655089 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fefd11e-b210-4f6b-911b-6c3af6376bda admin admin] Validating token access rules against request {{(pid=80396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:07:01.660952 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c97e87a0-bbb2-4571-977c-b54ee966d9eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f73d5a98be74242b45222df39fb6213', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:07:01.661859 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97e87a0-bbb2-4571-977c-b54ee966d9eb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:07:01.662170 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97e87a0-bbb2-4571-977c-b54ee966d9eb admin admin] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:07:01.662450 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97e87a0-bbb2-4571-977c-b54ee966d9eb admin admin] PATH_INFO: `/v3/users/abebefa74f9b4db2afad35349483aaf8` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:07:01.663721 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c97e87a0-bbb2-4571-977c-b54ee966d9eb admin admin] RBAC: Authorizing `identity:delete_user(user_id=abebefa74f9b4db2afad35349483aaf8)` {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:07:01.666351 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c97e87a0-bbb2-4571-977c-b54ee966d9eb admin admin] RBAC: Authorization granted {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:07:01.923771 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.notifications [None req-c97e87a0-bbb2-4571-977c-b54ee966d9eb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'abebefa74f9b4db2afad35349483aaf8'} {{(pid=80396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:07:01.925146 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.notifications [None req-c97e87a0-bbb2-4571-977c-b54ee966d9eb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'abebefa74f9b4db2afad35349483aaf8'} {{(pid=80396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:07:02.049963 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.notifications [None req-c97e87a0-bbb2-4571-977c-b54ee966d9eb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'abebefa74f9b4db2afad35349483aaf8'} {{(pid=80396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:07:02.084739 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.notifications [None req-c97e87a0-bbb2-4571-977c-b54ee966d9eb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'abebefa74f9b4db2afad35349483aaf8'} {{(pid=80396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:07:02.110375 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.notifications [None req-c97e87a0-bbb2-4571-977c-b54ee966d9eb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'abebefa74f9b4db2afad35349483aaf8'} {{(pid=80396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:07:02.124674 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 914/1842] 10.222.0.59 () {58 vars in 1223 bytes} [Thu Jun 2 16:07:01 2022] DELETE /identity/v3/users/abebefa74f9b4db2afad35349483aaf8 => generated 0 bytes in 598 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 16:07:02.683508 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a0c1a7-8311-4c15-83db-c6d911af0549 service cinder] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:07:02.709654 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a0c1a7-8311-4c15-83db-c6d911af0549 service cinder] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:07:02.785171 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1926b30c-a5a4-4017-87e9-77d9bbb6b976 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f73d5a98be74242b45222df39fb6213', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:07:02.786703 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1926b30c-a5a4-4017-87e9-77d9bbb6b976 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:07:02.786990 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1926b30c-a5a4-4017-87e9-77d9bbb6b976 admin admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:07:02.787267 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1926b30c-a5a4-4017-87e9-77d9bbb6b976 admin admin] PATH_INFO: `/v3/projects/11230dad2b654704bdfe6e1ef6113f37` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:07:02.788464 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1926b30c-a5a4-4017-87e9-77d9bbb6b976 admin admin] RBAC: Authorizing `identity:delete_project(project_id=11230dad2b654704bdfe6e1ef6113f37)` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:07:02.791400 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1926b30c-a5a4-4017-87e9-77d9bbb6b976 admin admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:07:03.076074 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.notifications [None req-1926b30c-a5a4-4017-87e9-77d9bbb6b976 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '11230dad2b654704bdfe6e1ef6113f37', 'request_id': 'req-1926b30c-a5a4-4017-87e9-77d9bbb6b976'} {{(pid=80395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:07:03.085487 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.notifications [None req-1926b30c-a5a4-4017-87e9-77d9bbb6b976 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '11230dad2b654704bdfe6e1ef6113f37', 'request_id': 'req-1926b30c-a5a4-4017-87e9-77d9bbb6b976'} {{(pid=80395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:07:03.194924 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.notifications [None req-1926b30c-a5a4-4017-87e9-77d9bbb6b976 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '11230dad2b654704bdfe6e1ef6113f37', 'request_id': 'req-1926b30c-a5a4-4017-87e9-77d9bbb6b976'} {{(pid=80395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:07:03.238499 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.notifications [None req-1926b30c-a5a4-4017-87e9-77d9bbb6b976 admin admin] The token cache is being invalidate because project 11230dad2b654704bdfe6e1ef6113f37 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80395) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 02 16:07:03.238800 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.notifications [None req-1926b30c-a5a4-4017-87e9-77d9bbb6b976 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:07:03.239534 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.notifications [None req-1926b30c-a5a4-4017-87e9-77d9bbb6b976 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:07:03.243276 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 929/1843] 10.222.0.59 () {58 vars in 1232 bytes} [Thu Jun 2 16:07:02 2022] DELETE /identity/v3/projects/11230dad2b654704bdfe6e1ef6113f37 => generated 0 bytes in 561 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 16:07:03.248225 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d16f29-e177-4120-85f7-7e44c498de16 None None] REQUEST_METHOD: `POST` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:07:03.248694 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d16f29-e177-4120-85f7-7e44c498de16 None None] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:07:03.248816 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d16f29-e177-4120-85f7-7e44c498de16 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:07:03.284805 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.auth.core [None req-b1d16f29-e177-4120-85f7-7e44c498de16 None None] MFA Rules not processed for user `400d1f4db9de49638549e5db29a041e1`. Rule list: `[]` (Enabled: `True`). {{(pid=80396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 16:07:03.286039 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.fernet_utils [None req-b1d16f29-e177-4120-85f7-7e44c498de16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:07:03.297158 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 16:07:03.383241 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 915/1844] 10.222.0.59 () {58 vars in 957 bytes} [Thu Jun 2 16:07:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 16:07:03.385275 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c487a5-14f4-49b4-b39f-aa6ca7adf288 None None] REQUEST_METHOD: `POST` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:07:03.385492 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c487a5-14f4-49b4-b39f-aa6ca7adf288 None None] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:07:03.385778 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c487a5-14f4-49b4-b39f-aa6ca7adf288 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:07:03.408600 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.auth.core [None req-62c487a5-14f4-49b4-b39f-aa6ca7adf288 None None] MFA Rules not processed for user `400d1f4db9de49638549e5db29a041e1`. Rule list: `[]` (Enabled: `True`). {{(pid=80395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 16:07:03.411933 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.fernet_utils [None req-62c487a5-14f4-49b4-b39f-aa6ca7adf288 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:07:03.431016 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 930/1845] 10.222.0.59 () {58 vars in 957 bytes} [Thu Jun 2 16:07:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 16:07:03.435526 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1d16f29-e177-4120-85f7-7e44c498de16 None None] Authenticating user token {{(pid=80396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:07:03.448410 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1d16f29-e177-4120-85f7-7e44c498de16 None None] Validating token access rules against request {{(pid=80396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:07:03.454867 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4aab806-650e-434a-9545-764a55389c2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f73d5a98be74242b45222df39fb6213', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:07:03.470061 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4aab806-650e-434a-9545-764a55389c2e admin admin] REQUEST_METHOD: `GET` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:07:03.470061 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4aab806-650e-434a-9545-764a55389c2e admin admin] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:07:03.470061 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4aab806-650e-434a-9545-764a55389c2e admin admin] PATH_INFO: `/v3/domains` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:07:03.470061 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4aab806-650e-434a-9545-764a55389c2e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80396) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 16:07:03.470061 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4aab806-650e-434a-9545-764a55389c2e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:07:03.470061 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4aab806-650e-434a-9545-764a55389c2e admin admin] RBAC: Authorization granted {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:07:03.482877 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 916/1846] 10.222.0.59 () {58 vars in 1152 bytes} [Thu Jun 2 16:07:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 16:07:03.487269 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62c487a5-14f4-49b4-b39f-aa6ca7adf288 None None] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:07:03.498217 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62c487a5-14f4-49b4-b39f-aa6ca7adf288 None None] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:07:03.503143 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a2a436a-87db-4dba-83f3-5183e7e7f142 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f73d5a98be74242b45222df39fb6213', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:07:03.503810 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a2a436a-87db-4dba-83f3-5183e7e7f142 admin admin] REQUEST_METHOD: `POST` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:07:03.504099 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a2a436a-87db-4dba-83f3-5183e7e7f142 admin admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:07:03.504382 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a2a436a-87db-4dba-83f3-5183e7e7f142 admin admin] PATH_INFO: `/v3/projects` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:07:03.505082 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a2a436a-87db-4dba-83f3-5183e7e7f142 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:07:03.507257 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a2a436a-87db-4dba-83f3-5183e7e7f142 admin admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:07:03.612453 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 931/1847] 10.222.0.59 () {60 vars in 1152 bytes} [Thu Jun 2 16:07:03 2022] POST /identity/v3/projects => generated 379 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 16:07:03.616802 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4aab806-650e-434a-9545-764a55389c2e admin admin] Authenticating user token {{(pid=80396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:07:03.631647 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4aab806-650e-434a-9545-764a55389c2e admin admin] Validating token access rules against request {{(pid=80396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:07:03.725241 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07fdaff7-8104-423f-9504-985af119d597 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f73d5a98be74242b45222df39fb6213', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:07:03.726153 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07fdaff7-8104-423f-9504-985af119d597 admin admin] REQUEST_METHOD: `POST` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:07:03.726449 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07fdaff7-8104-423f-9504-985af119d597 admin admin] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:07:03.726758 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07fdaff7-8104-423f-9504-985af119d597 admin admin] PATH_INFO: `/v3/users` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:07:03.728541 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07fdaff7-8104-423f-9504-985af119d597 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:07:03.730670 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07fdaff7-8104-423f-9504-985af119d597 admin admin] RBAC: Authorization granted {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:07:03.858693 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 917/1848] 10.222.0.59 () {60 vars in 1143 bytes} [Thu Jun 2 16:07:03 2022] POST /identity/v3/users => generated 290 bytes in 242 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 16:07:03.862378 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a2a436a-87db-4dba-83f3-5183e7e7f142 admin admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:07:03.873088 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a2a436a-87db-4dba-83f3-5183e7e7f142 admin admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:07:03.878433 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d00a6c0-e21b-42bd-bd16-733cb54a5042 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f73d5a98be74242b45222df39fb6213', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:07:03.879132 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d00a6c0-e21b-42bd-bd16-733cb54a5042 admin admin] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:07:03.879416 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d00a6c0-e21b-42bd-bd16-733cb54a5042 admin admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:07:03.879691 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d00a6c0-e21b-42bd-bd16-733cb54a5042 admin admin] PATH_INFO: `/v3/roles` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:07:03.880421 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d00a6c0-e21b-42bd-bd16-733cb54a5042 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:07:03.882017 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d00a6c0-e21b-42bd-bd16-733cb54a5042 admin admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:07:03.893001 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 932/1849] 10.222.0.59 () {58 vars in 1121 bytes} [Thu Jun 2 16:07:03 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 16:07:03.897099 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07fdaff7-8104-423f-9504-985af119d597 admin admin] Authenticating user token {{(pid=80396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:07:03.908496 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07fdaff7-8104-423f-9504-985af119d597 admin admin] Validating token access rules against request {{(pid=80396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:07:03.913329 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4230b9cf-1d89-4dfc-ae94-516a1a92d487 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f73d5a98be74242b45222df39fb6213', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:07:03.914152 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4230b9cf-1d89-4dfc-ae94-516a1a92d487 admin admin] REQUEST_METHOD: `GET` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:07:03.914504 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4230b9cf-1d89-4dfc-ae94-516a1a92d487 admin admin] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:07:03.916316 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4230b9cf-1d89-4dfc-ae94-516a1a92d487 admin admin] PATH_INFO: `/v3/roles` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:07:03.916316 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4230b9cf-1d89-4dfc-ae94-516a1a92d487 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:07:03.917783 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4230b9cf-1d89-4dfc-ae94-516a1a92d487 admin admin] RBAC: Authorization granted {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:07:03.928416 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 918/1850] 10.222.0.59 () {58 vars in 1121 bytes} [Thu Jun 2 16:07:03 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 02 16:07:03.932462 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d00a6c0-e21b-42bd-bd16-733cb54a5042 admin admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:07:03.944685 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d00a6c0-e21b-42bd-bd16-733cb54a5042 admin admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:07:03.951656 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78b0ce94-3b3d-4240-b89b-4e855c940d4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f73d5a98be74242b45222df39fb6213', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:07:03.952735 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b0ce94-3b3d-4240-b89b-4e855c940d4a admin admin] REQUEST_METHOD: `PUT` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:07:03.953241 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b0ce94-3b3d-4240-b89b-4e855c940d4a admin admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:07:03.953723 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b0ce94-3b3d-4240-b89b-4e855c940d4a admin admin] PATH_INFO: `/v3/projects/897ecb110cdc46ad96162d8dc311fc24/users/c6d602ddb7ce4a61b7d3a7a966fe681f/roles/649e0f2b5a264c419ea6a1441f123a03` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:07:03.983550 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78b0ce94-3b3d-4240-b89b-4e855c940d4a admin admin] RBAC: Authorizing `identity:create_grant(project_id=897ecb110cdc46ad96162d8dc311fc24, user_id=c6d602ddb7ce4a61b7d3a7a966fe681f, role_id=649e0f2b5a264c419ea6a1441f123a03)` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:07:03.986421 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78b0ce94-3b3d-4240-b89b-4e855c940d4a admin admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:07:04.115087 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 933/1851] 10.222.0.59 () {60 vars in 1482 bytes} [Thu Jun 2 16:07:03 2022] PUT /identity/v3/projects/897ecb110cdc46ad96162d8dc311fc24/users/c6d602ddb7ce4a61b7d3a7a966fe681f/roles/649e0f2b5a264c419ea6a1441f123a03 => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 16:07:04.126100 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d3dab9-84a6-440b-91d8-66dfb9896e01 None None] REQUEST_METHOD: `POST` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:07:04.126639 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d3dab9-84a6-440b-91d8-66dfb9896e01 None None] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:07:04.127086 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d3dab9-84a6-440b-91d8-66dfb9896e01 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:07:04.180163 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.auth.core [None req-a9d3dab9-84a6-440b-91d8-66dfb9896e01 None None] MFA Rules not processed for user `c6d602ddb7ce4a61b7d3a7a966fe681f`. Rule list: `[]` (Enabled: `True`). {{(pid=80396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 16:07:04.181879 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.fernet_utils [None req-a9d3dab9-84a6-440b-91d8-66dfb9896e01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:07:04.267360 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 919/1852] 10.222.0.59 () {58 vars in 957 bytes} [Thu Jun 2 16:07:04 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 16:07:04.271837 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78b0ce94-3b3d-4240-b89b-4e855c940d4a admin admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:07:04.341390 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78b0ce94-3b3d-4240-b89b-4e855c940d4a admin admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:07:04.346860 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f82836e-4596-4d37-a2a1-d6473e690169 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f73d5a98be74242b45222df39fb6213', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:07:04.347518 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f82836e-4596-4d37-a2a1-d6473e690169 admin admin] REQUEST_METHOD: `POST` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:07:04.347801 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f82836e-4596-4d37-a2a1-d6473e690169 admin admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:07:04.348076 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f82836e-4596-4d37-a2a1-d6473e690169 admin admin] PATH_INFO: `/v3/projects` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:07:04.348773 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f82836e-4596-4d37-a2a1-d6473e690169 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:07:04.350750 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f82836e-4596-4d37-a2a1-d6473e690169 admin admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:07:04.451921 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 934/1853] 10.222.0.59 () {60 vars in 1152 bytes} [Thu Jun 2 16:07:04 2022] POST /identity/v3/projects => generated 381 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 16:07:04.458131 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9d3dab9-84a6-440b-91d8-66dfb9896e01 None None] Authenticating user token {{(pid=80396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:07:04.469058 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9d3dab9-84a6-440b-91d8-66dfb9896e01 None None] Validating token access rules against request {{(pid=80396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:07:04.523456 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fea9b436-5757-48ba-ad4c-656cfe365591 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f73d5a98be74242b45222df39fb6213', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:07:04.524695 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea9b436-5757-48ba-ad4c-656cfe365591 admin admin] REQUEST_METHOD: `POST` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:07:04.524941 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea9b436-5757-48ba-ad4c-656cfe365591 admin admin] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:07:04.525212 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea9b436-5757-48ba-ad4c-656cfe365591 admin admin] PATH_INFO: `/v3/users` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:07:04.525888 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fea9b436-5757-48ba-ad4c-656cfe365591 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:07:04.527814 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fea9b436-5757-48ba-ad4c-656cfe365591 admin admin] RBAC: Authorization granted {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:07:04.607522 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 920/1854] 10.222.0.59 () {60 vars in 1143 bytes} [Thu Jun 2 16:07:04 2022] POST /identity/v3/users => generated 297 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 16:07:04.609895 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f82836e-4596-4d37-a2a1-d6473e690169 admin admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:07:04.620950 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f82836e-4596-4d37-a2a1-d6473e690169 admin admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:07:04.625636 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94b1d78c-4621-4825-844a-8d14665a47cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f73d5a98be74242b45222df39fb6213', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:07:04.626326 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b1d78c-4621-4825-844a-8d14665a47cd admin admin] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:07:04.626610 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b1d78c-4621-4825-844a-8d14665a47cd admin admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:07:04.626991 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b1d78c-4621-4825-844a-8d14665a47cd admin admin] PATH_INFO: `/v3/roles` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:07:04.627683 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94b1d78c-4621-4825-844a-8d14665a47cd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:07:04.629370 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94b1d78c-4621-4825-844a-8d14665a47cd admin admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:07:04.642346 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 935/1855] 10.222.0.59 () {58 vars in 1121 bytes} [Thu Jun 2 16:07:04 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 16:07:04.646526 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fea9b436-5757-48ba-ad4c-656cfe365591 admin admin] Authenticating user token {{(pid=80396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:07:04.656846 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fea9b436-5757-48ba-ad4c-656cfe365591 admin admin] Validating token access rules against request {{(pid=80396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:07:04.661719 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb51a776-f53a-4a9e-882a-a90c74ec7fb2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f73d5a98be74242b45222df39fb6213', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:07:04.662639 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb51a776-f53a-4a9e-882a-a90c74ec7fb2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:07:04.662919 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb51a776-f53a-4a9e-882a-a90c74ec7fb2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:07:04.663190 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb51a776-f53a-4a9e-882a-a90c74ec7fb2 admin admin] PATH_INFO: `/v3/projects/ccba667b0ca8492e99837dcc0804cc2f/users/798cb23117a14419920d2d9bd9bb1cf2/roles/f1e0c25f6e9049e897cb7350c7e54ab3` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:07:04.678402 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb51a776-f53a-4a9e-882a-a90c74ec7fb2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ccba667b0ca8492e99837dcc0804cc2f, user_id=798cb23117a14419920d2d9bd9bb1cf2, role_id=f1e0c25f6e9049e897cb7350c7e54ab3)` {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:07:04.682335 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb51a776-f53a-4a9e-882a-a90c74ec7fb2 admin admin] RBAC: Authorization granted {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:07:04.686375 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG dbcounter [-] [80396] Writing DB stats keystone:INSERT=3,keystone:SELECT=97 {{(pid=80396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 16:07:04.793246 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 921/1856] 10.222.0.59 () {60 vars in 1482 bytes} [Thu Jun 2 16:07:04 2022] PUT /identity/v3/projects/ccba667b0ca8492e99837dcc0804cc2f/users/798cb23117a14419920d2d9bd9bb1cf2/roles/f1e0c25f6e9049e897cb7350c7e54ab3 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 16:07:04.797308 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94b1d78c-4621-4825-844a-8d14665a47cd admin admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:07:04.808181 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94b1d78c-4621-4825-844a-8d14665a47cd admin admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:07:04.875650 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-929027ff-8152-4fb2-997c-df302cef43a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f73d5a98be74242b45222df39fb6213', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:07:04.876411 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929027ff-8152-4fb2-997c-df302cef43a9 admin admin] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:07:04.876705 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929027ff-8152-4fb2-997c-df302cef43a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:07:04.876981 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929027ff-8152-4fb2-997c-df302cef43a9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:07:04.877711 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-929027ff-8152-4fb2-997c-df302cef43a9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:07:04.879339 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-929027ff-8152-4fb2-997c-df302cef43a9 admin admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:07:04.893151 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 936/1857] 10.222.0.59 () {58 vars in 1121 bytes} [Thu Jun 2 16:07:04 2022] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 16:07:04.894587 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb51a776-f53a-4a9e-882a-a90c74ec7fb2 admin admin] Authenticating user token {{(pid=80396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:07:04.905685 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb51a776-f53a-4a9e-882a-a90c74ec7fb2 admin admin] Validating token access rules against request {{(pid=80396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:07:04.910328 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d90e826-fc2e-4538-b747-8ffa22cd4477 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f73d5a98be74242b45222df39fb6213', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:07:04.911208 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d90e826-fc2e-4538-b747-8ffa22cd4477 admin admin] REQUEST_METHOD: `PUT` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:07:04.911489 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d90e826-fc2e-4538-b747-8ffa22cd4477 admin admin] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:07:04.911763 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d90e826-fc2e-4538-b747-8ffa22cd4477 admin admin] PATH_INFO: `/v3/projects/ccba667b0ca8492e99837dcc0804cc2f/users/798cb23117a14419920d2d9bd9bb1cf2/roles/f1e0c25f6e9049e897cb7350c7e54ab3` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:07:04.913970 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d90e826-fc2e-4538-b747-8ffa22cd4477 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ccba667b0ca8492e99837dcc0804cc2f, user_id=798cb23117a14419920d2d9bd9bb1cf2, role_id=f1e0c25f6e9049e897cb7350c7e54ab3)` {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:07:04.917218 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d90e826-fc2e-4538-b747-8ffa22cd4477 admin admin] RBAC: Authorization granted {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:07:04.927471 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 922/1858] 10.222.0.59 () {60 vars in 1482 bytes} [Thu Jun 2 16:07:04 2022] PUT /identity/v3/projects/ccba667b0ca8492e99837dcc0804cc2f/users/798cb23117a14419920d2d9bd9bb1cf2/roles/f1e0c25f6e9049e897cb7350c7e54ab3 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 16:07:04.943804 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e3fcafd-bd02-42af-b5bb-d5d1c5e1fba0 None None] REQUEST_METHOD: `POST` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:07:04.944094 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e3fcafd-bd02-42af-b5bb-d5d1c5e1fba0 None None] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:07:04.944376 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e3fcafd-bd02-42af-b5bb-d5d1c5e1fba0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:07:04.978098 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.auth.core [None req-9e3fcafd-bd02-42af-b5bb-d5d1c5e1fba0 None None] MFA Rules not processed for user `798cb23117a14419920d2d9bd9bb1cf2`. Rule list: `[]` (Enabled: `True`). {{(pid=80395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 16:07:04.978098 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.fernet_utils [None req-9e3fcafd-bd02-42af-b5bb-d5d1c5e1fba0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:07:05.058879 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d90e826-fc2e-4538-b747-8ffa22cd4477 admin admin] Authenticating user token {{(pid=80396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:07:05.061205 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.fernet_utils [None req-6d90e826-fc2e-4538-b747-8ffa22cd4477 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:07:05.085594 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 937/1859] 10.222.0.59 () {58 vars in 957 bytes} [Thu Jun 2 16:07:04 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 16:07:05.095025 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e3fcafd-bd02-42af-b5bb-d5d1c5e1fba0 None None] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:07:05.105716 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.fernet_utils [None req-9e3fcafd-bd02-42af-b5bb-d5d1c5e1fba0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:07:05.143881 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d90e826-fc2e-4538-b747-8ffa22cd4477 admin admin] Validating token access rules against request {{(pid=80396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:07:05.148668 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ac007b6-e0fb-47bd-bb8c-2e4717929ed2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f73d5a98be74242b45222df39fb6213', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:07:05.149958 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac007b6-e0fb-47bd-bb8c-2e4717929ed2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:07:05.150341 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac007b6-e0fb-47bd-bb8c-2e4717929ed2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:07:05.150683 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac007b6-e0fb-47bd-bb8c-2e4717929ed2 admin admin] PATH_INFO: `/v3/users/b5d9178fba8949e3b0a0123dc4551c2b` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:07:05.151981 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ac007b6-e0fb-47bd-bb8c-2e4717929ed2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b5d9178fba8949e3b0a0123dc4551c2b)` {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:07:05.154127 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ac007b6-e0fb-47bd-bb8c-2e4717929ed2 admin admin] RBAC: Authorization granted {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:07:05.178091 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e3fcafd-bd02-42af-b5bb-d5d1c5e1fba0 None None] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:07:05.182349 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e31659df-d15c-4d4d-be71-d79e0ca65f9c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6534961c369940a5b88f310c6450250b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c87c981909d4b8db02783421818c79b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:07:05.183169 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31659df-d15c-4d4d-be71-d79e0ca65f9c service cinder] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:07:05.183511 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31659df-d15c-4d4d-be71-d79e0ca65f9c service cinder] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:07:05.183850 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31659df-d15c-4d4d-be71-d79e0ca65f9c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:07:05.193752 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e31659df-d15c-4d4d-be71-d79e0ca65f9c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:07:05.195244 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e31659df-d15c-4d4d-be71-d79e0ca65f9c service cinder] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:07:05.205743 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 938/1860] 10.222.0.59 () {60 vars in 1365 bytes} [Thu Jun 2 16:07:05 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 02 16:07:05.341170 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e31659df-d15c-4d4d-be71-d79e0ca65f9c service cinder] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:07:05.343492 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.fernet_utils [None req-e31659df-d15c-4d4d-be71-d79e0ca65f9c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:07:05.367545 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e31659df-d15c-4d4d-be71-d79e0ca65f9c service cinder] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:07:05.375173 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-244929fd-9bcb-4eee-b39d-3e546837bf91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f73d5a98be74242b45222df39fb6213', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:07:05.376217 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-244929fd-9bcb-4eee-b39d-3e546837bf91 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:07:05.377110 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-244929fd-9bcb-4eee-b39d-3e546837bf91 admin admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:07:05.377412 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-244929fd-9bcb-4eee-b39d-3e546837bf91 admin admin] PATH_INFO: `/v3/users/c0d551674d6a420d996dae5fc6e6df94` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:07:05.378996 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-244929fd-9bcb-4eee-b39d-3e546837bf91 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c0d551674d6a420d996dae5fc6e6df94)` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:07:05.381807 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-244929fd-9bcb-4eee-b39d-3e546837bf91 admin admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:07:05.507846 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.notifications [None req-5ac007b6-e0fb-47bd-bb8c-2e4717929ed2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b5d9178fba8949e3b0a0123dc4551c2b'} {{(pid=80396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:07:05.514800 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.notifications [None req-5ac007b6-e0fb-47bd-bb8c-2e4717929ed2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b5d9178fba8949e3b0a0123dc4551c2b'} {{(pid=80396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:07:05.613705 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.notifications [None req-5ac007b6-e0fb-47bd-bb8c-2e4717929ed2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b5d9178fba8949e3b0a0123dc4551c2b'} {{(pid=80396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:07:05.635134 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.notifications [None req-5ac007b6-e0fb-47bd-bb8c-2e4717929ed2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b5d9178fba8949e3b0a0123dc4551c2b'} {{(pid=80396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:07:05.642613 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.notifications [None req-5ac007b6-e0fb-47bd-bb8c-2e4717929ed2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b5d9178fba8949e3b0a0123dc4551c2b'} {{(pid=80396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:07:05.660020 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 923/1861] 10.222.0.59 () {58 vars in 1223 bytes} [Thu Jun 2 16:07:05 2022] DELETE /identity/v3/users/b5d9178fba8949e3b0a0123dc4551c2b => generated 0 bytes in 599 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 16:07:05.660020 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf315770-ebb7-4991-89ea-9d1adaca0eee None None] REQUEST_METHOD: `GET` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:07:05.660020 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf315770-ebb7-4991-89ea-9d1adaca0eee None None] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:07:05.660020 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf315770-ebb7-4991-89ea-9d1adaca0eee None None] PATH_INFO: `/` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:07:05.660951 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.notifications [None req-244929fd-9bcb-4eee-b39d-3e546837bf91 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c0d551674d6a420d996dae5fc6e6df94'} {{(pid=80395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:07:05.667450 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 924/1862] 10.222.0.59 () {54 vars in 921 bytes} [Thu Jun 2 16:07:05 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 16:07:05.669153 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5004a14-85db-4fd2-89a6-8b9618df25b6 None None] REQUEST_METHOD: `POST` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:07:05.669470 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5004a14-85db-4fd2-89a6-8b9618df25b6 None None] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:07:05.669734 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5004a14-85db-4fd2-89a6-8b9618df25b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:07:05.694787 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.auth.core [None req-f5004a14-85db-4fd2-89a6-8b9618df25b6 None None] MFA Rules not processed for user `400d1f4db9de49638549e5db29a041e1`. Rule list: `[]` (Enabled: `True`). {{(pid=80396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 16:07:05.696848 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.fernet_utils [None req-f5004a14-85db-4fd2-89a6-8b9618df25b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:07:05.742637 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.notifications [None req-244929fd-9bcb-4eee-b39d-3e546837bf91 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c0d551674d6a420d996dae5fc6e6df94'} {{(pid=80395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:07:05.759121 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.notifications [None req-244929fd-9bcb-4eee-b39d-3e546837bf91 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c0d551674d6a420d996dae5fc6e6df94'} {{(pid=80395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:07:05.760539 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.notifications [None req-244929fd-9bcb-4eee-b39d-3e546837bf91 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c0d551674d6a420d996dae5fc6e6df94'} {{(pid=80395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:07:05.768544 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.notifications [None req-244929fd-9bcb-4eee-b39d-3e546837bf91 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c0d551674d6a420d996dae5fc6e6df94'} {{(pid=80395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:07:05.775937 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 925/1863] 10.222.0.59 () {58 vars in 957 bytes} [Thu Jun 2 16:07:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 16:07:05.775937 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68fce40e-5d6c-47ec-b278-ae2bea48a910 None None] REQUEST_METHOD: `POST` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:07:05.775937 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68fce40e-5d6c-47ec-b278-ae2bea48a910 None None] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:07:05.775937 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68fce40e-5d6c-47ec-b278-ae2bea48a910 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:07:05.779399 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 939/1864] 10.222.0.59 () {58 vars in 1223 bytes} [Thu Jun 2 16:07:05 2022] DELETE /identity/v3/users/c0d551674d6a420d996dae5fc6e6df94 => generated 0 bytes in 436 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 16:07:05.780878 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb280ed7-e9bb-4e90-bcb3-f999744b48a7 None None] REQUEST_METHOD: `POST` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:07:05.781173 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb280ed7-e9bb-4e90-bcb3-f999744b48a7 None None] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:07:05.781570 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb280ed7-e9bb-4e90-bcb3-f999744b48a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:07:05.795439 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.auth.core [None req-68fce40e-5d6c-47ec-b278-ae2bea48a910 None None] MFA Rules not processed for user `52f9fe4b13574516bb0a8e2aa11a61e8`. Rule list: `[]` (Enabled: `True`). {{(pid=80396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 16:07:05.796635 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.fernet_utils [None req-68fce40e-5d6c-47ec-b278-ae2bea48a910 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:07:05.801769 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.auth.core [None req-cb280ed7-e9bb-4e90-bcb3-f999744b48a7 None None] MFA Rules not processed for user `400d1f4db9de49638549e5db29a041e1`. Rule list: `[]` (Enabled: `True`). {{(pid=80395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 16:07:05.803113 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.fernet_utils [None req-cb280ed7-e9bb-4e90-bcb3-f999744b48a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:07:05.933343 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 926/1865] 10.222.0.59 () {58 vars in 1018 bytes} [Thu Jun 2 16:07:05 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 16:07:05.934250 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68fce40e-5d6c-47ec-b278-ae2bea48a910 None None] Authenticating user token {{(pid=80396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:07:05.935968 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.fernet_utils [None req-68fce40e-5d6c-47ec-b278-ae2bea48a910 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:07:05.938910 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 940/1866] 10.222.0.59 () {58 vars in 957 bytes} [Thu Jun 2 16:07:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 16:07:05.952620 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb280ed7-e9bb-4e90-bcb3-f999744b48a7 None None] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:07:05.954353 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.fernet_utils [None req-cb280ed7-e9bb-4e90-bcb3-f999744b48a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:07:05.962441 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writing DB stats keystone:SELECT=84,keystone:DELETE=15,keystone:INSERT=1 {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 16:07:06.028067 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68fce40e-5d6c-47ec-b278-ae2bea48a910 None None] Validating token access rules against request {{(pid=80396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:07:06.033716 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04a58dac-215e-4862-887b-bd47eaf80e6b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9af40ddfe9ff4be3887b068f13a28dc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c87c981909d4b8db02783421818c79b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:07:06.034432 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a58dac-215e-4862-887b-bd47eaf80e6b service neutron] REQUEST_METHOD: `GET` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:07:06.035245 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a58dac-215e-4862-887b-bd47eaf80e6b service neutron] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:07:06.035633 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a58dac-215e-4862-887b-bd47eaf80e6b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:07:06.051999 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04a58dac-215e-4862-887b-bd47eaf80e6b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:07:06.054019 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04a58dac-215e-4862-887b-bd47eaf80e6b service neutron] RBAC: Authorization granted {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:07:06.075699 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 927/1867] 10.222.0.59 () {60 vars in 1365 bytes} [Thu Jun 2 16:07:05 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 135 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 16:07:06.075699 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04a58dac-215e-4862-887b-bd47eaf80e6b service neutron] Authenticating user token {{(pid=80396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:07:06.075699 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.fernet_utils [None req-04a58dac-215e-4862-887b-bd47eaf80e6b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:07:06.086104 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb280ed7-e9bb-4e90-bcb3-f999744b48a7 None None] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:07:06.096974 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21728dbb-f4b6-4e78-bccb-836cca43ddc4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9af40ddfe9ff4be3887b068f13a28dc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c87c981909d4b8db02783421818c79b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:07:06.098609 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21728dbb-f4b6-4e78-bccb-836cca43ddc4 service neutron] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:07:06.098864 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21728dbb-f4b6-4e78-bccb-836cca43ddc4 service neutron] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:07:06.100261 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21728dbb-f4b6-4e78-bccb-836cca43ddc4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:07:06.106290 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04a58dac-215e-4862-887b-bd47eaf80e6b service neutron] Validating token access rules against request {{(pid=80396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:07:06.118978 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-023661bf-0069-4ab3-a9a9-5c1ee0c9ef52 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52f9fe4b13574516bb0a8e2aa11a61e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c87c981909d4b8db02783421818c79b', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:07:06.124690 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-023661bf-0069-4ab3-a9a9-5c1ee0c9ef52 service nova] REQUEST_METHOD: `GET` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:07:06.125456 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-023661bf-0069-4ab3-a9a9-5c1ee0c9ef52 service nova] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:07:06.125928 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-023661bf-0069-4ab3-a9a9-5c1ee0c9ef52 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:07:06.128096 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21728dbb-f4b6-4e78-bccb-836cca43ddc4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:07:06.129524 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21728dbb-f4b6-4e78-bccb-836cca43ddc4 service neutron] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:07:06.141236 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-023661bf-0069-4ab3-a9a9-5c1ee0c9ef52 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:07:06.143510 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-023661bf-0069-4ab3-a9a9-5c1ee0c9ef52 service nova] RBAC: Authorization granted {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:07:06.156889 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 941/1868] 10.222.0.59 () {60 vars in 1365 bytes} [Thu Jun 2 16:07:05 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 205 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 16:07:06.157771 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21728dbb-f4b6-4e78-bccb-836cca43ddc4 service neutron] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:07:06.160729 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 928/1869] 10.222.0.59 () {60 vars in 1365 bytes} [Thu Jun 2 16:07:06 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 16:07:06.172594 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.fernet_utils [None req-21728dbb-f4b6-4e78-bccb-836cca43ddc4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:07:06.209092 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21728dbb-f4b6-4e78-bccb-836cca43ddc4 service neutron] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:07:06.223482 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9129ca5-087a-48f1-a40f-80da8f11e4fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f73d5a98be74242b45222df39fb6213', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:07:06.224468 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9129ca5-087a-48f1-a40f-80da8f11e4fc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:07:06.224753 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9129ca5-087a-48f1-a40f-80da8f11e4fc admin admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:07:06.225030 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9129ca5-087a-48f1-a40f-80da8f11e4fc admin admin] PATH_INFO: `/v3/users/4d5b7e18b655438f94156d4cc432fc32` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:07:06.226376 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9129ca5-087a-48f1-a40f-80da8f11e4fc admin admin] RBAC: Authorizing `identity:delete_user(user_id=4d5b7e18b655438f94156d4cc432fc32)` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:07:06.229397 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9129ca5-087a-48f1-a40f-80da8f11e4fc admin admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:07:06.475242 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.notifications [None req-e9129ca5-087a-48f1-a40f-80da8f11e4fc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4d5b7e18b655438f94156d4cc432fc32'} {{(pid=80395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:07:06.487531 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-023661bf-0069-4ab3-a9a9-5c1ee0c9ef52 service nova] Authenticating user token {{(pid=80396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:07:06.489089 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.fernet_utils [None req-023661bf-0069-4ab3-a9a9-5c1ee0c9ef52 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:07:06.515466 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-023661bf-0069-4ab3-a9a9-5c1ee0c9ef52 service nova] Validating token access rules against request {{(pid=80396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:07:06.534413 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53af449c-fede-40a6-bf39-48a56abdff5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f73d5a98be74242b45222df39fb6213', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:07:06.534413 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53af449c-fede-40a6-bf39-48a56abdff5f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:07:06.534413 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53af449c-fede-40a6-bf39-48a56abdff5f admin admin] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:07:06.534413 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53af449c-fede-40a6-bf39-48a56abdff5f admin admin] PATH_INFO: `/v3/users/c6d602ddb7ce4a61b7d3a7a966fe681f` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:07:06.534848 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53af449c-fede-40a6-bf39-48a56abdff5f admin admin] RBAC: Authorizing `identity:delete_user(user_id=c6d602ddb7ce4a61b7d3a7a966fe681f)` {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:07:06.537912 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53af449c-fede-40a6-bf39-48a56abdff5f admin admin] RBAC: Authorization granted {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:07:06.589034 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.notifications [None req-e9129ca5-087a-48f1-a40f-80da8f11e4fc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4d5b7e18b655438f94156d4cc432fc32'} {{(pid=80395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:07:06.612556 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.notifications [None req-e9129ca5-087a-48f1-a40f-80da8f11e4fc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4d5b7e18b655438f94156d4cc432fc32'} {{(pid=80395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:07:06.621883 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.notifications [None req-e9129ca5-087a-48f1-a40f-80da8f11e4fc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4d5b7e18b655438f94156d4cc432fc32'} {{(pid=80395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:07:06.630624 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.notifications [None req-e9129ca5-087a-48f1-a40f-80da8f11e4fc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4d5b7e18b655438f94156d4cc432fc32'} {{(pid=80395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:07:06.660630 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 942/1870] 10.222.0.59 () {58 vars in 1223 bytes} [Thu Jun 2 16:07:06 2022] DELETE /identity/v3/users/4d5b7e18b655438f94156d4cc432fc32 => generated 0 bytes in 503 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 16:07:06.665960 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ed4505-bd8d-41db-9a52-31ed002867d9 None None] REQUEST_METHOD: `POST` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:07:06.666301 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ed4505-bd8d-41db-9a52-31ed002867d9 None None] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:07:06.666591 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ed4505-bd8d-41db-9a52-31ed002867d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:07:06.702548 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.auth.core [None req-a1ed4505-bd8d-41db-9a52-31ed002867d9 None None] MFA Rules not processed for user `400d1f4db9de49638549e5db29a041e1`. Rule list: `[]` (Enabled: `True`). {{(pid=80395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 16:07:06.705227 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.fernet_utils [None req-a1ed4505-bd8d-41db-9a52-31ed002867d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:07:06.802204 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 943/1871] 10.222.0.59 () {58 vars in 957 bytes} [Thu Jun 2 16:07:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 16:07:06.844615 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1ed4505-bd8d-41db-9a52-31ed002867d9 None None] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:07:06.846412 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.fernet_utils [None req-a1ed4505-bd8d-41db-9a52-31ed002867d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:07:06.922364 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1ed4505-bd8d-41db-9a52-31ed002867d9 None None] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:07:06.928349 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a61c6f9-1459-41bf-b61e-f8d506d375db service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9af40ddfe9ff4be3887b068f13a28dc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c87c981909d4b8db02783421818c79b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:07:06.928349 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a61c6f9-1459-41bf-b61e-f8d506d375db service neutron] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:07:06.929377 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a61c6f9-1459-41bf-b61e-f8d506d375db service neutron] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:07:06.930627 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a61c6f9-1459-41bf-b61e-f8d506d375db service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:07:06.954568 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a61c6f9-1459-41bf-b61e-f8d506d375db service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:07:06.956568 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a61c6f9-1459-41bf-b61e-f8d506d375db service neutron] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:07:06.969852 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 944/1872] 10.222.0.59 () {60 vars in 1365 bytes} [Thu Jun 2 16:07:06 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 126 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 16:07:06.985534 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.notifications [None req-53af449c-fede-40a6-bf39-48a56abdff5f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c6d602ddb7ce4a61b7d3a7a966fe681f'} {{(pid=80396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:07:06.986377 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.notifications [None req-53af449c-fede-40a6-bf39-48a56abdff5f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c6d602ddb7ce4a61b7d3a7a966fe681f'} {{(pid=80396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:07:07.099327 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a61c6f9-1459-41bf-b61e-f8d506d375db service neutron] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:07:07.099327 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.fernet_utils [None req-3a61c6f9-1459-41bf-b61e-f8d506d375db service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:07:07.113455 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a61c6f9-1459-41bf-b61e-f8d506d375db service neutron] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:07:07.126646 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-381d8af3-90fb-4384-beb4-2fbeb979f102 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f73d5a98be74242b45222df39fb6213', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:07:07.127692 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381d8af3-90fb-4384-beb4-2fbeb979f102 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:07:07.127977 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381d8af3-90fb-4384-beb4-2fbeb979f102 admin admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:07:07.128260 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381d8af3-90fb-4384-beb4-2fbeb979f102 admin admin] PATH_INFO: `/v3/projects/316964edcf214913a1a97233baf85663` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:07:07.130333 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-381d8af3-90fb-4384-beb4-2fbeb979f102 admin admin] RBAC: Authorizing `identity:delete_project(project_id=316964edcf214913a1a97233baf85663)` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:07:07.132426 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-381d8af3-90fb-4384-beb4-2fbeb979f102 admin admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:07:07.132539 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.notifications [None req-53af449c-fede-40a6-bf39-48a56abdff5f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c6d602ddb7ce4a61b7d3a7a966fe681f'} {{(pid=80396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:07:07.154209 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.notifications [None req-53af449c-fede-40a6-bf39-48a56abdff5f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c6d602ddb7ce4a61b7d3a7a966fe681f'} {{(pid=80396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:07:07.179071 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.notifications [None req-53af449c-fede-40a6-bf39-48a56abdff5f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c6d602ddb7ce4a61b7d3a7a966fe681f'} {{(pid=80396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:07:07.198995 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 929/1873] 10.222.0.59 () {58 vars in 1223 bytes} [Thu Jun 2 16:07:06 2022] DELETE /identity/v3/users/c6d602ddb7ce4a61b7d3a7a966fe681f => generated 0 bytes in 712 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 02 16:07:07.200105 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53af449c-fede-40a6-bf39-48a56abdff5f admin admin] Authenticating user token {{(pid=80396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:07:07.203423 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.fernet_utils [None req-53af449c-fede-40a6-bf39-48a56abdff5f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:07:07.298393 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53af449c-fede-40a6-bf39-48a56abdff5f admin admin] Validating token access rules against request {{(pid=80396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:07:07.327235 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.notifications [None req-381d8af3-90fb-4384-beb4-2fbeb979f102 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '316964edcf214913a1a97233baf85663', 'request_id': 'req-381d8af3-90fb-4384-beb4-2fbeb979f102'} {{(pid=80395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:07:07.343692 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.notifications [None req-381d8af3-90fb-4384-beb4-2fbeb979f102 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '316964edcf214913a1a97233baf85663', 'request_id': 'req-381d8af3-90fb-4384-beb4-2fbeb979f102'} {{(pid=80395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:07:07.380167 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbb55c01-30d6-4a96-9027-8aa9301f2be7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f73d5a98be74242b45222df39fb6213', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:07:07.381098 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb55c01-30d6-4a96-9027-8aa9301f2be7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:07:07.381517 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb55c01-30d6-4a96-9027-8aa9301f2be7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:07:07.381714 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb55c01-30d6-4a96-9027-8aa9301f2be7 admin admin] PATH_INFO: `/v3/projects/bcbf991d931946138cfa385d149af8c3` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:07:07.382958 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbb55c01-30d6-4a96-9027-8aa9301f2be7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bcbf991d931946138cfa385d149af8c3)` {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:07:07.385265 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbb55c01-30d6-4a96-9027-8aa9301f2be7 admin admin] RBAC: Authorization granted {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:07:07.488897 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.notifications [None req-381d8af3-90fb-4384-beb4-2fbeb979f102 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '316964edcf214913a1a97233baf85663', 'request_id': 'req-381d8af3-90fb-4384-beb4-2fbeb979f102'} {{(pid=80395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:07:07.506242 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.notifications [None req-381d8af3-90fb-4384-beb4-2fbeb979f102 admin admin] The token cache is being invalidate because project 316964edcf214913a1a97233baf85663 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80395) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 02 16:07:07.506928 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.notifications [None req-381d8af3-90fb-4384-beb4-2fbeb979f102 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:07:07.507631 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.notifications [None req-381d8af3-90fb-4384-beb4-2fbeb979f102 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:07:07.512851 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 945/1874] 10.222.0.59 () {58 vars in 1232 bytes} [Thu Jun 2 16:07:07 2022] DELETE /identity/v3/projects/316964edcf214913a1a97233baf85663 => generated 0 bytes in 424 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 16:07:07.512851 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc33440d-3869-4910-8ecb-67384480342e None None] REQUEST_METHOD: `POST` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:07:07.512851 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc33440d-3869-4910-8ecb-67384480342e None None] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:07:07.512851 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc33440d-3869-4910-8ecb-67384480342e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:07:07.558843 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.notifications [None req-dbb55c01-30d6-4a96-9027-8aa9301f2be7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bcbf991d931946138cfa385d149af8c3', 'request_id': 'req-dbb55c01-30d6-4a96-9027-8aa9301f2be7'} {{(pid=80396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:07:07.561552 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.auth.core [None req-cc33440d-3869-4910-8ecb-67384480342e None None] MFA Rules not processed for user `400d1f4db9de49638549e5db29a041e1`. Rule list: `[]` (Enabled: `True`). {{(pid=80395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 16:07:07.564628 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.fernet_utils [None req-cc33440d-3869-4910-8ecb-67384480342e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:07:07.574489 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.notifications [None req-dbb55c01-30d6-4a96-9027-8aa9301f2be7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bcbf991d931946138cfa385d149af8c3', 'request_id': 'req-dbb55c01-30d6-4a96-9027-8aa9301f2be7'} {{(pid=80396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:07:07.675078 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 946/1875] 10.222.0.59 () {58 vars in 957 bytes} [Thu Jun 2 16:07:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 16:07:07.676140 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc33440d-3869-4910-8ecb-67384480342e None None] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:07:07.677533 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.fernet_utils [None req-cc33440d-3869-4910-8ecb-67384480342e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:07:07.683772 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.notifications [None req-dbb55c01-30d6-4a96-9027-8aa9301f2be7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bcbf991d931946138cfa385d149af8c3', 'request_id': 'req-dbb55c01-30d6-4a96-9027-8aa9301f2be7'} {{(pid=80396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:07:07.691733 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc33440d-3869-4910-8ecb-67384480342e None None] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:07:07.699171 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc300b12-3d09-4571-b147-dd5d769b8e8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f73d5a98be74242b45222df39fb6213', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:07:07.700352 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc300b12-3d09-4571-b147-dd5d769b8e8a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:07:07.700720 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc300b12-3d09-4571-b147-dd5d769b8e8a admin admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:07:07.701221 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc300b12-3d09-4571-b147-dd5d769b8e8a admin admin] PATH_INFO: `/v3/users/f5ba157550304933843facc749046dcc` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:07:07.702713 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc300b12-3d09-4571-b147-dd5d769b8e8a admin admin] RBAC: Authorizing `identity:delete_user(user_id=f5ba157550304933843facc749046dcc)` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:07:07.703018 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG dbcounter [-] [80396] Writing DB stats keystone:SELECT=93,keystone:DELETE=6,keystone:INSERT=1 {{(pid=80396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 16:07:07.704927 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc300b12-3d09-4571-b147-dd5d769b8e8a admin admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:07:07.706514 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.notifications [None req-dbb55c01-30d6-4a96-9027-8aa9301f2be7 admin admin] The token cache is being invalidate because project bcbf991d931946138cfa385d149af8c3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80396) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 02 16:07:07.707628 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.notifications [None req-dbb55c01-30d6-4a96-9027-8aa9301f2be7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:07:07.710713 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.notifications [None req-dbb55c01-30d6-4a96-9027-8aa9301f2be7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:07:07.715667 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 930/1876] 10.222.0.59 () {58 vars in 1232 bytes} [Thu Jun 2 16:07:07 2022] DELETE /identity/v3/projects/bcbf991d931946138cfa385d149af8c3 => generated 0 bytes in 516 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 16:07:07.720252 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbb55c01-30d6-4a96-9027-8aa9301f2be7 admin admin] Authenticating user token {{(pid=80396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:07:07.721843 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.fernet_utils [None req-dbb55c01-30d6-4a96-9027-8aa9301f2be7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:07:07.795742 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbb55c01-30d6-4a96-9027-8aa9301f2be7 admin admin] Validating token access rules against request {{(pid=80396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:07:07.799493 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3caf87c-ae24-493c-b68f-b52bf91142e7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9af40ddfe9ff4be3887b068f13a28dc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c87c981909d4b8db02783421818c79b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:07:07.800164 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3caf87c-ae24-493c-b68f-b52bf91142e7 service neutron] REQUEST_METHOD: `GET` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:07:07.800450 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3caf87c-ae24-493c-b68f-b52bf91142e7 service neutron] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:07:07.800726 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3caf87c-ae24-493c-b68f-b52bf91142e7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:07:07.802559 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.fernet_utils [None req-b3caf87c-ae24-493c-b68f-b52bf91142e7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:07:07.814232 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3caf87c-ae24-493c-b68f-b52bf91142e7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:07:07.815637 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3caf87c-ae24-493c-b68f-b52bf91142e7 service neutron] RBAC: Authorization granted {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:07:07.824900 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 931/1877] 10.222.0.59 () {60 vars in 1365 bytes} [Thu Jun 2 16:07:07 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 16:07:07.825670 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3caf87c-ae24-493c-b68f-b52bf91142e7 service neutron] Authenticating user token {{(pid=80396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:07:07.826896 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.fernet_utils [None req-b3caf87c-ae24-493c-b68f-b52bf91142e7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:07:07.841972 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3caf87c-ae24-493c-b68f-b52bf91142e7 service neutron] Validating token access rules against request {{(pid=80396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:07:07.846992 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cff9ece-a5f8-4644-9f0c-c5e621078f23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f73d5a98be74242b45222df39fb6213', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:07:07.848127 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cff9ece-a5f8-4644-9f0c-c5e621078f23 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:07:07.848747 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cff9ece-a5f8-4644-9f0c-c5e621078f23 admin admin] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:07:07.848747 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cff9ece-a5f8-4644-9f0c-c5e621078f23 admin admin] PATH_INFO: `/v3/users/9e28ca53978e401a8b1a39099e574f22` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:07:07.849944 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cff9ece-a5f8-4644-9f0c-c5e621078f23 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9e28ca53978e401a8b1a39099e574f22)` {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:07:07.851876 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cff9ece-a5f8-4644-9f0c-c5e621078f23 admin admin] RBAC: Authorization granted {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:07:07.991444 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.notifications [None req-fc300b12-3d09-4571-b147-dd5d769b8e8a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f5ba157550304933843facc749046dcc'} {{(pid=80395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:07:08.131619 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.notifications [None req-fc300b12-3d09-4571-b147-dd5d769b8e8a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f5ba157550304933843facc749046dcc'} {{(pid=80395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:07:08.151580 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.notifications [None req-fc300b12-3d09-4571-b147-dd5d769b8e8a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f5ba157550304933843facc749046dcc'} {{(pid=80395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:07:08.152511 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.notifications [None req-fc300b12-3d09-4571-b147-dd5d769b8e8a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f5ba157550304933843facc749046dcc'} {{(pid=80395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:07:08.159475 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.notifications [None req-fc300b12-3d09-4571-b147-dd5d769b8e8a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f5ba157550304933843facc749046dcc'} {{(pid=80395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:07:08.166935 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 947/1878] 10.222.0.59 () {58 vars in 1223 bytes} [Thu Jun 2 16:07:07 2022] DELETE /identity/v3/users/f5ba157550304933843facc749046dcc => generated 0 bytes in 491 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 16:07:08.168781 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc300b12-3d09-4571-b147-dd5d769b8e8a admin admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:07:08.172744 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.fernet_utils [None req-fc300b12-3d09-4571-b147-dd5d769b8e8a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:07:08.222689 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.notifications [None req-6cff9ece-a5f8-4644-9f0c-c5e621078f23 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9e28ca53978e401a8b1a39099e574f22'} {{(pid=80396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:07:08.223020 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.notifications [None req-6cff9ece-a5f8-4644-9f0c-c5e621078f23 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9e28ca53978e401a8b1a39099e574f22'} {{(pid=80396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:07:08.273013 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc300b12-3d09-4571-b147-dd5d769b8e8a admin admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:07:08.279301 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-129a6706-e02b-46c6-8432-023f39cc0180 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f73d5a98be74242b45222df39fb6213', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:07:08.280213 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-129a6706-e02b-46c6-8432-023f39cc0180 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:07:08.280490 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-129a6706-e02b-46c6-8432-023f39cc0180 admin admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:07:08.280771 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-129a6706-e02b-46c6-8432-023f39cc0180 admin admin] PATH_INFO: `/v3/projects/b098d8d6d04e4c1d917eb5413041d2d8` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:07:08.281974 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-129a6706-e02b-46c6-8432-023f39cc0180 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b098d8d6d04e4c1d917eb5413041d2d8)` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:07:08.284048 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-129a6706-e02b-46c6-8432-023f39cc0180 admin admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:07:08.301019 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.notifications [None req-6cff9ece-a5f8-4644-9f0c-c5e621078f23 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9e28ca53978e401a8b1a39099e574f22'} {{(pid=80396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:07:08.315076 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.notifications [None req-6cff9ece-a5f8-4644-9f0c-c5e621078f23 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9e28ca53978e401a8b1a39099e574f22'} {{(pid=80396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:07:08.322324 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.notifications [None req-6cff9ece-a5f8-4644-9f0c-c5e621078f23 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9e28ca53978e401a8b1a39099e574f22'} {{(pid=80396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:07:08.328338 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 932/1879] 10.222.0.59 () {58 vars in 1223 bytes} [Thu Jun 2 16:07:07 2022] DELETE /identity/v3/users/9e28ca53978e401a8b1a39099e574f22 => generated 0 bytes in 503 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 16:07:08.402260 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cff9ece-a5f8-4644-9f0c-c5e621078f23 admin admin] Authenticating user token {{(pid=80396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:07:08.404100 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.fernet_utils [None req-6cff9ece-a5f8-4644-9f0c-c5e621078f23 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:07:08.490798 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.notifications [None req-129a6706-e02b-46c6-8432-023f39cc0180 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b098d8d6d04e4c1d917eb5413041d2d8', 'request_id': 'req-129a6706-e02b-46c6-8432-023f39cc0180'} {{(pid=80395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:07:08.499761 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.notifications [None req-129a6706-e02b-46c6-8432-023f39cc0180 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b098d8d6d04e4c1d917eb5413041d2d8', 'request_id': 'req-129a6706-e02b-46c6-8432-023f39cc0180'} {{(pid=80395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:07:08.543531 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cff9ece-a5f8-4644-9f0c-c5e621078f23 admin admin] Validating token access rules against request {{(pid=80396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:07:08.610943 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.notifications [None req-129a6706-e02b-46c6-8432-023f39cc0180 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b098d8d6d04e4c1d917eb5413041d2d8', 'request_id': 'req-129a6706-e02b-46c6-8432-023f39cc0180'} {{(pid=80395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:07:08.632473 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.notifications [None req-129a6706-e02b-46c6-8432-023f39cc0180 admin admin] The token cache is being invalidate because project b098d8d6d04e4c1d917eb5413041d2d8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80395) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 02 16:07:08.632768 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.notifications [None req-129a6706-e02b-46c6-8432-023f39cc0180 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:07:08.634002 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.notifications [None req-129a6706-e02b-46c6-8432-023f39cc0180 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:07:08.635850 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 948/1880] 10.222.0.59 () {58 vars in 1232 bytes} [Thu Jun 2 16:07:08 2022] DELETE /identity/v3/projects/b098d8d6d04e4c1d917eb5413041d2d8 => generated 0 bytes in 468 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 16:07:08.639718 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-129a6706-e02b-46c6-8432-023f39cc0180 admin admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:07:08.651236 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.fernet_utils [None req-129a6706-e02b-46c6-8432-023f39cc0180 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:07:08.657144 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-275d12c0-9fe9-42b2-9f3d-3d52df3861ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f73d5a98be74242b45222df39fb6213', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:07:08.662993 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-275d12c0-9fe9-42b2-9f3d-3d52df3861ba admin admin] REQUEST_METHOD: `DELETE` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:07:08.662993 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-275d12c0-9fe9-42b2-9f3d-3d52df3861ba admin admin] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:07:08.662993 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-275d12c0-9fe9-42b2-9f3d-3d52df3861ba admin admin] PATH_INFO: `/v3/projects/897ecb110cdc46ad96162d8dc311fc24` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:07:08.662993 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-275d12c0-9fe9-42b2-9f3d-3d52df3861ba admin admin] RBAC: Authorizing `identity:delete_project(project_id=897ecb110cdc46ad96162d8dc311fc24)` {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:07:08.664788 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-275d12c0-9fe9-42b2-9f3d-3d52df3861ba admin admin] RBAC: Authorization granted {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:07:08.675417 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-129a6706-e02b-46c6-8432-023f39cc0180 admin admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:07:08.681482 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7291a074-183f-4460-a761-b44155f7eee6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f73d5a98be74242b45222df39fb6213', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:07:08.682566 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7291a074-183f-4460-a761-b44155f7eee6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:07:08.682925 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7291a074-183f-4460-a761-b44155f7eee6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:07:08.683256 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7291a074-183f-4460-a761-b44155f7eee6 admin admin] PATH_INFO: `/v3/users/b16c63eaf0384c4f9fe6fbdf3de557e5` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:07:08.685702 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7291a074-183f-4460-a761-b44155f7eee6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b16c63eaf0384c4f9fe6fbdf3de557e5)` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:07:08.690046 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7291a074-183f-4460-a761-b44155f7eee6 admin admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:07:09.085342 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.notifications [None req-7291a074-183f-4460-a761-b44155f7eee6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b16c63eaf0384c4f9fe6fbdf3de557e5'} {{(pid=80395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:07:09.087299 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.notifications [None req-275d12c0-9fe9-42b2-9f3d-3d52df3861ba admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '897ecb110cdc46ad96162d8dc311fc24', 'request_id': 'req-275d12c0-9fe9-42b2-9f3d-3d52df3861ba'} {{(pid=80396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:07:09.094030 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.notifications [None req-275d12c0-9fe9-42b2-9f3d-3d52df3861ba admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '897ecb110cdc46ad96162d8dc311fc24', 'request_id': 'req-275d12c0-9fe9-42b2-9f3d-3d52df3861ba'} {{(pid=80396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:07:09.223088 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.notifications [None req-7291a074-183f-4460-a761-b44155f7eee6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b16c63eaf0384c4f9fe6fbdf3de557e5'} {{(pid=80395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:07:09.239760 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.notifications [None req-7291a074-183f-4460-a761-b44155f7eee6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b16c63eaf0384c4f9fe6fbdf3de557e5'} {{(pid=80395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:07:09.240638 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.notifications [None req-7291a074-183f-4460-a761-b44155f7eee6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b16c63eaf0384c4f9fe6fbdf3de557e5'} {{(pid=80395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:07:09.249328 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.notifications [None req-7291a074-183f-4460-a761-b44155f7eee6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b16c63eaf0384c4f9fe6fbdf3de557e5'} {{(pid=80395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:07:09.256385 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 949/1881] 10.222.0.59 () {58 vars in 1223 bytes} [Thu Jun 2 16:07:08 2022] DELETE /identity/v3/users/b16c63eaf0384c4f9fe6fbdf3de557e5 => generated 0 bytes in 617 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 16:07:09.257746 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7291a074-183f-4460-a761-b44155f7eee6 admin admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:07:09.259704 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.fernet_utils [None req-7291a074-183f-4460-a761-b44155f7eee6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:07:09.292724 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.notifications [None req-275d12c0-9fe9-42b2-9f3d-3d52df3861ba admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '897ecb110cdc46ad96162d8dc311fc24', 'request_id': 'req-275d12c0-9fe9-42b2-9f3d-3d52df3861ba'} {{(pid=80396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:07:09.308586 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.notifications [None req-275d12c0-9fe9-42b2-9f3d-3d52df3861ba admin admin] The token cache is being invalidate because project 897ecb110cdc46ad96162d8dc311fc24 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80396) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 02 16:07:09.311445 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.notifications [None req-275d12c0-9fe9-42b2-9f3d-3d52df3861ba admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:07:09.313883 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.notifications [None req-275d12c0-9fe9-42b2-9f3d-3d52df3861ba admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:07:09.317671 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 933/1882] 10.222.0.59 () {58 vars in 1232 bytes} [Thu Jun 2 16:07:08 2022] DELETE /identity/v3/projects/897ecb110cdc46ad96162d8dc311fc24 => generated 0 bytes in 916 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 02 16:07:09.319634 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-275d12c0-9fe9-42b2-9f3d-3d52df3861ba admin admin] Authenticating user token {{(pid=80396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:07:09.322884 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.fernet_utils [None req-275d12c0-9fe9-42b2-9f3d-3d52df3861ba admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:07:09.339956 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7291a074-183f-4460-a761-b44155f7eee6 admin admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:07:09.345902 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d751338d-78b8-4634-845e-354fe41fbf3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f73d5a98be74242b45222df39fb6213', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:07:09.346860 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d751338d-78b8-4634-845e-354fe41fbf3c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:07:09.347141 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d751338d-78b8-4634-845e-354fe41fbf3c admin admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:07:09.347415 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d751338d-78b8-4634-845e-354fe41fbf3c admin admin] PATH_INFO: `/v3/projects/9fc7c1ceea434df3a17b67ee101d89b4` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:07:09.348612 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d751338d-78b8-4634-845e-354fe41fbf3c admin admin] RBAC: Authorizing `identity:delete_project(project_id=9fc7c1ceea434df3a17b67ee101d89b4)` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:07:09.350590 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d751338d-78b8-4634-845e-354fe41fbf3c admin admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:07:09.404269 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-275d12c0-9fe9-42b2-9f3d-3d52df3861ba admin admin] Validating token access rules against request {{(pid=80396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:07:09.409019 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd1ef79c-5fd5-41f7-a29c-46f635966a2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f73d5a98be74242b45222df39fb6213', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:07:09.409885 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd1ef79c-5fd5-41f7-a29c-46f635966a2c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:07:09.410200 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd1ef79c-5fd5-41f7-a29c-46f635966a2c admin admin] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:07:09.410471 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd1ef79c-5fd5-41f7-a29c-46f635966a2c admin admin] PATH_INFO: `/v3/projects/54888e6d059a44198834d00d62020eba` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:07:09.411749 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd1ef79c-5fd5-41f7-a29c-46f635966a2c admin admin] RBAC: Authorizing `identity:delete_project(project_id=54888e6d059a44198834d00d62020eba)` {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:07:09.413754 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd1ef79c-5fd5-41f7-a29c-46f635966a2c admin admin] RBAC: Authorization granted {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:07:09.563134 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.notifications [None req-d751338d-78b8-4634-845e-354fe41fbf3c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9fc7c1ceea434df3a17b67ee101d89b4', 'request_id': 'req-d751338d-78b8-4634-845e-354fe41fbf3c'} {{(pid=80395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:07:09.570459 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.notifications [None req-fd1ef79c-5fd5-41f7-a29c-46f635966a2c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '54888e6d059a44198834d00d62020eba', 'request_id': 'req-fd1ef79c-5fd5-41f7-a29c-46f635966a2c'} {{(pid=80396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:07:09.571755 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.notifications [None req-d751338d-78b8-4634-845e-354fe41fbf3c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9fc7c1ceea434df3a17b67ee101d89b4', 'request_id': 'req-d751338d-78b8-4634-845e-354fe41fbf3c'} {{(pid=80395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:07:09.588109 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.notifications [None req-fd1ef79c-5fd5-41f7-a29c-46f635966a2c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '54888e6d059a44198834d00d62020eba', 'request_id': 'req-fd1ef79c-5fd5-41f7-a29c-46f635966a2c'} {{(pid=80396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:07:09.617092 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writing DB stats keystone:DELETE=5,keystone:SELECT=91,keystone:INSERT=4 {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 16:07:09.652373 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.notifications [None req-d751338d-78b8-4634-845e-354fe41fbf3c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9fc7c1ceea434df3a17b67ee101d89b4', 'request_id': 'req-d751338d-78b8-4634-845e-354fe41fbf3c'} {{(pid=80395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:07:09.665811 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.notifications [None req-d751338d-78b8-4634-845e-354fe41fbf3c admin admin] The token cache is being invalidate because project 9fc7c1ceea434df3a17b67ee101d89b4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80395) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 02 16:07:09.666288 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.notifications [None req-d751338d-78b8-4634-845e-354fe41fbf3c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:07:09.667039 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.notifications [None req-d751338d-78b8-4634-845e-354fe41fbf3c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:07:09.671559 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 950/1883] 10.222.0.59 () {58 vars in 1232 bytes} [Thu Jun 2 16:07:09 2022] DELETE /identity/v3/projects/9fc7c1ceea434df3a17b67ee101d89b4 => generated 0 bytes in 412 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 16:07:09.671559 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d751338d-78b8-4634-845e-354fe41fbf3c admin admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:07:09.671559 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.fernet_utils [None req-d751338d-78b8-4634-845e-354fe41fbf3c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:07:09.719963 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.notifications [None req-fd1ef79c-5fd5-41f7-a29c-46f635966a2c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '54888e6d059a44198834d00d62020eba', 'request_id': 'req-fd1ef79c-5fd5-41f7-a29c-46f635966a2c'} {{(pid=80396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:07:09.731955 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.notifications [None req-fd1ef79c-5fd5-41f7-a29c-46f635966a2c admin admin] The token cache is being invalidate because project 54888e6d059a44198834d00d62020eba was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80396) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 02 16:07:09.732252 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.notifications [None req-fd1ef79c-5fd5-41f7-a29c-46f635966a2c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:07:09.732919 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.notifications [None req-fd1ef79c-5fd5-41f7-a29c-46f635966a2c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:07:09.734602 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 934/1884] 10.222.0.59 () {58 vars in 1232 bytes} [Thu Jun 2 16:07:09 2022] DELETE /identity/v3/projects/54888e6d059a44198834d00d62020eba => generated 0 bytes in 417 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 16:07:09.735445 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd1ef79c-5fd5-41f7-a29c-46f635966a2c admin admin] Authenticating user token {{(pid=80396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:07:09.736736 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.fernet_utils [None req-fd1ef79c-5fd5-41f7-a29c-46f635966a2c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:07:09.741020 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d751338d-78b8-4634-845e-354fe41fbf3c admin admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:07:09.746001 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0aced81-18f5-4d84-8fea-fc2a9229c849 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f73d5a98be74242b45222df39fb6213', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:07:09.747037 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0aced81-18f5-4d84-8fea-fc2a9229c849 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:07:09.747393 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0aced81-18f5-4d84-8fea-fc2a9229c849 admin admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:07:09.747668 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0aced81-18f5-4d84-8fea-fc2a9229c849 admin admin] PATH_INFO: `/v3/users/798cb23117a14419920d2d9bd9bb1cf2` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:07:09.748863 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0aced81-18f5-4d84-8fea-fc2a9229c849 admin admin] RBAC: Authorizing `identity:delete_user(user_id=798cb23117a14419920d2d9bd9bb1cf2)` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:07:09.750837 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0aced81-18f5-4d84-8fea-fc2a9229c849 admin admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:07:09.806413 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd1ef79c-5fd5-41f7-a29c-46f635966a2c admin admin] Validating token access rules against request {{(pid=80396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:07:09.811261 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bd10066-5d7f-4dd8-a12e-9866d30fedf4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f73d5a98be74242b45222df39fb6213', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:07:09.812131 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd10066-5d7f-4dd8-a12e-9866d30fedf4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:07:09.812414 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd10066-5d7f-4dd8-a12e-9866d30fedf4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:07:09.812686 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd10066-5d7f-4dd8-a12e-9866d30fedf4 admin admin] PATH_INFO: `/v3/users/6e774faea506495c9c58c326e6b169d1` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:07:09.813908 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bd10066-5d7f-4dd8-a12e-9866d30fedf4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6e774faea506495c9c58c326e6b169d1)` {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:07:09.815846 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bd10066-5d7f-4dd8-a12e-9866d30fedf4 admin admin] RBAC: Authorization granted {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:07:10.029017 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.notifications [None req-f0aced81-18f5-4d84-8fea-fc2a9229c849 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '798cb23117a14419920d2d9bd9bb1cf2'} {{(pid=80395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:07:10.063148 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.notifications [None req-1bd10066-5d7f-4dd8-a12e-9866d30fedf4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6e774faea506495c9c58c326e6b169d1'} {{(pid=80396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:07:10.063793 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.notifications [None req-1bd10066-5d7f-4dd8-a12e-9866d30fedf4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6e774faea506495c9c58c326e6b169d1'} {{(pid=80396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:07:10.201399 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.notifications [None req-f0aced81-18f5-4d84-8fea-fc2a9229c849 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '798cb23117a14419920d2d9bd9bb1cf2'} {{(pid=80395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:07:10.214913 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.notifications [None req-f0aced81-18f5-4d84-8fea-fc2a9229c849 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '798cb23117a14419920d2d9bd9bb1cf2'} {{(pid=80395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:07:10.215606 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.notifications [None req-f0aced81-18f5-4d84-8fea-fc2a9229c849 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '798cb23117a14419920d2d9bd9bb1cf2'} {{(pid=80395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:07:10.222697 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.notifications [None req-f0aced81-18f5-4d84-8fea-fc2a9229c849 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '798cb23117a14419920d2d9bd9bb1cf2'} {{(pid=80395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:07:10.229391 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 951/1885] 10.222.0.59 () {58 vars in 1223 bytes} [Thu Jun 2 16:07:09 2022] DELETE /identity/v3/users/798cb23117a14419920d2d9bd9bb1cf2 => generated 0 bytes in 560 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 16:07:10.230545 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a4eecd-b6ce-450d-af86-eb9c83196bdd None None] REQUEST_METHOD: `POST` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:07:10.230828 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a4eecd-b6ce-450d-af86-eb9c83196bdd None None] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:07:10.231102 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a4eecd-b6ce-450d-af86-eb9c83196bdd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:07:10.250322 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.auth.core [None req-00a4eecd-b6ce-450d-af86-eb9c83196bdd None None] MFA Rules not processed for user `400d1f4db9de49638549e5db29a041e1`. Rule list: `[]` (Enabled: `True`). {{(pid=80395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 16:07:10.251520 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.fernet_utils [None req-00a4eecd-b6ce-450d-af86-eb9c83196bdd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:07:10.307894 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.notifications [None req-1bd10066-5d7f-4dd8-a12e-9866d30fedf4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6e774faea506495c9c58c326e6b169d1'} {{(pid=80396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:07:10.313042 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 952/1886] 10.222.0.59 () {58 vars in 957 bytes} [Thu Jun 2 16:07:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 16:07:10.314062 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00a4eecd-b6ce-450d-af86-eb9c83196bdd None None] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:07:10.318859 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.fernet_utils [None req-00a4eecd-b6ce-450d-af86-eb9c83196bdd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:07:10.328050 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.notifications [None req-1bd10066-5d7f-4dd8-a12e-9866d30fedf4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6e774faea506495c9c58c326e6b169d1'} {{(pid=80396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:07:10.328477 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00a4eecd-b6ce-450d-af86-eb9c83196bdd None None] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:07:10.333605 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f0cd50e-422b-4d82-acc3-6f735b0f8948 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f73d5a98be74242b45222df39fb6213', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:07:10.334507 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f0cd50e-422b-4d82-acc3-6f735b0f8948 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:07:10.334797 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f0cd50e-422b-4d82-acc3-6f735b0f8948 admin admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:07:10.335141 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f0cd50e-422b-4d82-acc3-6f735b0f8948 admin admin] PATH_INFO: `/v3/projects/a0a183f3387e493cb36461d91fbac245` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:07:10.335274 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.notifications [None req-1bd10066-5d7f-4dd8-a12e-9866d30fedf4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6e774faea506495c9c58c326e6b169d1'} {{(pid=80396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:07:10.337112 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f0cd50e-422b-4d82-acc3-6f735b0f8948 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a0a183f3387e493cb36461d91fbac245)` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:07:10.339071 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f0cd50e-422b-4d82-acc3-6f735b0f8948 admin admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:07:10.343716 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 935/1887] 10.222.0.59 () {58 vars in 1223 bytes} [Thu Jun 2 16:07:09 2022] DELETE /identity/v3/users/6e774faea506495c9c58c326e6b169d1 => generated 0 bytes in 608 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 16:07:10.344756 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebffad38-77b9-429d-a987-23d718e260e7 None None] REQUEST_METHOD: `POST` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:07:10.345038 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebffad38-77b9-429d-a987-23d718e260e7 None None] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:07:10.345317 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebffad38-77b9-429d-a987-23d718e260e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:07:10.367908 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.auth.core [None req-ebffad38-77b9-429d-a987-23d718e260e7 None None] MFA Rules not processed for user `400d1f4db9de49638549e5db29a041e1`. Rule list: `[]` (Enabled: `True`). {{(pid=80396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 16:07:10.369156 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.fernet_utils [None req-ebffad38-77b9-429d-a987-23d718e260e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:07:10.437783 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 936/1888] 10.222.0.59 () {58 vars in 957 bytes} [Thu Jun 2 16:07:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 16:07:10.442340 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebffad38-77b9-429d-a987-23d718e260e7 None None] Authenticating user token {{(pid=80396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:07:10.452571 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebffad38-77b9-429d-a987-23d718e260e7 None None] Validating token access rules against request {{(pid=80396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:07:10.457301 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd1f1e73-14cf-420a-b5fb-020bd4c20e76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f73d5a98be74242b45222df39fb6213', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:07:10.458267 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd1f1e73-14cf-420a-b5fb-020bd4c20e76 admin admin] REQUEST_METHOD: `GET` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:07:10.458561 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd1f1e73-14cf-420a-b5fb-020bd4c20e76 admin admin] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:07:10.458830 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd1f1e73-14cf-420a-b5fb-020bd4c20e76 admin admin] PATH_INFO: `/v3/domains` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:07:10.459592 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd1f1e73-14cf-420a-b5fb-020bd4c20e76 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80396) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 16:07:10.459895 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd1f1e73-14cf-420a-b5fb-020bd4c20e76 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:07:10.462284 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd1f1e73-14cf-420a-b5fb-020bd4c20e76 admin admin] RBAC: Authorization granted {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:07:10.478095 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 937/1889] 10.222.0.59 () {58 vars in 1152 bytes} [Thu Jun 2 16:07:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 16:07:10.478986 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd1f1e73-14cf-420a-b5fb-020bd4c20e76 admin admin] Authenticating user token {{(pid=80396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:07:10.488754 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd1f1e73-14cf-420a-b5fb-020bd4c20e76 admin admin] Validating token access rules against request {{(pid=80396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:07:10.510856 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.notifications [None req-3f0cd50e-422b-4d82-acc3-6f735b0f8948 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a0a183f3387e493cb36461d91fbac245', 'request_id': 'req-3f0cd50e-422b-4d82-acc3-6f735b0f8948'} {{(pid=80395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:07:10.521245 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.notifications [None req-3f0cd50e-422b-4d82-acc3-6f735b0f8948 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a0a183f3387e493cb36461d91fbac245', 'request_id': 'req-3f0cd50e-422b-4d82-acc3-6f735b0f8948'} {{(pid=80395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:07:10.558199 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce5ddf6d-d20f-4c79-9f23-b084f8f79a4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f73d5a98be74242b45222df39fb6213', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:07:10.558914 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce5ddf6d-d20f-4c79-9f23-b084f8f79a4a admin admin] REQUEST_METHOD: `POST` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:07:10.559277 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce5ddf6d-d20f-4c79-9f23-b084f8f79a4a admin admin] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:07:10.559652 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce5ddf6d-d20f-4c79-9f23-b084f8f79a4a admin admin] PATH_INFO: `/v3/projects` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:07:10.560455 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce5ddf6d-d20f-4c79-9f23-b084f8f79a4a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:07:10.562643 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce5ddf6d-d20f-4c79-9f23-b084f8f79a4a admin admin] RBAC: Authorization granted {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:07:10.661507 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.notifications [None req-3f0cd50e-422b-4d82-acc3-6f735b0f8948 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a0a183f3387e493cb36461d91fbac245', 'request_id': 'req-3f0cd50e-422b-4d82-acc3-6f735b0f8948'} {{(pid=80395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:07:10.679375 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.notifications [None req-3f0cd50e-422b-4d82-acc3-6f735b0f8948 admin admin] The token cache is being invalidate because project a0a183f3387e493cb36461d91fbac245 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80395) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 02 16:07:10.679966 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.notifications [None req-3f0cd50e-422b-4d82-acc3-6f735b0f8948 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:07:10.682033 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.notifications [None req-3f0cd50e-422b-4d82-acc3-6f735b0f8948 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:07:10.686163 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 953/1890] 10.222.0.59 () {58 vars in 1232 bytes} [Thu Jun 2 16:07:10 2022] DELETE /identity/v3/projects/a0a183f3387e493cb36461d91fbac245 => generated 0 bytes in 372 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 16:07:10.691882 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb04b71b-c6be-43c5-b909-0a32204b86b7 None None] REQUEST_METHOD: `POST` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:07:10.692121 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb04b71b-c6be-43c5-b909-0a32204b86b7 None None] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:07:10.692493 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb04b71b-c6be-43c5-b909-0a32204b86b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:07:10.702596 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 938/1891] 10.222.0.59 () {60 vars in 1152 bytes} [Thu Jun 2 16:07:10 2022] POST /identity/v3/projects => generated 391 bytes in 224 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 16:07:10.706581 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce5ddf6d-d20f-4c79-9f23-b084f8f79a4a admin admin] Authenticating user token {{(pid=80396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:07:10.711174 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.fernet_utils [None req-ce5ddf6d-d20f-4c79-9f23-b084f8f79a4a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:07:10.718668 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.auth.core [None req-eb04b71b-c6be-43c5-b909-0a32204b86b7 None None] MFA Rules not processed for user `400d1f4db9de49638549e5db29a041e1`. Rule list: `[]` (Enabled: `True`). {{(pid=80395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 16:07:10.721113 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.fernet_utils [None req-eb04b71b-c6be-43c5-b909-0a32204b86b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:07:10.813705 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 954/1892] 10.222.0.59 () {58 vars in 957 bytes} [Thu Jun 2 16:07:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 16:07:10.832167 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4b0368-6256-4701-ab13-18f66cf905c4 None None] REQUEST_METHOD: `POST` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:07:10.832467 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4b0368-6256-4701-ab13-18f66cf905c4 None None] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:07:10.832753 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4b0368-6256-4701-ab13-18f66cf905c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:07:10.833940 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce5ddf6d-d20f-4c79-9f23-b084f8f79a4a admin admin] Validating token access rules against request {{(pid=80396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:07:10.843344 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34d58aa1-4f4e-475c-a6a2-e168d47eb535 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f73d5a98be74242b45222df39fb6213', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:07:10.844030 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d58aa1-4f4e-475c-a6a2-e168d47eb535 admin admin] REQUEST_METHOD: `POST` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:07:10.844311 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d58aa1-4f4e-475c-a6a2-e168d47eb535 admin admin] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:07:10.846170 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d58aa1-4f4e-475c-a6a2-e168d47eb535 admin admin] PATH_INFO: `/v3/users` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:07:10.846884 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34d58aa1-4f4e-475c-a6a2-e168d47eb535 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:07:10.851921 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34d58aa1-4f4e-475c-a6a2-e168d47eb535 admin admin] RBAC: Authorization granted {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:07:10.868301 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.auth.core [None req-de4b0368-6256-4701-ab13-18f66cf905c4 None None] MFA Rules not processed for user `400d1f4db9de49638549e5db29a041e1`. Rule list: `[]` (Enabled: `True`). {{(pid=80395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 16:07:10.869511 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.fernet_utils [None req-de4b0368-6256-4701-ab13-18f66cf905c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:07:10.883093 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 955/1893] 10.222.0.59 () {58 vars in 957 bytes} [Thu Jun 2 16:07:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 61 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 16:07:10.890192 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de4b0368-6256-4701-ab13-18f66cf905c4 None None] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:07:10.892053 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.fernet_utils [None req-de4b0368-6256-4701-ab13-18f66cf905c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:07:10.919661 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de4b0368-6256-4701-ab13-18f66cf905c4 None None] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:07:10.933477 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbc43c6e-e6d2-4238-a022-5eb6afc86b9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f73d5a98be74242b45222df39fb6213', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:07:10.933477 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc43c6e-e6d2-4238-a022-5eb6afc86b9a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:07:10.933477 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc43c6e-e6d2-4238-a022-5eb6afc86b9a admin admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:07:10.933477 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc43c6e-e6d2-4238-a022-5eb6afc86b9a admin admin] PATH_INFO: `/v3/projects/ccba667b0ca8492e99837dcc0804cc2f` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:07:10.934107 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbc43c6e-e6d2-4238-a022-5eb6afc86b9a admin admin] RBAC: Authorizing `identity:delete_project(project_id=ccba667b0ca8492e99837dcc0804cc2f)` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:07:10.937133 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbc43c6e-e6d2-4238-a022-5eb6afc86b9a admin admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:07:11.011471 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 939/1894] 10.222.0.59 () {60 vars in 1143 bytes} [Thu Jun 2 16:07:10 2022] POST /identity/v3/users => generated 296 bytes in 305 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 02 16:07:11.015370 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34d58aa1-4f4e-475c-a6a2-e168d47eb535 admin admin] Authenticating user token {{(pid=80396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:07:11.025221 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34d58aa1-4f4e-475c-a6a2-e168d47eb535 admin admin] Validating token access rules against request {{(pid=80396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:07:11.029853 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-809ae158-2a6e-46d7-9ccf-b9cce6f287f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f73d5a98be74242b45222df39fb6213', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:07:11.030532 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809ae158-2a6e-46d7-9ccf-b9cce6f287f3 admin admin] REQUEST_METHOD: `GET` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:07:11.030813 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809ae158-2a6e-46d7-9ccf-b9cce6f287f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:07:11.031088 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809ae158-2a6e-46d7-9ccf-b9cce6f287f3 admin admin] PATH_INFO: `/v3/domains` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:07:11.031807 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-809ae158-2a6e-46d7-9ccf-b9cce6f287f3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80396) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 16:07:11.032111 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-809ae158-2a6e-46d7-9ccf-b9cce6f287f3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:07:11.033694 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-809ae158-2a6e-46d7-9ccf-b9cce6f287f3 admin admin] RBAC: Authorization granted {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:07:11.049734 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 940/1895] 10.222.0.59 () {58 vars in 1152 bytes} [Thu Jun 2 16:07:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 16:07:11.050623 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-809ae158-2a6e-46d7-9ccf-b9cce6f287f3 admin admin] Authenticating user token {{(pid=80396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:07:11.062544 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-809ae158-2a6e-46d7-9ccf-b9cce6f287f3 admin admin] Validating token access rules against request {{(pid=80396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:07:11.068740 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40286ab2-83f3-48c8-8ff1-d727e1068c46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f73d5a98be74242b45222df39fb6213', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:07:11.069329 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40286ab2-83f3-48c8-8ff1-d727e1068c46 admin admin] REQUEST_METHOD: `GET` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:07:11.069690 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40286ab2-83f3-48c8-8ff1-d727e1068c46 admin admin] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:07:11.070140 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40286ab2-83f3-48c8-8ff1-d727e1068c46 admin admin] PATH_INFO: `/v3/roles` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:07:11.071437 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40286ab2-83f3-48c8-8ff1-d727e1068c46 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:07:11.073382 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40286ab2-83f3-48c8-8ff1-d727e1068c46 admin admin] RBAC: Authorization granted {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:07:11.085801 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 941/1896] 10.222.0.59 () {58 vars in 1121 bytes} [Thu Jun 2 16:07:11 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 16:07:11.087155 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40286ab2-83f3-48c8-8ff1-d727e1068c46 admin admin] Authenticating user token {{(pid=80396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:07:11.120365 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.notifications [None req-fbc43c6e-e6d2-4238-a022-5eb6afc86b9a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ccba667b0ca8492e99837dcc0804cc2f', 'request_id': 'req-fbc43c6e-e6d2-4238-a022-5eb6afc86b9a'} {{(pid=80395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:07:11.124549 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40286ab2-83f3-48c8-8ff1-d727e1068c46 admin admin] Validating token access rules against request {{(pid=80396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:07:11.131192 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.notifications [None req-fbc43c6e-e6d2-4238-a022-5eb6afc86b9a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ccba667b0ca8492e99837dcc0804cc2f', 'request_id': 'req-fbc43c6e-e6d2-4238-a022-5eb6afc86b9a'} {{(pid=80395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:07:11.222063 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e8672bb-b47c-4e6f-9413-f71bf6d7d025 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f73d5a98be74242b45222df39fb6213', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:07:11.228695 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e8672bb-b47c-4e6f-9413-f71bf6d7d025 admin admin] REQUEST_METHOD: `POST` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:07:11.228695 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e8672bb-b47c-4e6f-9413-f71bf6d7d025 admin admin] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:07:11.228695 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e8672bb-b47c-4e6f-9413-f71bf6d7d025 admin admin] PATH_INFO: `/v3/projects` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:07:11.228695 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e8672bb-b47c-4e6f-9413-f71bf6d7d025 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:07:11.228695 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e8672bb-b47c-4e6f-9413-f71bf6d7d025 admin admin] RBAC: Authorization granted {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:07:11.252382 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG dbcounter [-] [80396] Writing DB stats keystone:SELECT=89,keystone:DELETE=8,keystone:INSERT=3 {{(pid=80396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 16:07:11.256499 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.notifications [None req-fbc43c6e-e6d2-4238-a022-5eb6afc86b9a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ccba667b0ca8492e99837dcc0804cc2f', 'request_id': 'req-fbc43c6e-e6d2-4238-a022-5eb6afc86b9a'} {{(pid=80395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:07:11.277457 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.notifications [None req-fbc43c6e-e6d2-4238-a022-5eb6afc86b9a admin admin] The token cache is being invalidate because project ccba667b0ca8492e99837dcc0804cc2f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80395) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 02 16:07:11.277457 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.notifications [None req-fbc43c6e-e6d2-4238-a022-5eb6afc86b9a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:07:11.278439 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.notifications [None req-fbc43c6e-e6d2-4238-a022-5eb6afc86b9a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:07:11.281714 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 956/1897] 10.222.0.59 () {58 vars in 1232 bytes} [Thu Jun 2 16:07:10 2022] DELETE /identity/v3/projects/ccba667b0ca8492e99837dcc0804cc2f => generated 0 bytes in 398 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 16:07:11.286992 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbc43c6e-e6d2-4238-a022-5eb6afc86b9a admin admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:07:11.291012 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.fernet_utils [None req-fbc43c6e-e6d2-4238-a022-5eb6afc86b9a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:07:11.307724 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbc43c6e-e6d2-4238-a022-5eb6afc86b9a admin admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:07:11.313023 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-706e15dc-a2c7-436c-ae4c-eab96b857511 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f73d5a98be74242b45222df39fb6213', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:07:11.313700 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706e15dc-a2c7-436c-ae4c-eab96b857511 admin admin] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:07:11.313980 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706e15dc-a2c7-436c-ae4c-eab96b857511 admin admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:07:11.314291 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706e15dc-a2c7-436c-ae4c-eab96b857511 admin admin] PATH_INFO: `/v3/roles` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:07:11.315025 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-706e15dc-a2c7-436c-ae4c-eab96b857511 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:07:11.316618 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-706e15dc-a2c7-436c-ae4c-eab96b857511 admin admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:07:11.336210 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 957/1898] 10.222.0.59 () {58 vars in 1121 bytes} [Thu Jun 2 16:07:11 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 16:07:11.337547 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-706e15dc-a2c7-436c-ae4c-eab96b857511 admin admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:07:11.339245 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.fernet_utils [None req-706e15dc-a2c7-436c-ae4c-eab96b857511 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:07:11.351414 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-706e15dc-a2c7-436c-ae4c-eab96b857511 admin admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:07:11.356913 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8c2014b-3576-497b-b903-f1fdd787d019 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f73d5a98be74242b45222df39fb6213', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:07:11.357571 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c2014b-3576-497b-b903-f1fdd787d019 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:07:11.357852 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c2014b-3576-497b-b903-f1fdd787d019 admin admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:07:11.358165 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c2014b-3576-497b-b903-f1fdd787d019 admin admin] PATH_INFO: `/v3/projects/bac3263c1e08491bbc5a34d75e8bab7c` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:07:11.359327 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8c2014b-3576-497b-b903-f1fdd787d019 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bac3263c1e08491bbc5a34d75e8bab7c)` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:07:11.361212 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8c2014b-3576-497b-b903-f1fdd787d019 admin admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:07:11.402793 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 942/1899] 10.222.0.59 () {60 vars in 1152 bytes} [Thu Jun 2 16:07:11 2022] POST /identity/v3/projects => generated 367 bytes in 316 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 16:07:11.404115 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f69a0be8-ac19-46a5-9e5a-b119a47969da None None] REQUEST_METHOD: `POST` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:07:11.404379 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f69a0be8-ac19-46a5-9e5a-b119a47969da None None] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:07:11.404652 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f69a0be8-ac19-46a5-9e5a-b119a47969da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:07:11.423310 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.auth.core [None req-f69a0be8-ac19-46a5-9e5a-b119a47969da None None] MFA Rules not processed for user `400d1f4db9de49638549e5db29a041e1`. Rule list: `[]` (Enabled: `True`). {{(pid=80396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 16:07:11.424522 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.fernet_utils [None req-f69a0be8-ac19-46a5-9e5a-b119a47969da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:07:11.475350 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.notifications [None req-b8c2014b-3576-497b-b903-f1fdd787d019 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bac3263c1e08491bbc5a34d75e8bab7c', 'request_id': 'req-b8c2014b-3576-497b-b903-f1fdd787d019'} {{(pid=80395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:07:11.482856 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.notifications [None req-b8c2014b-3576-497b-b903-f1fdd787d019 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bac3263c1e08491bbc5a34d75e8bab7c', 'request_id': 'req-b8c2014b-3576-497b-b903-f1fdd787d019'} {{(pid=80395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:07:11.485809 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 943/1900] 10.222.0.59 () {58 vars in 957 bytes} [Thu Jun 2 16:07:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 16:07:11.486783 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f69a0be8-ac19-46a5-9e5a-b119a47969da None None] Authenticating user token {{(pid=80396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:07:11.495942 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f69a0be8-ac19-46a5-9e5a-b119a47969da None None] Validating token access rules against request {{(pid=80396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:07:11.554197 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3bb3135-10fa-46a5-8fe8-6ce8e053d961 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f73d5a98be74242b45222df39fb6213', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:07:11.555125 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3bb3135-10fa-46a5-8fe8-6ce8e053d961 admin admin] REQUEST_METHOD: `PUT` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:07:11.555412 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3bb3135-10fa-46a5-8fe8-6ce8e053d961 admin admin] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:07:11.555691 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3bb3135-10fa-46a5-8fe8-6ce8e053d961 admin admin] PATH_INFO: `/v3/projects/69f35418d2b540b580bf58355fe07c7b/users/213b9e98117041a7998b926a3c6e9c54/roles/649e0f2b5a264c419ea6a1441f123a03` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:07:11.570826 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3bb3135-10fa-46a5-8fe8-6ce8e053d961 admin admin] RBAC: Authorizing `identity:create_grant(project_id=69f35418d2b540b580bf58355fe07c7b, user_id=213b9e98117041a7998b926a3c6e9c54, role_id=649e0f2b5a264c419ea6a1441f123a03)` {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:07:11.574037 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3bb3135-10fa-46a5-8fe8-6ce8e053d961 admin admin] RBAC: Authorization granted {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:07:11.593706 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.notifications [None req-b8c2014b-3576-497b-b903-f1fdd787d019 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bac3263c1e08491bbc5a34d75e8bab7c', 'request_id': 'req-b8c2014b-3576-497b-b903-f1fdd787d019'} {{(pid=80395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:07:11.605423 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.notifications [None req-b8c2014b-3576-497b-b903-f1fdd787d019 admin admin] The token cache is being invalidate because project bac3263c1e08491bbc5a34d75e8bab7c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80395) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 02 16:07:11.605768 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.notifications [None req-b8c2014b-3576-497b-b903-f1fdd787d019 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:07:11.606455 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.notifications [None req-b8c2014b-3576-497b-b903-f1fdd787d019 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:07:11.608255 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 958/1901] 10.222.0.59 () {58 vars in 1232 bytes} [Thu Jun 2 16:07:11 2022] DELETE /identity/v3/projects/bac3263c1e08491bbc5a34d75e8bab7c => generated 0 bytes in 272 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 16:07:11.609072 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8c2014b-3576-497b-b903-f1fdd787d019 admin admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:07:11.610369 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.fernet_utils [None req-b8c2014b-3576-497b-b903-f1fdd787d019 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:07:11.623125 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8c2014b-3576-497b-b903-f1fdd787d019 admin admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:07:11.630014 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ad5b344-0ed0-444c-92a5-9dc73e409794 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f73d5a98be74242b45222df39fb6213', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:07:11.630842 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad5b344-0ed0-444c-92a5-9dc73e409794 admin admin] REQUEST_METHOD: `POST` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:07:11.631187 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad5b344-0ed0-444c-92a5-9dc73e409794 admin admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:07:11.631584 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad5b344-0ed0-444c-92a5-9dc73e409794 admin admin] PATH_INFO: `/v3/users` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:07:11.632311 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ad5b344-0ed0-444c-92a5-9dc73e409794 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:07:11.635330 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ad5b344-0ed0-444c-92a5-9dc73e409794 admin admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:07:11.703663 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 944/1902] 10.222.0.59 () {60 vars in 1482 bytes} [Thu Jun 2 16:07:11 2022] PUT /identity/v3/projects/69f35418d2b540b580bf58355fe07c7b/users/213b9e98117041a7998b926a3c6e9c54/roles/649e0f2b5a264c419ea6a1441f123a03 => generated 0 bytes in 217 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 16:07:11.705672 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1023feca-335c-407e-aa10-92ed3e035f68 None None] REQUEST_METHOD: `POST` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:07:11.705809 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1023feca-335c-407e-aa10-92ed3e035f68 None None] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:07:11.706350 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1023feca-335c-407e-aa10-92ed3e035f68 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:07:11.729211 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.auth.core [None req-1023feca-335c-407e-aa10-92ed3e035f68 None None] MFA Rules not processed for user `400d1f4db9de49638549e5db29a041e1`. Rule list: `[]` (Enabled: `True`). {{(pid=80396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 16:07:11.730630 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.fernet_utils [None req-1023feca-335c-407e-aa10-92ed3e035f68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:07:11.746006 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 959/1903] 10.222.0.59 () {60 vars in 1143 bytes} [Thu Jun 2 16:07:11 2022] POST /identity/v3/users => generated 284 bytes in 134 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 16:07:11.746006 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6700caed-c12f-48d6-a880-3b4184ac662b None None] REQUEST_METHOD: `POST` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:07:11.746006 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6700caed-c12f-48d6-a880-3b4184ac662b None None] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:07:11.746006 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6700caed-c12f-48d6-a880-3b4184ac662b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:07:11.766587 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.auth.core [None req-6700caed-c12f-48d6-a880-3b4184ac662b None None] MFA Rules not processed for user `400d1f4db9de49638549e5db29a041e1`. Rule list: `[]` (Enabled: `True`). {{(pid=80395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 16:07:11.767839 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.fernet_utils [None req-6700caed-c12f-48d6-a880-3b4184ac662b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:07:11.816145 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 945/1904] 10.222.0.59 () {58 vars in 957 bytes} [Thu Jun 2 16:07:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 16:07:11.816777 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc15d6f-fc6d-4154-95c2-588de9c6bb61 None None] REQUEST_METHOD: `POST` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:07:11.817069 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc15d6f-fc6d-4154-95c2-588de9c6bb61 None None] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:07:11.817351 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc15d6f-fc6d-4154-95c2-588de9c6bb61 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:07:11.845261 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.auth.core [None req-7dc15d6f-fc6d-4154-95c2-588de9c6bb61 None None] MFA Rules not processed for user `213b9e98117041a7998b926a3c6e9c54`. Rule list: `[]` (Enabled: `True`). {{(pid=80396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 16:07:11.850258 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 960/1905] 10.222.0.59 () {58 vars in 957 bytes} [Thu Jun 2 16:07:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 16:07:11.850407 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.fernet_utils [None req-7dc15d6f-fc6d-4154-95c2-588de9c6bb61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:07:11.850510 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6700caed-c12f-48d6-a880-3b4184ac662b None None] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:07:11.861188 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6700caed-c12f-48d6-a880-3b4184ac662b None None] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:07:11.866407 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b002ef3f-1ade-4ace-9f7c-4164b0e2ec1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f73d5a98be74242b45222df39fb6213', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:07:11.867058 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b002ef3f-1ade-4ace-9f7c-4164b0e2ec1e admin admin] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:07:11.867397 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b002ef3f-1ade-4ace-9f7c-4164b0e2ec1e admin admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:07:11.868557 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b002ef3f-1ade-4ace-9f7c-4164b0e2ec1e admin admin] PATH_INFO: `/v3/roles` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:07:11.869305 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b002ef3f-1ade-4ace-9f7c-4164b0e2ec1e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:07:11.871100 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b002ef3f-1ade-4ace-9f7c-4164b0e2ec1e admin admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:07:11.883926 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 961/1906] 10.222.0.59 () {58 vars in 1121 bytes} [Thu Jun 2 16:07:11 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 16:07:11.884981 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b002ef3f-1ade-4ace-9f7c-4164b0e2ec1e admin admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:07:11.897677 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b002ef3f-1ade-4ace-9f7c-4164b0e2ec1e admin admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:07:11.904436 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b596ff57-3490-44aa-8375-dad761093d66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f73d5a98be74242b45222df39fb6213', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:07:11.905181 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b596ff57-3490-44aa-8375-dad761093d66 admin admin] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:07:11.905540 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b596ff57-3490-44aa-8375-dad761093d66 admin admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:07:11.905892 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b596ff57-3490-44aa-8375-dad761093d66 admin admin] PATH_INFO: `/v3/domains` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:07:11.907254 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b596ff57-3490-44aa-8375-dad761093d66 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80395) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 16:07:11.907635 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b596ff57-3490-44aa-8375-dad761093d66 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:07:11.910010 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b596ff57-3490-44aa-8375-dad761093d66 admin admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:07:11.932647 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 962/1907] 10.222.0.59 () {58 vars in 1152 bytes} [Thu Jun 2 16:07:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 16:07:11.932647 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a37a0b-476b-4b87-bdf8-c50b45d63ee6 None None] REQUEST_METHOD: `POST` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:07:11.932647 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a37a0b-476b-4b87-bdf8-c50b45d63ee6 None None] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:07:11.932647 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a37a0b-476b-4b87-bdf8-c50b45d63ee6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:07:11.939712 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 946/1908] 10.222.0.59 () {58 vars in 957 bytes} [Thu Jun 2 16:07:11 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 16:07:11.945342 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dc15d6f-fc6d-4154-95c2-588de9c6bb61 None None] Authenticating user token {{(pid=80396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:07:11.952876 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.auth.core [None req-f9a37a0b-476b-4b87-bdf8-c50b45d63ee6 None None] MFA Rules not processed for user `400d1f4db9de49638549e5db29a041e1`. Rule list: `[]` (Enabled: `True`). {{(pid=80395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 16:07:11.954203 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.fernet_utils [None req-f9a37a0b-476b-4b87-bdf8-c50b45d63ee6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:07:11.966646 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 963/1909] 10.222.0.59 () {58 vars in 957 bytes} [Thu Jun 2 16:07:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 16:07:11.967980 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9a37a0b-476b-4b87-bdf8-c50b45d63ee6 None None] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:07:11.968604 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dc15d6f-fc6d-4154-95c2-588de9c6bb61 None None] Validating token access rules against request {{(pid=80396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:07:11.975205 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95cdec7f-ed20-4d42-ba09-9c9c4b2477fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f73d5a98be74242b45222df39fb6213', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:07:11.976627 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95cdec7f-ed20-4d42-ba09-9c9c4b2477fe admin admin] REQUEST_METHOD: `GET` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:07:11.977828 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95cdec7f-ed20-4d42-ba09-9c9c4b2477fe admin admin] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:07:11.978598 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95cdec7f-ed20-4d42-ba09-9c9c4b2477fe admin admin] PATH_INFO: `/v3/roles` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:07:11.979998 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9a37a0b-476b-4b87-bdf8-c50b45d63ee6 None None] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:07:11.980787 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95cdec7f-ed20-4d42-ba09-9c9c4b2477fe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:07:11.983349 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95cdec7f-ed20-4d42-ba09-9c9c4b2477fe admin admin] RBAC: Authorization granted {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:07:11.984779 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ccd62bd-b66d-44f9-a6ae-eb058d5035c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f73d5a98be74242b45222df39fb6213', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:07:11.985446 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ccd62bd-b66d-44f9-a6ae-eb058d5035c8 admin admin] REQUEST_METHOD: `POST` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:07:11.985730 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ccd62bd-b66d-44f9-a6ae-eb058d5035c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:07:11.986005 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ccd62bd-b66d-44f9-a6ae-eb058d5035c8 admin admin] PATH_INFO: `/v3/projects` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:07:11.987277 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ccd62bd-b66d-44f9-a6ae-eb058d5035c8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:07:11.988731 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ccd62bd-b66d-44f9-a6ae-eb058d5035c8 admin admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:07:11.995253 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 947/1910] 10.222.0.59 () {58 vars in 1121 bytes} [Thu Jun 2 16:07:11 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 16:07:11.995955 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95cdec7f-ed20-4d42-ba09-9c9c4b2477fe admin admin] Authenticating user token {{(pid=80396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:07:11.999756 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.fernet_utils [None req-95cdec7f-ed20-4d42-ba09-9c9c4b2477fe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:07:12.017271 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95cdec7f-ed20-4d42-ba09-9c9c4b2477fe admin admin] Validating token access rules against request {{(pid=80396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:07:12.021876 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-114830f8-9af7-4c89-b577-c79633ca7f70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f73d5a98be74242b45222df39fb6213', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:07:12.022562 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-114830f8-9af7-4c89-b577-c79633ca7f70 admin admin] REQUEST_METHOD: `POST` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:07:12.022846 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-114830f8-9af7-4c89-b577-c79633ca7f70 admin admin] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:07:12.023121 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-114830f8-9af7-4c89-b577-c79633ca7f70 admin admin] PATH_INFO: `/v3/projects` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:07:12.024383 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-114830f8-9af7-4c89-b577-c79633ca7f70 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:07:12.026682 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-114830f8-9af7-4c89-b577-c79633ca7f70 admin admin] RBAC: Authorization granted {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:07:12.097990 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 964/1911] 10.222.0.59 () {60 vars in 1152 bytes} [Thu Jun 2 16:07:11 2022] POST /identity/v3/projects => generated 385 bytes in 131 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 16:07:12.099028 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ccd62bd-b66d-44f9-a6ae-eb058d5035c8 admin admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:07:12.143982 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 948/1912] 10.222.0.59 () {60 vars in 1152 bytes} [Thu Jun 2 16:07:11 2022] POST /identity/v3/projects => generated 391 bytes in 148 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 16:07:12.144810 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-114830f8-9af7-4c89-b577-c79633ca7f70 admin admin] Authenticating user token {{(pid=80396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:07:12.164088 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ccd62bd-b66d-44f9-a6ae-eb058d5035c8 admin admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:07:12.209780 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-114830f8-9af7-4c89-b577-c79633ca7f70 admin admin] Validating token access rules against request {{(pid=80396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:07:12.216754 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66df68a6-ee56-4807-8f03-cb1b0c7425b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f73d5a98be74242b45222df39fb6213', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:07:12.217657 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66df68a6-ee56-4807-8f03-cb1b0c7425b1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:07:12.217935 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66df68a6-ee56-4807-8f03-cb1b0c7425b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:07:12.218233 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66df68a6-ee56-4807-8f03-cb1b0c7425b1 admin admin] PATH_INFO: `/v3/projects/dfcfcaf8fe324675ae5f3ab60a205538/users/a7ebe51237b34200a52d550d6e34e5d3/roles/649e0f2b5a264c419ea6a1441f123a03` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:07:12.223272 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ee6975f-778f-4b0a-8dd7-179217fba7b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f73d5a98be74242b45222df39fb6213', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:07:12.223934 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee6975f-778f-4b0a-8dd7-179217fba7b2 admin admin] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:07:12.224220 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee6975f-778f-4b0a-8dd7-179217fba7b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:07:12.224496 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee6975f-778f-4b0a-8dd7-179217fba7b2 admin admin] PATH_INFO: `/v3/domains` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:07:12.226232 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ee6975f-778f-4b0a-8dd7-179217fba7b2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80395) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 16:07:12.226232 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ee6975f-778f-4b0a-8dd7-179217fba7b2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:07:12.227653 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ee6975f-778f-4b0a-8dd7-179217fba7b2 admin admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:07:12.233320 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66df68a6-ee56-4807-8f03-cb1b0c7425b1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=dfcfcaf8fe324675ae5f3ab60a205538, user_id=a7ebe51237b34200a52d550d6e34e5d3, role_id=649e0f2b5a264c419ea6a1441f123a03)` {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:07:12.235989 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66df68a6-ee56-4807-8f03-cb1b0c7425b1 admin admin] RBAC: Authorization granted {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:07:12.243711 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 965/1913] 10.222.0.59 () {58 vars in 1152 bytes} [Thu Jun 2 16:07:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 16:07:12.243711 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ee6975f-778f-4b0a-8dd7-179217fba7b2 admin admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:07:12.249439 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ee6975f-778f-4b0a-8dd7-179217fba7b2 admin admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:07:12.254059 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d130c689-4cf8-4f80-a1ca-dc3576df8851 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f73d5a98be74242b45222df39fb6213', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:07:12.254741 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d130c689-4cf8-4f80-a1ca-dc3576df8851 admin admin] REQUEST_METHOD: `POST` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:07:12.255029 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d130c689-4cf8-4f80-a1ca-dc3576df8851 admin admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:07:12.255309 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d130c689-4cf8-4f80-a1ca-dc3576df8851 admin admin] PATH_INFO: `/v3/users` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:07:12.256000 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d130c689-4cf8-4f80-a1ca-dc3576df8851 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:07:12.257898 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d130c689-4cf8-4f80-a1ca-dc3576df8851 admin admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:07:12.380911 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 949/1914] 10.222.0.59 () {60 vars in 1482 bytes} [Thu Jun 2 16:07:12 2022] PUT /identity/v3/projects/dfcfcaf8fe324675ae5f3ab60a205538/users/a7ebe51237b34200a52d550d6e34e5d3/roles/649e0f2b5a264c419ea6a1441f123a03 => generated 0 bytes in 227 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 16:07:12.380911 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66df68a6-ee56-4807-8f03-cb1b0c7425b1 admin admin] Authenticating user token {{(pid=80396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:07:12.427145 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 966/1915] 10.222.0.59 () {60 vars in 1143 bytes} [Thu Jun 2 16:07:12 2022] POST /identity/v3/users => generated 293 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 16:07:12.427145 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d130c689-4cf8-4f80-a1ca-dc3576df8851 admin admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:07:12.437151 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66df68a6-ee56-4807-8f03-cb1b0c7425b1 admin admin] Validating token access rules against request {{(pid=80396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:07:12.437295 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d130c689-4cf8-4f80-a1ca-dc3576df8851 admin admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:07:12.442161 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73cab972-4c9e-4186-b05b-1a24faf0fc15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f73d5a98be74242b45222df39fb6213', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:07:12.442832 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73cab972-4c9e-4186-b05b-1a24faf0fc15 admin admin] REQUEST_METHOD: `POST` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:07:12.443112 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73cab972-4c9e-4186-b05b-1a24faf0fc15 admin admin] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:07:12.443387 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73cab972-4c9e-4186-b05b-1a24faf0fc15 admin admin] PATH_INFO: `/v3/users` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:07:12.443678 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10de4352-0df5-4a27-a664-f70feb7655af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f73d5a98be74242b45222df39fb6213', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:07:12.444118 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73cab972-4c9e-4186-b05b-1a24faf0fc15 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:07:12.444832 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10de4352-0df5-4a27-a664-f70feb7655af admin admin] REQUEST_METHOD: `POST` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:07:12.445330 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10de4352-0df5-4a27-a664-f70feb7655af admin admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:07:12.446532 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10de4352-0df5-4a27-a664-f70feb7655af admin admin] PATH_INFO: `/v3/projects` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:07:12.446770 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73cab972-4c9e-4186-b05b-1a24faf0fc15 admin admin] RBAC: Authorization granted {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:07:12.447643 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10de4352-0df5-4a27-a664-f70feb7655af admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:07:12.449860 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10de4352-0df5-4a27-a664-f70feb7655af admin admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:07:12.621179 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 950/1916] 10.222.0.59 () {60 vars in 1143 bytes} [Thu Jun 2 16:07:12 2022] POST /identity/v3/users => generated 302 bytes in 246 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 16:07:12.621179 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7021161e-6023-4d30-91d2-e40df764c8a7 None None] REQUEST_METHOD: `POST` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:07:12.621179 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7021161e-6023-4d30-91d2-e40df764c8a7 None None] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:07:12.621179 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7021161e-6023-4d30-91d2-e40df764c8a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:07:12.623009 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 967/1917] 10.222.0.59 () {60 vars in 1152 bytes} [Thu Jun 2 16:07:12 2022] POST /identity/v3/projects => generated 375 bytes in 197 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 16:07:12.626531 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10de4352-0df5-4a27-a664-f70feb7655af admin admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:07:12.652747 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.auth.core [None req-7021161e-6023-4d30-91d2-e40df764c8a7 None None] MFA Rules not processed for user `a7ebe51237b34200a52d550d6e34e5d3`. Rule list: `[]` (Enabled: `True`). {{(pid=80396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 16:07:12.654293 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.fernet_utils [None req-7021161e-6023-4d30-91d2-e40df764c8a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:07:12.710496 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10de4352-0df5-4a27-a664-f70feb7655af admin admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:07:12.721858 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9b2918b-9428-46ea-a83e-d8c587336ac7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f73d5a98be74242b45222df39fb6213', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:07:12.722560 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b2918b-9428-46ea-a83e-d8c587336ac7 admin admin] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:07:12.722844 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b2918b-9428-46ea-a83e-d8c587336ac7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:07:12.723119 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b2918b-9428-46ea-a83e-d8c587336ac7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:07:12.723856 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9b2918b-9428-46ea-a83e-d8c587336ac7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:07:12.725465 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9b2918b-9428-46ea-a83e-d8c587336ac7 admin admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:07:12.736576 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 968/1918] 10.222.0.59 () {58 vars in 1121 bytes} [Thu Jun 2 16:07:12 2022] GET /identity/v3/roles => generated 1420 bytes in 113 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 16:07:12.737252 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9b2918b-9428-46ea-a83e-d8c587336ac7 admin admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:07:12.741046 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 951/1919] 10.222.0.59 () {58 vars in 957 bytes} [Thu Jun 2 16:07:12 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 16:07:12.744489 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7021161e-6023-4d30-91d2-e40df764c8a7 None None] Authenticating user token {{(pid=80396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:07:12.747446 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9b2918b-9428-46ea-a83e-d8c587336ac7 admin admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:07:12.752304 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66c16d1b-a18b-4aad-b24f-311ecc2ec427 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f73d5a98be74242b45222df39fb6213', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:07:12.752989 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c16d1b-a18b-4aad-b24f-311ecc2ec427 admin admin] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:07:12.753270 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c16d1b-a18b-4aad-b24f-311ecc2ec427 admin admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:07:12.753539 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c16d1b-a18b-4aad-b24f-311ecc2ec427 admin admin] PATH_INFO: `/v3/roles` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:07:12.754314 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66c16d1b-a18b-4aad-b24f-311ecc2ec427 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:07:12.755888 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66c16d1b-a18b-4aad-b24f-311ecc2ec427 admin admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:07:12.756974 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7021161e-6023-4d30-91d2-e40df764c8a7 None None] Validating token access rules against request {{(pid=80396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:07:12.766894 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c943e68a-f4e0-4081-b933-f95b2712f196 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f73d5a98be74242b45222df39fb6213', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:07:12.770297 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 969/1920] 10.222.0.59 () {58 vars in 1121 bytes} [Thu Jun 2 16:07:12 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 16:07:12.770438 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c943e68a-f4e0-4081-b933-f95b2712f196 admin admin] REQUEST_METHOD: `POST` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:07:12.770438 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c943e68a-f4e0-4081-b933-f95b2712f196 admin admin] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:07:12.770438 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c943e68a-f4e0-4081-b933-f95b2712f196 admin admin] PATH_INFO: `/v3/users` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:07:12.770624 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66c16d1b-a18b-4aad-b24f-311ecc2ec427 admin admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:07:12.770692 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c943e68a-f4e0-4081-b933-f95b2712f196 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:07:12.771920 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c943e68a-f4e0-4081-b933-f95b2712f196 admin admin] RBAC: Authorization granted {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:07:12.779533 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66c16d1b-a18b-4aad-b24f-311ecc2ec427 admin admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:07:12.784433 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-890596dd-bb39-40d8-b804-075195d61f17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f73d5a98be74242b45222df39fb6213', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:07:12.785155 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890596dd-bb39-40d8-b804-075195d61f17 admin admin] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:07:12.785438 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890596dd-bb39-40d8-b804-075195d61f17 admin admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:07:12.785721 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890596dd-bb39-40d8-b804-075195d61f17 admin admin] PATH_INFO: `/v3/roles` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:07:12.786503 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-890596dd-bb39-40d8-b804-075195d61f17 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:07:12.788679 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-890596dd-bb39-40d8-b804-075195d61f17 admin admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:07:12.799993 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 970/1921] 10.222.0.59 () {58 vars in 1121 bytes} [Thu Jun 2 16:07:12 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 16:07:12.800971 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-890596dd-bb39-40d8-b804-075195d61f17 admin admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:07:12.811561 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-890596dd-bb39-40d8-b804-075195d61f17 admin admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:07:12.816074 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10855e18-5b0b-40aa-b286-5c04b0d6bbd0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f73d5a98be74242b45222df39fb6213', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:07:12.816730 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10855e18-5b0b-40aa-b286-5c04b0d6bbd0 admin admin] REQUEST_METHOD: `POST` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:07:12.817011 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10855e18-5b0b-40aa-b286-5c04b0d6bbd0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:07:12.817286 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10855e18-5b0b-40aa-b286-5c04b0d6bbd0 admin admin] PATH_INFO: `/v3/projects` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:07:12.817959 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10855e18-5b0b-40aa-b286-5c04b0d6bbd0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:07:12.819858 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10855e18-5b0b-40aa-b286-5c04b0d6bbd0 admin admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:07:12.950108 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 952/1922] 10.222.0.59 () {60 vars in 1143 bytes} [Thu Jun 2 16:07:12 2022] POST /identity/v3/users => generated 288 bytes in 208 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 16:07:12.950912 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c943e68a-f4e0-4081-b933-f95b2712f196 admin admin] Authenticating user token {{(pid=80396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:07:12.962876 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c943e68a-f4e0-4081-b933-f95b2712f196 admin admin] Validating token access rules against request {{(pid=80396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:07:12.967840 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b85b6e0a-833f-4d23-bf40-c4b3fb0bcca7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f73d5a98be74242b45222df39fb6213', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:07:12.968725 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b85b6e0a-833f-4d23-bf40-c4b3fb0bcca7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:07:12.969007 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b85b6e0a-833f-4d23-bf40-c4b3fb0bcca7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:07:12.969284 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b85b6e0a-833f-4d23-bf40-c4b3fb0bcca7 admin admin] PATH_INFO: `/v3/projects/eeee34f6303d4e8ab23d86c71cc7da81/users/db5fcfc8a7c8415994334adf280a676c/roles/f1e0c25f6e9049e897cb7350c7e54ab3` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:07:12.985389 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b85b6e0a-833f-4d23-bf40-c4b3fb0bcca7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=eeee34f6303d4e8ab23d86c71cc7da81, user_id=db5fcfc8a7c8415994334adf280a676c, role_id=f1e0c25f6e9049e897cb7350c7e54ab3)` {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:07:12.988113 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b85b6e0a-833f-4d23-bf40-c4b3fb0bcca7 admin admin] RBAC: Authorization granted {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:07:13.044717 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 971/1923] 10.222.0.59 () {60 vars in 1152 bytes} [Thu Jun 2 16:07:12 2022] POST /identity/v3/projects => generated 365 bytes in 241 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 16:07:13.044717 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10855e18-5b0b-40aa-b286-5c04b0d6bbd0 admin admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:07:13.088600 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 953/1924] 10.222.0.59 () {60 vars in 1482 bytes} [Thu Jun 2 16:07:12 2022] PUT /identity/v3/projects/eeee34f6303d4e8ab23d86c71cc7da81/users/db5fcfc8a7c8415994334adf280a676c/roles/f1e0c25f6e9049e897cb7350c7e54ab3 => generated 0 bytes in 135 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 16:07:13.088600 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b85b6e0a-833f-4d23-bf40-c4b3fb0bcca7 admin admin] Authenticating user token {{(pid=80396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:07:13.150464 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10855e18-5b0b-40aa-b286-5c04b0d6bbd0 admin admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:07:13.167818 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b85b6e0a-833f-4d23-bf40-c4b3fb0bcca7 admin admin] Validating token access rules against request {{(pid=80396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:07:13.172493 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b40a3aa8-688a-419b-ae7c-437eaea364d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f73d5a98be74242b45222df39fb6213', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:07:13.173161 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b40a3aa8-688a-419b-ae7c-437eaea364d1 admin admin] REQUEST_METHOD: `GET` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:07:13.173443 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b40a3aa8-688a-419b-ae7c-437eaea364d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:07:13.173717 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b40a3aa8-688a-419b-ae7c-437eaea364d1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:07:13.174468 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b40a3aa8-688a-419b-ae7c-437eaea364d1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:07:13.176203 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b40a3aa8-688a-419b-ae7c-437eaea364d1 admin admin] RBAC: Authorization granted {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:07:13.186888 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 954/1925] 10.222.0.59 () {58 vars in 1121 bytes} [Thu Jun 2 16:07:13 2022] GET /identity/v3/roles => generated 1420 bytes in 101 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 16:07:13.187726 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b40a3aa8-688a-419b-ae7c-437eaea364d1 admin admin] Authenticating user token {{(pid=80396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:07:13.200015 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b40a3aa8-688a-419b-ae7c-437eaea364d1 admin admin] Validating token access rules against request {{(pid=80396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:07:13.205854 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cd48442-356b-4384-8ef3-6155017119f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f73d5a98be74242b45222df39fb6213', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:07:13.206560 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd48442-356b-4384-8ef3-6155017119f2 admin admin] REQUEST_METHOD: `POST` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:07:13.206845 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd48442-356b-4384-8ef3-6155017119f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:07:13.207247 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd48442-356b-4384-8ef3-6155017119f2 admin admin] PATH_INFO: `/v3/users` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:07:13.207810 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cd48442-356b-4384-8ef3-6155017119f2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:07:13.210016 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cd48442-356b-4384-8ef3-6155017119f2 admin admin] RBAC: Authorization granted {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:07:13.231998 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ed646df-c749-4328-9673-7883ba94cdd4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f73d5a98be74242b45222df39fb6213', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:07:13.233551 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed646df-c749-4328-9673-7883ba94cdd4 admin admin] REQUEST_METHOD: `PUT` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:07:13.233551 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed646df-c749-4328-9673-7883ba94cdd4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:07:13.233744 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed646df-c749-4328-9673-7883ba94cdd4 admin admin] PATH_INFO: `/v3/projects/46170fe2093a46e08bf273c367c0cfcd/users/2e73ebe76e294679981478b5cc866cc1/roles/649e0f2b5a264c419ea6a1441f123a03` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:07:13.251132 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ed646df-c749-4328-9673-7883ba94cdd4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=46170fe2093a46e08bf273c367c0cfcd, user_id=2e73ebe76e294679981478b5cc866cc1, role_id=649e0f2b5a264c419ea6a1441f123a03)` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:07:13.253953 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ed646df-c749-4328-9673-7883ba94cdd4 admin admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:07:13.349677 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 16:07:13.426345 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 955/1926] 10.222.0.59 () {60 vars in 1143 bytes} [Thu Jun 2 16:07:13 2022] POST /identity/v3/users => generated 289 bytes in 234 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 16:07:13.426345 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cd48442-356b-4384-8ef3-6155017119f2 admin admin] Authenticating user token {{(pid=80396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:07:13.426875 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 972/1927] 10.222.0.59 () {60 vars in 1482 bytes} [Thu Jun 2 16:07:13 2022] PUT /identity/v3/projects/46170fe2093a46e08bf273c367c0cfcd/users/2e73ebe76e294679981478b5cc866cc1/roles/649e0f2b5a264c419ea6a1441f123a03 => generated 0 bytes in 382 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 16:07:13.426875 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ed646df-c749-4328-9673-7883ba94cdd4 admin admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:07:13.453649 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cd48442-356b-4384-8ef3-6155017119f2 admin admin] Validating token access rules against request {{(pid=80396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:07:13.511387 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ed646df-c749-4328-9673-7883ba94cdd4 admin admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:07:13.517190 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4aed2b0-3693-4ef6-934e-9c077eca72d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f73d5a98be74242b45222df39fb6213', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:07:13.517987 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4aed2b0-3693-4ef6-934e-9c077eca72d5 admin admin] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:07:13.518449 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4aed2b0-3693-4ef6-934e-9c077eca72d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:07:13.518886 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4aed2b0-3693-4ef6-934e-9c077eca72d5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:07:13.519683 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4aed2b0-3693-4ef6-934e-9c077eca72d5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:07:13.521662 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4aed2b0-3693-4ef6-934e-9c077eca72d5 admin admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:07:13.538552 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 973/1928] 10.222.0.59 () {58 vars in 1121 bytes} [Thu Jun 2 16:07:13 2022] GET /identity/v3/roles => generated 1420 bytes in 114 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 16:07:13.539880 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4aed2b0-3693-4ef6-934e-9c077eca72d5 admin admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:07:13.558008 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4aed2b0-3693-4ef6-934e-9c077eca72d5 admin admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:07:13.566688 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c5692f-e80e-493a-ab25-6485cb5d6873 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f73d5a98be74242b45222df39fb6213', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:07:13.568115 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c5692f-e80e-493a-ab25-6485cb5d6873 admin admin] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:07:13.568596 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c5692f-e80e-493a-ab25-6485cb5d6873 admin admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:07:13.569219 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c5692f-e80e-493a-ab25-6485cb5d6873 admin admin] PATH_INFO: `/v3/roles` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:07:13.570638 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98c5692f-e80e-493a-ab25-6485cb5d6873 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:07:13.572597 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98c5692f-e80e-493a-ab25-6485cb5d6873 admin admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:07:13.588772 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 974/1929] 10.222.0.59 () {58 vars in 1121 bytes} [Thu Jun 2 16:07:13 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 16:07:13.589798 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5764628-99bc-479c-a67d-5de015273d92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f73d5a98be74242b45222df39fb6213', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:07:13.590342 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5764628-99bc-479c-a67d-5de015273d92 admin admin] REQUEST_METHOD: `GET` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:07:13.590782 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5764628-99bc-479c-a67d-5de015273d92 admin admin] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:07:13.591064 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5764628-99bc-479c-a67d-5de015273d92 admin admin] PATH_INFO: `/v3/roles` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:07:13.591924 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5764628-99bc-479c-a67d-5de015273d92 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:07:13.592169 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed98db5d-116f-4f26-afde-1eb477e2fa07 None None] REQUEST_METHOD: `POST` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:07:13.592601 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed98db5d-116f-4f26-afde-1eb477e2fa07 None None] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:07:13.593052 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed98db5d-116f-4f26-afde-1eb477e2fa07 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:07:13.593559 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5764628-99bc-479c-a67d-5de015273d92 admin admin] RBAC: Authorization granted {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:07:13.625908 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 956/1930] 10.222.0.59 () {58 vars in 1121 bytes} [Thu Jun 2 16:07:13 2022] GET /identity/v3/roles => generated 1420 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 16:07:13.625908 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5764628-99bc-479c-a67d-5de015273d92 admin admin] Authenticating user token {{(pid=80396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:07:13.632635 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.auth.core [None req-ed98db5d-116f-4f26-afde-1eb477e2fa07 None None] MFA Rules not processed for user `2e73ebe76e294679981478b5cc866cc1`. Rule list: `[]` (Enabled: `True`). {{(pid=80395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 16:07:13.634741 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.fernet_utils [None req-ed98db5d-116f-4f26-afde-1eb477e2fa07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:07:13.653331 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5764628-99bc-479c-a67d-5de015273d92 admin admin] Validating token access rules against request {{(pid=80396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:07:13.663204 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ae376f4-ee42-44b5-8875-6ec4273d299f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f73d5a98be74242b45222df39fb6213', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:07:13.664030 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae376f4-ee42-44b5-8875-6ec4273d299f admin admin] REQUEST_METHOD: `PUT` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:07:13.664314 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae376f4-ee42-44b5-8875-6ec4273d299f admin admin] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:07:13.664647 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae376f4-ee42-44b5-8875-6ec4273d299f admin admin] PATH_INFO: `/v3/projects/6548654862a645b89ba7b518c2209357/users/964db856353448e58f40cbe0b5f20969/roles/649e0f2b5a264c419ea6a1441f123a03` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:07:13.684597 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ae376f4-ee42-44b5-8875-6ec4273d299f admin admin] RBAC: Authorizing `identity:create_grant(project_id=6548654862a645b89ba7b518c2209357, user_id=964db856353448e58f40cbe0b5f20969, role_id=649e0f2b5a264c419ea6a1441f123a03)` {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:07:13.687901 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ae376f4-ee42-44b5-8875-6ec4273d299f admin admin] RBAC: Authorization granted {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:07:13.720228 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 975/1931] 10.222.0.59 () {58 vars in 957 bytes} [Thu Jun 2 16:07:13 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 16:07:13.721285 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed98db5d-116f-4f26-afde-1eb477e2fa07 None None] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:07:13.731612 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed98db5d-116f-4f26-afde-1eb477e2fa07 None None] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:07:13.736559 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05be5eb0-ebba-41a5-b449-4d5b5076941f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f73d5a98be74242b45222df39fb6213', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:07:13.737469 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05be5eb0-ebba-41a5-b449-4d5b5076941f admin admin] REQUEST_METHOD: `PUT` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:07:13.737754 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05be5eb0-ebba-41a5-b449-4d5b5076941f admin admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:07:13.738036 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05be5eb0-ebba-41a5-b449-4d5b5076941f admin admin] PATH_INFO: `/v3/projects/9feb2e942d124076959cd0f67f2f4ac7/users/f3ef80514d5e4dbab9a183a662be0347/roles/f1e0c25f6e9049e897cb7350c7e54ab3` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:07:13.753799 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05be5eb0-ebba-41a5-b449-4d5b5076941f admin admin] RBAC: Authorizing `identity:create_grant(project_id=9feb2e942d124076959cd0f67f2f4ac7, user_id=f3ef80514d5e4dbab9a183a662be0347, role_id=f1e0c25f6e9049e897cb7350c7e54ab3)` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:07:13.756493 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05be5eb0-ebba-41a5-b449-4d5b5076941f admin admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:07:13.812234 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 957/1932] 10.222.0.59 () {60 vars in 1482 bytes} [Thu Jun 2 16:07:13 2022] PUT /identity/v3/projects/6548654862a645b89ba7b518c2209357/users/964db856353448e58f40cbe0b5f20969/roles/649e0f2b5a264c419ea6a1441f123a03 => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 16:07:13.813505 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ae376f4-ee42-44b5-8875-6ec4273d299f admin admin] Authenticating user token {{(pid=80396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:07:13.846826 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 976/1933] 10.222.0.59 () {60 vars in 1482 bytes} [Thu Jun 2 16:07:13 2022] PUT /identity/v3/projects/9feb2e942d124076959cd0f67f2f4ac7/users/f3ef80514d5e4dbab9a183a662be0347/roles/f1e0c25f6e9049e897cb7350c7e54ab3 => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 16:07:13.847899 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05be5eb0-ebba-41a5-b449-4d5b5076941f admin admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:07:13.851557 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.fernet_utils [None req-05be5eb0-ebba-41a5-b449-4d5b5076941f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:07:13.924469 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ae376f4-ee42-44b5-8875-6ec4273d299f admin admin] Validating token access rules against request {{(pid=80396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:07:13.934401 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05be5eb0-ebba-41a5-b449-4d5b5076941f admin admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:07:13.938628 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2c94e81-bbb2-481f-a032-155b0f7258d2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6534961c369940a5b88f310c6450250b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c87c981909d4b8db02783421818c79b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:07:13.939283 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c94e81-bbb2-481f-a032-155b0f7258d2 service cinder] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:07:13.939569 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c94e81-bbb2-481f-a032-155b0f7258d2 service cinder] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:07:13.939981 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c94e81-bbb2-481f-a032-155b0f7258d2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:07:13.996310 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1cd5b31-6537-4446-b6cc-0871a755a518 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f73d5a98be74242b45222df39fb6213', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:07:13.997495 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1cd5b31-6537-4446-b6cc-0871a755a518 admin admin] REQUEST_METHOD: `PUT` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:07:13.997848 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1cd5b31-6537-4446-b6cc-0871a755a518 admin admin] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:07:13.998374 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1cd5b31-6537-4446-b6cc-0871a755a518 admin admin] PATH_INFO: `/v3/projects/eeee34f6303d4e8ab23d86c71cc7da81/users/db5fcfc8a7c8415994334adf280a676c/roles/f1e0c25f6e9049e897cb7350c7e54ab3` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:07:14.000756 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1cd5b31-6537-4446-b6cc-0871a755a518 admin admin] RBAC: Authorizing `identity:create_grant(project_id=eeee34f6303d4e8ab23d86c71cc7da81, user_id=db5fcfc8a7c8415994334adf280a676c, role_id=f1e0c25f6e9049e897cb7350c7e54ab3)` {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:07:14.003718 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1cd5b31-6537-4446-b6cc-0871a755a518 admin admin] RBAC: Authorization granted {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:07:14.009104 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2c94e81-bbb2-481f-a032-155b0f7258d2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:07:14.011036 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2c94e81-bbb2-481f-a032-155b0f7258d2 service cinder] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:07:14.015428 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 958/1934] 10.222.0.59 () {60 vars in 1482 bytes} [Thu Jun 2 16:07:13 2022] PUT /identity/v3/projects/eeee34f6303d4e8ab23d86c71cc7da81/users/db5fcfc8a7c8415994334adf280a676c/roles/f1e0c25f6e9049e897cb7350c7e54ab3 => generated 0 bytes in 202 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 16:07:14.016577 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8331f4bd-2c58-4b51-8f19-19e04d9a86cd None None] REQUEST_METHOD: `POST` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:07:14.016871 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8331f4bd-2c58-4b51-8f19-19e04d9a86cd None None] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:07:14.017203 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8331f4bd-2c58-4b51-8f19-19e04d9a86cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:07:14.025599 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 977/1935] 10.222.0.59 () {60 vars in 1365 bytes} [Thu Jun 2 16:07:13 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 178 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 16:07:14.027128 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2c94e81-bbb2-481f-a032-155b0f7258d2 service cinder] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:07:14.043489 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2c94e81-bbb2-481f-a032-155b0f7258d2 service cinder] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:07:14.050021 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.auth.core [None req-8331f4bd-2c58-4b51-8f19-19e04d9a86cd None None] MFA Rules not processed for user `964db856353448e58f40cbe0b5f20969`. Rule list: `[]` (Enabled: `True`). {{(pid=80396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 16:07:14.051720 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.fernet_utils [None req-8331f4bd-2c58-4b51-8f19-19e04d9a86cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:07:14.163955 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 959/1936] 10.222.0.59 () {58 vars in 957 bytes} [Thu Jun 2 16:07:14 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 16:07:14.165321 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4622ae4-a1ec-4670-bb8a-d08f9bc9f56b None None] REQUEST_METHOD: `POST` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:07:14.165774 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4622ae4-a1ec-4670-bb8a-d08f9bc9f56b None None] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:07:14.166274 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4622ae4-a1ec-4670-bb8a-d08f9bc9f56b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:07:14.166738 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b537bc3c-7e36-4b41-97c9-e647472e2476 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f73d5a98be74242b45222df39fb6213', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:07:14.167582 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b537bc3c-7e36-4b41-97c9-e647472e2476 admin admin] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:07:14.168017 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b537bc3c-7e36-4b41-97c9-e647472e2476 admin admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:07:14.168433 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b537bc3c-7e36-4b41-97c9-e647472e2476 admin admin] PATH_INFO: `/v3/roles` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:07:14.170326 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b537bc3c-7e36-4b41-97c9-e647472e2476 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:07:14.172466 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b537bc3c-7e36-4b41-97c9-e647472e2476 admin admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:07:14.187619 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 978/1937] 10.222.0.59 () {58 vars in 1121 bytes} [Thu Jun 2 16:07:14 2022] GET /identity/v3/roles => generated 1420 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 16:07:14.191330 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b537bc3c-7e36-4b41-97c9-e647472e2476 admin admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:07:14.208872 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.auth.core [None req-f4622ae4-a1ec-4670-bb8a-d08f9bc9f56b None None] MFA Rules not processed for user `db5fcfc8a7c8415994334adf280a676c`. Rule list: `[]` (Enabled: `True`). {{(pid=80396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 16:07:14.212542 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.fernet_utils [None req-f4622ae4-a1ec-4670-bb8a-d08f9bc9f56b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:07:14.228337 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b537bc3c-7e36-4b41-97c9-e647472e2476 admin admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:07:14.246184 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e279a815-00f6-43d6-92ca-0163ee49acb7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f73d5a98be74242b45222df39fb6213', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:07:14.248601 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e279a815-00f6-43d6-92ca-0163ee49acb7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:07:14.253261 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e279a815-00f6-43d6-92ca-0163ee49acb7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:07:14.253261 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e279a815-00f6-43d6-92ca-0163ee49acb7 admin admin] PATH_INFO: `/v3/projects/9feb2e942d124076959cd0f67f2f4ac7/users/f3ef80514d5e4dbab9a183a662be0347/roles/f1e0c25f6e9049e897cb7350c7e54ab3` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:07:14.254421 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e279a815-00f6-43d6-92ca-0163ee49acb7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9feb2e942d124076959cd0f67f2f4ac7, user_id=f3ef80514d5e4dbab9a183a662be0347, role_id=f1e0c25f6e9049e897cb7350c7e54ab3)` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:07:14.257421 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e279a815-00f6-43d6-92ca-0163ee49acb7 admin admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:07:14.296949 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 979/1938] 10.222.0.59 () {60 vars in 1482 bytes} [Thu Jun 2 16:07:14 2022] PUT /identity/v3/projects/9feb2e942d124076959cd0f67f2f4ac7/users/f3ef80514d5e4dbab9a183a662be0347/roles/f1e0c25f6e9049e897cb7350c7e54ab3 => generated 0 bytes in 97 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 16:07:14.296949 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e279a815-00f6-43d6-92ca-0163ee49acb7 admin admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:07:14.296949 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.fernet_utils [None req-e279a815-00f6-43d6-92ca-0163ee49acb7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:07:14.316219 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 960/1939] 10.222.0.59 () {58 vars in 957 bytes} [Thu Jun 2 16:07:14 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 16:07:14.318382 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2879a53-4b4d-4835-866d-245eb245921f None None] REQUEST_METHOD: `POST` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:07:14.318871 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2879a53-4b4d-4835-866d-245eb245921f None None] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:07:14.319594 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2879a53-4b4d-4835-866d-245eb245921f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:07:14.358438 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.auth.core [None req-a2879a53-4b4d-4835-866d-245eb245921f None None] MFA Rules not processed for user `f3ef80514d5e4dbab9a183a662be0347`. Rule list: `[]` (Enabled: `True`). {{(pid=80396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 16:07:14.360394 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.fernet_utils [None req-a2879a53-4b4d-4835-866d-245eb245921f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:07:14.391752 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e279a815-00f6-43d6-92ca-0163ee49acb7 admin admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:07:14.394021 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a2fe9f0-801d-40d7-9536-7cf2f69fa5a2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6534961c369940a5b88f310c6450250b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c87c981909d4b8db02783421818c79b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:07:14.394772 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a2fe9f0-801d-40d7-9536-7cf2f69fa5a2 service cinder] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:07:14.395041 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a2fe9f0-801d-40d7-9536-7cf2f69fa5a2 service cinder] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:07:14.395460 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a2fe9f0-801d-40d7-9536-7cf2f69fa5a2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:07:14.454798 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 961/1940] 10.222.0.59 () {58 vars in 957 bytes} [Thu Jun 2 16:07:14 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 16:07:14.461980 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a2fe9f0-801d-40d7-9536-7cf2f69fa5a2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:07:14.463480 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a2fe9f0-801d-40d7-9536-7cf2f69fa5a2 service cinder] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:07:14.473200 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 980/1941] 10.222.0.59 () {60 vars in 1365 bytes} [Thu Jun 2 16:07:14 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 185 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 16:07:14.566435 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2879a53-4b4d-4835-866d-245eb245921f None None] Authenticating user token {{(pid=80396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:07:14.576971 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2879a53-4b4d-4835-866d-245eb245921f None None] Validating token access rules against request {{(pid=80396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:07:14.580566 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff9acf33-ec14-4bbf-9890-a4a54a9cf5cc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6534961c369940a5b88f310c6450250b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c87c981909d4b8db02783421818c79b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:07:14.581236 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff9acf33-ec14-4bbf-9890-a4a54a9cf5cc service cinder] REQUEST_METHOD: `GET` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:07:14.581572 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff9acf33-ec14-4bbf-9890-a4a54a9cf5cc service cinder] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:07:14.589883 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff9acf33-ec14-4bbf-9890-a4a54a9cf5cc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:07:14.646010 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff9acf33-ec14-4bbf-9890-a4a54a9cf5cc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:07:14.647548 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff9acf33-ec14-4bbf-9890-a4a54a9cf5cc service cinder] RBAC: Authorization granted {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:07:14.657485 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 962/1942] 10.222.0.59 () {60 vars in 1365 bytes} [Thu Jun 2 16:07:14 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 16:07:14.705605 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a2fe9f0-801d-40d7-9536-7cf2f69fa5a2 service cinder] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:07:14.715147 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a2fe9f0-801d-40d7-9536-7cf2f69fa5a2 service cinder] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:07:14.719094 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fef5346-92c4-48f2-bc07-89a36a17d103 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6534961c369940a5b88f310c6450250b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c87c981909d4b8db02783421818c79b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:07:14.719749 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fef5346-92c4-48f2-bc07-89a36a17d103 service cinder] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:07:14.720038 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fef5346-92c4-48f2-bc07-89a36a17d103 service cinder] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:07:14.720318 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fef5346-92c4-48f2-bc07-89a36a17d103 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:07:14.731446 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fef5346-92c4-48f2-bc07-89a36a17d103 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:07:14.732929 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fef5346-92c4-48f2-bc07-89a36a17d103 service cinder] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:07:14.744271 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 981/1943] 10.222.0.59 () {60 vars in 1365 bytes} [Thu Jun 2 16:07:14 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 16:07:14.977957 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG dbcounter [-] [80396] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 16:07:14.978585 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff9acf33-ec14-4bbf-9890-a4a54a9cf5cc service cinder] Authenticating user token {{(pid=80396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:07:14.987879 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff9acf33-ec14-4bbf-9890-a4a54a9cf5cc service cinder] Validating token access rules against request {{(pid=80396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:07:14.991788 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-353d6280-cd1c-4a6e-9a5a-24ce929b0718 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6534961c369940a5b88f310c6450250b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c87c981909d4b8db02783421818c79b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:07:14.992441 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-353d6280-cd1c-4a6e-9a5a-24ce929b0718 service cinder] REQUEST_METHOD: `GET` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:07:14.992986 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-353d6280-cd1c-4a6e-9a5a-24ce929b0718 service cinder] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:07:14.993208 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-353d6280-cd1c-4a6e-9a5a-24ce929b0718 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:07:15.050048 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-353d6280-cd1c-4a6e-9a5a-24ce929b0718 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:07:15.051514 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-353d6280-cd1c-4a6e-9a5a-24ce929b0718 service cinder] RBAC: Authorization granted {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:07:15.061083 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 963/1944] 10.222.0.59 () {60 vars in 1365 bytes} [Thu Jun 2 16:07:14 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 02 16:07:15.971778 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fef5346-92c4-48f2-bc07-89a36a17d103 service cinder] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:07:15.980930 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fef5346-92c4-48f2-bc07-89a36a17d103 service cinder] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:07:15.984902 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-066062c4-0805-498b-a809-af3ec1eec5be service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6534961c369940a5b88f310c6450250b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c87c981909d4b8db02783421818c79b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:07:15.985678 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-066062c4-0805-498b-a809-af3ec1eec5be service cinder] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:07:15.986026 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-066062c4-0805-498b-a809-af3ec1eec5be service cinder] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:07:15.986433 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-066062c4-0805-498b-a809-af3ec1eec5be service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:07:16.083180 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-066062c4-0805-498b-a809-af3ec1eec5be service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:07:16.084493 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-066062c4-0805-498b-a809-af3ec1eec5be service cinder] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:07:16.106058 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 982/1945] 10.222.0.59 () {60 vars in 1365 bytes} [Thu Jun 2 16:07:15 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 135 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 16:07:16.798884 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 16:07:17.137252 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG dbcounter [-] [80396] Writing DB stats keystone:INSERT=3,keystone:SELECT=90,keystone:DELETE=7 {{(pid=80396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 16:07:18.964549 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 16:07:19.981118 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG dbcounter [-] [80396] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=80396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 16:07:20.434394 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writing DB stats keystone:SELECT=100 {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 16:07:20.828648 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 16:07:21.125630 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG dbcounter [-] [80396] Writing DB stats keystone:SELECT=83,keystone:DELETE=13,keystone:INSERT=4 {{(pid=80396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 16:07:21.240321 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 16:07:21.781110 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 16:07:21.902967 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG dbcounter [-] [80396] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=80396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 16:07:22.129797 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writing DB stats keystone:SELECT=93,keystone:INSERT=4,keystone:DELETE=3 {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 16:07:22.217090 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG dbcounter [-] [80396] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 16:07:22.652832 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 16:07:22.743156 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG dbcounter [-] [80396] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 16:07:24.303038 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 16:07:24.475065 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG dbcounter [-] [80396] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=80396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 16:07:25.355469 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG dbcounter [-] [80396] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 16:07:25.692232 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 16:07:25.855617 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-353d6280-cd1c-4a6e-9a5a-24ce929b0718 service cinder] Authenticating user token {{(pid=80396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:07:25.923294 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-353d6280-cd1c-4a6e-9a5a-24ce929b0718 service cinder] Validating token access rules against request {{(pid=80396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:07:25.927978 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f47544-d1ab-4e22-91e5-65d2dcede8de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f73d5a98be74242b45222df39fb6213', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:07:25.928846 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f47544-d1ab-4e22-91e5-65d2dcede8de admin admin] REQUEST_METHOD: `DELETE` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:07:25.929128 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f47544-d1ab-4e22-91e5-65d2dcede8de admin admin] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:07:25.929403 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f47544-d1ab-4e22-91e5-65d2dcede8de admin admin] PATH_INFO: `/v3/users/213b9e98117041a7998b926a3c6e9c54` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:07:25.930726 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54f47544-d1ab-4e22-91e5-65d2dcede8de admin admin] RBAC: Authorizing `identity:delete_user(user_id=213b9e98117041a7998b926a3c6e9c54)` {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:07:25.932914 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54f47544-d1ab-4e22-91e5-65d2dcede8de admin admin] RBAC: Authorization granted {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:07:26.206412 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.notifications [None req-54f47544-d1ab-4e22-91e5-65d2dcede8de admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '213b9e98117041a7998b926a3c6e9c54'} {{(pid=80396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:07:26.207091 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.notifications [None req-54f47544-d1ab-4e22-91e5-65d2dcede8de admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '213b9e98117041a7998b926a3c6e9c54'} {{(pid=80396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:07:26.285518 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.notifications [None req-54f47544-d1ab-4e22-91e5-65d2dcede8de admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '213b9e98117041a7998b926a3c6e9c54'} {{(pid=80396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:07:26.302375 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.notifications [None req-54f47544-d1ab-4e22-91e5-65d2dcede8de admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '213b9e98117041a7998b926a3c6e9c54'} {{(pid=80396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:07:26.310885 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.notifications [None req-54f47544-d1ab-4e22-91e5-65d2dcede8de admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '213b9e98117041a7998b926a3c6e9c54'} {{(pid=80396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:07:26.324357 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 964/1946] 10.222.0.59 () {58 vars in 1223 bytes} [Thu Jun 2 16:07:25 2022] DELETE /identity/v3/users/213b9e98117041a7998b926a3c6e9c54 => generated 0 bytes in 466 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 16:07:26.327950 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3886ece-91dc-4b3e-9b8b-2098ca2572e5 None None] REQUEST_METHOD: `POST` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:07:26.328235 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3886ece-91dc-4b3e-9b8b-2098ca2572e5 None None] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:07:26.328504 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3886ece-91dc-4b3e-9b8b-2098ca2572e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:07:26.347400 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.auth.core [None req-e3886ece-91dc-4b3e-9b8b-2098ca2572e5 None None] MFA Rules not processed for user `400d1f4db9de49638549e5db29a041e1`. Rule list: `[]` (Enabled: `True`). {{(pid=80395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 16:07:26.348666 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.fernet_utils [None req-e3886ece-91dc-4b3e-9b8b-2098ca2572e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:07:26.377423 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG dbcounter [-] [80396] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 16:07:26.418444 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 983/1947] 10.222.0.59 () {58 vars in 957 bytes} [Thu Jun 2 16:07:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 16:07:26.429135 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f47544-d1ab-4e22-91e5-65d2dcede8de admin admin] Authenticating user token {{(pid=80396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:07:26.430848 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.fernet_utils [None req-54f47544-d1ab-4e22-91e5-65d2dcede8de admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:07:26.435950 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 16:07:26.526148 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f47544-d1ab-4e22-91e5-65d2dcede8de admin admin] Validating token access rules against request {{(pid=80396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:07:26.530391 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de46d8e-3f7a-4bdc-bf36-22e4d1569961 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9af40ddfe9ff4be3887b068f13a28dc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c87c981909d4b8db02783421818c79b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:07:26.531145 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de46d8e-3f7a-4bdc-bf36-22e4d1569961 service neutron] REQUEST_METHOD: `GET` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:07:26.531489 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de46d8e-3f7a-4bdc-bf36-22e4d1569961 service neutron] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:07:26.531850 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de46d8e-3f7a-4bdc-bf36-22e4d1569961 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:07:26.543518 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4de46d8e-3f7a-4bdc-bf36-22e4d1569961 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:07:26.545078 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4de46d8e-3f7a-4bdc-bf36-22e4d1569961 service neutron] RBAC: Authorization granted {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:07:26.566297 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 965/1948] 10.222.0.59 () {60 vars in 1365 bytes} [Thu Jun 2 16:07:26 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 138 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 16:07:27.111090 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3886ece-91dc-4b3e-9b8b-2098ca2572e5 None None] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:07:27.113223 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.fernet_utils [None req-e3886ece-91dc-4b3e-9b8b-2098ca2572e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:07:27.125791 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3886ece-91dc-4b3e-9b8b-2098ca2572e5 None None] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:07:27.130522 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b6f0979-1af7-4903-9019-609f98f7db5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f73d5a98be74242b45222df39fb6213', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:07:27.131360 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b6f0979-1af7-4903-9019-609f98f7db5b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:07:27.137136 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b6f0979-1af7-4903-9019-609f98f7db5b admin admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:07:27.137448 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b6f0979-1af7-4903-9019-609f98f7db5b admin admin] PATH_INFO: `/v3/projects/69f35418d2b540b580bf58355fe07c7b` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:07:27.138813 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b6f0979-1af7-4903-9019-609f98f7db5b admin admin] RBAC: Authorizing `identity:delete_project(project_id=69f35418d2b540b580bf58355fe07c7b)` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:07:27.140769 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b6f0979-1af7-4903-9019-609f98f7db5b admin admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:07:27.318101 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.notifications [None req-4b6f0979-1af7-4903-9019-609f98f7db5b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '69f35418d2b540b580bf58355fe07c7b', 'request_id': 'req-4b6f0979-1af7-4903-9019-609f98f7db5b'} {{(pid=80395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:07:27.331909 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.notifications [None req-4b6f0979-1af7-4903-9019-609f98f7db5b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '69f35418d2b540b580bf58355fe07c7b', 'request_id': 'req-4b6f0979-1af7-4903-9019-609f98f7db5b'} {{(pid=80395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:07:27.356580 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de46d8e-3f7a-4bdc-bf36-22e4d1569961 service neutron] Authenticating user token {{(pid=80396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:07:27.358613 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.fernet_utils [None req-4de46d8e-3f7a-4bdc-bf36-22e4d1569961 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:07:27.391067 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de46d8e-3f7a-4bdc-bf36-22e4d1569961 service neutron] Validating token access rules against request {{(pid=80396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:07:27.422939 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.notifications [None req-4b6f0979-1af7-4903-9019-609f98f7db5b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '69f35418d2b540b580bf58355fe07c7b', 'request_id': 'req-4b6f0979-1af7-4903-9019-609f98f7db5b'} {{(pid=80395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:07:27.440697 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.notifications [None req-4b6f0979-1af7-4903-9019-609f98f7db5b admin admin] The token cache is being invalidate because project 69f35418d2b540b580bf58355fe07c7b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80395) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 02 16:07:27.440697 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.notifications [None req-4b6f0979-1af7-4903-9019-609f98f7db5b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:07:27.440697 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.notifications [None req-4b6f0979-1af7-4903-9019-609f98f7db5b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:07:27.441992 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG dbcounter [-] [80396] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 16:07:27.448703 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 984/1949] 10.222.0.59 () {58 vars in 1232 bytes} [Thu Jun 2 16:07:27 2022] DELETE /identity/v3/projects/69f35418d2b540b580bf58355fe07c7b => generated 0 bytes in 334 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 16:07:27.450435 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b6f0979-1af7-4903-9019-609f98f7db5b admin admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:07:27.451870 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.fernet_utils [None req-4b6f0979-1af7-4903-9019-609f98f7db5b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:07:27.527214 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c779e1e-1b03-4f0e-8f07-e02a979dc3b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f73d5a98be74242b45222df39fb6213', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:07:27.528095 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c779e1e-1b03-4f0e-8f07-e02a979dc3b1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:07:27.528383 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c779e1e-1b03-4f0e-8f07-e02a979dc3b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:07:27.528667 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c779e1e-1b03-4f0e-8f07-e02a979dc3b1 admin admin] PATH_INFO: `/v3/users/5977780e274849ee8a2471738f5336be` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:07:27.529970 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c779e1e-1b03-4f0e-8f07-e02a979dc3b1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5977780e274849ee8a2471738f5336be)` {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:07:27.532220 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c779e1e-1b03-4f0e-8f07-e02a979dc3b1 admin admin] RBAC: Authorization granted {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:07:27.539249 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b6f0979-1af7-4903-9019-609f98f7db5b admin admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:07:27.565907 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f513aae4-614d-4be7-8ebb-f104e71a2847 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f73d5a98be74242b45222df39fb6213', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:07:27.567130 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f513aae4-614d-4be7-8ebb-f104e71a2847 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:07:27.567422 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f513aae4-614d-4be7-8ebb-f104e71a2847 admin admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:07:27.567698 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f513aae4-614d-4be7-8ebb-f104e71a2847 admin admin] PATH_INFO: `/v3/users/db5fcfc8a7c8415994334adf280a676c` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:07:27.568971 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f513aae4-614d-4be7-8ebb-f104e71a2847 admin admin] RBAC: Authorizing `identity:delete_user(user_id=db5fcfc8a7c8415994334adf280a676c)` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:07:27.571003 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f513aae4-614d-4be7-8ebb-f104e71a2847 admin admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:07:27.669207 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 16:07:27.856927 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.notifications [None req-9c779e1e-1b03-4f0e-8f07-e02a979dc3b1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5977780e274849ee8a2471738f5336be'} {{(pid=80396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:07:27.858987 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.notifications [None req-9c779e1e-1b03-4f0e-8f07-e02a979dc3b1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5977780e274849ee8a2471738f5336be'} {{(pid=80396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:07:27.868134 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.notifications [None req-f513aae4-614d-4be7-8ebb-f104e71a2847 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'db5fcfc8a7c8415994334adf280a676c'} {{(pid=80395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:07:27.977956 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.notifications [None req-9c779e1e-1b03-4f0e-8f07-e02a979dc3b1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5977780e274849ee8a2471738f5336be'} {{(pid=80396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:07:27.995863 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.notifications [None req-9c779e1e-1b03-4f0e-8f07-e02a979dc3b1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5977780e274849ee8a2471738f5336be'} {{(pid=80396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:07:28.004625 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.notifications [None req-9c779e1e-1b03-4f0e-8f07-e02a979dc3b1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5977780e274849ee8a2471738f5336be'} {{(pid=80396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:07:28.017223 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 966/1950] 10.222.0.59 () {58 vars in 1223 bytes} [Thu Jun 2 16:07:27 2022] DELETE /identity/v3/users/5977780e274849ee8a2471738f5336be => generated 0 bytes in 658 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 16:07:28.018685 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd74b624-0f7a-4788-96b5-6adcaf0ce8f2 None None] REQUEST_METHOD: `POST` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:07:28.018975 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd74b624-0f7a-4788-96b5-6adcaf0ce8f2 None None] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:07:28.021710 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd74b624-0f7a-4788-96b5-6adcaf0ce8f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:07:28.040229 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.auth.core [None req-bd74b624-0f7a-4788-96b5-6adcaf0ce8f2 None None] MFA Rules not processed for user `400d1f4db9de49638549e5db29a041e1`. Rule list: `[]` (Enabled: `True`). {{(pid=80396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 16:07:28.042228 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.fernet_utils [None req-bd74b624-0f7a-4788-96b5-6adcaf0ce8f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:07:28.078921 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.notifications [None req-f513aae4-614d-4be7-8ebb-f104e71a2847 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'db5fcfc8a7c8415994334adf280a676c'} {{(pid=80395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:07:28.097720 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.notifications [None req-f513aae4-614d-4be7-8ebb-f104e71a2847 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'db5fcfc8a7c8415994334adf280a676c'} {{(pid=80395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:07:28.098725 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.notifications [None req-f513aae4-614d-4be7-8ebb-f104e71a2847 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'db5fcfc8a7c8415994334adf280a676c'} {{(pid=80395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:07:28.109013 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.notifications [None req-f513aae4-614d-4be7-8ebb-f104e71a2847 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'db5fcfc8a7c8415994334adf280a676c'} {{(pid=80395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:07:28.115599 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 985/1951] 10.222.0.59 () {58 vars in 1223 bytes} [Thu Jun 2 16:07:27 2022] DELETE /identity/v3/users/db5fcfc8a7c8415994334adf280a676c => generated 0 bytes in 666 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 16:07:28.119040 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 967/1952] 10.222.0.59 () {58 vars in 957 bytes} [Thu Jun 2 16:07:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 16:07:28.138982 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f513aae4-614d-4be7-8ebb-f104e71a2847 admin admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:07:28.140801 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.fernet_utils [None req-f513aae4-614d-4be7-8ebb-f104e71a2847 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:07:28.218166 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f513aae4-614d-4be7-8ebb-f104e71a2847 admin admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:07:28.223225 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03fa626a-5057-4714-9df5-925894252497 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9af40ddfe9ff4be3887b068f13a28dc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c87c981909d4b8db02783421818c79b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:07:28.224047 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03fa626a-5057-4714-9df5-925894252497 service neutron] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:07:28.224366 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03fa626a-5057-4714-9df5-925894252497 service neutron] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:07:28.225396 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03fa626a-5057-4714-9df5-925894252497 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:07:28.287469 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03fa626a-5057-4714-9df5-925894252497 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:07:28.289030 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03fa626a-5057-4714-9df5-925894252497 service neutron] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:07:28.299108 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 986/1953] 10.222.0.59 () {60 vars in 1365 bytes} [Thu Jun 2 16:07:28 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 161 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 16:07:28.727013 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd74b624-0f7a-4788-96b5-6adcaf0ce8f2 None None] Authenticating user token {{(pid=80396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:07:28.731413 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.fernet_utils [None req-bd74b624-0f7a-4788-96b5-6adcaf0ce8f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:07:28.757227 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd74b624-0f7a-4788-96b5-6adcaf0ce8f2 None None] Validating token access rules against request {{(pid=80396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:07:28.764570 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79bde96b-2f42-482f-845b-267c9be579c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f73d5a98be74242b45222df39fb6213', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:07:28.765907 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79bde96b-2f42-482f-845b-267c9be579c4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:07:28.766487 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79bde96b-2f42-482f-845b-267c9be579c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:07:28.766963 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79bde96b-2f42-482f-845b-267c9be579c4 admin admin] PATH_INFO: `/v3/projects/eeee34f6303d4e8ab23d86c71cc7da81` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:07:28.769015 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79bde96b-2f42-482f-845b-267c9be579c4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=eeee34f6303d4e8ab23d86c71cc7da81)` {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:07:28.774563 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79bde96b-2f42-482f-845b-267c9be579c4 admin admin] RBAC: Authorization granted {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:07:28.979881 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03fa626a-5057-4714-9df5-925894252497 service neutron] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:07:28.981367 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.fernet_utils [None req-03fa626a-5057-4714-9df5-925894252497 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:07:29.003518 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03fa626a-5057-4714-9df5-925894252497 service neutron] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:07:29.011956 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.notifications [None req-79bde96b-2f42-482f-845b-267c9be579c4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'eeee34f6303d4e8ab23d86c71cc7da81', 'request_id': 'req-79bde96b-2f42-482f-845b-267c9be579c4'} {{(pid=80396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:07:29.019910 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.notifications [None req-79bde96b-2f42-482f-845b-267c9be579c4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'eeee34f6303d4e8ab23d86c71cc7da81', 'request_id': 'req-79bde96b-2f42-482f-845b-267c9be579c4'} {{(pid=80396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:07:29.101818 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb884635-9b7d-4852-b9ff-f6542e2221af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f73d5a98be74242b45222df39fb6213', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:07:29.101818 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb884635-9b7d-4852-b9ff-f6542e2221af admin admin] REQUEST_METHOD: `DELETE` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:07:29.101818 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb884635-9b7d-4852-b9ff-f6542e2221af admin admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:07:29.101818 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb884635-9b7d-4852-b9ff-f6542e2221af admin admin] PATH_INFO: `/v3/projects/55330393dc9b4a919d7ccd7cec9be7a2` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:07:29.102393 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb884635-9b7d-4852-b9ff-f6542e2221af admin admin] RBAC: Authorizing `identity:delete_project(project_id=55330393dc9b4a919d7ccd7cec9be7a2)` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:07:29.102393 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb884635-9b7d-4852-b9ff-f6542e2221af admin admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:07:29.131739 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.notifications [None req-79bde96b-2f42-482f-845b-267c9be579c4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'eeee34f6303d4e8ab23d86c71cc7da81', 'request_id': 'req-79bde96b-2f42-482f-845b-267c9be579c4'} {{(pid=80396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:07:29.141200 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.notifications [None req-79bde96b-2f42-482f-845b-267c9be579c4 admin admin] The token cache is being invalidate because project eeee34f6303d4e8ab23d86c71cc7da81 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80396) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 02 16:07:29.142140 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.notifications [None req-79bde96b-2f42-482f-845b-267c9be579c4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:07:29.143338 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.notifications [None req-79bde96b-2f42-482f-845b-267c9be579c4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:07:29.147030 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 968/1954] 10.222.0.59 () {58 vars in 1232 bytes} [Thu Jun 2 16:07:28 2022] DELETE /identity/v3/projects/eeee34f6303d4e8ab23d86c71cc7da81 => generated 0 bytes in 420 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 16:07:29.157946 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683db374-45ed-485d-b4b2-f57eb5972e70 None None] REQUEST_METHOD: `POST` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:07:29.158431 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683db374-45ed-485d-b4b2-f57eb5972e70 None None] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:07:29.158803 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683db374-45ed-485d-b4b2-f57eb5972e70 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:07:29.188425 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.auth.core [None req-683db374-45ed-485d-b4b2-f57eb5972e70 None None] MFA Rules not processed for user `400d1f4db9de49638549e5db29a041e1`. Rule list: `[]` (Enabled: `True`). {{(pid=80396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 16:07:29.189623 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.fernet_utils [None req-683db374-45ed-485d-b4b2-f57eb5972e70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:07:29.215723 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 969/1955] 10.222.0.59 () {58 vars in 957 bytes} [Thu Jun 2 16:07:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 64 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 16:07:29.224279 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1accb840-30a0-422d-994b-d85329905f41 None None] REQUEST_METHOD: `POST` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:07:29.224574 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1accb840-30a0-422d-994b-d85329905f41 None None] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:07:29.224863 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1accb840-30a0-422d-994b-d85329905f41 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:07:29.248935 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.auth.core [None req-1accb840-30a0-422d-994b-d85329905f41 None None] MFA Rules not processed for user `400d1f4db9de49638549e5db29a041e1`. Rule list: `[]` (Enabled: `True`). {{(pid=80396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 16:07:29.250167 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.fernet_utils [None req-1accb840-30a0-422d-994b-d85329905f41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:07:29.272140 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.notifications [None req-eb884635-9b7d-4852-b9ff-f6542e2221af admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '55330393dc9b4a919d7ccd7cec9be7a2', 'request_id': 'req-eb884635-9b7d-4852-b9ff-f6542e2221af'} {{(pid=80395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:07:29.297372 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.notifications [None req-eb884635-9b7d-4852-b9ff-f6542e2221af admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '55330393dc9b4a919d7ccd7cec9be7a2', 'request_id': 'req-eb884635-9b7d-4852-b9ff-f6542e2221af'} {{(pid=80395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:07:29.332691 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG dbcounter [-] [80396] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 16:07:29.345952 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 970/1956] 10.222.0.59 () {58 vars in 957 bytes} [Thu Jun 2 16:07:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 16:07:29.346947 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1accb840-30a0-422d-994b-d85329905f41 None None] Authenticating user token {{(pid=80396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:07:29.366136 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1accb840-30a0-422d-994b-d85329905f41 None None] Validating token access rules against request {{(pid=80396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:07:29.371719 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff76a92c-7f25-467a-88ee-2db0c7de6049 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f73d5a98be74242b45222df39fb6213', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:07:29.372387 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff76a92c-7f25-467a-88ee-2db0c7de6049 admin admin] REQUEST_METHOD: `GET` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:07:29.372668 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff76a92c-7f25-467a-88ee-2db0c7de6049 admin admin] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:07:29.372941 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff76a92c-7f25-467a-88ee-2db0c7de6049 admin admin] PATH_INFO: `/v3/domains` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:07:29.373675 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff76a92c-7f25-467a-88ee-2db0c7de6049 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80396) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 16:07:29.373979 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff76a92c-7f25-467a-88ee-2db0c7de6049 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:07:29.376175 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff76a92c-7f25-467a-88ee-2db0c7de6049 admin admin] RBAC: Authorization granted {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:07:29.389469 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.notifications [None req-eb884635-9b7d-4852-b9ff-f6542e2221af admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '55330393dc9b4a919d7ccd7cec9be7a2', 'request_id': 'req-eb884635-9b7d-4852-b9ff-f6542e2221af'} {{(pid=80395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:07:29.411569 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.notifications [None req-eb884635-9b7d-4852-b9ff-f6542e2221af admin admin] The token cache is being invalidate because project 55330393dc9b4a919d7ccd7cec9be7a2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80395) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 02 16:07:29.411926 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.notifications [None req-eb884635-9b7d-4852-b9ff-f6542e2221af admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:07:29.412517 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.notifications [None req-eb884635-9b7d-4852-b9ff-f6542e2221af admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:07:29.413942 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 971/1957] 10.222.0.59 () {58 vars in 1152 bytes} [Thu Jun 2 16:07:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 16:07:29.414940 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff76a92c-7f25-467a-88ee-2db0c7de6049 admin admin] Authenticating user token {{(pid=80396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:07:29.418401 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 987/1958] 10.222.0.59 () {58 vars in 1232 bytes} [Thu Jun 2 16:07:28 2022] DELETE /identity/v3/projects/55330393dc9b4a919d7ccd7cec9be7a2 => generated 0 bytes in 435 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 02 16:07:29.419166 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb884635-9b7d-4852-b9ff-f6542e2221af admin admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:07:29.419487 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.fernet_utils [None req-ff76a92c-7f25-467a-88ee-2db0c7de6049 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:07:29.426574 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.fernet_utils [None req-eb884635-9b7d-4852-b9ff-f6542e2221af admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:07:29.433286 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writing DB stats keystone:DELETE=14,keystone:SELECT=84,keystone:INSERT=2 {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 16:07:29.448375 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff76a92c-7f25-467a-88ee-2db0c7de6049 admin admin] Validating token access rules against request {{(pid=80396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:07:29.467775 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb884635-9b7d-4852-b9ff-f6542e2221af admin admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:07:29.473228 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-944d3a0c-5bae-48b6-81c2-6df8b2119400 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f73d5a98be74242b45222df39fb6213', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:07:29.477386 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944d3a0c-5bae-48b6-81c2-6df8b2119400 admin admin] REQUEST_METHOD: `POST` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:07:29.477386 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944d3a0c-5bae-48b6-81c2-6df8b2119400 admin admin] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:07:29.477386 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944d3a0c-5bae-48b6-81c2-6df8b2119400 admin admin] PATH_INFO: `/v3/projects` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:07:29.477386 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-944d3a0c-5bae-48b6-81c2-6df8b2119400 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:07:29.478202 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-944d3a0c-5bae-48b6-81c2-6df8b2119400 admin admin] RBAC: Authorization granted {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:07:29.481931 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df4764a5-dd39-45ee-94ef-0e3c41291da6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f73d5a98be74242b45222df39fb6213', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:07:29.482933 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df4764a5-dd39-45ee-94ef-0e3c41291da6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:07:29.484543 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df4764a5-dd39-45ee-94ef-0e3c41291da6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:07:29.487129 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df4764a5-dd39-45ee-94ef-0e3c41291da6 admin admin] PATH_INFO: `/v3/users/2c8a89c960f242bb95583c887b3406b2` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:07:29.488170 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df4764a5-dd39-45ee-94ef-0e3c41291da6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2c8a89c960f242bb95583c887b3406b2)` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:07:29.491622 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df4764a5-dd39-45ee-94ef-0e3c41291da6 admin admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:07:29.591584 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 972/1959] 10.222.0.59 () {60 vars in 1152 bytes} [Thu Jun 2 16:07:29 2022] POST /identity/v3/projects => generated 387 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 16:07:29.592541 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-944d3a0c-5bae-48b6-81c2-6df8b2119400 admin admin] Authenticating user token {{(pid=80396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:07:29.685355 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-944d3a0c-5bae-48b6-81c2-6df8b2119400 admin admin] Validating token access rules against request {{(pid=80396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:07:29.693446 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d79caeeb-f3a4-4460-8c89-6dad836040b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f73d5a98be74242b45222df39fb6213', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:07:29.694459 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d79caeeb-f3a4-4460-8c89-6dad836040b6 admin admin] REQUEST_METHOD: `POST` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:07:29.694929 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d79caeeb-f3a4-4460-8c89-6dad836040b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:07:29.695691 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d79caeeb-f3a4-4460-8c89-6dad836040b6 admin admin] PATH_INFO: `/v3/users` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:07:29.696465 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d79caeeb-f3a4-4460-8c89-6dad836040b6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:07:29.699845 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d79caeeb-f3a4-4460-8c89-6dad836040b6 admin admin] RBAC: Authorization granted {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:07:29.768564 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.notifications [None req-df4764a5-dd39-45ee-94ef-0e3c41291da6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2c8a89c960f242bb95583c887b3406b2'} {{(pid=80395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:07:29.822579 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 973/1960] 10.222.0.59 () {60 vars in 1143 bytes} [Thu Jun 2 16:07:29 2022] POST /identity/v3/users => generated 294 bytes in 227 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 16:07:29.824739 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d79caeeb-f3a4-4460-8c89-6dad836040b6 admin admin] Authenticating user token {{(pid=80396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:07:29.846351 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d79caeeb-f3a4-4460-8c89-6dad836040b6 admin admin] Validating token access rules against request {{(pid=80396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:07:29.852873 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b09c207c-c371-4283-beaf-898fe5ace6a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f73d5a98be74242b45222df39fb6213', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:07:29.854025 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09c207c-c371-4283-beaf-898fe5ace6a9 admin admin] REQUEST_METHOD: `GET` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:07:29.854959 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09c207c-c371-4283-beaf-898fe5ace6a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:07:29.855335 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09c207c-c371-4283-beaf-898fe5ace6a9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:07:29.857978 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b09c207c-c371-4283-beaf-898fe5ace6a9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:07:29.860162 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b09c207c-c371-4283-beaf-898fe5ace6a9 admin admin] RBAC: Authorization granted {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:07:29.874576 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 974/1961] 10.222.0.59 () {58 vars in 1121 bytes} [Thu Jun 2 16:07:29 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 16:07:29.881037 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.notifications [None req-df4764a5-dd39-45ee-94ef-0e3c41291da6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2c8a89c960f242bb95583c887b3406b2'} {{(pid=80395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:07:29.894048 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b09c207c-c371-4283-beaf-898fe5ace6a9 admin admin] Authenticating user token {{(pid=80396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:07:29.903835 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.notifications [None req-df4764a5-dd39-45ee-94ef-0e3c41291da6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2c8a89c960f242bb95583c887b3406b2'} {{(pid=80395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:07:29.905676 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.notifications [None req-df4764a5-dd39-45ee-94ef-0e3c41291da6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2c8a89c960f242bb95583c887b3406b2'} {{(pid=80395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:07:29.917086 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.notifications [None req-df4764a5-dd39-45ee-94ef-0e3c41291da6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2c8a89c960f242bb95583c887b3406b2'} {{(pid=80395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:07:29.926850 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 988/1962] 10.222.0.59 () {58 vars in 1223 bytes} [Thu Jun 2 16:07:29 2022] DELETE /identity/v3/users/2c8a89c960f242bb95583c887b3406b2 => generated 0 bytes in 508 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 16:07:29.928364 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df4764a5-dd39-45ee-94ef-0e3c41291da6 admin admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:07:29.930607 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.fernet_utils [None req-df4764a5-dd39-45ee-94ef-0e3c41291da6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:07:29.935752 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b09c207c-c371-4283-beaf-898fe5ace6a9 admin admin] Validating token access rules against request {{(pid=80396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:07:30.011671 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df4764a5-dd39-45ee-94ef-0e3c41291da6 admin admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:07:30.016873 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4c4c282-e226-4129-a6a7-43bed0d3de0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f73d5a98be74242b45222df39fb6213', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:07:30.018322 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c4c282-e226-4129-a6a7-43bed0d3de0a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:07:30.019155 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c4c282-e226-4129-a6a7-43bed0d3de0a admin admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:07:30.019594 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c4c282-e226-4129-a6a7-43bed0d3de0a admin admin] PATH_INFO: `/v3/users/a7ebe51237b34200a52d550d6e34e5d3` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:07:30.021434 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4c4c282-e226-4129-a6a7-43bed0d3de0a admin admin] RBAC: Authorizing `identity:delete_user(user_id=a7ebe51237b34200a52d550d6e34e5d3)` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:07:30.024852 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4c4c282-e226-4129-a6a7-43bed0d3de0a admin admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:07:30.044523 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3122387-3b9d-48a9-82bf-8ebf1af846ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f73d5a98be74242b45222df39fb6213', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:07:30.045495 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3122387-3b9d-48a9-82bf-8ebf1af846ee admin admin] REQUEST_METHOD: `GET` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:07:30.049551 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3122387-3b9d-48a9-82bf-8ebf1af846ee admin admin] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:07:30.050004 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3122387-3b9d-48a9-82bf-8ebf1af846ee admin admin] PATH_INFO: `/v3/roles` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:07:30.051914 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3122387-3b9d-48a9-82bf-8ebf1af846ee admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:07:30.058416 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3122387-3b9d-48a9-82bf-8ebf1af846ee admin admin] RBAC: Authorization granted {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:07:30.076588 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 975/1963] 10.222.0.59 () {58 vars in 1121 bytes} [Thu Jun 2 16:07:29 2022] GET /identity/v3/roles => generated 1420 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 16:07:30.078211 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3122387-3b9d-48a9-82bf-8ebf1af846ee admin admin] Authenticating user token {{(pid=80396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:07:30.080035 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.fernet_utils [None req-f3122387-3b9d-48a9-82bf-8ebf1af846ee admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:07:30.099209 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3122387-3b9d-48a9-82bf-8ebf1af846ee admin admin] Validating token access rules against request {{(pid=80396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:07:30.105773 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3675e16c-fc03-4c83-8a93-e921c6173c33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f73d5a98be74242b45222df39fb6213', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:07:30.107187 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3675e16c-fc03-4c83-8a93-e921c6173c33 admin admin] REQUEST_METHOD: `PUT` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:07:30.107551 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3675e16c-fc03-4c83-8a93-e921c6173c33 admin admin] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:07:30.107898 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3675e16c-fc03-4c83-8a93-e921c6173c33 admin admin] PATH_INFO: `/v3/projects/c2300a67910d406dbc806b387faf46b7/users/988a426f2fa84999bd5eabc6e0420dda/roles/649e0f2b5a264c419ea6a1441f123a03` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:07:30.164474 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3675e16c-fc03-4c83-8a93-e921c6173c33 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c2300a67910d406dbc806b387faf46b7, user_id=988a426f2fa84999bd5eabc6e0420dda, role_id=649e0f2b5a264c419ea6a1441f123a03)` {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:07:30.168126 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3675e16c-fc03-4c83-8a93-e921c6173c33 admin admin] RBAC: Authorization granted {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:07:30.334401 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 976/1964] 10.222.0.59 () {60 vars in 1482 bytes} [Thu Jun 2 16:07:30 2022] PUT /identity/v3/projects/c2300a67910d406dbc806b387faf46b7/users/988a426f2fa84999bd5eabc6e0420dda/roles/649e0f2b5a264c419ea6a1441f123a03 => generated 0 bytes in 257 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 16:07:30.358265 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162ae1b6-2ece-4b14-8139-316b64100d96 None None] REQUEST_METHOD: `POST` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:07:30.358479 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.notifications [None req-f4c4c282-e226-4129-a6a7-43bed0d3de0a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a7ebe51237b34200a52d550d6e34e5d3'} {{(pid=80395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:07:30.362008 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162ae1b6-2ece-4b14-8139-316b64100d96 None None] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:07:30.362008 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162ae1b6-2ece-4b14-8139-316b64100d96 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:07:30.412039 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.auth.core [None req-162ae1b6-2ece-4b14-8139-316b64100d96 None None] MFA Rules not processed for user `988a426f2fa84999bd5eabc6e0420dda`. Rule list: `[]` (Enabled: `True`). {{(pid=80396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 16:07:30.413314 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.fernet_utils [None req-162ae1b6-2ece-4b14-8139-316b64100d96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:07:30.486020 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.notifications [None req-f4c4c282-e226-4129-a6a7-43bed0d3de0a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a7ebe51237b34200a52d550d6e34e5d3'} {{(pid=80395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:07:30.500014 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.notifications [None req-f4c4c282-e226-4129-a6a7-43bed0d3de0a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a7ebe51237b34200a52d550d6e34e5d3'} {{(pid=80395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:07:30.500867 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.notifications [None req-f4c4c282-e226-4129-a6a7-43bed0d3de0a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a7ebe51237b34200a52d550d6e34e5d3'} {{(pid=80395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:07:30.508747 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.notifications [None req-f4c4c282-e226-4129-a6a7-43bed0d3de0a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a7ebe51237b34200a52d550d6e34e5d3'} {{(pid=80395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:07:30.516078 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 977/1965] 10.222.0.59 () {58 vars in 957 bytes} [Thu Jun 2 16:07:30 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 16:07:30.519113 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-162ae1b6-2ece-4b14-8139-316b64100d96 None None] Authenticating user token {{(pid=80396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:07:30.519358 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 989/1966] 10.222.0.59 () {58 vars in 1223 bytes} [Thu Jun 2 16:07:29 2022] DELETE /identity/v3/users/a7ebe51237b34200a52d550d6e34e5d3 => generated 0 bytes in 589 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 16:07:30.519714 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.fernet_utils [None req-162ae1b6-2ece-4b14-8139-316b64100d96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:07:30.520869 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9799e9-68cc-46a3-bce3-2bc51298a498 None None] REQUEST_METHOD: `POST` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:07:30.521168 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9799e9-68cc-46a3-bce3-2bc51298a498 None None] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:07:30.521454 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9799e9-68cc-46a3-bce3-2bc51298a498 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:07:30.543913 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.auth.core [None req-3e9799e9-68cc-46a3-bce3-2bc51298a498 None None] MFA Rules not processed for user `400d1f4db9de49638549e5db29a041e1`. Rule list: `[]` (Enabled: `True`). {{(pid=80395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 16:07:30.544929 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.fernet_utils [None req-3e9799e9-68cc-46a3-bce3-2bc51298a498 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:07:30.615379 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-162ae1b6-2ece-4b14-8139-316b64100d96 None None] Validating token access rules against request {{(pid=80396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:07:30.666373 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 990/1967] 10.222.0.59 () {58 vars in 957 bytes} [Thu Jun 2 16:07:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 02 16:07:30.666373 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e9799e9-68cc-46a3-bce3-2bc51298a498 None None] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:07:30.666373 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.fernet_utils [None req-3e9799e9-68cc-46a3-bce3-2bc51298a498 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:07:30.678378 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e9799e9-68cc-46a3-bce3-2bc51298a498 None None] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:07:30.693148 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95333a74-e86e-4466-acc1-1de55a6fba47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f73d5a98be74242b45222df39fb6213', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:07:30.693829 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95333a74-e86e-4466-acc1-1de55a6fba47 admin admin] REQUEST_METHOD: `POST` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:07:30.694139 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95333a74-e86e-4466-acc1-1de55a6fba47 admin admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:07:30.694427 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95333a74-e86e-4466-acc1-1de55a6fba47 admin admin] PATH_INFO: `/v3/projects` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:07:30.695597 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95333a74-e86e-4466-acc1-1de55a6fba47 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:07:30.697823 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99bc9ec3-e2ba-4337-948b-128bb121444b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f73d5a98be74242b45222df39fb6213', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:07:30.698018 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95333a74-e86e-4466-acc1-1de55a6fba47 admin admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:07:30.698342 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99bc9ec3-e2ba-4337-948b-128bb121444b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:07:30.698628 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99bc9ec3-e2ba-4337-948b-128bb121444b admin admin] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:07:30.698905 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99bc9ec3-e2ba-4337-948b-128bb121444b admin admin] PATH_INFO: `/v3/users/2e73ebe76e294679981478b5cc866cc1` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:07:30.700173 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99bc9ec3-e2ba-4337-948b-128bb121444b admin admin] RBAC: Authorizing `identity:delete_user(user_id=2e73ebe76e294679981478b5cc866cc1)` {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:07:30.703235 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99bc9ec3-e2ba-4337-948b-128bb121444b admin admin] RBAC: Authorization granted {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:07:30.818760 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 991/1968] 10.222.0.59 () {60 vars in 1152 bytes} [Thu Jun 2 16:07:30 2022] POST /identity/v3/projects => generated 387 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 16:07:30.820037 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95333a74-e86e-4466-acc1-1de55a6fba47 admin admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:07:30.821788 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.fernet_utils [None req-95333a74-e86e-4466-acc1-1de55a6fba47 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:07:30.891301 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95333a74-e86e-4466-acc1-1de55a6fba47 admin admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:07:30.895883 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c402bc9-ca5a-4621-bd8b-46a04aa6ef6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f73d5a98be74242b45222df39fb6213', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:07:30.896876 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c402bc9-ca5a-4621-bd8b-46a04aa6ef6b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:07:30.897157 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c402bc9-ca5a-4621-bd8b-46a04aa6ef6b admin admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:07:30.897433 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c402bc9-ca5a-4621-bd8b-46a04aa6ef6b admin admin] PATH_INFO: `/v3/projects/4c1134ebfa714939b0847cdfaf2ac9cc` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:07:30.898666 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c402bc9-ca5a-4621-bd8b-46a04aa6ef6b admin admin] RBAC: Authorizing `identity:delete_project(project_id=4c1134ebfa714939b0847cdfaf2ac9cc)` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:07:30.901109 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c402bc9-ca5a-4621-bd8b-46a04aa6ef6b admin admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:07:30.988289 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.notifications [None req-99bc9ec3-e2ba-4337-948b-128bb121444b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2e73ebe76e294679981478b5cc866cc1'} {{(pid=80396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:07:30.989522 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.notifications [None req-99bc9ec3-e2ba-4337-948b-128bb121444b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2e73ebe76e294679981478b5cc866cc1'} {{(pid=80396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:07:31.063315 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.notifications [None req-1c402bc9-ca5a-4621-bd8b-46a04aa6ef6b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4c1134ebfa714939b0847cdfaf2ac9cc', 'request_id': 'req-1c402bc9-ca5a-4621-bd8b-46a04aa6ef6b'} {{(pid=80395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:07:31.069532 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.notifications [None req-1c402bc9-ca5a-4621-bd8b-46a04aa6ef6b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4c1134ebfa714939b0847cdfaf2ac9cc', 'request_id': 'req-1c402bc9-ca5a-4621-bd8b-46a04aa6ef6b'} {{(pid=80395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:07:31.081216 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG dbcounter [-] [80396] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 16:07:31.081880 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.notifications [None req-99bc9ec3-e2ba-4337-948b-128bb121444b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2e73ebe76e294679981478b5cc866cc1'} {{(pid=80396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:07:31.095485 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.notifications [None req-99bc9ec3-e2ba-4337-948b-128bb121444b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2e73ebe76e294679981478b5cc866cc1'} {{(pid=80396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:07:31.102304 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.notifications [None req-99bc9ec3-e2ba-4337-948b-128bb121444b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2e73ebe76e294679981478b5cc866cc1'} {{(pid=80396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:07:31.108779 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 978/1969] 10.222.0.59 () {58 vars in 1223 bytes} [Thu Jun 2 16:07:30 2022] DELETE /identity/v3/users/2e73ebe76e294679981478b5cc866cc1 => generated 0 bytes in 592 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 16:07:31.109523 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99bc9ec3-e2ba-4337-948b-128bb121444b admin admin] Authenticating user token {{(pid=80396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:07:31.110936 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.fernet_utils [None req-99bc9ec3-e2ba-4337-948b-128bb121444b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:07:31.155289 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writing DB stats keystone:SELECT=85,keystone:DELETE=13,keystone:INSERT=2 {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 16:07:31.170349 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99bc9ec3-e2ba-4337-948b-128bb121444b admin admin] Validating token access rules against request {{(pid=80396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:07:31.174122 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b55ed666-8d7d-4333-93f1-52bddbece23b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9af40ddfe9ff4be3887b068f13a28dc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c87c981909d4b8db02783421818c79b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:07:31.174830 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b55ed666-8d7d-4333-93f1-52bddbece23b service neutron] REQUEST_METHOD: `GET` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:07:31.175170 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b55ed666-8d7d-4333-93f1-52bddbece23b service neutron] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:07:31.175448 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b55ed666-8d7d-4333-93f1-52bddbece23b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:07:31.177255 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.fernet_utils [None req-b55ed666-8d7d-4333-93f1-52bddbece23b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:07:31.218682 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.notifications [None req-1c402bc9-ca5a-4621-bd8b-46a04aa6ef6b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4c1134ebfa714939b0847cdfaf2ac9cc', 'request_id': 'req-1c402bc9-ca5a-4621-bd8b-46a04aa6ef6b'} {{(pid=80395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:07:31.232685 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.notifications [None req-1c402bc9-ca5a-4621-bd8b-46a04aa6ef6b admin admin] The token cache is being invalidate because project 4c1134ebfa714939b0847cdfaf2ac9cc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80395) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 02 16:07:31.232685 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.notifications [None req-1c402bc9-ca5a-4621-bd8b-46a04aa6ef6b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:07:31.232685 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.notifications [None req-1c402bc9-ca5a-4621-bd8b-46a04aa6ef6b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:07:31.232685 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 992/1970] 10.222.0.59 () {58 vars in 1232 bytes} [Thu Jun 2 16:07:30 2022] DELETE /identity/v3/projects/4c1134ebfa714939b0847cdfaf2ac9cc => generated 0 bytes in 411 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 16:07:31.232685 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c402bc9-ca5a-4621-bd8b-46a04aa6ef6b admin admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:07:31.233148 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.fernet_utils [None req-1c402bc9-ca5a-4621-bd8b-46a04aa6ef6b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:07:31.247119 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b55ed666-8d7d-4333-93f1-52bddbece23b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:07:31.248619 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b55ed666-8d7d-4333-93f1-52bddbece23b service neutron] RBAC: Authorization granted {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:07:31.259093 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 979/1971] 10.222.0.59 () {60 vars in 1365 bytes} [Thu Jun 2 16:07:31 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 150 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 16:07:31.260528 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7764d727-8082-492f-bcd2-46f95a511e58 None None] REQUEST_METHOD: `POST` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:07:31.260916 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7764d727-8082-492f-bcd2-46f95a511e58 None None] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:07:31.261197 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7764d727-8082-492f-bcd2-46f95a511e58 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:07:31.283667 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.auth.core [None req-7764d727-8082-492f-bcd2-46f95a511e58 None None] MFA Rules not processed for user `400d1f4db9de49638549e5db29a041e1`. Rule list: `[]` (Enabled: `True`). {{(pid=80396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 16:07:31.285151 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.fernet_utils [None req-7764d727-8082-492f-bcd2-46f95a511e58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:07:31.298747 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 980/1972] 10.222.0.59 () {58 vars in 957 bytes} [Thu Jun 2 16:07:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 16:07:31.298747 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0453eedb-f6ca-40a2-8f1d-2489d19696f1 None None] REQUEST_METHOD: `POST` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:07:31.298747 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0453eedb-f6ca-40a2-8f1d-2489d19696f1 None None] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:07:31.298747 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0453eedb-f6ca-40a2-8f1d-2489d19696f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:07:31.315553 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c402bc9-ca5a-4621-bd8b-46a04aa6ef6b admin admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:07:31.321603 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7881d8ea-095f-457b-9d52-8e444fc8c13b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f73d5a98be74242b45222df39fb6213', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:07:31.322417 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7881d8ea-095f-457b-9d52-8e444fc8c13b admin admin] REQUEST_METHOD: `POST` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:07:31.322765 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7881d8ea-095f-457b-9d52-8e444fc8c13b admin admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:07:31.323116 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7881d8ea-095f-457b-9d52-8e444fc8c13b admin admin] PATH_INFO: `/v3/users` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:07:31.324102 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7881d8ea-095f-457b-9d52-8e444fc8c13b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:07:31.324671 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.auth.core [None req-0453eedb-f6ca-40a2-8f1d-2489d19696f1 None None] MFA Rules not processed for user `400d1f4db9de49638549e5db29a041e1`. Rule list: `[]` (Enabled: `True`). {{(pid=80396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 16:07:31.325790 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.fernet_utils [None req-0453eedb-f6ca-40a2-8f1d-2489d19696f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:07:31.326633 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7881d8ea-095f-457b-9d52-8e444fc8c13b admin admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:07:31.344727 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 981/1973] 10.222.0.59 () {58 vars in 957 bytes} [Thu Jun 2 16:07:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 16:07:31.344727 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0453eedb-f6ca-40a2-8f1d-2489d19696f1 None None] Authenticating user token {{(pid=80396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:07:31.344727 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.fernet_utils [None req-0453eedb-f6ca-40a2-8f1d-2489d19696f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:07:31.356323 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0453eedb-f6ca-40a2-8f1d-2489d19696f1 None None] Validating token access rules against request {{(pid=80396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:07:31.360304 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5517afaa-f525-4d94-ad7a-21c466c56a35 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9af40ddfe9ff4be3887b068f13a28dc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c87c981909d4b8db02783421818c79b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:07:31.361073 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5517afaa-f525-4d94-ad7a-21c466c56a35 service neutron] REQUEST_METHOD: `GET` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:07:31.361454 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5517afaa-f525-4d94-ad7a-21c466c56a35 service neutron] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:07:31.361829 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5517afaa-f525-4d94-ad7a-21c466c56a35 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:07:31.374723 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5517afaa-f525-4d94-ad7a-21c466c56a35 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:07:31.376426 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5517afaa-f525-4d94-ad7a-21c466c56a35 service neutron] RBAC: Authorization granted {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:07:31.391871 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 982/1974] 10.222.0.59 () {60 vars in 1365 bytes} [Thu Jun 2 16:07:31 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 16:07:31.395575 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da75c8d-26d0-4741-a87e-c720ce5bea47 None None] REQUEST_METHOD: `POST` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:07:31.396354 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da75c8d-26d0-4741-a87e-c720ce5bea47 None None] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:07:31.397181 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da75c8d-26d0-4741-a87e-c720ce5bea47 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:07:31.433063 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.auth.core [None req-1da75c8d-26d0-4741-a87e-c720ce5bea47 None None] MFA Rules not processed for user `400d1f4db9de49638549e5db29a041e1`. Rule list: `[]` (Enabled: `True`). {{(pid=80396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 16:07:31.434551 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.fernet_utils [None req-1da75c8d-26d0-4741-a87e-c720ce5bea47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:07:31.446204 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 983/1975] 10.222.0.59 () {58 vars in 957 bytes} [Thu Jun 2 16:07:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 16:07:31.450694 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 993/1976] 10.222.0.59 () {60 vars in 1143 bytes} [Thu Jun 2 16:07:31 2022] POST /identity/v3/users => generated 300 bytes in 219 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 16:07:31.451522 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1da75c8d-26d0-4741-a87e-c720ce5bea47 None None] Authenticating user token {{(pid=80396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:07:31.454673 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7881d8ea-095f-457b-9d52-8e444fc8c13b admin admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:07:31.466111 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1da75c8d-26d0-4741-a87e-c720ce5bea47 None None] Validating token access rules against request {{(pid=80396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:07:31.469309 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7881d8ea-095f-457b-9d52-8e444fc8c13b admin admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:07:31.472994 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6294a156-a6bc-4683-9564-f72f37ef4177 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f73d5a98be74242b45222df39fb6213', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:07:31.473653 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6294a156-a6bc-4683-9564-f72f37ef4177 admin admin] REQUEST_METHOD: `GET` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:07:31.474235 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6294a156-a6bc-4683-9564-f72f37ef4177 admin admin] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:07:31.474530 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6294a156-a6bc-4683-9564-f72f37ef4177 admin admin] PATH_INFO: `/v3/domains` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:07:31.475247 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6294a156-a6bc-4683-9564-f72f37ef4177 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80396) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 16:07:31.475552 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6294a156-a6bc-4683-9564-f72f37ef4177 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:07:31.476810 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e45042b0-c340-4b96-9b89-e82a1b23de6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f73d5a98be74242b45222df39fb6213', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:07:31.477143 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6294a156-a6bc-4683-9564-f72f37ef4177 admin admin] RBAC: Authorization granted {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:07:31.477903 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45042b0-c340-4b96-9b89-e82a1b23de6b admin admin] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:07:31.478436 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45042b0-c340-4b96-9b89-e82a1b23de6b admin admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:07:31.478895 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45042b0-c340-4b96-9b89-e82a1b23de6b admin admin] PATH_INFO: `/v3/roles` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:07:31.480212 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e45042b0-c340-4b96-9b89-e82a1b23de6b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:07:31.484210 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e45042b0-c340-4b96-9b89-e82a1b23de6b admin admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:07:31.503711 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 984/1977] 10.222.0.59 () {58 vars in 1152 bytes} [Thu Jun 2 16:07:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 16:07:31.504941 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6294a156-a6bc-4683-9564-f72f37ef4177 admin admin] Authenticating user token {{(pid=80396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:07:31.510275 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 994/1978] 10.222.0.59 () {58 vars in 1121 bytes} [Thu Jun 2 16:07:31 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 02 16:07:31.513949 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e45042b0-c340-4b96-9b89-e82a1b23de6b admin admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:07:31.517776 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6294a156-a6bc-4683-9564-f72f37ef4177 admin admin] Validating token access rules against request {{(pid=80396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:07:31.523820 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a974fe9-c534-412f-a242-7c5630491e4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f73d5a98be74242b45222df39fb6213', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:07:31.524556 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a974fe9-c534-412f-a242-7c5630491e4c admin admin] REQUEST_METHOD: `POST` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:07:31.524840 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a974fe9-c534-412f-a242-7c5630491e4c admin admin] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:07:31.525217 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a974fe9-c534-412f-a242-7c5630491e4c admin admin] PATH_INFO: `/v3/projects` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:07:31.526244 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a974fe9-c534-412f-a242-7c5630491e4c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:07:31.526711 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e45042b0-c340-4b96-9b89-e82a1b23de6b admin admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:07:31.531902 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a974fe9-c534-412f-a242-7c5630491e4c admin admin] RBAC: Authorization granted {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:07:31.546952 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e172fe49-cb0e-4074-85e9-063c66cda021 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f73d5a98be74242b45222df39fb6213', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:07:31.548032 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e172fe49-cb0e-4074-85e9-063c66cda021 admin admin] REQUEST_METHOD: `PUT` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:07:31.548200 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e172fe49-cb0e-4074-85e9-063c66cda021 admin admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:07:31.548464 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e172fe49-cb0e-4074-85e9-063c66cda021 admin admin] PATH_INFO: `/v3/projects/a881c24ffb8f4cb993b0cbe2dc3e83ad/users/378fd162124b4c19869e13c074be1eed/roles/f1e0c25f6e9049e897cb7350c7e54ab3` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:07:31.572612 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e172fe49-cb0e-4074-85e9-063c66cda021 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a881c24ffb8f4cb993b0cbe2dc3e83ad, user_id=378fd162124b4c19869e13c074be1eed, role_id=f1e0c25f6e9049e897cb7350c7e54ab3)` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:07:31.577882 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e172fe49-cb0e-4074-85e9-063c66cda021 admin admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:07:31.694056 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 985/1979] 10.222.0.59 () {60 vars in 1152 bytes} [Thu Jun 2 16:07:31 2022] POST /identity/v3/projects => generated 375 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 16:07:31.698869 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a974fe9-c534-412f-a242-7c5630491e4c admin admin] Authenticating user token {{(pid=80396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:07:31.727372 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 995/1980] 10.222.0.59 () {60 vars in 1482 bytes} [Thu Jun 2 16:07:31 2022] PUT /identity/v3/projects/a881c24ffb8f4cb993b0cbe2dc3e83ad/users/378fd162124b4c19869e13c074be1eed/roles/f1e0c25f6e9049e897cb7350c7e54ab3 => generated 0 bytes in 214 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 16:07:31.732199 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e172fe49-cb0e-4074-85e9-063c66cda021 admin admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:07:31.762469 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a974fe9-c534-412f-a242-7c5630491e4c admin admin] Validating token access rules against request {{(pid=80396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:07:31.797623 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e172fe49-cb0e-4074-85e9-063c66cda021 admin admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:07:31.802530 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af171bf4-f879-4fee-8981-da937342ac86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f73d5a98be74242b45222df39fb6213', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:07:31.803189 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af171bf4-f879-4fee-8981-da937342ac86 admin admin] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:07:31.803471 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af171bf4-f879-4fee-8981-da937342ac86 admin admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:07:31.803748 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af171bf4-f879-4fee-8981-da937342ac86 admin admin] PATH_INFO: `/v3/roles` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:07:31.804503 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af171bf4-f879-4fee-8981-da937342ac86 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:07:31.806131 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af171bf4-f879-4fee-8981-da937342ac86 admin admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:07:31.816411 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 996/1981] 10.222.0.59 () {58 vars in 1121 bytes} [Thu Jun 2 16:07:31 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 02 16:07:31.820243 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af171bf4-f879-4fee-8981-da937342ac86 admin admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:07:31.822306 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86cb1d0e-d86e-43b3-8e3c-7a83792fc25c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f73d5a98be74242b45222df39fb6213', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:07:31.822984 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86cb1d0e-d86e-43b3-8e3c-7a83792fc25c admin admin] REQUEST_METHOD: `POST` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:07:31.823262 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86cb1d0e-d86e-43b3-8e3c-7a83792fc25c admin admin] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:07:31.823543 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86cb1d0e-d86e-43b3-8e3c-7a83792fc25c admin admin] PATH_INFO: `/v3/users` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:07:31.824230 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86cb1d0e-d86e-43b3-8e3c-7a83792fc25c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:07:31.826175 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86cb1d0e-d86e-43b3-8e3c-7a83792fc25c admin admin] RBAC: Authorization granted {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:07:31.830270 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af171bf4-f879-4fee-8981-da937342ac86 admin admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:07:31.835169 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c53fb5-8dbb-49f9-84e0-2a15cfd8d8ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f73d5a98be74242b45222df39fb6213', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:07:31.836035 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c53fb5-8dbb-49f9-84e0-2a15cfd8d8ba admin admin] REQUEST_METHOD: `PUT` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:07:31.836317 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c53fb5-8dbb-49f9-84e0-2a15cfd8d8ba admin admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:07:31.836608 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c53fb5-8dbb-49f9-84e0-2a15cfd8d8ba admin admin] PATH_INFO: `/v3/projects/a881c24ffb8f4cb993b0cbe2dc3e83ad/users/378fd162124b4c19869e13c074be1eed/roles/f1e0c25f6e9049e897cb7350c7e54ab3` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:07:31.839644 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44c53fb5-8dbb-49f9-84e0-2a15cfd8d8ba admin admin] RBAC: Authorizing `identity:create_grant(project_id=a881c24ffb8f4cb993b0cbe2dc3e83ad, user_id=378fd162124b4c19869e13c074be1eed, role_id=f1e0c25f6e9049e897cb7350c7e54ab3)` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:07:31.842285 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44c53fb5-8dbb-49f9-84e0-2a15cfd8d8ba admin admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:07:31.852491 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 997/1982] 10.222.0.59 () {60 vars in 1482 bytes} [Thu Jun 2 16:07:31 2022] PUT /identity/v3/projects/a881c24ffb8f4cb993b0cbe2dc3e83ad/users/378fd162124b4c19869e13c074be1eed/roles/f1e0c25f6e9049e897cb7350c7e54ab3 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 02 16:07:31.863104 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc699830-f016-41db-abd6-5827a8e30e13 None None] REQUEST_METHOD: `POST` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:07:31.863733 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc699830-f016-41db-abd6-5827a8e30e13 None None] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:07:31.864019 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc699830-f016-41db-abd6-5827a8e30e13 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:07:31.963395 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.auth.core [None req-fc699830-f016-41db-abd6-5827a8e30e13 None None] MFA Rules not processed for user `378fd162124b4c19869e13c074be1eed`. Rule list: `[]` (Enabled: `True`). {{(pid=80395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 16:07:31.964621 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.fernet_utils [None req-fc699830-f016-41db-abd6-5827a8e30e13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:07:32.039955 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 998/1983] 10.222.0.59 () {58 vars in 957 bytes} [Thu Jun 2 16:07:31 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 02 16:07:32.041281 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc699830-f016-41db-abd6-5827a8e30e13 None None] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:07:32.042422 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.fernet_utils [None req-fc699830-f016-41db-abd6-5827a8e30e13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:07:32.055578 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 986/1984] 10.222.0.59 () {60 vars in 1143 bytes} [Thu Jun 2 16:07:31 2022] POST /identity/v3/users => generated 288 bytes in 357 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 02 16:07:32.057260 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86cb1d0e-d86e-43b3-8e3c-7a83792fc25c admin admin] Authenticating user token {{(pid=80396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:07:32.061209 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.fernet_utils [None req-86cb1d0e-d86e-43b3-8e3c-7a83792fc25c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:07:32.116395 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc699830-f016-41db-abd6-5827a8e30e13 None None] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:07:32.121316 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e92d2f-665c-4c16-8e4f-bb53d390cd4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f73d5a98be74242b45222df39fb6213', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:07:32.122216 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e92d2f-665c-4c16-8e4f-bb53d390cd4f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:07:32.122506 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e92d2f-665c-4c16-8e4f-bb53d390cd4f admin admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:07:32.122788 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e92d2f-665c-4c16-8e4f-bb53d390cd4f admin admin] PATH_INFO: `/v3/projects/dfcfcaf8fe324675ae5f3ab60a205538` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:07:32.123983 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4e92d2f-665c-4c16-8e4f-bb53d390cd4f admin admin] RBAC: Authorizing `identity:delete_project(project_id=dfcfcaf8fe324675ae5f3ab60a205538)` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:07:32.126002 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4e92d2f-665c-4c16-8e4f-bb53d390cd4f admin admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:07:32.126594 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86cb1d0e-d86e-43b3-8e3c-7a83792fc25c admin admin] Validating token access rules against request {{(pid=80396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:07:32.176082 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c6dce81-03f5-42c4-8ea2-0ede9bbc5a29 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6534961c369940a5b88f310c6450250b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c87c981909d4b8db02783421818c79b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:07:32.176735 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6dce81-03f5-42c4-8ea2-0ede9bbc5a29 service cinder] REQUEST_METHOD: `GET` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:07:32.177015 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6dce81-03f5-42c4-8ea2-0ede9bbc5a29 service cinder] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:07:32.177334 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6dce81-03f5-42c4-8ea2-0ede9bbc5a29 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:07:32.193702 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c6dce81-03f5-42c4-8ea2-0ede9bbc5a29 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:07:32.195989 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c6dce81-03f5-42c4-8ea2-0ede9bbc5a29 service cinder] RBAC: Authorization granted {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:07:32.208288 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 987/1985] 10.222.0.59 () {60 vars in 1365 bytes} [Thu Jun 2 16:07:32 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 152 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 16:07:32.209270 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c6dce81-03f5-42c4-8ea2-0ede9bbc5a29 service cinder] Authenticating user token {{(pid=80396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:07:32.220361 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c6dce81-03f5-42c4-8ea2-0ede9bbc5a29 service cinder] Validating token access rules against request {{(pid=80396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:07:32.224932 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25d29d16-bdb6-4285-b069-d91f4a5a829b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f73d5a98be74242b45222df39fb6213', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:07:32.225587 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d29d16-bdb6-4285-b069-d91f4a5a829b admin admin] REQUEST_METHOD: `GET` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:07:32.225874 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d29d16-bdb6-4285-b069-d91f4a5a829b admin admin] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:07:32.226185 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d29d16-bdb6-4285-b069-d91f4a5a829b admin admin] PATH_INFO: `/v3/roles` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:07:32.226913 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25d29d16-bdb6-4285-b069-d91f4a5a829b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:07:32.228885 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25d29d16-bdb6-4285-b069-d91f4a5a829b admin admin] RBAC: Authorization granted {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:07:32.239377 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 988/1986] 10.222.0.59 () {58 vars in 1121 bytes} [Thu Jun 2 16:07:32 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 16:07:32.240211 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25d29d16-bdb6-4285-b069-d91f4a5a829b admin admin] Authenticating user token {{(pid=80396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:07:32.242612 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.fernet_utils [None req-25d29d16-bdb6-4285-b069-d91f4a5a829b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:07:32.257389 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25d29d16-bdb6-4285-b069-d91f4a5a829b admin admin] Validating token access rules against request {{(pid=80396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:07:32.264254 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc34cc8a-ce58-4edc-b1be-e5bcdf0086ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f73d5a98be74242b45222df39fb6213', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:07:32.266294 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc34cc8a-ce58-4edc-b1be-e5bcdf0086ef admin admin] REQUEST_METHOD: `DELETE` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:07:32.266580 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc34cc8a-ce58-4edc-b1be-e5bcdf0086ef admin admin] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:07:32.266858 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc34cc8a-ce58-4edc-b1be-e5bcdf0086ef admin admin] PATH_INFO: `/v3/projects/46170fe2093a46e08bf273c367c0cfcd` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:07:32.268110 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc34cc8a-ce58-4edc-b1be-e5bcdf0086ef admin admin] RBAC: Authorizing `identity:delete_project(project_id=46170fe2093a46e08bf273c367c0cfcd)` {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:07:32.270021 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc34cc8a-ce58-4edc-b1be-e5bcdf0086ef admin admin] RBAC: Authorization granted {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:07:32.293057 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.notifications [None req-e4e92d2f-665c-4c16-8e4f-bb53d390cd4f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dfcfcaf8fe324675ae5f3ab60a205538', 'request_id': 'req-e4e92d2f-665c-4c16-8e4f-bb53d390cd4f'} {{(pid=80395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:07:32.299522 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.notifications [None req-e4e92d2f-665c-4c16-8e4f-bb53d390cd4f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dfcfcaf8fe324675ae5f3ab60a205538', 'request_id': 'req-e4e92d2f-665c-4c16-8e4f-bb53d390cd4f'} {{(pid=80395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:07:32.354479 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.notifications [None req-e4e92d2f-665c-4c16-8e4f-bb53d390cd4f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dfcfcaf8fe324675ae5f3ab60a205538', 'request_id': 'req-e4e92d2f-665c-4c16-8e4f-bb53d390cd4f'} {{(pid=80395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:07:32.367048 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.notifications [None req-e4e92d2f-665c-4c16-8e4f-bb53d390cd4f admin admin] The token cache is being invalidate because project dfcfcaf8fe324675ae5f3ab60a205538 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80395) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 02 16:07:32.367440 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.notifications [None req-e4e92d2f-665c-4c16-8e4f-bb53d390cd4f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:07:32.368179 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.notifications [None req-e4e92d2f-665c-4c16-8e4f-bb53d390cd4f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:07:32.371139 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 999/1987] 10.222.0.59 () {58 vars in 1232 bytes} [Thu Jun 2 16:07:32 2022] DELETE /identity/v3/projects/dfcfcaf8fe324675ae5f3ab60a205538 => generated 0 bytes in 331 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 16:07:32.372076 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e92d2f-665c-4c16-8e4f-bb53d390cd4f admin admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:07:32.376001 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.fernet_utils [None req-e4e92d2f-665c-4c16-8e4f-bb53d390cd4f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:07:32.378647 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.notifications [None req-bc34cc8a-ce58-4edc-b1be-e5bcdf0086ef admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '46170fe2093a46e08bf273c367c0cfcd', 'request_id': 'req-bc34cc8a-ce58-4edc-b1be-e5bcdf0086ef'} {{(pid=80396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:07:32.387038 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.notifications [None req-bc34cc8a-ce58-4edc-b1be-e5bcdf0086ef admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '46170fe2093a46e08bf273c367c0cfcd', 'request_id': 'req-bc34cc8a-ce58-4edc-b1be-e5bcdf0086ef'} {{(pid=80396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:07:32.441556 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e92d2f-665c-4c16-8e4f-bb53d390cd4f admin admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:07:32.489906 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.notifications [None req-bc34cc8a-ce58-4edc-b1be-e5bcdf0086ef admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '46170fe2093a46e08bf273c367c0cfcd', 'request_id': 'req-bc34cc8a-ce58-4edc-b1be-e5bcdf0086ef'} {{(pid=80396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:07:32.500982 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52ac157f-b6a8-40ae-8047-43888d78ffd0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f73d5a98be74242b45222df39fb6213', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:07:32.501506 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ac157f-b6a8-40ae-8047-43888d78ffd0 admin admin] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:07:32.501825 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ac157f-b6a8-40ae-8047-43888d78ffd0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:07:32.502158 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ac157f-b6a8-40ae-8047-43888d78ffd0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:07:32.502925 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52ac157f-b6a8-40ae-8047-43888d78ffd0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:07:32.507902 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.notifications [None req-bc34cc8a-ce58-4edc-b1be-e5bcdf0086ef admin admin] The token cache is being invalidate because project 46170fe2093a46e08bf273c367c0cfcd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80396) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 02 16:07:32.507902 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.notifications [None req-bc34cc8a-ce58-4edc-b1be-e5bcdf0086ef admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:07:32.507902 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.notifications [None req-bc34cc8a-ce58-4edc-b1be-e5bcdf0086ef admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:07:32.508609 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52ac157f-b6a8-40ae-8047-43888d78ffd0 admin admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:07:32.508710 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 989/1988] 10.222.0.59 () {58 vars in 1232 bytes} [Thu Jun 2 16:07:32 2022] DELETE /identity/v3/projects/46170fe2093a46e08bf273c367c0cfcd => generated 0 bytes in 266 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 16:07:32.510760 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc34cc8a-ce58-4edc-b1be-e5bcdf0086ef admin admin] Authenticating user token {{(pid=80396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:07:32.512200 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.fernet_utils [None req-bc34cc8a-ce58-4edc-b1be-e5bcdf0086ef admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:07:32.524122 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 1000/1989] 10.222.0.59 () {58 vars in 1121 bytes} [Thu Jun 2 16:07:32 2022] GET /identity/v3/roles => generated 1420 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 16:07:32.524122 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a40d5f-e863-4242-9645-9c90db3d3dbc None None] REQUEST_METHOD: `POST` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:07:32.524122 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a40d5f-e863-4242-9645-9c90db3d3dbc None None] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:07:32.524122 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a40d5f-e863-4242-9645-9c90db3d3dbc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:07:32.532083 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc34cc8a-ce58-4edc-b1be-e5bcdf0086ef admin admin] Validating token access rules against request {{(pid=80396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:07:32.537305 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-344afbdc-1dad-4ce5-a52d-e45bf568c18b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f73d5a98be74242b45222df39fb6213', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:07:32.538239 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344afbdc-1dad-4ce5-a52d-e45bf568c18b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:07:32.538641 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344afbdc-1dad-4ce5-a52d-e45bf568c18b admin admin] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:07:32.538788 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344afbdc-1dad-4ce5-a52d-e45bf568c18b admin admin] PATH_INFO: `/v3/users/f3ef80514d5e4dbab9a183a662be0347` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:07:32.540266 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-344afbdc-1dad-4ce5-a52d-e45bf568c18b admin admin] RBAC: Authorizing `identity:delete_user(user_id=f3ef80514d5e4dbab9a183a662be0347)` {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:07:32.542256 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-344afbdc-1dad-4ce5-a52d-e45bf568c18b admin admin] RBAC: Authorization granted {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:07:32.544496 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.auth.core [None req-05a40d5f-e863-4242-9645-9c90db3d3dbc None None] MFA Rules not processed for user `400d1f4db9de49638549e5db29a041e1`. Rule list: `[]` (Enabled: `True`). {{(pid=80395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 16:07:32.545871 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.fernet_utils [None req-05a40d5f-e863-4242-9645-9c90db3d3dbc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:07:32.554322 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 1001/1990] 10.222.0.59 () {58 vars in 957 bytes} [Thu Jun 2 16:07:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 16:07:32.559381 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05a40d5f-e863-4242-9645-9c90db3d3dbc None None] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:07:32.562404 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.fernet_utils [None req-05a40d5f-e863-4242-9645-9c90db3d3dbc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:07:32.577872 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05a40d5f-e863-4242-9645-9c90db3d3dbc None None] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:07:32.582517 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f9ef684-af38-48e0-99c8-126fd62a952d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f73d5a98be74242b45222df39fb6213', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:07:32.583386 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f9ef684-af38-48e0-99c8-126fd62a952d admin admin] REQUEST_METHOD: `PUT` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:07:32.583666 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f9ef684-af38-48e0-99c8-126fd62a952d admin admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:07:32.584193 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f9ef684-af38-48e0-99c8-126fd62a952d admin admin] PATH_INFO: `/v3/projects/675dc5c023e945658e11602065a4006c/users/dafc55126ee74d75a02919e75cd7136c/roles/649e0f2b5a264c419ea6a1441f123a03` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:07:32.599786 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f9ef684-af38-48e0-99c8-126fd62a952d admin admin] RBAC: Authorizing `identity:create_grant(project_id=675dc5c023e945658e11602065a4006c, user_id=dafc55126ee74d75a02919e75cd7136c, role_id=649e0f2b5a264c419ea6a1441f123a03)` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:07:32.602439 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f9ef684-af38-48e0-99c8-126fd62a952d admin admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:07:32.716252 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 1002/1991] 10.222.0.59 () {60 vars in 1482 bytes} [Thu Jun 2 16:07:32 2022] PUT /identity/v3/projects/675dc5c023e945658e11602065a4006c/users/dafc55126ee74d75a02919e75cd7136c/roles/649e0f2b5a264c419ea6a1441f123a03 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 16:07:32.719799 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a677c90e-a0cb-4422-a6a7-0a44337b4a55 None None] REQUEST_METHOD: `POST` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:07:32.720763 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a677c90e-a0cb-4422-a6a7-0a44337b4a55 None None] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:07:32.721455 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a677c90e-a0cb-4422-a6a7-0a44337b4a55 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:07:32.775239 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.auth.core [None req-a677c90e-a0cb-4422-a6a7-0a44337b4a55 None None] MFA Rules not processed for user `400d1f4db9de49638549e5db29a041e1`. Rule list: `[]` (Enabled: `True`). {{(pid=80395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 16:07:32.778628 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.fernet_utils [None req-a677c90e-a0cb-4422-a6a7-0a44337b4a55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:07:32.826089 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.notifications [None req-344afbdc-1dad-4ce5-a52d-e45bf568c18b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f3ef80514d5e4dbab9a183a662be0347'} {{(pid=80396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:07:32.827002 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.notifications [None req-344afbdc-1dad-4ce5-a52d-e45bf568c18b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f3ef80514d5e4dbab9a183a662be0347'} {{(pid=80396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:07:32.896175 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 1003/1992] 10.222.0.59 () {58 vars in 957 bytes} [Thu Jun 2 16:07:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 16:07:32.897494 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94cedf1-139d-4405-adb1-23bd1e6f9e27 None None] REQUEST_METHOD: `POST` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:07:32.897784 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94cedf1-139d-4405-adb1-23bd1e6f9e27 None None] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:07:32.898064 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94cedf1-139d-4405-adb1-23bd1e6f9e27 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:07:32.925864 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.auth.core [None req-a94cedf1-139d-4405-adb1-23bd1e6f9e27 None None] MFA Rules not processed for user `dafc55126ee74d75a02919e75cd7136c`. Rule list: `[]` (Enabled: `True`). {{(pid=80395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 16:07:32.927133 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.fernet_utils [None req-a94cedf1-139d-4405-adb1-23bd1e6f9e27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:07:32.946461 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG dbcounter [-] [80396] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 16:07:32.982738 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.notifications [None req-344afbdc-1dad-4ce5-a52d-e45bf568c18b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f3ef80514d5e4dbab9a183a662be0347'} {{(pid=80396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:07:32.997531 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.notifications [None req-344afbdc-1dad-4ce5-a52d-e45bf568c18b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f3ef80514d5e4dbab9a183a662be0347'} {{(pid=80396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:07:32.997999 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 1004/1993] 10.222.0.59 () {58 vars in 957 bytes} [Thu Jun 2 16:07:32 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 16:07:32.998766 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a94cedf1-139d-4405-adb1-23bd1e6f9e27 None None] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:07:33.008541 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.notifications [None req-344afbdc-1dad-4ce5-a52d-e45bf568c18b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f3ef80514d5e4dbab9a183a662be0347'} {{(pid=80396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:07:33.009760 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a94cedf1-139d-4405-adb1-23bd1e6f9e27 None None] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:07:33.014865 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 990/1994] 10.222.0.59 () {58 vars in 1223 bytes} [Thu Jun 2 16:07:32 2022] DELETE /identity/v3/users/f3ef80514d5e4dbab9a183a662be0347 => generated 0 bytes in 509 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 16:07:33.015053 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c937b63-90df-48cf-988c-365c43a60ae7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f73d5a98be74242b45222df39fb6213', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:07:33.015691 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-344afbdc-1dad-4ce5-a52d-e45bf568c18b admin admin] Authenticating user token {{(pid=80396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:07:33.015794 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c937b63-90df-48cf-988c-365c43a60ae7 admin admin] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:07:33.016021 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c937b63-90df-48cf-988c-365c43a60ae7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:07:33.016297 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c937b63-90df-48cf-988c-365c43a60ae7 admin admin] PATH_INFO: `/v3/domains` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:07:33.017082 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c937b63-90df-48cf-988c-365c43a60ae7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80395) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 16:07:33.017182 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.fernet_utils [None req-344afbdc-1dad-4ce5-a52d-e45bf568c18b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:07:33.017384 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c937b63-90df-48cf-988c-365c43a60ae7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:07:33.019149 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c937b63-90df-48cf-988c-365c43a60ae7 admin admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:07:33.035572 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 1005/1995] 10.222.0.59 () {58 vars in 1152 bytes} [Thu Jun 2 16:07:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 16:07:33.037215 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c937b63-90df-48cf-988c-365c43a60ae7 admin admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:07:33.048252 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c937b63-90df-48cf-988c-365c43a60ae7 admin admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:07:33.086809 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writing DB stats keystone:DELETE=8,keystone:SELECT=87,keystone:INSERT=5 {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 16:07:33.097347 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-344afbdc-1dad-4ce5-a52d-e45bf568c18b admin admin] Validating token access rules against request {{(pid=80396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:07:33.105052 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f27f67-26a2-4696-af57-7780ea293597 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f73d5a98be74242b45222df39fb6213', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:07:33.106303 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f27f67-26a2-4696-af57-7780ea293597 admin admin] REQUEST_METHOD: `POST` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:07:33.106602 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f27f67-26a2-4696-af57-7780ea293597 admin admin] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:07:33.106878 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f27f67-26a2-4696-af57-7780ea293597 admin admin] PATH_INFO: `/v3/projects` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:07:33.107569 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71f27f67-26a2-4696-af57-7780ea293597 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:07:33.110006 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71f27f67-26a2-4696-af57-7780ea293597 admin admin] RBAC: Authorization granted {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:07:33.111846 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07cfe9d6-f070-4a8e-8888-9f00221420d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f73d5a98be74242b45222df39fb6213', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:07:33.112769 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07cfe9d6-f070-4a8e-8888-9f00221420d7 admin admin] REQUEST_METHOD: `POST` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:07:33.113189 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07cfe9d6-f070-4a8e-8888-9f00221420d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:07:33.113472 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07cfe9d6-f070-4a8e-8888-9f00221420d7 admin admin] PATH_INFO: `/v3/projects` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:07:33.114212 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07cfe9d6-f070-4a8e-8888-9f00221420d7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:07:33.117962 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07cfe9d6-f070-4a8e-8888-9f00221420d7 admin admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:07:33.240188 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 991/1996] 10.222.0.59 () {60 vars in 1152 bytes} [Thu Jun 2 16:07:33 2022] POST /identity/v3/projects => generated 377 bytes in 225 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 16:07:33.242361 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 1006/1997] 10.222.0.59 () {60 vars in 1152 bytes} [Thu Jun 2 16:07:33 2022] POST /identity/v3/projects => generated 371 bytes in 205 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 02 16:07:33.243326 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f27f67-26a2-4696-af57-7780ea293597 admin admin] Authenticating user token {{(pid=80396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:07:33.244623 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07cfe9d6-f070-4a8e-8888-9f00221420d7 admin admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:07:33.347599 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f27f67-26a2-4696-af57-7780ea293597 admin admin] Validating token access rules against request {{(pid=80396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:07:33.352671 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82d31b5a-a9aa-44b4-9852-c334464e5db1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f73d5a98be74242b45222df39fb6213', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:07:33.354101 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d31b5a-a9aa-44b4-9852-c334464e5db1 admin admin] REQUEST_METHOD: `POST` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:07:33.354413 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d31b5a-a9aa-44b4-9852-c334464e5db1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:07:33.354687 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d31b5a-a9aa-44b4-9852-c334464e5db1 admin admin] PATH_INFO: `/v3/users` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:07:33.355481 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82d31b5a-a9aa-44b4-9852-c334464e5db1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:07:33.357549 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82d31b5a-a9aa-44b4-9852-c334464e5db1 admin admin] RBAC: Authorization granted {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:07:33.369519 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07cfe9d6-f070-4a8e-8888-9f00221420d7 admin admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:07:33.376249 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae2c17f9-65b1-42c1-9523-41783753178c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f73d5a98be74242b45222df39fb6213', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:07:33.377025 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2c17f9-65b1-42c1-9523-41783753178c admin admin] REQUEST_METHOD: `POST` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:07:33.377303 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2c17f9-65b1-42c1-9523-41783753178c admin admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:07:33.377601 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2c17f9-65b1-42c1-9523-41783753178c admin admin] PATH_INFO: `/v3/users` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:07:33.378335 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae2c17f9-65b1-42c1-9523-41783753178c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:07:33.380329 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae2c17f9-65b1-42c1-9523-41783753178c admin admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:07:33.473491 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 992/1998] 10.222.0.59 () {60 vars in 1143 bytes} [Thu Jun 2 16:07:33 2022] POST /identity/v3/users => generated 286 bytes in 231 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 16:07:33.477681 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82d31b5a-a9aa-44b4-9852-c334464e5db1 admin admin] Authenticating user token {{(pid=80396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:07:33.488049 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82d31b5a-a9aa-44b4-9852-c334464e5db1 admin admin] Validating token access rules against request {{(pid=80396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:07:33.492817 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3e7ea72-b5c5-4346-bb09-ae6e9e09f8c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f73d5a98be74242b45222df39fb6213', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:07:33.493476 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e7ea72-b5c5-4346-bb09-ae6e9e09f8c2 admin admin] REQUEST_METHOD: `GET` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:07:33.493978 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e7ea72-b5c5-4346-bb09-ae6e9e09f8c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:07:33.494284 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e7ea72-b5c5-4346-bb09-ae6e9e09f8c2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:07:33.495020 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3e7ea72-b5c5-4346-bb09-ae6e9e09f8c2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:07:33.497315 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3e7ea72-b5c5-4346-bb09-ae6e9e09f8c2 admin admin] RBAC: Authorization granted {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:07:33.508166 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 993/1999] 10.222.0.59 () {58 vars in 1121 bytes} [Thu Jun 2 16:07:33 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 02 16:07:33.512756 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3e7ea72-b5c5-4346-bb09-ae6e9e09f8c2 admin admin] Authenticating user token {{(pid=80396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:07:33.523125 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3e7ea72-b5c5-4346-bb09-ae6e9e09f8c2 admin admin] Validating token access rules against request {{(pid=80396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:07:33.529872 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2070cf85-b2e2-4722-aee6-a4f8d38f96ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f73d5a98be74242b45222df39fb6213', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:07:33.530578 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2070cf85-b2e2-4722-aee6-a4f8d38f96ca admin admin] REQUEST_METHOD: `GET` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:07:33.530861 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2070cf85-b2e2-4722-aee6-a4f8d38f96ca admin admin] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:07:33.531144 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2070cf85-b2e2-4722-aee6-a4f8d38f96ca admin admin] PATH_INFO: `/v3/roles` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:07:33.531878 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2070cf85-b2e2-4722-aee6-a4f8d38f96ca admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:07:33.537891 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2070cf85-b2e2-4722-aee6-a4f8d38f96ca admin admin] RBAC: Authorization granted {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:07:33.538015 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 1007/2000] 10.222.0.59 () {60 vars in 1143 bytes} [Thu Jun 2 16:07:33 2022] POST /identity/v3/users => generated 295 bytes in 291 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 16:07:33.538894 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae2c17f9-65b1-42c1-9523-41783753178c admin admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:07:33.547969 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 994/2001] 10.222.0.59 () {58 vars in 1121 bytes} [Thu Jun 2 16:07:33 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 02 16:07:33.548807 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae2c17f9-65b1-42c1-9523-41783753178c admin admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:07:33.551840 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2070cf85-b2e2-4722-aee6-a4f8d38f96ca admin admin] Authenticating user token {{(pid=80396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:07:33.555683 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-133149b2-30c2-4a47-97bd-500e16b9e6a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f73d5a98be74242b45222df39fb6213', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:07:33.556363 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133149b2-30c2-4a47-97bd-500e16b9e6a8 admin admin] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:07:33.557261 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133149b2-30c2-4a47-97bd-500e16b9e6a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:07:33.557261 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133149b2-30c2-4a47-97bd-500e16b9e6a8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:07:33.557685 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-133149b2-30c2-4a47-97bd-500e16b9e6a8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:07:33.559551 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-133149b2-30c2-4a47-97bd-500e16b9e6a8 admin admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:07:33.573383 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2070cf85-b2e2-4722-aee6-a4f8d38f96ca admin admin] Validating token access rules against request {{(pid=80396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:07:33.573383 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a6b6e79-c1ce-4e25-bc1e-30d4df110467 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f73d5a98be74242b45222df39fb6213', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:07:33.573383 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6b6e79-c1ce-4e25-bc1e-30d4df110467 admin admin] REQUEST_METHOD: `PUT` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:07:33.573383 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6b6e79-c1ce-4e25-bc1e-30d4df110467 admin admin] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:07:33.574088 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6b6e79-c1ce-4e25-bc1e-30d4df110467 admin admin] PATH_INFO: `/v3/projects/e05229f5166b417b93651a04a405e7f4/users/c75eb91d9b2c4de5ae06d6f0715d0a76/roles/649e0f2b5a264c419ea6a1441f123a03` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:07:33.574192 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 1008/2002] 10.222.0.59 () {58 vars in 1121 bytes} [Thu Jun 2 16:07:33 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 02 16:07:33.576660 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-133149b2-30c2-4a47-97bd-500e16b9e6a8 admin admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:07:33.579930 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.fernet_utils [None req-133149b2-30c2-4a47-97bd-500e16b9e6a8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:07:33.596864 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-133149b2-30c2-4a47-97bd-500e16b9e6a8 admin admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:07:33.600234 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a6b6e79-c1ce-4e25-bc1e-30d4df110467 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e05229f5166b417b93651a04a405e7f4, user_id=c75eb91d9b2c4de5ae06d6f0715d0a76, role_id=649e0f2b5a264c419ea6a1441f123a03)` {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:07:33.602841 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce1d8173-3729-4769-844e-3a52b5c9d8d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f73d5a98be74242b45222df39fb6213', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:07:33.603423 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a6b6e79-c1ce-4e25-bc1e-30d4df110467 admin admin] RBAC: Authorization granted {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:07:33.604076 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce1d8173-3729-4769-844e-3a52b5c9d8d2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:07:33.604466 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce1d8173-3729-4769-844e-3a52b5c9d8d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:07:33.604831 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce1d8173-3729-4769-844e-3a52b5c9d8d2 admin admin] PATH_INFO: `/v3/projects/9feb2e942d124076959cd0f67f2f4ac7` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:07:33.606279 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce1d8173-3729-4769-844e-3a52b5c9d8d2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9feb2e942d124076959cd0f67f2f4ac7)` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:07:33.609030 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce1d8173-3729-4769-844e-3a52b5c9d8d2 admin admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:07:33.718994 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 995/2003] 10.222.0.59 () {60 vars in 1482 bytes} [Thu Jun 2 16:07:33 2022] PUT /identity/v3/projects/e05229f5166b417b93651a04a405e7f4/users/c75eb91d9b2c4de5ae06d6f0715d0a76/roles/649e0f2b5a264c419ea6a1441f123a03 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 02 16:07:33.724941 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a6b6e79-c1ce-4e25-bc1e-30d4df110467 admin admin] Authenticating user token {{(pid=80396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:07:33.730961 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.notifications [None req-ce1d8173-3729-4769-844e-3a52b5c9d8d2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9feb2e942d124076959cd0f67f2f4ac7', 'request_id': 'req-ce1d8173-3729-4769-844e-3a52b5c9d8d2'} {{(pid=80395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:07:33.737862 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.notifications [None req-ce1d8173-3729-4769-844e-3a52b5c9d8d2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9feb2e942d124076959cd0f67f2f4ac7', 'request_id': 'req-ce1d8173-3729-4769-844e-3a52b5c9d8d2'} {{(pid=80395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:07:33.789609 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a6b6e79-c1ce-4e25-bc1e-30d4df110467 admin admin] Validating token access rules against request {{(pid=80396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:07:33.845672 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0efe63f-c136-40e7-b0f3-0af5bca4d8cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f73d5a98be74242b45222df39fb6213', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:07:33.846607 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0efe63f-c136-40e7-b0f3-0af5bca4d8cc admin admin] REQUEST_METHOD: `PUT` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:07:33.846891 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0efe63f-c136-40e7-b0f3-0af5bca4d8cc admin admin] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:07:33.847170 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0efe63f-c136-40e7-b0f3-0af5bca4d8cc admin admin] PATH_INFO: `/v3/projects/06a32d5dbd7446af8b3056920d848108/users/092a4bb6d19a4d1c99f17cd499326254/roles/f1e0c25f6e9049e897cb7350c7e54ab3` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:07:33.852449 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.notifications [None req-ce1d8173-3729-4769-844e-3a52b5c9d8d2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9feb2e942d124076959cd0f67f2f4ac7', 'request_id': 'req-ce1d8173-3729-4769-844e-3a52b5c9d8d2'} {{(pid=80395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:07:33.865867 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0efe63f-c136-40e7-b0f3-0af5bca4d8cc admin admin] RBAC: Authorizing `identity:create_grant(project_id=06a32d5dbd7446af8b3056920d848108, user_id=092a4bb6d19a4d1c99f17cd499326254, role_id=f1e0c25f6e9049e897cb7350c7e54ab3)` {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:07:33.866179 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.notifications [None req-ce1d8173-3729-4769-844e-3a52b5c9d8d2 admin admin] The token cache is being invalidate because project 9feb2e942d124076959cd0f67f2f4ac7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80395) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 02 16:07:33.866179 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.notifications [None req-ce1d8173-3729-4769-844e-3a52b5c9d8d2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:07:33.866896 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.notifications [None req-ce1d8173-3729-4769-844e-3a52b5c9d8d2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:07:33.868786 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0efe63f-c136-40e7-b0f3-0af5bca4d8cc admin admin] RBAC: Authorization granted {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:07:33.870353 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 1009/2004] 10.222.0.59 () {58 vars in 1232 bytes} [Thu Jun 2 16:07:33 2022] DELETE /identity/v3/projects/9feb2e942d124076959cd0f67f2f4ac7 => generated 0 bytes in 294 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 02 16:07:33.871324 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce1d8173-3729-4769-844e-3a52b5c9d8d2 admin admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:07:33.872995 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.fernet_utils [None req-ce1d8173-3729-4769-844e-3a52b5c9d8d2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:07:33.887741 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce1d8173-3729-4769-844e-3a52b5c9d8d2 admin admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:07:33.894324 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20b32d90-6644-4713-9b95-7557f8096c5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f73d5a98be74242b45222df39fb6213', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:07:33.898280 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b32d90-6644-4713-9b95-7557f8096c5f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:07:33.898280 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b32d90-6644-4713-9b95-7557f8096c5f admin admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:07:33.898280 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b32d90-6644-4713-9b95-7557f8096c5f admin admin] PATH_INFO: `/v3/users/988a426f2fa84999bd5eabc6e0420dda` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:07:33.898280 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20b32d90-6644-4713-9b95-7557f8096c5f admin admin] RBAC: Authorizing `identity:delete_user(user_id=988a426f2fa84999bd5eabc6e0420dda)` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:07:33.899613 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20b32d90-6644-4713-9b95-7557f8096c5f admin admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:07:34.039321 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 996/2005] 10.222.0.59 () {60 vars in 1482 bytes} [Thu Jun 2 16:07:33 2022] PUT /identity/v3/projects/06a32d5dbd7446af8b3056920d848108/users/092a4bb6d19a4d1c99f17cd499326254/roles/f1e0c25f6e9049e897cb7350c7e54ab3 => generated 0 bytes in 320 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 16:07:34.041613 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea4e995f-0cb0-42f5-ac0a-0063ac9f5aa1 None None] REQUEST_METHOD: `POST` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:07:34.041921 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea4e995f-0cb0-42f5-ac0a-0063ac9f5aa1 None None] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:07:34.042201 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea4e995f-0cb0-42f5-ac0a-0063ac9f5aa1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:07:34.069676 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.auth.core [None req-ea4e995f-0cb0-42f5-ac0a-0063ac9f5aa1 None None] MFA Rules not processed for user `c75eb91d9b2c4de5ae06d6f0715d0a76`. Rule list: `[]` (Enabled: `True`). {{(pid=80396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 16:07:34.070924 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.fernet_utils [None req-ea4e995f-0cb0-42f5-ac0a-0063ac9f5aa1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:07:34.135806 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 997/2006] 10.222.0.59 () {58 vars in 957 bytes} [Thu Jun 2 16:07:34 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 16:07:34.137092 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a9a35c4-7c17-4659-bd76-e8898cd82c8f None None] REQUEST_METHOD: `POST` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:07:34.137380 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a9a35c4-7c17-4659-bd76-e8898cd82c8f None None] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:07:34.137663 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a9a35c4-7c17-4659-bd76-e8898cd82c8f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:07:34.155258 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.auth.core [None req-5a9a35c4-7c17-4659-bd76-e8898cd82c8f None None] MFA Rules not processed for user `400d1f4db9de49638549e5db29a041e1`. Rule list: `[]` (Enabled: `True`). {{(pid=80396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 16:07:34.156438 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.fernet_utils [None req-5a9a35c4-7c17-4659-bd76-e8898cd82c8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:07:34.214935 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 998/2007] 10.222.0.59 () {58 vars in 957 bytes} [Thu Jun 2 16:07:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 16:07:34.215884 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a9a35c4-7c17-4659-bd76-e8898cd82c8f None None] Authenticating user token {{(pid=80396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:07:34.217293 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.fernet_utils [None req-5a9a35c4-7c17-4659-bd76-e8898cd82c8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:07:34.230357 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a9a35c4-7c17-4659-bd76-e8898cd82c8f None None] Validating token access rules against request {{(pid=80396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:07:34.235434 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52f6b8c4-2518-4987-958b-c795fda2b48d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f73d5a98be74242b45222df39fb6213', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:07:34.236079 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f6b8c4-2518-4987-958b-c795fda2b48d admin admin] REQUEST_METHOD: `GET` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:07:34.236363 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f6b8c4-2518-4987-958b-c795fda2b48d admin admin] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:07:34.236638 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f6b8c4-2518-4987-958b-c795fda2b48d admin admin] PATH_INFO: `/v3/roles` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:07:34.237392 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52f6b8c4-2518-4987-958b-c795fda2b48d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:07:34.239017 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52f6b8c4-2518-4987-958b-c795fda2b48d admin admin] RBAC: Authorization granted {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:07:34.249088 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 999/2008] 10.222.0.59 () {58 vars in 1121 bytes} [Thu Jun 2 16:07:34 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 16:07:34.249937 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52f6b8c4-2518-4987-958b-c795fda2b48d admin admin] Authenticating user token {{(pid=80396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:07:34.251608 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.fernet_utils [None req-52f6b8c4-2518-4987-958b-c795fda2b48d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:07:34.263593 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52f6b8c4-2518-4987-958b-c795fda2b48d admin admin] Validating token access rules against request {{(pid=80396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:07:34.268321 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb42e417-5127-4ee1-9972-80b4000ce3c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f73d5a98be74242b45222df39fb6213', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:07:34.268937 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb42e417-5127-4ee1-9972-80b4000ce3c3 admin admin] REQUEST_METHOD: `POST` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:07:34.269220 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb42e417-5127-4ee1-9972-80b4000ce3c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:07:34.269495 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb42e417-5127-4ee1-9972-80b4000ce3c3 admin admin] PATH_INFO: `/v3/projects` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:07:34.270199 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb42e417-5127-4ee1-9972-80b4000ce3c3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:07:34.272049 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb42e417-5127-4ee1-9972-80b4000ce3c3 admin admin] RBAC: Authorization granted {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:07:34.296579 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.notifications [None req-20b32d90-6644-4713-9b95-7557f8096c5f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '988a426f2fa84999bd5eabc6e0420dda'} {{(pid=80395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:07:34.472330 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.notifications [None req-20b32d90-6644-4713-9b95-7557f8096c5f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '988a426f2fa84999bd5eabc6e0420dda'} {{(pid=80395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:07:34.481018 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 1000/2009] 10.222.0.59 () {60 vars in 1152 bytes} [Thu Jun 2 16:07:34 2022] POST /identity/v3/projects => generated 375 bytes in 231 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 16:07:34.482625 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6206e33-c841-4a87-af04-33968af95495 None None] REQUEST_METHOD: `POST` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:07:34.482911 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6206e33-c841-4a87-af04-33968af95495 None None] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:07:34.483183 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6206e33-c841-4a87-af04-33968af95495 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:07:34.488610 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.notifications [None req-20b32d90-6644-4713-9b95-7557f8096c5f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '988a426f2fa84999bd5eabc6e0420dda'} {{(pid=80395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:07:34.489294 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.notifications [None req-20b32d90-6644-4713-9b95-7557f8096c5f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '988a426f2fa84999bd5eabc6e0420dda'} {{(pid=80395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:07:34.496357 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.notifications [None req-20b32d90-6644-4713-9b95-7557f8096c5f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '988a426f2fa84999bd5eabc6e0420dda'} {{(pid=80395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:07:34.500962 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.auth.core [None req-e6206e33-c841-4a87-af04-33968af95495 None None] MFA Rules not processed for user `400d1f4db9de49638549e5db29a041e1`. Rule list: `[]` (Enabled: `True`). {{(pid=80396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 16:07:34.502226 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.fernet_utils [None req-e6206e33-c841-4a87-af04-33968af95495 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:07:34.502386 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 1010/2010] 10.222.0.59 () {58 vars in 1223 bytes} [Thu Jun 2 16:07:33 2022] DELETE /identity/v3/users/988a426f2fa84999bd5eabc6e0420dda => generated 0 bytes in 631 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 16:07:34.503141 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20b32d90-6644-4713-9b95-7557f8096c5f admin admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:07:34.504415 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.fernet_utils [None req-20b32d90-6644-4713-9b95-7557f8096c5f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:07:34.574607 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20b32d90-6644-4713-9b95-7557f8096c5f admin admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:07:34.575289 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 1001/2011] 10.222.0.59 () {58 vars in 957 bytes} [Thu Jun 2 16:07:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 16:07:34.579250 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6206e33-c841-4a87-af04-33968af95495 None None] Authenticating user token {{(pid=80396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:07:34.580614 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.fernet_utils [None req-e6206e33-c841-4a87-af04-33968af95495 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:07:34.584699 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23300ef4-f839-47c8-b723-dcccbaaa2fe7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f73d5a98be74242b45222df39fb6213', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:07:34.585605 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23300ef4-f839-47c8-b723-dcccbaaa2fe7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:07:34.585891 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23300ef4-f839-47c8-b723-dcccbaaa2fe7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:07:34.586206 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23300ef4-f839-47c8-b723-dcccbaaa2fe7 admin admin] PATH_INFO: `/v3/projects/06a32d5dbd7446af8b3056920d848108/users/092a4bb6d19a4d1c99f17cd499326254/roles/f1e0c25f6e9049e897cb7350c7e54ab3` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:07:34.589143 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23300ef4-f839-47c8-b723-dcccbaaa2fe7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=06a32d5dbd7446af8b3056920d848108, user_id=092a4bb6d19a4d1c99f17cd499326254, role_id=f1e0c25f6e9049e897cb7350c7e54ab3)` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:07:34.591991 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23300ef4-f839-47c8-b723-dcccbaaa2fe7 admin admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:07:34.593279 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6206e33-c841-4a87-af04-33968af95495 None None] Validating token access rules against request {{(pid=80396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:07:34.598100 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11b03f2e-1c11-4e0e-853e-0a9e8b147eb5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f73d5a98be74242b45222df39fb6213', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:07:34.598775 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b03f2e-1c11-4e0e-853e-0a9e8b147eb5 admin admin] REQUEST_METHOD: `POST` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:07:34.599065 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b03f2e-1c11-4e0e-853e-0a9e8b147eb5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:07:34.599350 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b03f2e-1c11-4e0e-853e-0a9e8b147eb5 admin admin] PATH_INFO: `/v3/users` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:07:34.600056 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11b03f2e-1c11-4e0e-853e-0a9e8b147eb5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:07:34.601966 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11b03f2e-1c11-4e0e-853e-0a9e8b147eb5 admin admin] RBAC: Authorization granted {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:07:34.603239 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 1011/2012] 10.222.0.59 () {60 vars in 1482 bytes} [Thu Jun 2 16:07:34 2022] PUT /identity/v3/projects/06a32d5dbd7446af8b3056920d848108/users/092a4bb6d19a4d1c99f17cd499326254/roles/f1e0c25f6e9049e897cb7350c7e54ab3 => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 16:07:34.604622 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d569e7cf-ed74-4fbd-ba97-8e0448261c81 None None] REQUEST_METHOD: `POST` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:07:34.604906 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d569e7cf-ed74-4fbd-ba97-8e0448261c81 None None] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:07:34.605182 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d569e7cf-ed74-4fbd-ba97-8e0448261c81 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:07:34.624604 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.auth.core [None req-d569e7cf-ed74-4fbd-ba97-8e0448261c81 None None] MFA Rules not processed for user `400d1f4db9de49638549e5db29a041e1`. Rule list: `[]` (Enabled: `True`). {{(pid=80395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 16:07:34.625815 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.fernet_utils [None req-d569e7cf-ed74-4fbd-ba97-8e0448261c81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:07:34.700492 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 1012/2013] 10.222.0.59 () {58 vars in 957 bytes} [Thu Jun 2 16:07:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 16:07:34.700492 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d569e7cf-ed74-4fbd-ba97-8e0448261c81 None None] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:07:34.712455 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d569e7cf-ed74-4fbd-ba97-8e0448261c81 None None] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:07:34.715608 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 1002/2014] 10.222.0.59 () {60 vars in 1143 bytes} [Thu Jun 2 16:07:34 2022] POST /identity/v3/users => generated 288 bytes in 140 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 16:07:34.717751 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffbee91c-e73e-400c-b9ad-396f9b186571 None None] REQUEST_METHOD: `POST` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:07:34.717751 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffbee91c-e73e-400c-b9ad-396f9b186571 None None] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:07:34.717751 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffbee91c-e73e-400c-b9ad-396f9b186571 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:07:34.721120 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82b567ab-21dc-4050-9c75-f5f800856d0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f73d5a98be74242b45222df39fb6213', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:07:34.721813 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b567ab-21dc-4050-9c75-f5f800856d0d admin admin] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:07:34.722178 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b567ab-21dc-4050-9c75-f5f800856d0d admin admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:07:34.722450 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b567ab-21dc-4050-9c75-f5f800856d0d admin admin] PATH_INFO: `/v3/domains` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:07:34.723137 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82b567ab-21dc-4050-9c75-f5f800856d0d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80395) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 16:07:34.723445 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82b567ab-21dc-4050-9c75-f5f800856d0d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:07:34.725180 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82b567ab-21dc-4050-9c75-f5f800856d0d admin admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:07:34.737691 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 1013/2015] 10.222.0.59 () {58 vars in 1152 bytes} [Thu Jun 2 16:07:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 16:07:34.738619 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82b567ab-21dc-4050-9c75-f5f800856d0d admin admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:07:34.740393 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.fernet_utils [None req-82b567ab-21dc-4050-9c75-f5f800856d0d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:07:34.751593 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.auth.core [None req-ffbee91c-e73e-400c-b9ad-396f9b186571 None None] MFA Rules not processed for user `092a4bb6d19a4d1c99f17cd499326254`. Rule list: `[]` (Enabled: `True`). {{(pid=80396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 16:07:34.752894 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.fernet_utils [None req-ffbee91c-e73e-400c-b9ad-396f9b186571 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:07:34.797612 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82b567ab-21dc-4050-9c75-f5f800856d0d admin admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:07:34.801317 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49b282c0-5fb3-41bc-9ec5-f94b88af9272 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9af40ddfe9ff4be3887b068f13a28dc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c87c981909d4b8db02783421818c79b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:07:34.801963 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b282c0-5fb3-41bc-9ec5-f94b88af9272 service neutron] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:07:34.802315 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b282c0-5fb3-41bc-9ec5-f94b88af9272 service neutron] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:07:34.802600 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b282c0-5fb3-41bc-9ec5-f94b88af9272 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:07:34.813108 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49b282c0-5fb3-41bc-9ec5-f94b88af9272 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:07:34.813542 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49b282c0-5fb3-41bc-9ec5-f94b88af9272 service neutron] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:07:34.820966 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 1003/2016] 10.222.0.59 () {58 vars in 957 bytes} [Thu Jun 2 16:07:34 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 16:07:34.822519 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffbee91c-e73e-400c-b9ad-396f9b186571 None None] Authenticating user token {{(pid=80396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:07:34.824053 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 1014/2017] 10.222.0.59 () {60 vars in 1365 bytes} [Thu Jun 2 16:07:34 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 16:07:34.824726 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49b282c0-5fb3-41bc-9ec5-f94b88af9272 service neutron] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:07:34.835461 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49b282c0-5fb3-41bc-9ec5-f94b88af9272 service neutron] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:07:34.841370 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffbee91c-e73e-400c-b9ad-396f9b186571 None None] Validating token access rules against request {{(pid=80396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:07:34.841700 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e88027d-38f3-4151-acb4-9b52ea8d41e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f73d5a98be74242b45222df39fb6213', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:07:34.842289 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e88027d-38f3-4151-acb4-9b52ea8d41e6 admin admin] REQUEST_METHOD: `POST` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:07:34.842576 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e88027d-38f3-4151-acb4-9b52ea8d41e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:07:34.846603 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e88027d-38f3-4151-acb4-9b52ea8d41e6 admin admin] PATH_INFO: `/v3/projects` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:07:34.846603 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e88027d-38f3-4151-acb4-9b52ea8d41e6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:07:34.846603 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e88027d-38f3-4151-acb4-9b52ea8d41e6 admin admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:07:34.846825 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-479644c7-eb20-40e6-94d6-d344bff1b496 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f73d5a98be74242b45222df39fb6213', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:07:34.847079 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-479644c7-eb20-40e6-94d6-d344bff1b496 admin admin] REQUEST_METHOD: `GET` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:07:34.847504 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-479644c7-eb20-40e6-94d6-d344bff1b496 admin admin] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:07:34.847786 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-479644c7-eb20-40e6-94d6-d344bff1b496 admin admin] PATH_INFO: `/v3/roles` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:07:34.848518 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-479644c7-eb20-40e6-94d6-d344bff1b496 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:07:34.850188 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-479644c7-eb20-40e6-94d6-d344bff1b496 admin admin] RBAC: Authorization granted {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:07:34.864540 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 1004/2018] 10.222.0.59 () {58 vars in 1121 bytes} [Thu Jun 2 16:07:34 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 16:07:34.864540 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-479644c7-eb20-40e6-94d6-d344bff1b496 admin admin] Authenticating user token {{(pid=80396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:07:34.864540 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.fernet_utils [None req-479644c7-eb20-40e6-94d6-d344bff1b496 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:07:34.932897 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-479644c7-eb20-40e6-94d6-d344bff1b496 admin admin] Validating token access rules against request {{(pid=80396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:07:34.936726 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71aeb6f8-4aff-4c0e-9238-9927bc372c01 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6534961c369940a5b88f310c6450250b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c87c981909d4b8db02783421818c79b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:07:34.937398 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71aeb6f8-4aff-4c0e-9238-9927bc372c01 service cinder] REQUEST_METHOD: `GET` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:07:34.937705 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71aeb6f8-4aff-4c0e-9238-9927bc372c01 service cinder] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:07:34.937983 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71aeb6f8-4aff-4c0e-9238-9927bc372c01 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:07:34.941102 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG dbcounter [-] [80396] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 16:07:34.942648 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.fernet_utils [None req-71aeb6f8-4aff-4c0e-9238-9927bc372c01 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:07:34.999939 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 1015/2019] 10.222.0.59 () {60 vars in 1152 bytes} [Thu Jun 2 16:07:34 2022] POST /identity/v3/projects => generated 381 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 16:07:35.001143 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e88027d-38f3-4151-acb4-9b52ea8d41e6 admin admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:07:35.004921 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71aeb6f8-4aff-4c0e-9238-9927bc372c01 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:07:35.006395 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71aeb6f8-4aff-4c0e-9238-9927bc372c01 service cinder] RBAC: Authorization granted {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:07:35.016184 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 1005/2020] 10.222.0.59 () {60 vars in 1365 bytes} [Thu Jun 2 16:07:34 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 154 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 16:07:35.016963 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71aeb6f8-4aff-4c0e-9238-9927bc372c01 service cinder] Authenticating user token {{(pid=80396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:07:35.028694 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 16:07:35.037796 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71aeb6f8-4aff-4c0e-9238-9927bc372c01 service cinder] Validating token access rules against request {{(pid=80396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:07:35.087138 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e88027d-38f3-4151-acb4-9b52ea8d41e6 admin admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:07:35.098456 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5d820e4-6b0c-4ec3-af9f-81f0dc266fb0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f73d5a98be74242b45222df39fb6213', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:07:35.099798 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d820e4-6b0c-4ec3-af9f-81f0dc266fb0 admin admin] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:07:35.100397 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d820e4-6b0c-4ec3-af9f-81f0dc266fb0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:07:35.101157 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d820e4-6b0c-4ec3-af9f-81f0dc266fb0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:07:35.102485 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5d820e4-6b0c-4ec3-af9f-81f0dc266fb0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:07:35.103556 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-587ee9ae-0120-4ffd-b079-9255a1a1364f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f73d5a98be74242b45222df39fb6213', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:07:35.104330 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-587ee9ae-0120-4ffd-b079-9255a1a1364f admin admin] REQUEST_METHOD: `POST` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:07:35.104612 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-587ee9ae-0120-4ffd-b079-9255a1a1364f admin admin] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:07:35.104893 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-587ee9ae-0120-4ffd-b079-9255a1a1364f admin admin] PATH_INFO: `/v3/users` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:07:35.105596 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-587ee9ae-0120-4ffd-b079-9255a1a1364f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:07:35.107446 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5d820e4-6b0c-4ec3-af9f-81f0dc266fb0 admin admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:07:35.107567 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-587ee9ae-0120-4ffd-b079-9255a1a1364f admin admin] RBAC: Authorization granted {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:07:35.131933 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 1016/2021] 10.222.0.59 () {58 vars in 1121 bytes} [Thu Jun 2 16:07:35 2022] GET /identity/v3/roles => generated 1420 bytes in 131 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 16:07:35.137067 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5d820e4-6b0c-4ec3-af9f-81f0dc266fb0 admin admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:07:35.151913 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5d820e4-6b0c-4ec3-af9f-81f0dc266fb0 admin admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:07:35.159899 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdbffa05-3fe5-4f2b-90f6-603bb1c4a605 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f73d5a98be74242b45222df39fb6213', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:07:35.160805 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdbffa05-3fe5-4f2b-90f6-603bb1c4a605 admin admin] REQUEST_METHOD: `PUT` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:07:35.165747 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdbffa05-3fe5-4f2b-90f6-603bb1c4a605 admin admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:07:35.165747 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdbffa05-3fe5-4f2b-90f6-603bb1c4a605 admin admin] PATH_INFO: `/v3/projects/fb93c72dbbf14fba948c144503e487be/users/3de6bb89e6854c8caf3f8ca84e408f91/roles/649e0f2b5a264c419ea6a1441f123a03` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:07:35.183644 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdbffa05-3fe5-4f2b-90f6-603bb1c4a605 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fb93c72dbbf14fba948c144503e487be, user_id=3de6bb89e6854c8caf3f8ca84e408f91, role_id=649e0f2b5a264c419ea6a1441f123a03)` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:07:35.187173 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdbffa05-3fe5-4f2b-90f6-603bb1c4a605 admin admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:07:35.247453 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 1006/2022] 10.222.0.59 () {60 vars in 1143 bytes} [Thu Jun 2 16:07:35 2022] POST /identity/v3/users => generated 291 bytes in 231 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 16:07:35.249144 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 1017/2023] 10.222.0.59 () {60 vars in 1482 bytes} [Thu Jun 2 16:07:35 2022] PUT /identity/v3/projects/fb93c72dbbf14fba948c144503e487be/users/3de6bb89e6854c8caf3f8ca84e408f91/roles/649e0f2b5a264c419ea6a1441f123a03 => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 16:07:35.251478 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-587ee9ae-0120-4ffd-b079-9255a1a1364f admin admin] Authenticating user token {{(pid=80396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:07:35.261359 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2561e4-121f-4a9d-a0e3-e09340aefda2 None None] REQUEST_METHOD: `POST` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:07:35.261652 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2561e4-121f-4a9d-a0e3-e09340aefda2 None None] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:07:35.261934 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2561e4-121f-4a9d-a0e3-e09340aefda2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:07:35.263052 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-587ee9ae-0120-4ffd-b079-9255a1a1364f admin admin] Validating token access rules against request {{(pid=80396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:07:35.292642 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.auth.core [None req-3b2561e4-121f-4a9d-a0e3-e09340aefda2 None None] MFA Rules not processed for user `3de6bb89e6854c8caf3f8ca84e408f91`. Rule list: `[]` (Enabled: `True`). {{(pid=80395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 16:07:35.293837 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.fernet_utils [None req-3b2561e4-121f-4a9d-a0e3-e09340aefda2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:07:35.340503 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aaa8ab9-f3a5-4440-8be3-a2ccce56b4ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f73d5a98be74242b45222df39fb6213', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:07:35.344723 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aaa8ab9-f3a5-4440-8be3-a2ccce56b4ae admin admin] REQUEST_METHOD: `GET` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:07:35.344723 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aaa8ab9-f3a5-4440-8be3-a2ccce56b4ae admin admin] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:07:35.344723 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aaa8ab9-f3a5-4440-8be3-a2ccce56b4ae admin admin] PATH_INFO: `/v3/roles` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:07:35.344723 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aaa8ab9-f3a5-4440-8be3-a2ccce56b4ae admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:07:35.344723 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aaa8ab9-f3a5-4440-8be3-a2ccce56b4ae admin admin] RBAC: Authorization granted {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:07:35.359012 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 1007/2024] 10.222.0.59 () {58 vars in 1121 bytes} [Thu Jun 2 16:07:35 2022] GET /identity/v3/roles => generated 1420 bytes in 105 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 16:07:35.359012 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aaa8ab9-f3a5-4440-8be3-a2ccce56b4ae admin admin] Authenticating user token {{(pid=80396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:07:35.359012 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.fernet_utils [None req-7aaa8ab9-f3a5-4440-8be3-a2ccce56b4ae admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:07:35.372752 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aaa8ab9-f3a5-4440-8be3-a2ccce56b4ae admin admin] Validating token access rules against request {{(pid=80396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:07:35.385160 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 1018/2025] 10.222.0.59 () {58 vars in 957 bytes} [Thu Jun 2 16:07:35 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 16:07:35.385160 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b2561e4-121f-4a9d-a0e3-e09340aefda2 None None] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:07:35.385366 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0775910-f1b0-4d4e-afb1-56c3290960ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f73d5a98be74242b45222df39fb6213', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:07:35.385366 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0775910-f1b0-4d4e-afb1-56c3290960ba admin admin] REQUEST_METHOD: `DELETE` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:07:35.385366 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0775910-f1b0-4d4e-afb1-56c3290960ba admin admin] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:07:35.385366 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0775910-f1b0-4d4e-afb1-56c3290960ba admin admin] PATH_INFO: `/v3/projects/c2300a67910d406dbc806b387faf46b7` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:07:35.385667 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0775910-f1b0-4d4e-afb1-56c3290960ba admin admin] RBAC: Authorizing `identity:delete_project(project_id=c2300a67910d406dbc806b387faf46b7)` {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:07:35.385667 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0775910-f1b0-4d4e-afb1-56c3290960ba admin admin] RBAC: Authorization granted {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:07:35.387028 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b2561e4-121f-4a9d-a0e3-e09340aefda2 None None] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:07:35.391922 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cf67e5c-2806-4011-b720-3184a960b242 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f73d5a98be74242b45222df39fb6213', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:07:35.392575 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf67e5c-2806-4011-b720-3184a960b242 admin admin] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:07:35.392853 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf67e5c-2806-4011-b720-3184a960b242 admin admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:07:35.393124 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf67e5c-2806-4011-b720-3184a960b242 admin admin] PATH_INFO: `/v3/roles` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:07:35.393845 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cf67e5c-2806-4011-b720-3184a960b242 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:07:35.395465 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cf67e5c-2806-4011-b720-3184a960b242 admin admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:07:35.409212 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 1019/2026] 10.222.0.59 () {58 vars in 1121 bytes} [Thu Jun 2 16:07:35 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 16:07:35.409212 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cf67e5c-2806-4011-b720-3184a960b242 admin admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:07:35.416240 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cf67e5c-2806-4011-b720-3184a960b242 admin admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:07:35.420797 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23a903f7-23c0-4630-87ab-cdd417bdbc62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f73d5a98be74242b45222df39fb6213', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:07:35.421414 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a903f7-23c0-4630-87ab-cdd417bdbc62 admin admin] REQUEST_METHOD: `POST` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:07:35.421701 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a903f7-23c0-4630-87ab-cdd417bdbc62 admin admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:07:35.421969 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a903f7-23c0-4630-87ab-cdd417bdbc62 admin admin] PATH_INFO: `/v3/projects` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:07:35.422670 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23a903f7-23c0-4630-87ab-cdd417bdbc62 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:07:35.424529 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23a903f7-23c0-4630-87ab-cdd417bdbc62 admin admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:07:35.544072 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.notifications [None req-d0775910-f1b0-4d4e-afb1-56c3290960ba admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c2300a67910d406dbc806b387faf46b7', 'request_id': 'req-d0775910-f1b0-4d4e-afb1-56c3290960ba'} {{(pid=80396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:07:35.550609 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.notifications [None req-d0775910-f1b0-4d4e-afb1-56c3290960ba admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c2300a67910d406dbc806b387faf46b7', 'request_id': 'req-d0775910-f1b0-4d4e-afb1-56c3290960ba'} {{(pid=80396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:07:35.570600 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 1020/2027] 10.222.0.59 () {60 vars in 1152 bytes} [Thu Jun 2 16:07:35 2022] POST /identity/v3/projects => generated 377 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 16:07:35.570600 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23a903f7-23c0-4630-87ab-cdd417bdbc62 admin admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:07:35.630983 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23a903f7-23c0-4630-87ab-cdd417bdbc62 admin admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:07:35.636817 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d57666ab-600c-4b9e-bcfd-db0e344d929a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f73d5a98be74242b45222df39fb6213', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:07:35.637871 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d57666ab-600c-4b9e-bcfd-db0e344d929a admin admin] REQUEST_METHOD: `PUT` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:07:35.638182 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d57666ab-600c-4b9e-bcfd-db0e344d929a admin admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:07:35.638457 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d57666ab-600c-4b9e-bcfd-db0e344d929a admin admin] PATH_INFO: `/v3/projects/d9ee7c8b95a94d4fb6c1e0f96ebc59bf/users/d91670bedace4a6fa306c1d09527a793/roles/649e0f2b5a264c419ea6a1441f123a03` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:07:35.659173 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d57666ab-600c-4b9e-bcfd-db0e344d929a admin admin] RBAC: Authorizing `identity:create_grant(project_id=d9ee7c8b95a94d4fb6c1e0f96ebc59bf, user_id=d91670bedace4a6fa306c1d09527a793, role_id=649e0f2b5a264c419ea6a1441f123a03)` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:07:35.659173 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d57666ab-600c-4b9e-bcfd-db0e344d929a admin admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:07:35.678754 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.notifications [None req-d0775910-f1b0-4d4e-afb1-56c3290960ba admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c2300a67910d406dbc806b387faf46b7', 'request_id': 'req-d0775910-f1b0-4d4e-afb1-56c3290960ba'} {{(pid=80396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:07:35.692862 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.notifications [None req-d0775910-f1b0-4d4e-afb1-56c3290960ba admin admin] The token cache is being invalidate because project c2300a67910d406dbc806b387faf46b7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80396) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 02 16:07:35.693157 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.notifications [None req-d0775910-f1b0-4d4e-afb1-56c3290960ba admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:07:35.694251 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.notifications [None req-d0775910-f1b0-4d4e-afb1-56c3290960ba admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:07:35.695886 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 1008/2028] 10.222.0.59 () {58 vars in 1232 bytes} [Thu Jun 2 16:07:35 2022] DELETE /identity/v3/projects/c2300a67910d406dbc806b387faf46b7 => generated 0 bytes in 339 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 16:07:35.696632 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0775910-f1b0-4d4e-afb1-56c3290960ba admin admin] Authenticating user token {{(pid=80396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:07:35.698768 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.fernet_utils [None req-d0775910-f1b0-4d4e-afb1-56c3290960ba admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:07:35.755699 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 1021/2029] 10.222.0.59 () {60 vars in 1482 bytes} [Thu Jun 2 16:07:35 2022] PUT /identity/v3/projects/d9ee7c8b95a94d4fb6c1e0f96ebc59bf/users/d91670bedace4a6fa306c1d09527a793/roles/649e0f2b5a264c419ea6a1441f123a03 => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 16:07:35.756559 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d57666ab-600c-4b9e-bcfd-db0e344d929a admin admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:07:35.758195 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.fernet_utils [None req-d57666ab-600c-4b9e-bcfd-db0e344d929a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:07:35.768983 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0775910-f1b0-4d4e-afb1-56c3290960ba admin admin] Validating token access rules against request {{(pid=80396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:07:35.829074 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3fe9dd2-b951-4a16-8d19-ab5d9cda50be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f73d5a98be74242b45222df39fb6213', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:07:35.829758 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3fe9dd2-b951-4a16-8d19-ab5d9cda50be admin admin] REQUEST_METHOD: `POST` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:07:35.830045 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3fe9dd2-b951-4a16-8d19-ab5d9cda50be admin admin] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:07:35.830354 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3fe9dd2-b951-4a16-8d19-ab5d9cda50be admin admin] PATH_INFO: `/v3/users` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:07:35.831879 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3fe9dd2-b951-4a16-8d19-ab5d9cda50be admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:07:35.833207 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3fe9dd2-b951-4a16-8d19-ab5d9cda50be admin admin] RBAC: Authorization granted {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:07:35.841093 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d57666ab-600c-4b9e-bcfd-db0e344d929a admin admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:07:35.850556 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a3a54f3-9c27-415e-84ea-5e9aa0fb9ff9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f73d5a98be74242b45222df39fb6213', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:07:35.851467 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a3a54f3-9c27-415e-84ea-5e9aa0fb9ff9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:07:35.851849 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a3a54f3-9c27-415e-84ea-5e9aa0fb9ff9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:07:35.852121 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a3a54f3-9c27-415e-84ea-5e9aa0fb9ff9 admin admin] PATH_INFO: `/v3/users/378fd162124b4c19869e13c074be1eed` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:07:35.853424 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a3a54f3-9c27-415e-84ea-5e9aa0fb9ff9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=378fd162124b4c19869e13c074be1eed)` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:07:35.856050 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a3a54f3-9c27-415e-84ea-5e9aa0fb9ff9 admin admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:07:35.961250 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 1009/2030] 10.222.0.59 () {60 vars in 1143 bytes} [Thu Jun 2 16:07:35 2022] POST /identity/v3/users => generated 295 bytes in 262 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 16:07:35.961250 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd62023a-a134-4f99-8ff6-0958c6a557bd None None] REQUEST_METHOD: `POST` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:07:35.961250 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd62023a-a134-4f99-8ff6-0958c6a557bd None None] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:07:35.961250 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd62023a-a134-4f99-8ff6-0958c6a557bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:07:35.988480 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.auth.core [None req-dd62023a-a134-4f99-8ff6-0958c6a557bd None None] MFA Rules not processed for user `d91670bedace4a6fa306c1d09527a793`. Rule list: `[]` (Enabled: `True`). {{(pid=80396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 16:07:35.989713 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.fernet_utils [None req-dd62023a-a134-4f99-8ff6-0958c6a557bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:07:36.057714 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG dbcounter [-] [80396] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 16:07:36.060029 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 1010/2031] 10.222.0.59 () {58 vars in 957 bytes} [Thu Jun 2 16:07:35 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 16:07:36.060841 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd62023a-a134-4f99-8ff6-0958c6a557bd None None] Authenticating user token {{(pid=80396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:07:36.072404 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd62023a-a134-4f99-8ff6-0958c6a557bd None None] Validating token access rules against request {{(pid=80396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:07:36.077034 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eca7b71-78b4-4836-9f94-b29abbf31921 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f73d5a98be74242b45222df39fb6213', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:07:36.077677 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eca7b71-78b4-4836-9f94-b29abbf31921 admin admin] REQUEST_METHOD: `GET` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:07:36.077956 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eca7b71-78b4-4836-9f94-b29abbf31921 admin admin] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:07:36.078265 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eca7b71-78b4-4836-9f94-b29abbf31921 admin admin] PATH_INFO: `/v3/roles` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:07:36.078985 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eca7b71-78b4-4836-9f94-b29abbf31921 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:07:36.080562 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eca7b71-78b4-4836-9f94-b29abbf31921 admin admin] RBAC: Authorization granted {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:07:36.086799 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.notifications [None req-0a3a54f3-9c27-415e-84ea-5e9aa0fb9ff9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '378fd162124b4c19869e13c074be1eed'} {{(pid=80395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:07:36.091365 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 1011/2032] 10.222.0.59 () {58 vars in 1121 bytes} [Thu Jun 2 16:07:36 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 16:07:36.092191 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eca7b71-78b4-4836-9f94-b29abbf31921 admin admin] Authenticating user token {{(pid=80396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:07:36.094217 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.fernet_utils [None req-8eca7b71-78b4-4836-9f94-b29abbf31921 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:07:36.106707 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eca7b71-78b4-4836-9f94-b29abbf31921 admin admin] Validating token access rules against request {{(pid=80396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:07:36.111103 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65c313e1-d575-4e8b-9b82-49fe12a54f05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f73d5a98be74242b45222df39fb6213', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:07:36.111926 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c313e1-d575-4e8b-9b82-49fe12a54f05 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:07:36.112208 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c313e1-d575-4e8b-9b82-49fe12a54f05 admin admin] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:07:36.112480 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c313e1-d575-4e8b-9b82-49fe12a54f05 admin admin] PATH_INFO: `/v3/users/964db856353448e58f40cbe0b5f20969` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:07:36.113643 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65c313e1-d575-4e8b-9b82-49fe12a54f05 admin admin] RBAC: Authorizing `identity:delete_user(user_id=964db856353448e58f40cbe0b5f20969)` {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:07:36.115564 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65c313e1-d575-4e8b-9b82-49fe12a54f05 admin admin] RBAC: Authorization granted {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:07:36.187130 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.notifications [None req-0a3a54f3-9c27-415e-84ea-5e9aa0fb9ff9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '378fd162124b4c19869e13c074be1eed'} {{(pid=80395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:07:36.199722 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.notifications [None req-0a3a54f3-9c27-415e-84ea-5e9aa0fb9ff9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '378fd162124b4c19869e13c074be1eed'} {{(pid=80395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:07:36.200381 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.notifications [None req-0a3a54f3-9c27-415e-84ea-5e9aa0fb9ff9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '378fd162124b4c19869e13c074be1eed'} {{(pid=80395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:07:36.207078 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.notifications [None req-0a3a54f3-9c27-415e-84ea-5e9aa0fb9ff9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '378fd162124b4c19869e13c074be1eed'} {{(pid=80395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:07:36.213123 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 1022/2033] 10.222.0.59 () {58 vars in 1223 bytes} [Thu Jun 2 16:07:35 2022] DELETE /identity/v3/users/378fd162124b4c19869e13c074be1eed => generated 0 bytes in 457 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 16:07:36.213882 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a3a54f3-9c27-415e-84ea-5e9aa0fb9ff9 admin admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:07:36.215232 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.fernet_utils [None req-0a3a54f3-9c27-415e-84ea-5e9aa0fb9ff9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:07:36.277614 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 16:07:36.282354 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a3a54f3-9c27-415e-84ea-5e9aa0fb9ff9 admin admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:07:36.287005 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9cdec4c-2bfa-4ba9-a7ef-c6f2747ac982 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f73d5a98be74242b45222df39fb6213', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:07:36.287662 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9cdec4c-2bfa-4ba9-a7ef-c6f2747ac982 admin admin] REQUEST_METHOD: `POST` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:07:36.287947 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9cdec4c-2bfa-4ba9-a7ef-c6f2747ac982 admin admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:07:36.288227 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9cdec4c-2bfa-4ba9-a7ef-c6f2747ac982 admin admin] PATH_INFO: `/v3/projects` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:07:36.288920 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9cdec4c-2bfa-4ba9-a7ef-c6f2747ac982 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:07:36.291397 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9cdec4c-2bfa-4ba9-a7ef-c6f2747ac982 admin admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:07:36.313023 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.notifications [None req-65c313e1-d575-4e8b-9b82-49fe12a54f05 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '964db856353448e58f40cbe0b5f20969'} {{(pid=80396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:07:36.314132 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.notifications [None req-65c313e1-d575-4e8b-9b82-49fe12a54f05 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '964db856353448e58f40cbe0b5f20969'} {{(pid=80396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:07:36.389860 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.notifications [None req-65c313e1-d575-4e8b-9b82-49fe12a54f05 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '964db856353448e58f40cbe0b5f20969'} {{(pid=80396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:07:36.400781 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 1023/2034] 10.222.0.59 () {60 vars in 1152 bytes} [Thu Jun 2 16:07:36 2022] POST /identity/v3/projects => generated 383 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 16:07:36.400781 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9cdec4c-2bfa-4ba9-a7ef-c6f2747ac982 admin admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:07:36.404984 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.fernet_utils [None req-c9cdec4c-2bfa-4ba9-a7ef-c6f2747ac982 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:07:36.407448 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.notifications [None req-65c313e1-d575-4e8b-9b82-49fe12a54f05 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '964db856353448e58f40cbe0b5f20969'} {{(pid=80396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:07:36.416364 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.notifications [None req-65c313e1-d575-4e8b-9b82-49fe12a54f05 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '964db856353448e58f40cbe0b5f20969'} {{(pid=80396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:07:36.423374 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 1012/2035] 10.222.0.59 () {58 vars in 1223 bytes} [Thu Jun 2 16:07:36 2022] DELETE /identity/v3/users/964db856353448e58f40cbe0b5f20969 => generated 0 bytes in 331 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 16:07:36.424300 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65c313e1-d575-4e8b-9b82-49fe12a54f05 admin admin] Authenticating user token {{(pid=80396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:07:36.425976 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.fernet_utils [None req-65c313e1-d575-4e8b-9b82-49fe12a54f05 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:07:36.478923 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9cdec4c-2bfa-4ba9-a7ef-c6f2747ac982 admin admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:07:36.512992 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65c313e1-d575-4e8b-9b82-49fe12a54f05 admin admin] Validating token access rules against request {{(pid=80396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:07:36.518469 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d5d0ac5-fc9b-4677-9aad-1f8e797d979d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f73d5a98be74242b45222df39fb6213', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:07:36.519114 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d5d0ac5-fc9b-4677-9aad-1f8e797d979d admin admin] REQUEST_METHOD: `POST` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:07:36.519405 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d5d0ac5-fc9b-4677-9aad-1f8e797d979d admin admin] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:07:36.519684 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d5d0ac5-fc9b-4677-9aad-1f8e797d979d admin admin] PATH_INFO: `/v3/users` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:07:36.520383 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d5d0ac5-fc9b-4677-9aad-1f8e797d979d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:07:36.522447 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d5d0ac5-fc9b-4677-9aad-1f8e797d979d admin admin] RBAC: Authorization granted {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:07:36.537779 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9635bdca-6bd1-4899-b71f-edead6e9a273 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f73d5a98be74242b45222df39fb6213', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:07:36.538729 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9635bdca-6bd1-4899-b71f-edead6e9a273 admin admin] REQUEST_METHOD: `PUT` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:07:36.539039 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9635bdca-6bd1-4899-b71f-edead6e9a273 admin admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:07:36.542764 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9635bdca-6bd1-4899-b71f-edead6e9a273 admin admin] PATH_INFO: `/v3/projects/8a4728f3bee44417b9dc16c9f8b07113/users/4de1d518140347d1b50c3c0024f4aa77/roles/f1e0c25f6e9049e897cb7350c7e54ab3` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:07:36.556232 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9635bdca-6bd1-4899-b71f-edead6e9a273 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8a4728f3bee44417b9dc16c9f8b07113, user_id=4de1d518140347d1b50c3c0024f4aa77, role_id=f1e0c25f6e9049e897cb7350c7e54ab3)` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:07:36.559565 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9635bdca-6bd1-4899-b71f-edead6e9a273 admin admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:07:36.624766 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 1013/2036] 10.222.0.59 () {60 vars in 1143 bytes} [Thu Jun 2 16:07:36 2022] POST /identity/v3/users => generated 298 bytes in 201 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 16:07:36.626038 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-293500e2-0d2d-4535-a2ed-14a88b8a4783 None None] REQUEST_METHOD: `POST` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:07:36.626379 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-293500e2-0d2d-4535-a2ed-14a88b8a4783 None None] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:07:36.626662 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-293500e2-0d2d-4535-a2ed-14a88b8a4783 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:07:36.641286 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 1024/2037] 10.222.0.59 () {60 vars in 1482 bytes} [Thu Jun 2 16:07:36 2022] PUT /identity/v3/projects/8a4728f3bee44417b9dc16c9f8b07113/users/4de1d518140347d1b50c3c0024f4aa77/roles/f1e0c25f6e9049e897cb7350c7e54ab3 => generated 0 bytes in 243 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 16:07:36.642045 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9635bdca-6bd1-4899-b71f-edead6e9a273 admin admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:07:36.645412 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.auth.core [None req-293500e2-0d2d-4535-a2ed-14a88b8a4783 None None] MFA Rules not processed for user `400d1f4db9de49638549e5db29a041e1`. Rule list: `[]` (Enabled: `True`). {{(pid=80396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 16:07:36.646651 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.fernet_utils [None req-293500e2-0d2d-4535-a2ed-14a88b8a4783 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:07:36.719030 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 1014/2038] 10.222.0.59 () {58 vars in 957 bytes} [Thu Jun 2 16:07:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 16:07:36.721525 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-293500e2-0d2d-4535-a2ed-14a88b8a4783 None None] Authenticating user token {{(pid=80396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:07:36.721640 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9635bdca-6bd1-4899-b71f-edead6e9a273 admin admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:07:36.729916 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-293500e2-0d2d-4535-a2ed-14a88b8a4783 None None] Validating token access rules against request {{(pid=80396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:07:36.730454 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3ea9710-29b9-4fc3-a29d-fe9376d6ada1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f73d5a98be74242b45222df39fb6213', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:07:36.731222 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ea9710-29b9-4fc3-a29d-fe9376d6ada1 admin admin] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:07:36.731563 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ea9710-29b9-4fc3-a29d-fe9376d6ada1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:07:36.731859 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ea9710-29b9-4fc3-a29d-fe9376d6ada1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:07:36.733246 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3ea9710-29b9-4fc3-a29d-fe9376d6ada1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:07:36.734857 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3ea9710-29b9-4fc3-a29d-fe9376d6ada1 admin admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:07:36.735145 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e96db0e-4f97-4863-a789-9396defc5bad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f73d5a98be74242b45222df39fb6213', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:07:36.735805 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e96db0e-4f97-4863-a789-9396defc5bad admin admin] REQUEST_METHOD: `GET` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:07:36.736088 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e96db0e-4f97-4863-a789-9396defc5bad admin admin] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:07:36.736361 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e96db0e-4f97-4863-a789-9396defc5bad admin admin] PATH_INFO: `/v3/roles` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:07:36.737086 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e96db0e-4f97-4863-a789-9396defc5bad admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:07:36.738698 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e96db0e-4f97-4863-a789-9396defc5bad admin admin] RBAC: Authorization granted {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:07:36.741701 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG dbcounter [-] [80396] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 16:07:36.747778 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 1025/2039] 10.222.0.59 () {58 vars in 1121 bytes} [Thu Jun 2 16:07:36 2022] GET /identity/v3/roles => generated 1420 bytes in 105 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 16:07:36.747778 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3ea9710-29b9-4fc3-a29d-fe9376d6ada1 admin admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:07:36.749698 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.fernet_utils [None req-e3ea9710-29b9-4fc3-a29d-fe9376d6ada1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:07:36.751922 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 1015/2040] 10.222.0.59 () {58 vars in 1121 bytes} [Thu Jun 2 16:07:36 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 16:07:36.752760 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e96db0e-4f97-4863-a789-9396defc5bad admin admin] Authenticating user token {{(pid=80396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:07:36.763153 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.fernet_utils [None req-3e96db0e-4f97-4863-a789-9396defc5bad admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:07:36.765127 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3ea9710-29b9-4fc3-a29d-fe9376d6ada1 admin admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:07:36.769952 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0edf887-1bfd-4e12-ab3f-bc90d4ec60ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f73d5a98be74242b45222df39fb6213', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:07:36.770841 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0edf887-1bfd-4e12-ab3f-bc90d4ec60ce admin admin] REQUEST_METHOD: `DELETE` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:07:36.771143 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0edf887-1bfd-4e12-ab3f-bc90d4ec60ce admin admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:07:36.771439 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0edf887-1bfd-4e12-ab3f-bc90d4ec60ce admin admin] PATH_INFO: `/v3/projects/a881c24ffb8f4cb993b0cbe2dc3e83ad` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:07:36.772665 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0edf887-1bfd-4e12-ab3f-bc90d4ec60ce admin admin] RBAC: Authorizing `identity:delete_project(project_id=a881c24ffb8f4cb993b0cbe2dc3e83ad)` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:07:36.774674 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0edf887-1bfd-4e12-ab3f-bc90d4ec60ce admin admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:07:36.813658 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e96db0e-4f97-4863-a789-9396defc5bad admin admin] Validating token access rules against request {{(pid=80396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:07:36.817325 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd463a6a-1835-4570-b27e-8a012721b491 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9af40ddfe9ff4be3887b068f13a28dc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c87c981909d4b8db02783421818c79b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:07:36.817969 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd463a6a-1835-4570-b27e-8a012721b491 service neutron] REQUEST_METHOD: `GET` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:07:36.818294 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd463a6a-1835-4570-b27e-8a012721b491 service neutron] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:07:36.818576 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd463a6a-1835-4570-b27e-8a012721b491 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:07:36.827805 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd463a6a-1835-4570-b27e-8a012721b491 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:07:36.829234 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd463a6a-1835-4570-b27e-8a012721b491 service neutron] RBAC: Authorization granted {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:07:36.839139 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 1016/2041] 10.222.0.59 () {60 vars in 1365 bytes} [Thu Jun 2 16:07:36 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 16:07:36.839908 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd463a6a-1835-4570-b27e-8a012721b491 service neutron] Authenticating user token {{(pid=80396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:07:36.848851 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd463a6a-1835-4570-b27e-8a012721b491 service neutron] Validating token access rules against request {{(pid=80396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:07:36.854209 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f50d6e8e-1adf-4dbf-a85c-00ab06007fea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f73d5a98be74242b45222df39fb6213', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:07:36.855247 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50d6e8e-1adf-4dbf-a85c-00ab06007fea admin admin] REQUEST_METHOD: `PUT` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:07:36.855675 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50d6e8e-1adf-4dbf-a85c-00ab06007fea admin admin] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:07:36.855964 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50d6e8e-1adf-4dbf-a85c-00ab06007fea admin admin] PATH_INFO: `/v3/projects/360ea1cb629d4f0fb245f1e96c8d7545/users/d2bccb5c8fe04d4f9ffc7e2e59313a0e/roles/f1e0c25f6e9049e897cb7350c7e54ab3` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:07:36.861942 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 16:07:36.872020 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f50d6e8e-1adf-4dbf-a85c-00ab06007fea admin admin] RBAC: Authorizing `identity:create_grant(project_id=360ea1cb629d4f0fb245f1e96c8d7545, user_id=d2bccb5c8fe04d4f9ffc7e2e59313a0e, role_id=f1e0c25f6e9049e897cb7350c7e54ab3)` {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:07:36.874759 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f50d6e8e-1adf-4dbf-a85c-00ab06007fea admin admin] RBAC: Authorization granted {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:07:36.996309 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 1017/2042] 10.222.0.59 () {60 vars in 1482 bytes} [Thu Jun 2 16:07:36 2022] PUT /identity/v3/projects/360ea1cb629d4f0fb245f1e96c8d7545/users/d2bccb5c8fe04d4f9ffc7e2e59313a0e/roles/f1e0c25f6e9049e897cb7350c7e54ab3 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 16:07:36.997533 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f50d6e8e-1adf-4dbf-a85c-00ab06007fea admin admin] Authenticating user token {{(pid=80396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:07:37.006991 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.notifications [None req-a0edf887-1bfd-4e12-ab3f-bc90d4ec60ce admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a881c24ffb8f4cb993b0cbe2dc3e83ad', 'request_id': 'req-a0edf887-1bfd-4e12-ab3f-bc90d4ec60ce'} {{(pid=80395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:07:37.014635 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.notifications [None req-a0edf887-1bfd-4e12-ab3f-bc90d4ec60ce admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a881c24ffb8f4cb993b0cbe2dc3e83ad', 'request_id': 'req-a0edf887-1bfd-4e12-ab3f-bc90d4ec60ce'} {{(pid=80395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:07:37.081298 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f50d6e8e-1adf-4dbf-a85c-00ab06007fea admin admin] Validating token access rules against request {{(pid=80396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:07:37.135309 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.notifications [None req-a0edf887-1bfd-4e12-ab3f-bc90d4ec60ce admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a881c24ffb8f4cb993b0cbe2dc3e83ad', 'request_id': 'req-a0edf887-1bfd-4e12-ab3f-bc90d4ec60ce'} {{(pid=80395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:07:37.145516 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1e58605-e980-4cc7-aa4a-7b4b49dcd5b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f73d5a98be74242b45222df39fb6213', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:07:37.146580 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.notifications [None req-a0edf887-1bfd-4e12-ab3f-bc90d4ec60ce admin admin] The token cache is being invalidate because project a881c24ffb8f4cb993b0cbe2dc3e83ad was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80395) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 02 16:07:37.146695 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e58605-e980-4cc7-aa4a-7b4b49dcd5b4 admin admin] REQUEST_METHOD: `PUT` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:07:37.146931 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.notifications [None req-a0edf887-1bfd-4e12-ab3f-bc90d4ec60ce admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:07:37.147050 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e58605-e980-4cc7-aa4a-7b4b49dcd5b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:07:37.147253 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e58605-e980-4cc7-aa4a-7b4b49dcd5b4 admin admin] PATH_INFO: `/v3/projects/8a4728f3bee44417b9dc16c9f8b07113/users/4de1d518140347d1b50c3c0024f4aa77/roles/f1e0c25f6e9049e897cb7350c7e54ab3` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:07:37.147822 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.notifications [None req-a0edf887-1bfd-4e12-ab3f-bc90d4ec60ce admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:07:37.153269 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 1026/2043] 10.222.0.59 () {58 vars in 1232 bytes} [Thu Jun 2 16:07:36 2022] DELETE /identity/v3/projects/a881c24ffb8f4cb993b0cbe2dc3e83ad => generated 0 bytes in 402 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 16:07:37.153465 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1e58605-e980-4cc7-aa4a-7b4b49dcd5b4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8a4728f3bee44417b9dc16c9f8b07113, user_id=4de1d518140347d1b50c3c0024f4aa77, role_id=f1e0c25f6e9049e897cb7350c7e54ab3)` {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:07:37.153553 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0edf887-1bfd-4e12-ab3f-bc90d4ec60ce admin admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:07:37.153629 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1e58605-e980-4cc7-aa4a-7b4b49dcd5b4 admin admin] RBAC: Authorization granted {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:07:37.154670 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.fernet_utils [None req-a0edf887-1bfd-4e12-ab3f-bc90d4ec60ce admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:07:37.164825 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 1018/2044] 10.222.0.59 () {60 vars in 1482 bytes} [Thu Jun 2 16:07:36 2022] PUT /identity/v3/projects/8a4728f3bee44417b9dc16c9f8b07113/users/4de1d518140347d1b50c3c0024f4aa77/roles/f1e0c25f6e9049e897cb7350c7e54ab3 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 16:07:37.172763 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff0bd2a-6e00-45b8-b78d-2af3bb67f79a None None] REQUEST_METHOD: `POST` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:07:37.172763 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff0bd2a-6e00-45b8-b78d-2af3bb67f79a None None] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:07:37.172763 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff0bd2a-6e00-45b8-b78d-2af3bb67f79a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:07:37.182417 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0edf887-1bfd-4e12-ab3f-bc90d4ec60ce admin admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:07:37.193926 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.auth.core [None req-cff0bd2a-6e00-45b8-b78d-2af3bb67f79a None None] MFA Rules not processed for user `400d1f4db9de49638549e5db29a041e1`. Rule list: `[]` (Enabled: `True`). {{(pid=80396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 16:07:37.195121 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.fernet_utils [None req-cff0bd2a-6e00-45b8-b78d-2af3bb67f79a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:07:37.243112 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1833d8c-dce7-49cf-ae87-91717b1fda10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f73d5a98be74242b45222df39fb6213', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:07:37.243809 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1833d8c-dce7-49cf-ae87-91717b1fda10 admin admin] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:07:37.244158 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1833d8c-dce7-49cf-ae87-91717b1fda10 admin admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:07:37.244438 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1833d8c-dce7-49cf-ae87-91717b1fda10 admin admin] PATH_INFO: `/v3/roles` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:07:37.245176 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1833d8c-dce7-49cf-ae87-91717b1fda10 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:07:37.246822 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1833d8c-dce7-49cf-ae87-91717b1fda10 admin admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:07:37.257493 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 1019/2045] 10.222.0.59 () {58 vars in 957 bytes} [Thu Jun 2 16:07:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 16:07:37.257848 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 1027/2046] 10.222.0.59 () {58 vars in 1121 bytes} [Thu Jun 2 16:07:37 2022] GET /identity/v3/roles => generated 1420 bytes in 108 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 16:07:37.261248 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc6285b-6f83-480e-885f-153d46dfaced None None] REQUEST_METHOD: `POST` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:07:37.261248 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc6285b-6f83-480e-885f-153d46dfaced None None] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:07:37.261248 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc6285b-6f83-480e-885f-153d46dfaced None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:07:37.262500 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1833d8c-dce7-49cf-ae87-91717b1fda10 admin admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:07:37.273518 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1833d8c-dce7-49cf-ae87-91717b1fda10 admin admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:07:37.279454 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e796a5c-9476-403a-8242-250ecfae40a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f73d5a98be74242b45222df39fb6213', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:07:37.280386 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e796a5c-9476-403a-8242-250ecfae40a1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:07:37.280673 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e796a5c-9476-403a-8242-250ecfae40a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:07:37.280952 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e796a5c-9476-403a-8242-250ecfae40a1 admin admin] PATH_INFO: `/v3/projects/360ea1cb629d4f0fb245f1e96c8d7545/users/d2bccb5c8fe04d4f9ffc7e2e59313a0e/roles/f1e0c25f6e9049e897cb7350c7e54ab3` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:07:37.282987 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e796a5c-9476-403a-8242-250ecfae40a1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=360ea1cb629d4f0fb245f1e96c8d7545, user_id=d2bccb5c8fe04d4f9ffc7e2e59313a0e, role_id=f1e0c25f6e9049e897cb7350c7e54ab3)` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:07:37.285833 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e796a5c-9476-403a-8242-250ecfae40a1 admin admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:07:37.288234 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.auth.core [None req-1cc6285b-6f83-480e-885f-153d46dfaced None None] MFA Rules not processed for user `4de1d518140347d1b50c3c0024f4aa77`. Rule list: `[]` (Enabled: `True`). {{(pid=80396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 16:07:37.289455 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.fernet_utils [None req-1cc6285b-6f83-480e-885f-153d46dfaced None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:07:37.298376 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 1028/2047] 10.222.0.59 () {60 vars in 1482 bytes} [Thu Jun 2 16:07:37 2022] PUT /identity/v3/projects/360ea1cb629d4f0fb245f1e96c8d7545/users/d2bccb5c8fe04d4f9ffc7e2e59313a0e/roles/f1e0c25f6e9049e897cb7350c7e54ab3 => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 02 16:07:37.308100 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0301ba4-ffa0-417a-92db-82f43d201a2a None None] REQUEST_METHOD: `POST` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:07:37.308461 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0301ba4-ffa0-417a-92db-82f43d201a2a None None] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:07:37.308828 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0301ba4-ffa0-417a-92db-82f43d201a2a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:07:37.331497 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.auth.core [None req-d0301ba4-ffa0-417a-92db-82f43d201a2a None None] MFA Rules not processed for user `400d1f4db9de49638549e5db29a041e1`. Rule list: `[]` (Enabled: `True`). {{(pid=80395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 16:07:37.332763 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.fernet_utils [None req-d0301ba4-ffa0-417a-92db-82f43d201a2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:07:37.364287 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 1020/2048] 10.222.0.59 () {58 vars in 957 bytes} [Thu Jun 2 16:07:37 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 16:07:37.365689 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9c6d3f-f134-4251-820c-6500066df893 None None] REQUEST_METHOD: `POST` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:07:37.365991 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9c6d3f-f134-4251-820c-6500066df893 None None] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:07:37.366299 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9c6d3f-f134-4251-820c-6500066df893 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:07:37.402996 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.auth.core [None req-0e9c6d3f-f134-4251-820c-6500066df893 None None] MFA Rules not processed for user `d2bccb5c8fe04d4f9ffc7e2e59313a0e`. Rule list: `[]` (Enabled: `True`). {{(pid=80396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 16:07:37.404052 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 1029/2049] 10.222.0.59 () {58 vars in 957 bytes} [Thu Jun 2 16:07:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 16:07:37.404207 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.fernet_utils [None req-0e9c6d3f-f134-4251-820c-6500066df893 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:07:37.405578 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0301ba4-ffa0-417a-92db-82f43d201a2a None None] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:07:37.408918 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.fernet_utils [None req-d0301ba4-ffa0-417a-92db-82f43d201a2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:07:37.421276 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0301ba4-ffa0-417a-92db-82f43d201a2a None None] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:07:37.427029 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-166137e0-da86-4622-8e71-63d7e38632b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f73d5a98be74242b45222df39fb6213', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:07:37.427886 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166137e0-da86-4622-8e71-63d7e38632b5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:07:37.428167 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166137e0-da86-4622-8e71-63d7e38632b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:07:37.428529 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166137e0-da86-4622-8e71-63d7e38632b5 admin admin] PATH_INFO: `/v3/projects/6548654862a645b89ba7b518c2209357` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:07:37.429683 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-166137e0-da86-4622-8e71-63d7e38632b5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6548654862a645b89ba7b518c2209357)` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:07:37.432332 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-166137e0-da86-4622-8e71-63d7e38632b5 admin admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:07:37.477571 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 1021/2050] 10.222.0.59 () {58 vars in 957 bytes} [Thu Jun 2 16:07:37 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 16:07:37.478493 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e9c6d3f-f134-4251-820c-6500066df893 None None] Authenticating user token {{(pid=80396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:07:37.479788 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.fernet_utils [None req-0e9c6d3f-f134-4251-820c-6500066df893 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:07:37.542178 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e9c6d3f-f134-4251-820c-6500066df893 None None] Validating token access rules against request {{(pid=80396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:07:37.550623 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG dbcounter [-] [80396] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=80396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 16:07:37.560421 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.notifications [None req-166137e0-da86-4622-8e71-63d7e38632b5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6548654862a645b89ba7b518c2209357', 'request_id': 'req-166137e0-da86-4622-8e71-63d7e38632b5'} {{(pid=80395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:07:37.566862 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.notifications [None req-166137e0-da86-4622-8e71-63d7e38632b5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6548654862a645b89ba7b518c2209357', 'request_id': 'req-166137e0-da86-4622-8e71-63d7e38632b5'} {{(pid=80395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:07:37.594822 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 16:07:37.609932 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b580e8a-c1fd-4713-bd1d-71c6ad07492d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6534961c369940a5b88f310c6450250b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c87c981909d4b8db02783421818c79b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:07:37.610624 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b580e8a-c1fd-4713-bd1d-71c6ad07492d service cinder] REQUEST_METHOD: `GET` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:07:37.610919 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b580e8a-c1fd-4713-bd1d-71c6ad07492d service cinder] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:07:37.611199 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b580e8a-c1fd-4713-bd1d-71c6ad07492d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:07:37.613044 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.fernet_utils [None req-7b580e8a-c1fd-4713-bd1d-71c6ad07492d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:07:37.651682 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.notifications [None req-166137e0-da86-4622-8e71-63d7e38632b5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6548654862a645b89ba7b518c2209357', 'request_id': 'req-166137e0-da86-4622-8e71-63d7e38632b5'} {{(pid=80395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:07:37.664069 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.notifications [None req-166137e0-da86-4622-8e71-63d7e38632b5 admin admin] The token cache is being invalidate because project 6548654862a645b89ba7b518c2209357 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80395) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 02 16:07:37.664802 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.notifications [None req-166137e0-da86-4622-8e71-63d7e38632b5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:07:37.665507 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.notifications [None req-166137e0-da86-4622-8e71-63d7e38632b5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:07:37.668408 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 1030/2051] 10.222.0.59 () {58 vars in 1232 bytes} [Thu Jun 2 16:07:37 2022] DELETE /identity/v3/projects/6548654862a645b89ba7b518c2209357 => generated 0 bytes in 263 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 16:07:37.669532 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-166137e0-da86-4622-8e71-63d7e38632b5 admin admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:07:37.670905 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.fernet_utils [None req-166137e0-da86-4622-8e71-63d7e38632b5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:07:37.676260 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b580e8a-c1fd-4713-bd1d-71c6ad07492d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:07:37.677791 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b580e8a-c1fd-4713-bd1d-71c6ad07492d service cinder] RBAC: Authorization granted {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:07:37.698218 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 1022/2052] 10.222.0.59 () {60 vars in 1365 bytes} [Thu Jun 2 16:07:37 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 220 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 16:07:37.699518 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b580e8a-c1fd-4713-bd1d-71c6ad07492d service cinder] Authenticating user token {{(pid=80396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:07:37.701355 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.fernet_utils [None req-7b580e8a-c1fd-4713-bd1d-71c6ad07492d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:07:37.714163 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b580e8a-c1fd-4713-bd1d-71c6ad07492d service cinder] Validating token access rules against request {{(pid=80396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:07:37.718429 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9dba2a8-8599-4097-ad6b-06047b59c644 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6534961c369940a5b88f310c6450250b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c87c981909d4b8db02783421818c79b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:07:37.719416 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9dba2a8-8599-4097-ad6b-06047b59c644 service cinder] REQUEST_METHOD: `GET` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:07:37.719416 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9dba2a8-8599-4097-ad6b-06047b59c644 service cinder] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:07:37.719606 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9dba2a8-8599-4097-ad6b-06047b59c644 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:07:37.721905 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.fernet_utils [None req-e9dba2a8-8599-4097-ad6b-06047b59c644 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:07:37.748339 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-166137e0-da86-4622-8e71-63d7e38632b5 admin admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:07:37.754633 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b009882e-b35d-4246-a3c3-939cb0780130 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f73d5a98be74242b45222df39fb6213', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:07:37.755482 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b009882e-b35d-4246-a3c3-939cb0780130 admin admin] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:07:37.755908 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b009882e-b35d-4246-a3c3-939cb0780130 admin admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:07:37.756648 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b009882e-b35d-4246-a3c3-939cb0780130 admin admin] PATH_INFO: `/v3/domains` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:07:37.757517 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b009882e-b35d-4246-a3c3-939cb0780130 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80395) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 16:07:37.757945 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b009882e-b35d-4246-a3c3-939cb0780130 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:07:37.759779 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b009882e-b35d-4246-a3c3-939cb0780130 admin admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:07:37.777932 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 1031/2053] 10.222.0.59 () {58 vars in 1152 bytes} [Thu Jun 2 16:07:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 109 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 16:07:37.779438 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b9338c-cb67-4d43-abb2-8993009af926 None None] REQUEST_METHOD: `POST` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:07:37.779823 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b9338c-cb67-4d43-abb2-8993009af926 None None] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:07:37.780823 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b9338c-cb67-4d43-abb2-8993009af926 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:07:37.803985 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.auth.core [None req-e3b9338c-cb67-4d43-abb2-8993009af926 None None] MFA Rules not processed for user `400d1f4db9de49638549e5db29a041e1`. Rule list: `[]` (Enabled: `True`). {{(pid=80395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 16:07:37.805948 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.fernet_utils [None req-e3b9338c-cb67-4d43-abb2-8993009af926 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:07:37.811391 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9dba2a8-8599-4097-ad6b-06047b59c644 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:07:37.816813 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9dba2a8-8599-4097-ad6b-06047b59c644 service cinder] RBAC: Authorization granted {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:07:37.816933 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 1032/2054] 10.222.0.59 () {58 vars in 957 bytes} [Thu Jun 2 16:07:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 16:07:37.817186 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3b9338c-cb67-4d43-abb2-8993009af926 None None] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:07:37.825079 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 1023/2055] 10.222.0.59 () {60 vars in 1365 bytes} [Thu Jun 2 16:07:37 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 126 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 16:07:37.826673 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de520e83-0ac7-421f-8099-62dcf7fe74e6 None None] REQUEST_METHOD: `POST` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:07:37.827112 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de520e83-0ac7-421f-8099-62dcf7fe74e6 None None] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:07:37.827536 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de520e83-0ac7-421f-8099-62dcf7fe74e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:07:37.842181 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3b9338c-cb67-4d43-abb2-8993009af926 None None] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:07:37.849471 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.auth.core [None req-de520e83-0ac7-421f-8099-62dcf7fe74e6 None None] MFA Rules not processed for user `400d1f4db9de49638549e5db29a041e1`. Rule list: `[]` (Enabled: `True`). {{(pid=80396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 16:07:37.851110 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.fernet_utils [None req-de520e83-0ac7-421f-8099-62dcf7fe74e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:07:37.857718 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f55a003f-7c53-4c48-aea9-c0ac51237bdd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f73d5a98be74242b45222df39fb6213', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:07:37.858605 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f55a003f-7c53-4c48-aea9-c0ac51237bdd admin admin] REQUEST_METHOD: `POST` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:07:37.859039 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f55a003f-7c53-4c48-aea9-c0ac51237bdd admin admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:07:37.859588 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f55a003f-7c53-4c48-aea9-c0ac51237bdd admin admin] PATH_INFO: `/v3/projects` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:07:37.861940 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f55a003f-7c53-4c48-aea9-c0ac51237bdd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:07:37.865806 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 1024/2056] 10.222.0.59 () {58 vars in 957 bytes} [Thu Jun 2 16:07:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 16:07:37.867239 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f55a003f-7c53-4c48-aea9-c0ac51237bdd admin admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:07:37.870375 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de520e83-0ac7-421f-8099-62dcf7fe74e6 None None] Authenticating user token {{(pid=80396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:07:37.880243 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de520e83-0ac7-421f-8099-62dcf7fe74e6 None None] Validating token access rules against request {{(pid=80396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:07:37.885540 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40eec046-398f-4d7f-8fbd-6aa6c05c53b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f73d5a98be74242b45222df39fb6213', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:07:37.886235 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40eec046-398f-4d7f-8fbd-6aa6c05c53b9 admin admin] REQUEST_METHOD: `GET` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:07:37.886607 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40eec046-398f-4d7f-8fbd-6aa6c05c53b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:07:37.886916 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40eec046-398f-4d7f-8fbd-6aa6c05c53b9 admin admin] PATH_INFO: `/v3/domains` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:07:37.887650 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40eec046-398f-4d7f-8fbd-6aa6c05c53b9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80396) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 16:07:37.888056 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40eec046-398f-4d7f-8fbd-6aa6c05c53b9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:07:37.889663 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40eec046-398f-4d7f-8fbd-6aa6c05c53b9 admin admin] RBAC: Authorization granted {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:07:37.908661 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 1025/2057] 10.222.0.59 () {58 vars in 1152 bytes} [Thu Jun 2 16:07:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 16:07:37.920636 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40eec046-398f-4d7f-8fbd-6aa6c05c53b9 admin admin] Authenticating user token {{(pid=80396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:07:37.933537 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40eec046-398f-4d7f-8fbd-6aa6c05c53b9 admin admin] Validating token access rules against request {{(pid=80396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:07:37.938837 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef1d3291-dc83-42da-a4f2-055c396d0d15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f73d5a98be74242b45222df39fb6213', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:07:37.939687 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef1d3291-dc83-42da-a4f2-055c396d0d15 admin admin] REQUEST_METHOD: `POST` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:07:37.939896 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef1d3291-dc83-42da-a4f2-055c396d0d15 admin admin] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:07:37.940163 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef1d3291-dc83-42da-a4f2-055c396d0d15 admin admin] PATH_INFO: `/v3/projects` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:07:37.940861 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef1d3291-dc83-42da-a4f2-055c396d0d15 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:07:37.942859 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef1d3291-dc83-42da-a4f2-055c396d0d15 admin admin] RBAC: Authorization granted {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:07:38.007882 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 1033/2058] 10.222.0.59 () {60 vars in 1152 bytes} [Thu Jun 2 16:07:37 2022] POST /identity/v3/projects => generated 377 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 16:07:38.012316 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f55a003f-7c53-4c48-aea9-c0ac51237bdd admin admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:07:38.080479 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 1026/2059] 10.222.0.59 () {60 vars in 1152 bytes} [Thu Jun 2 16:07:37 2022] POST /identity/v3/projects => generated 385 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 02 16:07:38.081539 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef1d3291-dc83-42da-a4f2-055c396d0d15 admin admin] Authenticating user token {{(pid=80396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:07:38.109407 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f55a003f-7c53-4c48-aea9-c0ac51237bdd admin admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:07:38.175704 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef1d3291-dc83-42da-a4f2-055c396d0d15 admin admin] Validating token access rules against request {{(pid=80396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:07:38.184148 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b09ff3e-9d5e-4662-99cd-ab9755501813 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f73d5a98be74242b45222df39fb6213', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:07:38.185027 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b09ff3e-9d5e-4662-99cd-ab9755501813 admin admin] REQUEST_METHOD: `POST` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:07:38.185424 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b09ff3e-9d5e-4662-99cd-ab9755501813 admin admin] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:07:38.185890 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b09ff3e-9d5e-4662-99cd-ab9755501813 admin admin] PATH_INFO: `/v3/users` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:07:38.186902 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b09ff3e-9d5e-4662-99cd-ab9755501813 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:07:38.188672 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b09ff3e-9d5e-4662-99cd-ab9755501813 admin admin] RBAC: Authorization granted {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:07:38.206049 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d24f988-2a75-47de-8b0a-29aa7feec195 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f73d5a98be74242b45222df39fb6213', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:07:38.206766 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d24f988-2a75-47de-8b0a-29aa7feec195 admin admin] REQUEST_METHOD: `POST` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:07:38.207054 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d24f988-2a75-47de-8b0a-29aa7feec195 admin admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:07:38.210038 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d24f988-2a75-47de-8b0a-29aa7feec195 admin admin] PATH_INFO: `/v3/users` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:07:38.210038 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d24f988-2a75-47de-8b0a-29aa7feec195 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:07:38.210375 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d24f988-2a75-47de-8b0a-29aa7feec195 admin admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:07:38.322499 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 1027/2060] 10.222.0.59 () {60 vars in 1143 bytes} [Thu Jun 2 16:07:38 2022] POST /identity/v3/users => generated 293 bytes in 241 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 02 16:07:38.323300 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 1034/2061] 10.222.0.59 () {60 vars in 1143 bytes} [Thu Jun 2 16:07:38 2022] POST /identity/v3/users => generated 289 bytes in 311 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 16:07:38.326886 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d24f988-2a75-47de-8b0a-29aa7feec195 admin admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:07:38.327027 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b09ff3e-9d5e-4662-99cd-ab9755501813 admin admin] Authenticating user token {{(pid=80396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:07:38.337151 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d24f988-2a75-47de-8b0a-29aa7feec195 admin admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:07:38.337441 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b09ff3e-9d5e-4662-99cd-ab9755501813 admin admin] Validating token access rules against request {{(pid=80396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:07:38.343054 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c460bab-42ca-45be-9cc0-4dae8fc2a475 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f73d5a98be74242b45222df39fb6213', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:07:38.343737 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c460bab-42ca-45be-9cc0-4dae8fc2a475 admin admin] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:07:38.344028 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c460bab-42ca-45be-9cc0-4dae8fc2a475 admin admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:07:38.344305 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c460bab-42ca-45be-9cc0-4dae8fc2a475 admin admin] PATH_INFO: `/v3/roles` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:07:38.345042 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c460bab-42ca-45be-9cc0-4dae8fc2a475 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:07:38.346699 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c460bab-42ca-45be-9cc0-4dae8fc2a475 admin admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:07:38.348479 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5392e2b7-c740-43e4-958b-99be9de1ac9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f73d5a98be74242b45222df39fb6213', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:07:38.349438 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5392e2b7-c740-43e4-958b-99be9de1ac9c admin admin] REQUEST_METHOD: `GET` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:07:38.349568 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5392e2b7-c740-43e4-958b-99be9de1ac9c admin admin] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:07:38.349826 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5392e2b7-c740-43e4-958b-99be9de1ac9c admin admin] PATH_INFO: `/v3/roles` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:07:38.354786 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5392e2b7-c740-43e4-958b-99be9de1ac9c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:07:38.356415 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5392e2b7-c740-43e4-958b-99be9de1ac9c admin admin] RBAC: Authorization granted {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:07:38.358876 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 1035/2062] 10.222.0.59 () {58 vars in 1121 bytes} [Thu Jun 2 16:07:38 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 16:07:38.365375 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c460bab-42ca-45be-9cc0-4dae8fc2a475 admin admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:07:38.370257 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 1028/2063] 10.222.0.59 () {58 vars in 1121 bytes} [Thu Jun 2 16:07:38 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 02 16:07:38.375013 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5392e2b7-c740-43e4-958b-99be9de1ac9c admin admin] Authenticating user token {{(pid=80396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:07:38.377251 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c460bab-42ca-45be-9cc0-4dae8fc2a475 admin admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:07:38.382094 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ebcd232-37f5-4419-a72c-482c8cc86ca3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f73d5a98be74242b45222df39fb6213', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:07:38.382783 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ebcd232-37f5-4419-a72c-482c8cc86ca3 admin admin] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:07:38.383068 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ebcd232-37f5-4419-a72c-482c8cc86ca3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:07:38.383355 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ebcd232-37f5-4419-a72c-482c8cc86ca3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:07:38.384082 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ebcd232-37f5-4419-a72c-482c8cc86ca3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:07:38.386960 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ebcd232-37f5-4419-a72c-482c8cc86ca3 admin admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:07:38.387276 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5392e2b7-c740-43e4-958b-99be9de1ac9c admin admin] Validating token access rules against request {{(pid=80396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:07:38.391878 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ca9fb42-a96e-44ef-afe3-9ca958e3d8d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f73d5a98be74242b45222df39fb6213', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:07:38.392527 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca9fb42-a96e-44ef-afe3-9ca958e3d8d2 admin admin] REQUEST_METHOD: `GET` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:07:38.392802 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca9fb42-a96e-44ef-afe3-9ca958e3d8d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:07:38.393071 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca9fb42-a96e-44ef-afe3-9ca958e3d8d2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:07:38.393794 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ca9fb42-a96e-44ef-afe3-9ca958e3d8d2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:07:38.395533 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ca9fb42-a96e-44ef-afe3-9ca958e3d8d2 admin admin] RBAC: Authorization granted {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:07:38.398265 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 1036/2064] 10.222.0.59 () {58 vars in 1121 bytes} [Thu Jun 2 16:07:38 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 16:07:38.403026 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ebcd232-37f5-4419-a72c-482c8cc86ca3 admin admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:07:38.410645 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 1029/2065] 10.222.0.59 () {58 vars in 1121 bytes} [Thu Jun 2 16:07:38 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 02 16:07:38.411706 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ca9fb42-a96e-44ef-afe3-9ca958e3d8d2 admin admin] Authenticating user token {{(pid=80396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:07:38.413369 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ebcd232-37f5-4419-a72c-482c8cc86ca3 admin admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:07:38.418145 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43a4a93b-9a40-4ba3-bfaf-a263e84434f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f73d5a98be74242b45222df39fb6213', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:07:38.419053 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a4a93b-9a40-4ba3-bfaf-a263e84434f5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:07:38.420307 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a4a93b-9a40-4ba3-bfaf-a263e84434f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:07:38.425890 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a4a93b-9a40-4ba3-bfaf-a263e84434f5 admin admin] PATH_INFO: `/v3/projects/b9ae3e4e2fa943d497623a549e23f906/users/88d362d24ff54106b00d945599f2a61d/roles/649e0f2b5a264c419ea6a1441f123a03` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:07:38.425998 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ca9fb42-a96e-44ef-afe3-9ca958e3d8d2 admin admin] Validating token access rules against request {{(pid=80396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:07:38.427213 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82b953bd-e8fa-46ed-bb05-b442b991a0c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f73d5a98be74242b45222df39fb6213', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:07:38.428110 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b953bd-e8fa-46ed-bb05-b442b991a0c3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:07:38.428396 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b953bd-e8fa-46ed-bb05-b442b991a0c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:07:38.428716 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b953bd-e8fa-46ed-bb05-b442b991a0c3 admin admin] PATH_INFO: `/v3/projects/622c2570d7f54d0ca8951b3a57f13a9a/users/0d40bcbad6344bc6b1573669fa57ccd4/roles/649e0f2b5a264c419ea6a1441f123a03` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:07:38.436478 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43a4a93b-9a40-4ba3-bfaf-a263e84434f5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b9ae3e4e2fa943d497623a549e23f906, user_id=88d362d24ff54106b00d945599f2a61d, role_id=649e0f2b5a264c419ea6a1441f123a03)` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:07:38.439173 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43a4a93b-9a40-4ba3-bfaf-a263e84434f5 admin admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:07:38.443855 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82b953bd-e8fa-46ed-bb05-b442b991a0c3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=622c2570d7f54d0ca8951b3a57f13a9a, user_id=0d40bcbad6344bc6b1573669fa57ccd4, role_id=649e0f2b5a264c419ea6a1441f123a03)` {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:07:38.446519 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82b953bd-e8fa-46ed-bb05-b442b991a0c3 admin admin] RBAC: Authorization granted {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:07:38.480578 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG dbcounter [-] [80396] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 16:07:38.566221 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 1037/2066] 10.222.0.59 () {60 vars in 1482 bytes} [Thu Jun 2 16:07:38 2022] PUT /identity/v3/projects/b9ae3e4e2fa943d497623a549e23f906/users/88d362d24ff54106b00d945599f2a61d/roles/649e0f2b5a264c419ea6a1441f123a03 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 02 16:07:38.571008 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd90c1e-339d-49bf-a035-13c6161361c3 None None] REQUEST_METHOD: `POST` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:07:38.571296 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd90c1e-339d-49bf-a035-13c6161361c3 None None] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:07:38.571572 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd90c1e-339d-49bf-a035-13c6161361c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:07:38.589795 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.auth.core [None req-cbd90c1e-339d-49bf-a035-13c6161361c3 None None] MFA Rules not processed for user `400d1f4db9de49638549e5db29a041e1`. Rule list: `[]` (Enabled: `True`). {{(pid=80395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 16:07:38.591955 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 16:07:38.593079 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.fernet_utils [None req-cbd90c1e-339d-49bf-a035-13c6161361c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:07:38.597106 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 1030/2067] 10.222.0.59 () {60 vars in 1482 bytes} [Thu Jun 2 16:07:38 2022] PUT /identity/v3/projects/622c2570d7f54d0ca8951b3a57f13a9a/users/0d40bcbad6344bc6b1573669fa57ccd4/roles/649e0f2b5a264c419ea6a1441f123a03 => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 16:07:38.611130 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6136fe7a-1b03-444d-9ba8-b5c8bf6ea78c None None] REQUEST_METHOD: `POST` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:07:38.611571 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6136fe7a-1b03-444d-9ba8-b5c8bf6ea78c None None] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:07:38.611981 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6136fe7a-1b03-444d-9ba8-b5c8bf6ea78c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:07:38.662104 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.auth.core [None req-6136fe7a-1b03-444d-9ba8-b5c8bf6ea78c None None] MFA Rules not processed for user `0d40bcbad6344bc6b1573669fa57ccd4`. Rule list: `[]` (Enabled: `True`). {{(pid=80396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 16:07:38.662878 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.fernet_utils [None req-6136fe7a-1b03-444d-9ba8-b5c8bf6ea78c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:07:38.684656 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 1038/2068] 10.222.0.59 () {58 vars in 957 bytes} [Thu Jun 2 16:07:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 02 16:07:38.691225 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbd90c1e-339d-49bf-a035-13c6161361c3 None None] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:07:38.695447 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.fernet_utils [None req-cbd90c1e-339d-49bf-a035-13c6161361c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:07:38.741379 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 1031/2069] 10.222.0.59 () {58 vars in 957 bytes} [Thu Jun 2 16:07:38 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 02 16:07:38.752911 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6136fe7a-1b03-444d-9ba8-b5c8bf6ea78c None None] Authenticating user token {{(pid=80396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:07:38.754381 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.fernet_utils [None req-6136fe7a-1b03-444d-9ba8-b5c8bf6ea78c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:07:38.756048 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbd90c1e-339d-49bf-a035-13c6161361c3 None None] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:07:38.766723 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2945c0e3-34f7-4045-b5f2-2d94b11d2b1e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9af40ddfe9ff4be3887b068f13a28dc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c87c981909d4b8db02783421818c79b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:07:38.767514 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2945c0e3-34f7-4045-b5f2-2d94b11d2b1e service neutron] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:07:38.767918 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2945c0e3-34f7-4045-b5f2-2d94b11d2b1e service neutron] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:07:38.768226 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2945c0e3-34f7-4045-b5f2-2d94b11d2b1e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:07:38.783524 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2945c0e3-34f7-4045-b5f2-2d94b11d2b1e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:07:38.785638 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2945c0e3-34f7-4045-b5f2-2d94b11d2b1e service neutron] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:07:38.806306 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 1039/2070] 10.222.0.59 () {60 vars in 1365 bytes} [Thu Jun 2 16:07:38 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 02 16:07:38.839817 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6136fe7a-1b03-444d-9ba8-b5c8bf6ea78c None None] Validating token access rules against request {{(pid=80396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:07:38.843739 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b90c3b0-6106-46f7-8bd4-e0d22a315fc5 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e673e7e0a4bf4c77bdb3e5325d0d3275', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c87c981909d4b8db02783421818c79b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:07:38.844409 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b90c3b0-6106-46f7-8bd4-e0d22a315fc5 service glance] REQUEST_METHOD: `GET` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:07:38.844695 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b90c3b0-6106-46f7-8bd4-e0d22a315fc5 service glance] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:07:38.845345 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b90c3b0-6106-46f7-8bd4-e0d22a315fc5 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:07:38.857593 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b90c3b0-6106-46f7-8bd4-e0d22a315fc5 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:07:38.859386 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b90c3b0-6106-46f7-8bd4-e0d22a315fc5 service glance] RBAC: Authorization granted {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:07:38.869846 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 1032/2071] 10.222.0.59 () {60 vars in 1365 bytes} [Thu Jun 2 16:07:38 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 02 16:07:39.007539 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG dbcounter [-] [80396] Writing DB stats keystone:SELECT=100 {{(pid=80396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 16:07:39.475230 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG dbcounter [-] [80396] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 16:07:39.966529 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 16:07:41.088810 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2945c0e3-34f7-4045-b5f2-2d94b11d2b1e service neutron] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:07:41.090345 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.fernet_utils [None req-2945c0e3-34f7-4045-b5f2-2d94b11d2b1e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:07:41.170113 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG dbcounter [-] [80396] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 16:07:41.179333 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2945c0e3-34f7-4045-b5f2-2d94b11d2b1e service neutron] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:07:41.183513 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c973ed4a-064a-46e1-8add-cfbad451d2ee service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6534961c369940a5b88f310c6450250b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c87c981909d4b8db02783421818c79b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:07:41.184955 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c973ed4a-064a-46e1-8add-cfbad451d2ee service cinder] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:07:41.185247 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c973ed4a-064a-46e1-8add-cfbad451d2ee service cinder] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:07:41.185901 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c973ed4a-064a-46e1-8add-cfbad451d2ee service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:07:41.194976 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.fernet_utils [None req-c973ed4a-064a-46e1-8add-cfbad451d2ee service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:07:41.286357 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c973ed4a-064a-46e1-8add-cfbad451d2ee service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:07:41.289469 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c973ed4a-064a-46e1-8add-cfbad451d2ee service cinder] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:07:41.300621 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 1040/2072] 10.222.0.59 () {60 vars in 1365 bytes} [Thu Jun 2 16:07:41 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 213 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 16:07:41.618356 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 16:07:43.160818 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG dbcounter [-] [80396] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 16:07:43.419466 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 16:07:44.238587 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG dbcounter [-] [80396] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 16:07:44.475779 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 16:07:45.234771 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b90c3b0-6106-46f7-8bd4-e0d22a315fc5 service glance] Authenticating user token {{(pid=80396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:07:45.236218 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.fernet_utils [None req-7b90c3b0-6106-46f7-8bd4-e0d22a315fc5 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:07:45.250617 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b90c3b0-6106-46f7-8bd4-e0d22a315fc5 service glance] Validating token access rules against request {{(pid=80396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:07:45.257310 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cb674bb-9ca0-4b7d-b8dc-0d728ab140fd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6534961c369940a5b88f310c6450250b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c87c981909d4b8db02783421818c79b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:07:45.257989 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb674bb-9ca0-4b7d-b8dc-0d728ab140fd service cinder] REQUEST_METHOD: `GET` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:07:45.258319 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb674bb-9ca0-4b7d-b8dc-0d728ab140fd service cinder] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:07:45.258601 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb674bb-9ca0-4b7d-b8dc-0d728ab140fd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:07:45.263240 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.fernet_utils [None req-2cb674bb-9ca0-4b7d-b8dc-0d728ab140fd service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:07:45.370362 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cb674bb-9ca0-4b7d-b8dc-0d728ab140fd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:07:45.372306 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cb674bb-9ca0-4b7d-b8dc-0d728ab140fd service cinder] RBAC: Authorization granted {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:07:45.386188 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 1033/2073] 10.222.0.59 () {60 vars in 1365 bytes} [Thu Jun 2 16:07:45 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 152 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 16:07:45.401219 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG dbcounter [-] [80396] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 16:07:45.585988 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3579517-b623-4fda-a7e5-5d6a7543cc89 None None] REQUEST_METHOD: `POST` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:07:45.587026 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3579517-b623-4fda-a7e5-5d6a7543cc89 None None] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:07:45.593408 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3579517-b623-4fda-a7e5-5d6a7543cc89 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:07:45.655746 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.auth.core [None req-b3579517-b623-4fda-a7e5-5d6a7543cc89 None None] MFA Rules not processed for user `88d362d24ff54106b00d945599f2a61d`. Rule list: `[]` (Enabled: `True`). {{(pid=80395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 16:07:45.655746 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.fernet_utils [None req-b3579517-b623-4fda-a7e5-5d6a7543cc89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:07:45.717613 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cb674bb-9ca0-4b7d-b8dc-0d728ab140fd service cinder] Authenticating user token {{(pid=80396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:07:45.725902 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cb674bb-9ca0-4b7d-b8dc-0d728ab140fd service cinder] Validating token access rules against request {{(pid=80396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:07:45.730401 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aac08312-c621-4842-b2f7-cb2a852977e7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6534961c369940a5b88f310c6450250b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c87c981909d4b8db02783421818c79b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:07:45.731037 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac08312-c621-4842-b2f7-cb2a852977e7 service cinder] REQUEST_METHOD: `GET` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:07:45.731318 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac08312-c621-4842-b2f7-cb2a852977e7 service cinder] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:07:45.731589 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac08312-c621-4842-b2f7-cb2a852977e7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:07:45.733341 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.fernet_utils [None req-aac08312-c621-4842-b2f7-cb2a852977e7 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:07:45.736024 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 1041/2074] 10.222.0.59 () {58 vars in 957 bytes} [Thu Jun 2 16:07:45 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 16:07:45.740175 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3579517-b623-4fda-a7e5-5d6a7543cc89 None None] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:07:45.750995 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3579517-b623-4fda-a7e5-5d6a7543cc89 None None] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:07:45.755630 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40d8bc72-cf81-4fcd-94a7-110610b7b4da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f73d5a98be74242b45222df39fb6213', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:07:45.756265 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d8bc72-cf81-4fcd-94a7-110610b7b4da admin admin] REQUEST_METHOD: `POST` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:07:45.756553 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d8bc72-cf81-4fcd-94a7-110610b7b4da admin admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:07:45.756825 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d8bc72-cf81-4fcd-94a7-110610b7b4da admin admin] PATH_INFO: `/v3/projects` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:07:45.757510 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40d8bc72-cf81-4fcd-94a7-110610b7b4da admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:07:45.760145 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40d8bc72-cf81-4fcd-94a7-110610b7b4da admin admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:07:45.807937 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aac08312-c621-4842-b2f7-cb2a852977e7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:07:45.809520 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aac08312-c621-4842-b2f7-cb2a852977e7 service cinder] RBAC: Authorization granted {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:07:45.820018 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 1034/2075] 10.222.0.59 () {60 vars in 1365 bytes} [Thu Jun 2 16:07:45 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 16:07:45.884113 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 1042/2076] 10.222.0.59 () {60 vars in 1152 bytes} [Thu Jun 2 16:07:45 2022] POST /identity/v3/projects => generated 385 bytes in 144 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 02 16:07:45.888253 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aac08312-c621-4842-b2f7-cb2a852977e7 service cinder] Authenticating user token {{(pid=80396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:07:45.898449 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aac08312-c621-4842-b2f7-cb2a852977e7 service cinder] Validating token access rules against request {{(pid=80396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:07:45.973388 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-806f7c71-a25a-44ee-aa47-55d1f83e5813 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f73d5a98be74242b45222df39fb6213', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:07:45.974062 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-806f7c71-a25a-44ee-aa47-55d1f83e5813 admin admin] REQUEST_METHOD: `POST` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:07:45.974422 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-806f7c71-a25a-44ee-aa47-55d1f83e5813 admin admin] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:07:45.974713 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-806f7c71-a25a-44ee-aa47-55d1f83e5813 admin admin] PATH_INFO: `/v3/users` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:07:45.975433 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-806f7c71-a25a-44ee-aa47-55d1f83e5813 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:07:45.977412 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-806f7c71-a25a-44ee-aa47-55d1f83e5813 admin admin] RBAC: Authorization granted {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:07:46.109509 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 1035/2077] 10.222.0.59 () {60 vars in 1143 bytes} [Thu Jun 2 16:07:45 2022] POST /identity/v3/users => generated 299 bytes in 219 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 02 16:07:46.111707 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40d8bc72-cf81-4fcd-94a7-110610b7b4da admin admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:07:46.124205 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40d8bc72-cf81-4fcd-94a7-110610b7b4da admin admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:07:46.133561 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6610d4fa-5436-4905-b502-02df8d016105 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f73d5a98be74242b45222df39fb6213', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:07:46.134447 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6610d4fa-5436-4905-b502-02df8d016105 admin admin] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:07:46.135062 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6610d4fa-5436-4905-b502-02df8d016105 admin admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:07:46.135350 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6610d4fa-5436-4905-b502-02df8d016105 admin admin] PATH_INFO: `/v3/roles` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:07:46.140994 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6610d4fa-5436-4905-b502-02df8d016105 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:07:46.148554 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6610d4fa-5436-4905-b502-02df8d016105 admin admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:07:46.167348 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 1043/2078] 10.222.0.59 () {58 vars in 1121 bytes} [Thu Jun 2 16:07:46 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 16:07:46.171183 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-806f7c71-a25a-44ee-aa47-55d1f83e5813 admin admin] Authenticating user token {{(pid=80396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:07:46.199494 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-806f7c71-a25a-44ee-aa47-55d1f83e5813 admin admin] Validating token access rules against request {{(pid=80396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:07:46.218632 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6edaa061-a31a-4d8c-8c80-29c582ced70b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f73d5a98be74242b45222df39fb6213', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:07:46.219544 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6edaa061-a31a-4d8c-8c80-29c582ced70b admin admin] REQUEST_METHOD: `PUT` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:07:46.219819 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6edaa061-a31a-4d8c-8c80-29c582ced70b admin admin] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:07:46.228787 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6edaa061-a31a-4d8c-8c80-29c582ced70b admin admin] PATH_INFO: `/v3/projects/0206b1e1d2f34c44bba5570f30d4c677/users/76c62c880c2a43a1b68b0ed41af39835/roles/f1e0c25f6e9049e897cb7350c7e54ab3` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:07:46.237688 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6edaa061-a31a-4d8c-8c80-29c582ced70b admin admin] RBAC: Authorizing `identity:create_grant(project_id=0206b1e1d2f34c44bba5570f30d4c677, user_id=76c62c880c2a43a1b68b0ed41af39835, role_id=f1e0c25f6e9049e897cb7350c7e54ab3)` {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:07:46.240500 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6edaa061-a31a-4d8c-8c80-29c582ced70b admin admin] RBAC: Authorization granted {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:07:46.363146 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 1036/2079] 10.222.0.59 () {60 vars in 1482 bytes} [Thu Jun 2 16:07:46 2022] PUT /identity/v3/projects/0206b1e1d2f34c44bba5570f30d4c677/users/76c62c880c2a43a1b68b0ed41af39835/roles/f1e0c25f6e9049e897cb7350c7e54ab3 => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 16:07:46.368920 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6610d4fa-5436-4905-b502-02df8d016105 admin admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:07:46.379671 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6610d4fa-5436-4905-b502-02df8d016105 admin admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:07:46.449024 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c9d67e8-08d8-4379-b557-8ade40e7304e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f73d5a98be74242b45222df39fb6213', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:07:46.449709 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c9d67e8-08d8-4379-b557-8ade40e7304e admin admin] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:07:46.457205 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c9d67e8-08d8-4379-b557-8ade40e7304e admin admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:07:46.457205 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c9d67e8-08d8-4379-b557-8ade40e7304e admin admin] PATH_INFO: `/v3/roles` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:07:46.457205 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c9d67e8-08d8-4379-b557-8ade40e7304e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:07:46.457205 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c9d67e8-08d8-4379-b557-8ade40e7304e admin admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:07:46.464391 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 1044/2080] 10.222.0.59 () {58 vars in 1121 bytes} [Thu Jun 2 16:07:46 2022] GET /identity/v3/roles => generated 1420 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 16:07:46.469300 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6edaa061-a31a-4d8c-8c80-29c582ced70b admin admin] Authenticating user token {{(pid=80396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:07:46.487256 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6edaa061-a31a-4d8c-8c80-29c582ced70b admin admin] Validating token access rules against request {{(pid=80396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:07:46.495882 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-061f0819-ceb1-409d-88bc-86fa3a9d0e8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f73d5a98be74242b45222df39fb6213', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:07:46.496962 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061f0819-ceb1-409d-88bc-86fa3a9d0e8f admin admin] REQUEST_METHOD: `PUT` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:07:46.497338 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061f0819-ceb1-409d-88bc-86fa3a9d0e8f admin admin] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:07:46.497624 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061f0819-ceb1-409d-88bc-86fa3a9d0e8f admin admin] PATH_INFO: `/v3/projects/0206b1e1d2f34c44bba5570f30d4c677/users/76c62c880c2a43a1b68b0ed41af39835/roles/f1e0c25f6e9049e897cb7350c7e54ab3` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:07:46.499720 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-061f0819-ceb1-409d-88bc-86fa3a9d0e8f admin admin] RBAC: Authorizing `identity:create_grant(project_id=0206b1e1d2f34c44bba5570f30d4c677, user_id=76c62c880c2a43a1b68b0ed41af39835, role_id=f1e0c25f6e9049e897cb7350c7e54ab3)` {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:07:46.503096 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-061f0819-ceb1-409d-88bc-86fa3a9d0e8f admin admin] RBAC: Authorization granted {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:07:46.516484 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 1037/2081] 10.222.0.59 () {60 vars in 1482 bytes} [Thu Jun 2 16:07:46 2022] PUT /identity/v3/projects/0206b1e1d2f34c44bba5570f30d4c677/users/76c62c880c2a43a1b68b0ed41af39835/roles/f1e0c25f6e9049e897cb7350c7e54ab3 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 16:07:46.761931 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 16:07:47.645988 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c9d67e8-08d8-4379-b557-8ade40e7304e admin admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:07:47.647943 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.fernet_utils [None req-1c9d67e8-08d8-4379-b557-8ade40e7304e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:07:47.653025 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG dbcounter [-] [80396] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 16:07:47.679653 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c9d67e8-08d8-4379-b557-8ade40e7304e admin admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:07:47.817856 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78730c56-77e4-4be2-96cc-e3381a73688a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f73d5a98be74242b45222df39fb6213', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:07:47.819134 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78730c56-77e4-4be2-96cc-e3381a73688a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:07:47.820800 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78730c56-77e4-4be2-96cc-e3381a73688a admin admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:07:47.820800 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78730c56-77e4-4be2-96cc-e3381a73688a admin admin] PATH_INFO: `/v3/users/1400263107254337be69dc15e8d046d4` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:07:47.822836 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78730c56-77e4-4be2-96cc-e3381a73688a admin admin] RBAC: Authorizing `identity:delete_user(user_id=1400263107254337be69dc15e8d046d4)` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:07:47.825712 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78730c56-77e4-4be2-96cc-e3381a73688a admin admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:07:48.115293 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.notifications [None req-78730c56-77e4-4be2-96cc-e3381a73688a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1400263107254337be69dc15e8d046d4'} {{(pid=80395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:07:48.223392 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.notifications [None req-78730c56-77e4-4be2-96cc-e3381a73688a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1400263107254337be69dc15e8d046d4'} {{(pid=80395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:07:48.240240 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.notifications [None req-78730c56-77e4-4be2-96cc-e3381a73688a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1400263107254337be69dc15e8d046d4'} {{(pid=80395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:07:48.240973 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.notifications [None req-78730c56-77e4-4be2-96cc-e3381a73688a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1400263107254337be69dc15e8d046d4'} {{(pid=80395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:07:48.249773 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.notifications [None req-78730c56-77e4-4be2-96cc-e3381a73688a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1400263107254337be69dc15e8d046d4'} {{(pid=80395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:07:48.255800 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 1045/2082] 10.222.0.59 () {58 vars in 1223 bytes} [Thu Jun 2 16:07:47 2022] DELETE /identity/v3/users/1400263107254337be69dc15e8d046d4 => generated 0 bytes in 610 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 16:07:48.379355 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 16:07:48.554694 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-061f0819-ceb1-409d-88bc-86fa3a9d0e8f admin admin] Authenticating user token {{(pid=80396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:07:48.558476 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.fernet_utils [None req-061f0819-ceb1-409d-88bc-86fa3a9d0e8f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:07:48.579258 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-061f0819-ceb1-409d-88bc-86fa3a9d0e8f admin admin] Validating token access rules against request {{(pid=80396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:07:48.644768 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1188a533-745e-4e65-b976-90a3f601e35f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f73d5a98be74242b45222df39fb6213', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:07:48.645630 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1188a533-745e-4e65-b976-90a3f601e35f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:07:48.645912 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1188a533-745e-4e65-b976-90a3f601e35f admin admin] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:07:48.646219 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1188a533-745e-4e65-b976-90a3f601e35f admin admin] PATH_INFO: `/v3/projects/8e72d608f9b243739572bf4fab56bd13` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:07:48.647411 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1188a533-745e-4e65-b976-90a3f601e35f admin admin] RBAC: Authorizing `identity:delete_project(project_id=8e72d608f9b243739572bf4fab56bd13)` {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:07:48.649344 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1188a533-745e-4e65-b976-90a3f601e35f admin admin] RBAC: Authorization granted {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:07:48.785068 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.notifications [None req-1188a533-745e-4e65-b976-90a3f601e35f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8e72d608f9b243739572bf4fab56bd13', 'request_id': 'req-1188a533-745e-4e65-b976-90a3f601e35f'} {{(pid=80396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:07:48.807205 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.notifications [None req-1188a533-745e-4e65-b976-90a3f601e35f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8e72d608f9b243739572bf4fab56bd13', 'request_id': 'req-1188a533-745e-4e65-b976-90a3f601e35f'} {{(pid=80396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:07:48.955633 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.notifications [None req-1188a533-745e-4e65-b976-90a3f601e35f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8e72d608f9b243739572bf4fab56bd13', 'request_id': 'req-1188a533-745e-4e65-b976-90a3f601e35f'} {{(pid=80396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:07:48.968974 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.notifications [None req-1188a533-745e-4e65-b976-90a3f601e35f admin admin] The token cache is being invalidate because project 8e72d608f9b243739572bf4fab56bd13 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80396) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 02 16:07:48.969577 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.notifications [None req-1188a533-745e-4e65-b976-90a3f601e35f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:07:48.970428 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.notifications [None req-1188a533-745e-4e65-b976-90a3f601e35f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:07:48.972884 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 1038/2083] 10.222.0.59 () {58 vars in 1232 bytes} [Thu Jun 2 16:07:48 2022] DELETE /identity/v3/projects/8e72d608f9b243739572bf4fab56bd13 => generated 0 bytes in 419 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 16:07:48.982619 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d63b359-b81b-4a80-861d-4a9d9e370c4f None None] REQUEST_METHOD: `POST` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:07:48.984347 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d63b359-b81b-4a80-861d-4a9d9e370c4f None None] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:07:48.986866 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d63b359-b81b-4a80-861d-4a9d9e370c4f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:07:49.023132 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.auth.core [None req-8d63b359-b81b-4a80-861d-4a9d9e370c4f None None] MFA Rules not processed for user `400d1f4db9de49638549e5db29a041e1`. Rule list: `[]` (Enabled: `True`). {{(pid=80395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 16:07:49.024439 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.fernet_utils [None req-8d63b359-b81b-4a80-861d-4a9d9e370c4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:07:49.115717 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 1046/2084] 10.222.0.59 () {58 vars in 957 bytes} [Thu Jun 2 16:07:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 16:07:49.125432 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2929a146-5739-4f40-b0a8-be4af21306d6 None None] REQUEST_METHOD: `POST` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:07:49.126363 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2929a146-5739-4f40-b0a8-be4af21306d6 None None] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:07:49.126807 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2929a146-5739-4f40-b0a8-be4af21306d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:07:49.148490 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.auth.core [None req-2929a146-5739-4f40-b0a8-be4af21306d6 None None] MFA Rules not processed for user `400d1f4db9de49638549e5db29a041e1`. Rule list: `[]` (Enabled: `True`). {{(pid=80396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 16:07:49.149706 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.fernet_utils [None req-2929a146-5739-4f40-b0a8-be4af21306d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:07:49.158522 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 1039/2085] 10.222.0.59 () {58 vars in 957 bytes} [Thu Jun 2 16:07:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 16:07:49.162926 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d63b359-b81b-4a80-861d-4a9d9e370c4f None None] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:07:49.173583 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d63b359-b81b-4a80-861d-4a9d9e370c4f None None] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:07:49.179655 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8744493c-9e49-48ca-8056-8f6e795e6f5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f73d5a98be74242b45222df39fb6213', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:07:49.180539 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8744493c-9e49-48ca-8056-8f6e795e6f5b admin admin] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:07:49.186214 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8744493c-9e49-48ca-8056-8f6e795e6f5b admin admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:07:49.192134 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8744493c-9e49-48ca-8056-8f6e795e6f5b admin admin] PATH_INFO: `/v3/domains` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:07:49.193188 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8744493c-9e49-48ca-8056-8f6e795e6f5b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80395) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 16:07:49.193829 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8744493c-9e49-48ca-8056-8f6e795e6f5b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:07:49.195622 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8744493c-9e49-48ca-8056-8f6e795e6f5b admin admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:07:49.210677 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 1047/2086] 10.222.0.59 () {58 vars in 1152 bytes} [Thu Jun 2 16:07:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 16:07:49.214870 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2929a146-5739-4f40-b0a8-be4af21306d6 None None] Authenticating user token {{(pid=80396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:07:49.226583 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2929a146-5739-4f40-b0a8-be4af21306d6 None None] Validating token access rules against request {{(pid=80396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:07:49.235250 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df88805f-2d4d-4ce7-968c-616ef659c300 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f73d5a98be74242b45222df39fb6213', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:07:49.236099 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df88805f-2d4d-4ce7-968c-616ef659c300 admin admin] REQUEST_METHOD: `POST` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:07:49.236395 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df88805f-2d4d-4ce7-968c-616ef659c300 admin admin] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:07:49.236676 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df88805f-2d4d-4ce7-968c-616ef659c300 admin admin] PATH_INFO: `/v3/projects` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:07:49.237419 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df88805f-2d4d-4ce7-968c-616ef659c300 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:07:49.239433 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df88805f-2d4d-4ce7-968c-616ef659c300 admin admin] RBAC: Authorization granted {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:07:49.254743 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG dbcounter [-] [80396] Writing DB stats keystone:SELECT=95,keystone:INSERT=3,keystone:DELETE=2 {{(pid=80396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 16:07:49.359446 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 1040/2087] 10.222.0.59 () {60 vars in 1152 bytes} [Thu Jun 2 16:07:49 2022] POST /identity/v3/projects => generated 389 bytes in 145 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 16:07:49.363206 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8744493c-9e49-48ca-8056-8f6e795e6f5b admin admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:07:49.375149 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8744493c-9e49-48ca-8056-8f6e795e6f5b admin admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:07:49.506127 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c99217b5-c6f9-485e-9aad-c319d35db617 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f73d5a98be74242b45222df39fb6213', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:07:49.515042 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c99217b5-c6f9-485e-9aad-c319d35db617 admin admin] REQUEST_METHOD: `POST` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:07:49.515637 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c99217b5-c6f9-485e-9aad-c319d35db617 admin admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:07:49.515977 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c99217b5-c6f9-485e-9aad-c319d35db617 admin admin] PATH_INFO: `/v3/users` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:07:49.516888 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c99217b5-c6f9-485e-9aad-c319d35db617 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:07:49.519669 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c99217b5-c6f9-485e-9aad-c319d35db617 admin admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:07:49.621552 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 1048/2088] 10.222.0.59 () {60 vars in 1143 bytes} [Thu Jun 2 16:07:49 2022] POST /identity/v3/users => generated 295 bytes in 259 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 16:07:49.625440 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df88805f-2d4d-4ce7-968c-616ef659c300 admin admin] Authenticating user token {{(pid=80396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:07:49.637715 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df88805f-2d4d-4ce7-968c-616ef659c300 admin admin] Validating token access rules against request {{(pid=80396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:07:49.643315 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61340b78-6720-463b-a4b9-96537ce1776d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f73d5a98be74242b45222df39fb6213', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:07:49.643990 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61340b78-6720-463b-a4b9-96537ce1776d admin admin] REQUEST_METHOD: `GET` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:07:49.644426 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61340b78-6720-463b-a4b9-96537ce1776d admin admin] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:07:49.645003 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61340b78-6720-463b-a4b9-96537ce1776d admin admin] PATH_INFO: `/v3/roles` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:07:49.645933 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61340b78-6720-463b-a4b9-96537ce1776d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:07:49.647763 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61340b78-6720-463b-a4b9-96537ce1776d admin admin] RBAC: Authorization granted {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:07:49.659382 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 1041/2089] 10.222.0.59 () {58 vars in 1121 bytes} [Thu Jun 2 16:07:49 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 16:07:49.663345 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c99217b5-c6f9-485e-9aad-c319d35db617 admin admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:07:49.677342 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c99217b5-c6f9-485e-9aad-c319d35db617 admin admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:07:49.683951 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08233d39-f218-41a5-806c-557fef698535 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f73d5a98be74242b45222df39fb6213', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:07:49.684644 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08233d39-f218-41a5-806c-557fef698535 admin admin] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:07:49.684908 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08233d39-f218-41a5-806c-557fef698535 admin admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:07:49.685180 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08233d39-f218-41a5-806c-557fef698535 admin admin] PATH_INFO: `/v3/roles` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:07:49.685917 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08233d39-f218-41a5-806c-557fef698535 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:07:49.687559 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08233d39-f218-41a5-806c-557fef698535 admin admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:07:49.704589 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61340b78-6720-463b-a4b9-96537ce1776d admin admin] Authenticating user token {{(pid=80396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:07:49.704904 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 1049/2090] 10.222.0.59 () {58 vars in 1121 bytes} [Thu Jun 2 16:07:49 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 16:07:49.716192 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61340b78-6720-463b-a4b9-96537ce1776d admin admin] Validating token access rules against request {{(pid=80396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:07:49.721442 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3d2edde-4879-4df6-88a3-5e380570a93b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f73d5a98be74242b45222df39fb6213', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:07:49.722378 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d2edde-4879-4df6-88a3-5e380570a93b admin admin] REQUEST_METHOD: `PUT` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:07:49.722866 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d2edde-4879-4df6-88a3-5e380570a93b admin admin] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:07:49.723224 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d2edde-4879-4df6-88a3-5e380570a93b admin admin] PATH_INFO: `/v3/projects/470abf75f36f4a84b9382efc2aa2fc1c/users/95108cdd8e134be3823d5024f7037b3e/roles/649e0f2b5a264c419ea6a1441f123a03` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:07:49.742256 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3d2edde-4879-4df6-88a3-5e380570a93b admin admin] RBAC: Authorizing `identity:create_grant(project_id=470abf75f36f4a84b9382efc2aa2fc1c, user_id=95108cdd8e134be3823d5024f7037b3e, role_id=649e0f2b5a264c419ea6a1441f123a03)` {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:07:49.746409 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3d2edde-4879-4df6-88a3-5e380570a93b admin admin] RBAC: Authorization granted {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:07:49.898565 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 1042/2091] 10.222.0.59 () {60 vars in 1482 bytes} [Thu Jun 2 16:07:49 2022] PUT /identity/v3/projects/470abf75f36f4a84b9382efc2aa2fc1c/users/95108cdd8e134be3823d5024f7037b3e/roles/649e0f2b5a264c419ea6a1441f123a03 => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 02 16:07:49.903082 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1124ea2a-2a03-4473-8351-52daf7dacfe4 None None] REQUEST_METHOD: `POST` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:07:49.903610 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1124ea2a-2a03-4473-8351-52daf7dacfe4 None None] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:07:49.904971 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1124ea2a-2a03-4473-8351-52daf7dacfe4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:07:49.933712 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.auth.core [None req-1124ea2a-2a03-4473-8351-52daf7dacfe4 None None] MFA Rules not processed for user `400d1f4db9de49638549e5db29a041e1`. Rule list: `[]` (Enabled: `True`). {{(pid=80395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 16:07:49.937315 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.fernet_utils [None req-1124ea2a-2a03-4473-8351-52daf7dacfe4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:07:50.147444 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 1050/2092] 10.222.0.59 () {58 vars in 957 bytes} [Thu Jun 2 16:07:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 245 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 16:07:50.156353 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3d2edde-4879-4df6-88a3-5e380570a93b admin admin] Authenticating user token {{(pid=80396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:07:50.158170 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.fernet_utils [None req-a3d2edde-4879-4df6-88a3-5e380570a93b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:07:50.296320 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3d2edde-4879-4df6-88a3-5e380570a93b admin admin] Validating token access rules against request {{(pid=80396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:07:50.300337 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a03ee9b-b482-428b-b6da-c6bf5f2fc773 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9af40ddfe9ff4be3887b068f13a28dc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c87c981909d4b8db02783421818c79b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:07:50.301091 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a03ee9b-b482-428b-b6da-c6bf5f2fc773 service neutron] REQUEST_METHOD: `GET` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:07:50.301631 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a03ee9b-b482-428b-b6da-c6bf5f2fc773 service neutron] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:07:50.302009 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a03ee9b-b482-428b-b6da-c6bf5f2fc773 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:07:50.317558 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a03ee9b-b482-428b-b6da-c6bf5f2fc773 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:07:50.319146 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a03ee9b-b482-428b-b6da-c6bf5f2fc773 service neutron] RBAC: Authorization granted {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:07:50.331941 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 1043/2093] 10.222.0.59 () {60 vars in 1365 bytes} [Thu Jun 2 16:07:50 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 176 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 16:07:50.773390 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 16:07:52.018170 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG dbcounter [-] [80396] Writing DB stats keystone:SELECT=82,keystone:DELETE=15,keystone:INSERT=3 {{(pid=80396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 16:07:52.850001 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1124ea2a-2a03-4473-8351-52daf7dacfe4 None None] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:07:52.853962 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.fernet_utils [None req-1124ea2a-2a03-4473-8351-52daf7dacfe4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:07:52.879134 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writing DB stats keystone:SELECT=80,keystone:INSERT=5,keystone:DELETE=15 {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 16:07:52.968099 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1124ea2a-2a03-4473-8351-52daf7dacfe4 None None] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:07:52.972978 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0966730c-d48a-4cfe-9971-bbe9eb53a541 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6534961c369940a5b88f310c6450250b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c87c981909d4b8db02783421818c79b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:07:52.976189 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0966730c-d48a-4cfe-9971-bbe9eb53a541 service cinder] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:07:52.976189 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0966730c-d48a-4cfe-9971-bbe9eb53a541 service cinder] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:07:52.976189 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0966730c-d48a-4cfe-9971-bbe9eb53a541 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:07:52.976776 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.fernet_utils [None req-0966730c-d48a-4cfe-9971-bbe9eb53a541 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:07:53.049086 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0966730c-d48a-4cfe-9971-bbe9eb53a541 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:07:53.050770 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0966730c-d48a-4cfe-9971-bbe9eb53a541 service cinder] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:07:53.062488 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 1051/2094] 10.222.0.59 () {60 vars in 1365 bytes} [Thu Jun 2 16:07:52 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 213 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 16:07:54.876883 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-399df36f-5799-49b6-9e60-8a2b51fa6aef None None] REQUEST_METHOD: `POST` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:07:54.877405 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-399df36f-5799-49b6-9e60-8a2b51fa6aef None None] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:07:54.877766 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-399df36f-5799-49b6-9e60-8a2b51fa6aef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:07:54.907456 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.auth.core [None req-399df36f-5799-49b6-9e60-8a2b51fa6aef None None] MFA Rules not processed for user `76c62c880c2a43a1b68b0ed41af39835`. Rule list: `[]` (Enabled: `True`). {{(pid=80396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 16:07:54.908772 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.fernet_utils [None req-399df36f-5799-49b6-9e60-8a2b51fa6aef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:07:54.995716 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 1044/2095] 10.222.0.59 () {58 vars in 957 bytes} [Thu Jun 2 16:07:54 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 16:07:55.011179 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0966730c-d48a-4cfe-9971-bbe9eb53a541 service cinder] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:07:55.014021 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.fernet_utils [None req-0966730c-d48a-4cfe-9971-bbe9eb53a541 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:07:55.104662 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0966730c-d48a-4cfe-9971-bbe9eb53a541 service cinder] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:07:55.109231 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08443732-de58-4ef0-8461-c1d9b27135e4 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e673e7e0a4bf4c77bdb3e5325d0d3275', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c87c981909d4b8db02783421818c79b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:07:55.115630 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08443732-de58-4ef0-8461-c1d9b27135e4 service glance] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:07:55.116156 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08443732-de58-4ef0-8461-c1d9b27135e4 service glance] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:07:55.116705 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08443732-de58-4ef0-8461-c1d9b27135e4 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:07:55.126775 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.fernet_utils [None req-08443732-de58-4ef0-8461-c1d9b27135e4 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:07:55.308456 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08443732-de58-4ef0-8461-c1d9b27135e4 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:07:55.310045 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08443732-de58-4ef0-8461-c1d9b27135e4 service glance] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:07:55.322765 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 1052/2096] 10.222.0.59 () {60 vars in 1365 bytes} [Thu Jun 2 16:07:55 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 02 16:07:55.589982 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-399df36f-5799-49b6-9e60-8a2b51fa6aef None None] Authenticating user token {{(pid=80396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:07:55.591512 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.fernet_utils [None req-399df36f-5799-49b6-9e60-8a2b51fa6aef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:07:55.607316 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-399df36f-5799-49b6-9e60-8a2b51fa6aef None None] Validating token access rules against request {{(pid=80396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:07:55.613743 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02cc30c9-6c44-49dd-b69f-ce0041eb2d16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f73d5a98be74242b45222df39fb6213', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:07:55.615944 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02cc30c9-6c44-49dd-b69f-ce0041eb2d16 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:07:55.616660 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02cc30c9-6c44-49dd-b69f-ce0041eb2d16 admin admin] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:07:55.617205 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02cc30c9-6c44-49dd-b69f-ce0041eb2d16 admin admin] PATH_INFO: `/v3/users/c75eb91d9b2c4de5ae06d6f0715d0a76` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:07:55.619608 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02cc30c9-6c44-49dd-b69f-ce0041eb2d16 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c75eb91d9b2c4de5ae06d6f0715d0a76)` {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:07:55.621807 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02cc30c9-6c44-49dd-b69f-ce0041eb2d16 admin admin] RBAC: Authorization granted {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:07:55.624216 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cee2215-51ff-455e-a85c-794684249de4 None None] REQUEST_METHOD: `POST` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:07:55.624592 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cee2215-51ff-455e-a85c-794684249de4 None None] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:07:55.624947 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cee2215-51ff-455e-a85c-794684249de4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:07:55.651564 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.auth.core [None req-3cee2215-51ff-455e-a85c-794684249de4 None None] MFA Rules not processed for user `11b714eb2dda4460a8ff52215e671bfa`. Rule list: `[]` (Enabled: `True`). {{(pid=80395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 16:07:55.652948 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.fernet_utils [None req-3cee2215-51ff-455e-a85c-794684249de4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:07:55.662680 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG dbcounter [-] [80396] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 16:07:55.730759 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 1053/2097] 10.222.0.59 () {58 vars in 1009 bytes} [Thu Jun 2 16:07:55 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 16:07:55.776166 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cee2215-51ff-455e-a85c-794684249de4 None None] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:07:55.777713 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.fernet_utils [None req-3cee2215-51ff-455e-a85c-794684249de4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:07:55.874421 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cee2215-51ff-455e-a85c-794684249de4 None None] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:07:55.894344 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b2432a1-9b6a-445d-b471-387d763fc04c service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31bd858bf7674f43a99b77d11bc3c1a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c87c981909d4b8db02783421818c79b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:07:55.894344 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b2432a1-9b6a-445d-b471-387d763fc04c service swift] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:07:55.894344 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b2432a1-9b6a-445d-b471-387d763fc04c service swift] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:07:55.894344 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b2432a1-9b6a-445d-b471-387d763fc04c service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:07:55.903126 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b2432a1-9b6a-445d-b471-387d763fc04c service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:07:55.904779 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b2432a1-9b6a-445d-b471-387d763fc04c service swift] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:07:55.906742 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.notifications [None req-02cc30c9-6c44-49dd-b69f-ce0041eb2d16 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c75eb91d9b2c4de5ae06d6f0715d0a76'} {{(pid=80396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:07:55.908795 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.notifications [None req-02cc30c9-6c44-49dd-b69f-ce0041eb2d16 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c75eb91d9b2c4de5ae06d6f0715d0a76'} {{(pid=80396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:07:55.914039 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 1054/2098] 10.222.0.59 () {60 vars in 1384 bytes} [Thu Jun 2 16:07:55 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 139 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 02 16:07:56.058580 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.notifications [None req-02cc30c9-6c44-49dd-b69f-ce0041eb2d16 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c75eb91d9b2c4de5ae06d6f0715d0a76'} {{(pid=80396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:07:56.091992 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.notifications [None req-02cc30c9-6c44-49dd-b69f-ce0041eb2d16 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c75eb91d9b2c4de5ae06d6f0715d0a76'} {{(pid=80396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:07:56.100456 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.notifications [None req-02cc30c9-6c44-49dd-b69f-ce0041eb2d16 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c75eb91d9b2c4de5ae06d6f0715d0a76'} {{(pid=80396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:07:56.113432 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 1045/2099] 10.222.0.59 () {58 vars in 1223 bytes} [Thu Jun 2 16:07:55 2022] DELETE /identity/v3/users/c75eb91d9b2c4de5ae06d6f0715d0a76 => generated 0 bytes in 524 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 16:07:56.117866 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09386863-806e-4bd7-bb5c-8e5a613a79d6 None None] REQUEST_METHOD: `POST` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:07:56.122537 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09386863-806e-4bd7-bb5c-8e5a613a79d6 None None] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:07:56.123151 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09386863-806e-4bd7-bb5c-8e5a613a79d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:07:56.153181 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.auth.core [None req-09386863-806e-4bd7-bb5c-8e5a613a79d6 None None] MFA Rules not processed for user `400d1f4db9de49638549e5db29a041e1`. Rule list: `[]` (Enabled: `True`). {{(pid=80395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 16:07:56.154694 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.fernet_utils [None req-09386863-806e-4bd7-bb5c-8e5a613a79d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:07:56.303237 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 1055/2100] 10.222.0.59 () {58 vars in 957 bytes} [Thu Jun 2 16:07:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 16:07:56.303664 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02cc30c9-6c44-49dd-b69f-ce0041eb2d16 admin admin] Authenticating user token {{(pid=80396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:07:56.304519 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writing DB stats keystone:SELECT=97,keystone:DELETE=2,keystone:INSERT=1 {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 16:07:56.305106 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.fernet_utils [None req-02cc30c9-6c44-49dd-b69f-ce0041eb2d16 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:07:56.492414 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02cc30c9-6c44-49dd-b69f-ce0041eb2d16 admin admin] Validating token access rules against request {{(pid=80396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:07:56.508911 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6196d471-f434-4328-829f-b1651996c301 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9af40ddfe9ff4be3887b068f13a28dc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c87c981909d4b8db02783421818c79b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:07:56.510324 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6196d471-f434-4328-829f-b1651996c301 service neutron] REQUEST_METHOD: `GET` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:07:56.514114 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6196d471-f434-4328-829f-b1651996c301 service neutron] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:07:56.514489 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6196d471-f434-4328-829f-b1651996c301 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:07:56.551405 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6196d471-f434-4328-829f-b1651996c301 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:07:56.552868 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6196d471-f434-4328-829f-b1651996c301 service neutron] RBAC: Authorization granted {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:07:56.578965 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 1046/2101] 10.222.0.59 () {60 vars in 1365 bytes} [Thu Jun 2 16:07:56 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 274 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 02 16:07:56.869970 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG dbcounter [-] [80396] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 16:07:57.380211 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09386863-806e-4bd7-bb5c-8e5a613a79d6 None None] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:07:57.380211 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.fernet_utils [None req-09386863-806e-4bd7-bb5c-8e5a613a79d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:07:57.400741 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09386863-806e-4bd7-bb5c-8e5a613a79d6 None None] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:07:57.410862 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a03d912e-da44-41dc-848f-a89607614099 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f73d5a98be74242b45222df39fb6213', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:07:57.412491 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a03d912e-da44-41dc-848f-a89607614099 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:07:57.412968 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a03d912e-da44-41dc-848f-a89607614099 admin admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:07:57.413479 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a03d912e-da44-41dc-848f-a89607614099 admin admin] PATH_INFO: `/v3/projects/e05229f5166b417b93651a04a405e7f4` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:07:57.415818 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a03d912e-da44-41dc-848f-a89607614099 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e05229f5166b417b93651a04a405e7f4)` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:07:57.418760 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a03d912e-da44-41dc-848f-a89607614099 admin admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:07:57.561972 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.notifications [None req-a03d912e-da44-41dc-848f-a89607614099 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e05229f5166b417b93651a04a405e7f4', 'request_id': 'req-a03d912e-da44-41dc-848f-a89607614099'} {{(pid=80395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:07:57.577203 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.notifications [None req-a03d912e-da44-41dc-848f-a89607614099 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e05229f5166b417b93651a04a405e7f4', 'request_id': 'req-a03d912e-da44-41dc-848f-a89607614099'} {{(pid=80395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:07:57.686494 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.notifications [None req-a03d912e-da44-41dc-848f-a89607614099 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e05229f5166b417b93651a04a405e7f4', 'request_id': 'req-a03d912e-da44-41dc-848f-a89607614099'} {{(pid=80395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:07:57.705915 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.notifications [None req-a03d912e-da44-41dc-848f-a89607614099 admin admin] The token cache is being invalidate because project e05229f5166b417b93651a04a405e7f4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80395) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 02 16:07:57.706249 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.notifications [None req-a03d912e-da44-41dc-848f-a89607614099 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:07:57.710915 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.notifications [None req-a03d912e-da44-41dc-848f-a89607614099 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:07:57.713249 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 1056/2102] 10.222.0.59 () {58 vars in 1232 bytes} [Thu Jun 2 16:07:57 2022] DELETE /identity/v3/projects/e05229f5166b417b93651a04a405e7f4 => generated 0 bytes in 337 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 16:07:57.717011 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6196d471-f434-4328-829f-b1651996c301 service neutron] Authenticating user token {{(pid=80396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:07:57.732790 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6196d471-f434-4328-829f-b1651996c301 service neutron] Validating token access rules against request {{(pid=80396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:07:57.975632 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53bcc764-ed0f-49d6-84d1-55027bfa8582 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f73d5a98be74242b45222df39fb6213', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:07:57.976418 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53bcc764-ed0f-49d6-84d1-55027bfa8582 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:07:57.980764 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53bcc764-ed0f-49d6-84d1-55027bfa8582 admin admin] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:07:57.981175 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53bcc764-ed0f-49d6-84d1-55027bfa8582 admin admin] PATH_INFO: `/v3/users/3de6bb89e6854c8caf3f8ca84e408f91` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:07:57.987866 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53bcc764-ed0f-49d6-84d1-55027bfa8582 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3de6bb89e6854c8caf3f8ca84e408f91)` {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:07:57.997000 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53bcc764-ed0f-49d6-84d1-55027bfa8582 admin admin] RBAC: Authorization granted {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:07:58.321913 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.notifications [None req-53bcc764-ed0f-49d6-84d1-55027bfa8582 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3de6bb89e6854c8caf3f8ca84e408f91'} {{(pid=80396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:07:58.324350 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.notifications [None req-53bcc764-ed0f-49d6-84d1-55027bfa8582 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3de6bb89e6854c8caf3f8ca84e408f91'} {{(pid=80396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:07:58.407998 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.notifications [None req-53bcc764-ed0f-49d6-84d1-55027bfa8582 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3de6bb89e6854c8caf3f8ca84e408f91'} {{(pid=80396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:07:58.428186 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.notifications [None req-53bcc764-ed0f-49d6-84d1-55027bfa8582 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3de6bb89e6854c8caf3f8ca84e408f91'} {{(pid=80396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:07:58.454419 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.notifications [None req-53bcc764-ed0f-49d6-84d1-55027bfa8582 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3de6bb89e6854c8caf3f8ca84e408f91'} {{(pid=80396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:07:58.492215 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 1047/2103] 10.222.0.59 () {58 vars in 1223 bytes} [Thu Jun 2 16:07:57 2022] DELETE /identity/v3/users/3de6bb89e6854c8caf3f8ca84e408f91 => generated 0 bytes in 775 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 16:07:58.668910 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 16:07:59.074764 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG dbcounter [-] [80396] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 16:07:59.528538 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a03d912e-da44-41dc-848f-a89607614099 admin admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:07:59.530002 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.fernet_utils [None req-a03d912e-da44-41dc-848f-a89607614099 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:07:59.570107 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a03d912e-da44-41dc-848f-a89607614099 admin admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:07:59.700354 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27870d33-18ec-40dc-9ccc-c78638ded65b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f73d5a98be74242b45222df39fb6213', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:07:59.703762 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27870d33-18ec-40dc-9ccc-c78638ded65b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:07:59.704044 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27870d33-18ec-40dc-9ccc-c78638ded65b admin admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:07:59.704317 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27870d33-18ec-40dc-9ccc-c78638ded65b admin admin] PATH_INFO: `/v3/projects/fb93c72dbbf14fba948c144503e487be` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:07:59.706951 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27870d33-18ec-40dc-9ccc-c78638ded65b admin admin] RBAC: Authorizing `identity:delete_project(project_id=fb93c72dbbf14fba948c144503e487be)` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:07:59.715603 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27870d33-18ec-40dc-9ccc-c78638ded65b admin admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:07:59.815517 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c4d9e5b-dad4-4ef1-8d0e-84b5dbd55c96 None None] REQUEST_METHOD: `POST` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:07:59.816027 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c4d9e5b-dad4-4ef1-8d0e-84b5dbd55c96 None None] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:07:59.816576 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c4d9e5b-dad4-4ef1-8d0e-84b5dbd55c96 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:07:59.885773 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.auth.core [None req-9c4d9e5b-dad4-4ef1-8d0e-84b5dbd55c96 None None] MFA Rules not processed for user `95108cdd8e134be3823d5024f7037b3e`. Rule list: `[]` (Enabled: `True`). {{(pid=80396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 16:07:59.888265 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.fernet_utils [None req-9c4d9e5b-dad4-4ef1-8d0e-84b5dbd55c96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:07:59.905999 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.notifications [None req-27870d33-18ec-40dc-9ccc-c78638ded65b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fb93c72dbbf14fba948c144503e487be', 'request_id': 'req-27870d33-18ec-40dc-9ccc-c78638ded65b'} {{(pid=80395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:07:59.919126 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.notifications [None req-27870d33-18ec-40dc-9ccc-c78638ded65b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fb93c72dbbf14fba948c144503e487be', 'request_id': 'req-27870d33-18ec-40dc-9ccc-c78638ded65b'} {{(pid=80395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:07:59.998612 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.notifications [None req-27870d33-18ec-40dc-9ccc-c78638ded65b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fb93c72dbbf14fba948c144503e487be', 'request_id': 'req-27870d33-18ec-40dc-9ccc-c78638ded65b'} {{(pid=80395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:08:00.021252 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.notifications [None req-27870d33-18ec-40dc-9ccc-c78638ded65b admin admin] The token cache is being invalidate because project fb93c72dbbf14fba948c144503e487be was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80395) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 02 16:08:00.021564 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.notifications [None req-27870d33-18ec-40dc-9ccc-c78638ded65b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:08:00.024607 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.notifications [None req-27870d33-18ec-40dc-9ccc-c78638ded65b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:08:00.038651 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 1057/2104] 10.222.0.59 () {58 vars in 1232 bytes} [Thu Jun 2 16:07:59 2022] DELETE /identity/v3/projects/fb93c72dbbf14fba948c144503e487be => generated 0 bytes in 503 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 16:08:00.049831 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27870d33-18ec-40dc-9ccc-c78638ded65b admin admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:08:00.069759 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 16:08:00.070984 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.fernet_utils [None req-27870d33-18ec-40dc-9ccc-c78638ded65b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:08:00.090540 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 1048/2105] 10.222.0.59 () {58 vars in 957 bytes} [Thu Jun 2 16:07:59 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 276 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 02 16:08:00.108961 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c4d9e5b-dad4-4ef1-8d0e-84b5dbd55c96 None None] Authenticating user token {{(pid=80396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:08:00.115070 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.fernet_utils [None req-9c4d9e5b-dad4-4ef1-8d0e-84b5dbd55c96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:08:00.233016 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27870d33-18ec-40dc-9ccc-c78638ded65b admin admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:08:00.238422 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c7e5e5e-e41c-44e3-9931-1f989e1448c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f73d5a98be74242b45222df39fb6213', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:08:00.242759 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c7e5e5e-e41c-44e3-9931-1f989e1448c3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:08:00.243971 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c7e5e5e-e41c-44e3-9931-1f989e1448c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:08:00.245695 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c7e5e5e-e41c-44e3-9931-1f989e1448c3 admin admin] PATH_INFO: `/v3/users/4de1d518140347d1b50c3c0024f4aa77` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:08:00.252751 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c7e5e5e-e41c-44e3-9931-1f989e1448c3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4de1d518140347d1b50c3c0024f4aa77)` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:08:00.255059 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c7e5e5e-e41c-44e3-9931-1f989e1448c3 admin admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:08:00.260970 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c4d9e5b-dad4-4ef1-8d0e-84b5dbd55c96 None None] Validating token access rules against request {{(pid=80396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:08:00.269808 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc0fbb74-1e2f-479e-afe6-75538619aabe service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52f9fe4b13574516bb0a8e2aa11a61e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c87c981909d4b8db02783421818c79b', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:08:00.270501 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0fbb74-1e2f-479e-afe6-75538619aabe service nova] REQUEST_METHOD: `GET` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:08:00.270792 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0fbb74-1e2f-479e-afe6-75538619aabe service nova] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:08:00.271072 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0fbb74-1e2f-479e-afe6-75538619aabe service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:08:00.295268 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc0fbb74-1e2f-479e-afe6-75538619aabe service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:08:00.300420 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc0fbb74-1e2f-479e-afe6-75538619aabe service nova] RBAC: Authorization granted {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:08:00.330353 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 1049/2106] 10.222.0.59 () {60 vars in 1365 bytes} [Thu Jun 2 16:08:00 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 222 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 16:08:00.416211 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG dbcounter [-] [80396] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=80396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 16:08:00.561149 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.notifications [None req-1c7e5e5e-e41c-44e3-9931-1f989e1448c3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4de1d518140347d1b50c3c0024f4aa77'} {{(pid=80395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:08:00.647391 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.notifications [None req-1c7e5e5e-e41c-44e3-9931-1f989e1448c3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4de1d518140347d1b50c3c0024f4aa77'} {{(pid=80395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:08:00.663604 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.notifications [None req-1c7e5e5e-e41c-44e3-9931-1f989e1448c3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4de1d518140347d1b50c3c0024f4aa77'} {{(pid=80395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:08:00.664894 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.notifications [None req-1c7e5e5e-e41c-44e3-9931-1f989e1448c3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4de1d518140347d1b50c3c0024f4aa77'} {{(pid=80395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:08:00.678020 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.notifications [None req-1c7e5e5e-e41c-44e3-9931-1f989e1448c3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4de1d518140347d1b50c3c0024f4aa77'} {{(pid=80395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:08:00.709192 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 1058/2107] 10.222.0.59 () {58 vars in 1223 bytes} [Thu Jun 2 16:08:00 2022] DELETE /identity/v3/users/4de1d518140347d1b50c3c0024f4aa77 => generated 0 bytes in 671 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 16:08:01.381124 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc0fbb74-1e2f-479e-afe6-75538619aabe service nova] Authenticating user token {{(pid=80396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:08:01.402013 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc0fbb74-1e2f-479e-afe6-75538619aabe service nova] Validating token access rules against request {{(pid=80396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:08:01.601948 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d704be3-e66b-4017-a29a-3ff231b50d44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f73d5a98be74242b45222df39fb6213', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:08:01.603785 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d704be3-e66b-4017-a29a-3ff231b50d44 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:08:01.604339 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d704be3-e66b-4017-a29a-3ff231b50d44 admin admin] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:08:01.605179 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d704be3-e66b-4017-a29a-3ff231b50d44 admin admin] PATH_INFO: `/v3/projects/8a4728f3bee44417b9dc16c9f8b07113` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:08:01.606925 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d704be3-e66b-4017-a29a-3ff231b50d44 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8a4728f3bee44417b9dc16c9f8b07113)` {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:08:01.609748 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d704be3-e66b-4017-a29a-3ff231b50d44 admin admin] RBAC: Authorization granted {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:08:01.788196 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.notifications [None req-8d704be3-e66b-4017-a29a-3ff231b50d44 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8a4728f3bee44417b9dc16c9f8b07113', 'request_id': 'req-8d704be3-e66b-4017-a29a-3ff231b50d44'} {{(pid=80396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:08:01.800269 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.notifications [None req-8d704be3-e66b-4017-a29a-3ff231b50d44 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8a4728f3bee44417b9dc16c9f8b07113', 'request_id': 'req-8d704be3-e66b-4017-a29a-3ff231b50d44'} {{(pid=80396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:08:01.898510 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.notifications [None req-8d704be3-e66b-4017-a29a-3ff231b50d44 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8a4728f3bee44417b9dc16c9f8b07113', 'request_id': 'req-8d704be3-e66b-4017-a29a-3ff231b50d44'} {{(pid=80396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:08:01.915143 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.notifications [None req-8d704be3-e66b-4017-a29a-3ff231b50d44 admin admin] The token cache is being invalidate because project 8a4728f3bee44417b9dc16c9f8b07113 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80396) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 02 16:08:01.931601 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.notifications [None req-8d704be3-e66b-4017-a29a-3ff231b50d44 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:08:01.931601 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.notifications [None req-8d704be3-e66b-4017-a29a-3ff231b50d44 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:08:01.931601 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 1050/2108] 10.222.0.59 () {58 vars in 1232 bytes} [Thu Jun 2 16:08:01 2022] DELETE /identity/v3/projects/8a4728f3bee44417b9dc16c9f8b07113 => generated 0 bytes in 542 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 16:08:01.932116 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd8f23a-1279-4352-929f-c5168b258101 None None] REQUEST_METHOD: `POST` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:08:01.932116 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd8f23a-1279-4352-929f-c5168b258101 None None] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:08:01.932116 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd8f23a-1279-4352-929f-c5168b258101 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:08:01.957250 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.auth.core [None req-8cd8f23a-1279-4352-929f-c5168b258101 None None] MFA Rules not processed for user `400d1f4db9de49638549e5db29a041e1`. Rule list: `[]` (Enabled: `True`). {{(pid=80395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 16:08:01.965838 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.fernet_utils [None req-8cd8f23a-1279-4352-929f-c5168b258101 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:08:02.157913 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 1059/2109] 10.222.0.59 () {58 vars in 957 bytes} [Thu Jun 2 16:08:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 230 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 16:08:02.175784 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e639cbe-cd76-49e4-a7f3-7769085f52ef None None] REQUEST_METHOD: `POST` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:08:02.176244 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e639cbe-cd76-49e4-a7f3-7769085f52ef None None] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:08:02.176708 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e639cbe-cd76-49e4-a7f3-7769085f52ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:08:02.206896 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.auth.core [None req-1e639cbe-cd76-49e4-a7f3-7769085f52ef None None] MFA Rules not processed for user `400d1f4db9de49638549e5db29a041e1`. Rule list: `[]` (Enabled: `True`). {{(pid=80396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 16:08:02.208142 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.fernet_utils [None req-1e639cbe-cd76-49e4-a7f3-7769085f52ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:08:02.226461 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 1051/2110] 10.222.0.59 () {58 vars in 957 bytes} [Thu Jun 2 16:08:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 16:08:02.228035 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cd8f23a-1279-4352-929f-c5168b258101 None None] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:08:02.241380 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cd8f23a-1279-4352-929f-c5168b258101 None None] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:08:02.315579 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-083516f5-ba5f-4e1a-a988-fb66aed3d600 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f73d5a98be74242b45222df39fb6213', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:08:02.315579 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083516f5-ba5f-4e1a-a988-fb66aed3d600 admin admin] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:08:02.315579 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083516f5-ba5f-4e1a-a988-fb66aed3d600 admin admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:08:02.315579 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083516f5-ba5f-4e1a-a988-fb66aed3d600 admin admin] PATH_INFO: `/v3/domains` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:08:02.315874 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-083516f5-ba5f-4e1a-a988-fb66aed3d600 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80395) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 16:08:02.315874 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-083516f5-ba5f-4e1a-a988-fb66aed3d600 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:08:02.315874 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-083516f5-ba5f-4e1a-a988-fb66aed3d600 admin admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:08:02.315874 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 1060/2111] 10.222.0.59 () {58 vars in 1152 bytes} [Thu Jun 2 16:08:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 16:08:02.318515 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e639cbe-cd76-49e4-a7f3-7769085f52ef None None] Authenticating user token {{(pid=80396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:08:02.341309 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e639cbe-cd76-49e4-a7f3-7769085f52ef None None] Validating token access rules against request {{(pid=80396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:08:02.346266 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-897208c1-3c03-4d94-8151-f8aa075aa7cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f73d5a98be74242b45222df39fb6213', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:08:02.346953 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-897208c1-3c03-4d94-8151-f8aa075aa7cf admin admin] REQUEST_METHOD: `POST` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:08:02.347239 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-897208c1-3c03-4d94-8151-f8aa075aa7cf admin admin] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:08:02.347517 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-897208c1-3c03-4d94-8151-f8aa075aa7cf admin admin] PATH_INFO: `/v3/projects` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:08:02.348230 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-897208c1-3c03-4d94-8151-f8aa075aa7cf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:08:02.350214 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-897208c1-3c03-4d94-8151-f8aa075aa7cf admin admin] RBAC: Authorization granted {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:08:02.698710 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 1052/2112] 10.222.0.59 () {60 vars in 1152 bytes} [Thu Jun 2 16:08:02 2022] POST /identity/v3/projects => generated 369 bytes in 377 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 16:08:02.699296 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 16:08:02.700571 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-083516f5-ba5f-4e1a-a988-fb66aed3d600 admin admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:08:02.714938 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-083516f5-ba5f-4e1a-a988-fb66aed3d600 admin admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:08:02.808289 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe365a5d-f6dd-4e7f-9fb9-1147bdf70677 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f73d5a98be74242b45222df39fb6213', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:08:02.809157 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe365a5d-f6dd-4e7f-9fb9-1147bdf70677 admin admin] REQUEST_METHOD: `POST` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:08:02.816343 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe365a5d-f6dd-4e7f-9fb9-1147bdf70677 admin admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:08:02.816343 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe365a5d-f6dd-4e7f-9fb9-1147bdf70677 admin admin] PATH_INFO: `/v3/users` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:08:02.816343 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe365a5d-f6dd-4e7f-9fb9-1147bdf70677 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:08:02.816343 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe365a5d-f6dd-4e7f-9fb9-1147bdf70677 admin admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:08:02.926473 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 1061/2113] 10.222.0.59 () {60 vars in 1143 bytes} [Thu Jun 2 16:08:02 2022] POST /identity/v3/users => generated 285 bytes in 227 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 16:08:02.934522 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-897208c1-3c03-4d94-8151-f8aa075aa7cf admin admin] Authenticating user token {{(pid=80396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:08:02.955828 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-897208c1-3c03-4d94-8151-f8aa075aa7cf admin admin] Validating token access rules against request {{(pid=80396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:08:02.966558 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fd13363-c525-4b03-b355-b4620937f061 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f73d5a98be74242b45222df39fb6213', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:08:02.967244 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd13363-c525-4b03-b355-b4620937f061 admin admin] REQUEST_METHOD: `GET` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:08:02.967525 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd13363-c525-4b03-b355-b4620937f061 admin admin] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:08:02.967801 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd13363-c525-4b03-b355-b4620937f061 admin admin] PATH_INFO: `/v3/roles` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:08:02.968536 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fd13363-c525-4b03-b355-b4620937f061 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:08:02.972335 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fd13363-c525-4b03-b355-b4620937f061 admin admin] RBAC: Authorization granted {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:08:02.992437 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 1053/2114] 10.222.0.59 () {58 vars in 1121 bytes} [Thu Jun 2 16:08:02 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 02 16:08:02.994194 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe365a5d-f6dd-4e7f-9fb9-1147bdf70677 admin admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:08:03.018403 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe365a5d-f6dd-4e7f-9fb9-1147bdf70677 admin admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:08:03.021197 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-328b8213-3f5f-4455-8f15-98f6d5b143c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f73d5a98be74242b45222df39fb6213', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:08:03.021874 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328b8213-3f5f-4455-8f15-98f6d5b143c2 admin admin] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:08:03.022189 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328b8213-3f5f-4455-8f15-98f6d5b143c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:08:03.022471 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328b8213-3f5f-4455-8f15-98f6d5b143c2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:08:03.023317 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-328b8213-3f5f-4455-8f15-98f6d5b143c2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:08:03.025867 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-328b8213-3f5f-4455-8f15-98f6d5b143c2 admin admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:08:03.041154 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 1062/2115] 10.222.0.59 () {58 vars in 1121 bytes} [Thu Jun 2 16:08:02 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 16:08:03.043065 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fd13363-c525-4b03-b355-b4620937f061 admin admin] Authenticating user token {{(pid=80396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:08:03.055405 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fd13363-c525-4b03-b355-b4620937f061 admin admin] Validating token access rules against request {{(pid=80396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:08:03.062467 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5daa06d8-abd1-4b73-9401-fbfb6e19a343 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f73d5a98be74242b45222df39fb6213', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:08:03.063670 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5daa06d8-abd1-4b73-9401-fbfb6e19a343 admin admin] REQUEST_METHOD: `PUT` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:08:03.065769 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5daa06d8-abd1-4b73-9401-fbfb6e19a343 admin admin] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:08:03.065769 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5daa06d8-abd1-4b73-9401-fbfb6e19a343 admin admin] PATH_INFO: `/v3/projects/e8ab89e9e7d2411a9a83575058cf908b/users/5413eb32f0a04b2996a78f974877c52e/roles/649e0f2b5a264c419ea6a1441f123a03` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:08:03.085478 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5daa06d8-abd1-4b73-9401-fbfb6e19a343 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e8ab89e9e7d2411a9a83575058cf908b, user_id=5413eb32f0a04b2996a78f974877c52e, role_id=649e0f2b5a264c419ea6a1441f123a03)` {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:08:03.089743 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5daa06d8-abd1-4b73-9401-fbfb6e19a343 admin admin] RBAC: Authorization granted {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:08:03.124773 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG dbcounter [-] [80396] Writing DB stats keystone:SELECT=96,keystone:INSERT=3,keystone:DELETE=1 {{(pid=80396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 16:08:03.240604 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c901c153-b523-431a-b74c-27bc536167f6 None None] REQUEST_METHOD: `POST` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:08:03.240939 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c901c153-b523-431a-b74c-27bc536167f6 None None] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:08:03.241204 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c901c153-b523-431a-b74c-27bc536167f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:08:03.242589 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 1054/2116] 10.222.0.59 () {60 vars in 1482 bytes} [Thu Jun 2 16:08:03 2022] PUT /identity/v3/projects/e8ab89e9e7d2411a9a83575058cf908b/users/5413eb32f0a04b2996a78f974877c52e/roles/649e0f2b5a264c419ea6a1441f123a03 => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 16:08:03.280089 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.auth.core [None req-c901c153-b523-431a-b74c-27bc536167f6 None None] MFA Rules not processed for user `5413eb32f0a04b2996a78f974877c52e`. Rule list: `[]` (Enabled: `True`). {{(pid=80395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 16:08:03.282218 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.fernet_utils [None req-c901c153-b523-431a-b74c-27bc536167f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:08:03.427461 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 1063/2117] 10.222.0.59 () {58 vars in 957 bytes} [Thu Jun 2 16:08:03 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 16:08:04.211571 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 16:08:04.625042 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef1eb69-b1c9-4222-9691-18514866c46f None None] REQUEST_METHOD: `POST` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:08:04.625973 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef1eb69-b1c9-4222-9691-18514866c46f None None] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:08:04.628487 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef1eb69-b1c9-4222-9691-18514866c46f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:08:04.649105 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.auth.core [None req-aef1eb69-b1c9-4222-9691-18514866c46f None None] MFA Rules not processed for user `95108cdd8e134be3823d5024f7037b3e`. Rule list: `[]` (Enabled: `True`). {{(pid=80396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 16:08:04.650878 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.fernet_utils [None req-aef1eb69-b1c9-4222-9691-18514866c46f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:08:04.734729 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 1055/2118] 10.222.0.59 () {58 vars in 957 bytes} [Thu Jun 2 16:08:04 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 16:08:05.447300 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG dbcounter [-] [80396] Writing DB stats keystone:SELECT=87,keystone:DELETE=9,keystone:INSERT=4 {{(pid=80396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 16:08:05.865122 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c901c153-b523-431a-b74c-27bc536167f6 None None] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:08:05.867414 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.fernet_utils [None req-c901c153-b523-431a-b74c-27bc536167f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:08:05.976919 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c901c153-b523-431a-b74c-27bc536167f6 None None] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:08:05.993127 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0049fe1d-83c9-4923-9fed-9b8b3c2ee3b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f73d5a98be74242b45222df39fb6213', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:08:06.003212 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0049fe1d-83c9-4923-9fed-9b8b3c2ee3b4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:08:06.008133 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0049fe1d-83c9-4923-9fed-9b8b3c2ee3b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:08:06.011163 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0049fe1d-83c9-4923-9fed-9b8b3c2ee3b4 admin admin] PATH_INFO: `/v3/users/d91670bedace4a6fa306c1d09527a793` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:08:06.017505 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0049fe1d-83c9-4923-9fed-9b8b3c2ee3b4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d91670bedace4a6fa306c1d09527a793)` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:08:06.023528 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0049fe1d-83c9-4923-9fed-9b8b3c2ee3b4 admin admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:08:06.321967 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.notifications [None req-0049fe1d-83c9-4923-9fed-9b8b3c2ee3b4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd91670bedace4a6fa306c1d09527a793'} {{(pid=80395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:08:06.425905 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.notifications [None req-0049fe1d-83c9-4923-9fed-9b8b3c2ee3b4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd91670bedace4a6fa306c1d09527a793'} {{(pid=80395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:08:06.457676 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.notifications [None req-0049fe1d-83c9-4923-9fed-9b8b3c2ee3b4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd91670bedace4a6fa306c1d09527a793'} {{(pid=80395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:08:06.458467 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.notifications [None req-0049fe1d-83c9-4923-9fed-9b8b3c2ee3b4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd91670bedace4a6fa306c1d09527a793'} {{(pid=80395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:08:06.483393 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.notifications [None req-0049fe1d-83c9-4923-9fed-9b8b3c2ee3b4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd91670bedace4a6fa306c1d09527a793'} {{(pid=80395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:08:06.490540 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 1064/2119] 10.222.0.59 () {58 vars in 1223 bytes} [Thu Jun 2 16:08:05 2022] DELETE /identity/v3/users/d91670bedace4a6fa306c1d09527a793 => generated 0 bytes in 627 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 16:08:06.496392 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713824cc-ff06-41fb-9b40-51380a43f4a6 None None] REQUEST_METHOD: `POST` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:08:06.496898 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713824cc-ff06-41fb-9b40-51380a43f4a6 None None] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:08:06.496978 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713824cc-ff06-41fb-9b40-51380a43f4a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:08:06.525933 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.auth.core [None req-713824cc-ff06-41fb-9b40-51380a43f4a6 None None] MFA Rules not processed for user `400d1f4db9de49638549e5db29a041e1`. Rule list: `[]` (Enabled: `True`). {{(pid=80396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 16:08:06.527406 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.fernet_utils [None req-713824cc-ff06-41fb-9b40-51380a43f4a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:08:06.581688 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 16:08:06.626821 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 1056/2120] 10.222.0.59 () {58 vars in 957 bytes} [Thu Jun 2 16:08:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 02 16:08:06.642916 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0049fe1d-83c9-4923-9fed-9b8b3c2ee3b4 admin admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:08:06.644411 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.fernet_utils [None req-0049fe1d-83c9-4923-9fed-9b8b3c2ee3b4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:08:06.683673 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-713824cc-ff06-41fb-9b40-51380a43f4a6 None None] Authenticating user token {{(pid=80396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:08:06.685763 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.fernet_utils [None req-713824cc-ff06-41fb-9b40-51380a43f4a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:08:06.746009 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0049fe1d-83c9-4923-9fed-9b8b3c2ee3b4 admin admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:08:06.750280 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e51c277-d757-4099-8814-83f539a9206e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9af40ddfe9ff4be3887b068f13a28dc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c87c981909d4b8db02783421818c79b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:08:06.751052 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e51c277-d757-4099-8814-83f539a9206e service neutron] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:08:06.751440 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e51c277-d757-4099-8814-83f539a9206e service neutron] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:08:06.751819 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e51c277-d757-4099-8814-83f539a9206e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:08:06.762664 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e51c277-d757-4099-8814-83f539a9206e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:08:06.765432 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e51c277-d757-4099-8814-83f539a9206e service neutron] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:08:06.766516 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-713824cc-ff06-41fb-9b40-51380a43f4a6 None None] Validating token access rules against request {{(pid=80396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:08:06.770260 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b71e35d1-60be-4bd0-8fa7-492abcd5d9e3 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e673e7e0a4bf4c77bdb3e5325d0d3275', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c87c981909d4b8db02783421818c79b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:08:06.771225 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b71e35d1-60be-4bd0-8fa7-492abcd5d9e3 service glance] REQUEST_METHOD: `GET` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:08:06.771508 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b71e35d1-60be-4bd0-8fa7-492abcd5d9e3 service glance] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:08:06.772388 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b71e35d1-60be-4bd0-8fa7-492abcd5d9e3 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:08:06.782796 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.fernet_utils [None req-b71e35d1-60be-4bd0-8fa7-492abcd5d9e3 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:08:06.783467 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 1065/2121] 10.222.0.59 () {60 vars in 1365 bytes} [Thu Jun 2 16:08:06 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 141 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 16:08:06.875608 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b71e35d1-60be-4bd0-8fa7-492abcd5d9e3 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:08:06.877400 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b71e35d1-60be-4bd0-8fa7-492abcd5d9e3 service glance] RBAC: Authorization granted {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:08:06.887959 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 1057/2122] 10.222.0.59 () {60 vars in 1365 bytes} [Thu Jun 2 16:08:06 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 206 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 16:08:07.985724 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e51c277-d757-4099-8814-83f539a9206e service neutron] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:08:07.987204 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.fernet_utils [None req-3e51c277-d757-4099-8814-83f539a9206e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:08:08.024362 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e51c277-d757-4099-8814-83f539a9206e service neutron] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:08:08.042967 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8124d194-446c-45c4-81b1-deadd2933546 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f73d5a98be74242b45222df39fb6213', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:08:08.048106 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8124d194-446c-45c4-81b1-deadd2933546 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:08:08.048444 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8124d194-446c-45c4-81b1-deadd2933546 admin admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:08:08.048731 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8124d194-446c-45c4-81b1-deadd2933546 admin admin] PATH_INFO: `/v3/projects/d9ee7c8b95a94d4fb6c1e0f96ebc59bf` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:08:08.053893 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8124d194-446c-45c4-81b1-deadd2933546 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d9ee7c8b95a94d4fb6c1e0f96ebc59bf)` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:08:08.058844 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8124d194-446c-45c4-81b1-deadd2933546 admin admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:08:08.301084 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.notifications [None req-8124d194-446c-45c4-81b1-deadd2933546 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd9ee7c8b95a94d4fb6c1e0f96ebc59bf', 'request_id': 'req-8124d194-446c-45c4-81b1-deadd2933546'} {{(pid=80395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:08:08.313903 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.notifications [None req-8124d194-446c-45c4-81b1-deadd2933546 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd9ee7c8b95a94d4fb6c1e0f96ebc59bf', 'request_id': 'req-8124d194-446c-45c4-81b1-deadd2933546'} {{(pid=80395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:08:08.489142 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.notifications [None req-8124d194-446c-45c4-81b1-deadd2933546 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd9ee7c8b95a94d4fb6c1e0f96ebc59bf', 'request_id': 'req-8124d194-446c-45c4-81b1-deadd2933546'} {{(pid=80395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:08:08.507858 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.notifications [None req-8124d194-446c-45c4-81b1-deadd2933546 admin admin] The token cache is being invalidate because project d9ee7c8b95a94d4fb6c1e0f96ebc59bf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80395) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 02 16:08:08.508396 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.notifications [None req-8124d194-446c-45c4-81b1-deadd2933546 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:08:08.509303 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.notifications [None req-8124d194-446c-45c4-81b1-deadd2933546 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:08:08.511919 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 1066/2123] 10.222.0.59 () {58 vars in 1232 bytes} [Thu Jun 2 16:08:07 2022] DELETE /identity/v3/projects/d9ee7c8b95a94d4fb6c1e0f96ebc59bf => generated 0 bytes in 526 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 16:08:08.515620 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b71e35d1-60be-4bd0-8fa7-492abcd5d9e3 service glance] Authenticating user token {{(pid=80396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:08:08.531401 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b71e35d1-60be-4bd0-8fa7-492abcd5d9e3 service glance] Validating token access rules against request {{(pid=80396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:08:08.573961 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG dbcounter [-] [80396] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 16:08:08.606931 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9e8f1dc-dbd0-434b-a157-576478ff2a1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f73d5a98be74242b45222df39fb6213', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:08:08.607816 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e8f1dc-dbd0-434b-a157-576478ff2a1e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:08:08.608281 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e8f1dc-dbd0-434b-a157-576478ff2a1e admin admin] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:08:08.608690 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e8f1dc-dbd0-434b-a157-576478ff2a1e admin admin] PATH_INFO: `/v3/users/d2bccb5c8fe04d4f9ffc7e2e59313a0e` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:08:08.610773 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9e8f1dc-dbd0-434b-a157-576478ff2a1e admin admin] RBAC: Authorizing `identity:delete_user(user_id=d2bccb5c8fe04d4f9ffc7e2e59313a0e)` {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:08:08.613503 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9e8f1dc-dbd0-434b-a157-576478ff2a1e admin admin] RBAC: Authorization granted {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:08:08.831904 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.notifications [None req-b9e8f1dc-dbd0-434b-a157-576478ff2a1e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd2bccb5c8fe04d4f9ffc7e2e59313a0e'} {{(pid=80396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:08:08.832884 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.notifications [None req-b9e8f1dc-dbd0-434b-a157-576478ff2a1e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd2bccb5c8fe04d4f9ffc7e2e59313a0e'} {{(pid=80396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:08:08.982398 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.notifications [None req-b9e8f1dc-dbd0-434b-a157-576478ff2a1e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd2bccb5c8fe04d4f9ffc7e2e59313a0e'} {{(pid=80396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:08:09.008616 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.notifications [None req-b9e8f1dc-dbd0-434b-a157-576478ff2a1e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd2bccb5c8fe04d4f9ffc7e2e59313a0e'} {{(pid=80396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:08:09.025962 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.notifications [None req-b9e8f1dc-dbd0-434b-a157-576478ff2a1e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd2bccb5c8fe04d4f9ffc7e2e59313a0e'} {{(pid=80396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:08:09.038702 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 1058/2124] 10.222.0.59 () {58 vars in 1223 bytes} [Thu Jun 2 16:08:08 2022] DELETE /identity/v3/users/d2bccb5c8fe04d4f9ffc7e2e59313a0e => generated 0 bytes in 523 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 16:08:09.678271 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8124d194-446c-45c4-81b1-deadd2933546 admin admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:08:09.680201 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.fernet_utils [None req-8124d194-446c-45c4-81b1-deadd2933546 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:08:09.706649 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8124d194-446c-45c4-81b1-deadd2933546 admin admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:08:09.795396 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 16:08:09.796285 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a787c32-286f-4387-9313-13b95a1330b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f73d5a98be74242b45222df39fb6213', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:08:09.797359 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a787c32-286f-4387-9313-13b95a1330b8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:08:09.797709 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a787c32-286f-4387-9313-13b95a1330b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:08:09.798051 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a787c32-286f-4387-9313-13b95a1330b8 admin admin] PATH_INFO: `/v3/projects/360ea1cb629d4f0fb245f1e96c8d7545` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:08:09.805607 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a787c32-286f-4387-9313-13b95a1330b8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=360ea1cb629d4f0fb245f1e96c8d7545)` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:08:09.805607 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a787c32-286f-4387-9313-13b95a1330b8 admin admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:08:09.961379 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.notifications [None req-8a787c32-286f-4387-9313-13b95a1330b8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '360ea1cb629d4f0fb245f1e96c8d7545', 'request_id': 'req-8a787c32-286f-4387-9313-13b95a1330b8'} {{(pid=80395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:08:09.973195 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.notifications [None req-8a787c32-286f-4387-9313-13b95a1330b8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '360ea1cb629d4f0fb245f1e96c8d7545', 'request_id': 'req-8a787c32-286f-4387-9313-13b95a1330b8'} {{(pid=80395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:08:10.052079 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.notifications [None req-8a787c32-286f-4387-9313-13b95a1330b8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '360ea1cb629d4f0fb245f1e96c8d7545', 'request_id': 'req-8a787c32-286f-4387-9313-13b95a1330b8'} {{(pid=80395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:08:10.064432 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.notifications [None req-8a787c32-286f-4387-9313-13b95a1330b8 admin admin] The token cache is being invalidate because project 360ea1cb629d4f0fb245f1e96c8d7545 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80395) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 02 16:08:10.064814 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.notifications [None req-8a787c32-286f-4387-9313-13b95a1330b8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:08:10.065546 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.notifications [None req-8a787c32-286f-4387-9313-13b95a1330b8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:08:10.072373 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 1067/2125] 10.222.0.59 () {58 vars in 1232 bytes} [Thu Jun 2 16:08:09 2022] DELETE /identity/v3/projects/360ea1cb629d4f0fb245f1e96c8d7545 => generated 0 bytes in 390 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 16:08:10.074272 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27fc5551-21cc-4de8-8990-0222898c00a2 None None] REQUEST_METHOD: `POST` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:08:10.074890 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27fc5551-21cc-4de8-8990-0222898c00a2 None None] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:08:10.075188 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27fc5551-21cc-4de8-8990-0222898c00a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:08:10.096191 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.auth.core [None req-27fc5551-21cc-4de8-8990-0222898c00a2 None None] MFA Rules not processed for user `400d1f4db9de49638549e5db29a041e1`. Rule list: `[]` (Enabled: `True`). {{(pid=80396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 16:08:10.097681 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.fernet_utils [None req-27fc5551-21cc-4de8-8990-0222898c00a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:08:10.176872 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG dbcounter [-] [80396] Writing DB stats keystone:SELECT=100 {{(pid=80396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 16:08:10.230347 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 1059/2126] 10.222.0.59 () {58 vars in 957 bytes} [Thu Jun 2 16:08:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 16:08:10.246005 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b20b8e-a782-473e-92b0-ff56d7068e30 None None] REQUEST_METHOD: `POST` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:08:10.246414 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b20b8e-a782-473e-92b0-ff56d7068e30 None None] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:08:10.246758 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b20b8e-a782-473e-92b0-ff56d7068e30 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:08:10.283317 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.auth.core [None req-25b20b8e-a782-473e-92b0-ff56d7068e30 None None] MFA Rules not processed for user `400d1f4db9de49638549e5db29a041e1`. Rule list: `[]` (Enabled: `True`). {{(pid=80395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 16:08:10.284634 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.fernet_utils [None req-25b20b8e-a782-473e-92b0-ff56d7068e30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:08:10.310059 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 1068/2127] 10.222.0.59 () {58 vars in 957 bytes} [Thu Jun 2 16:08:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 58 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 16:08:10.311462 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27fc5551-21cc-4de8-8990-0222898c00a2 None None] Authenticating user token {{(pid=80396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:08:10.330325 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27fc5551-21cc-4de8-8990-0222898c00a2 None None] Validating token access rules against request {{(pid=80396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:08:10.343718 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d13a4bfd-0862-4555-8782-694ab0fc84ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f73d5a98be74242b45222df39fb6213', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:08:10.343718 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d13a4bfd-0862-4555-8782-694ab0fc84ef admin admin] REQUEST_METHOD: `GET` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:08:10.343718 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d13a4bfd-0862-4555-8782-694ab0fc84ef admin admin] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:08:10.343718 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d13a4bfd-0862-4555-8782-694ab0fc84ef admin admin] PATH_INFO: `/v3/domains` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:08:10.344072 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d13a4bfd-0862-4555-8782-694ab0fc84ef admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80396) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 16:08:10.344072 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d13a4bfd-0862-4555-8782-694ab0fc84ef admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:08:10.346121 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d13a4bfd-0862-4555-8782-694ab0fc84ef admin admin] RBAC: Authorization granted {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:08:10.367084 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 1060/2128] 10.222.0.59 () {58 vars in 1152 bytes} [Thu Jun 2 16:08:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 16:08:10.369093 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25b20b8e-a782-473e-92b0-ff56d7068e30 None None] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:08:10.392130 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25b20b8e-a782-473e-92b0-ff56d7068e30 None None] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:08:10.392130 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87941e89-a0e9-4066-b7fd-3947ef67d24f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f73d5a98be74242b45222df39fb6213', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:08:10.392130 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87941e89-a0e9-4066-b7fd-3947ef67d24f admin admin] REQUEST_METHOD: `POST` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:08:10.392130 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87941e89-a0e9-4066-b7fd-3947ef67d24f admin admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:08:10.392481 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87941e89-a0e9-4066-b7fd-3947ef67d24f admin admin] PATH_INFO: `/v3/projects` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:08:10.392481 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87941e89-a0e9-4066-b7fd-3947ef67d24f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:08:10.392481 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87941e89-a0e9-4066-b7fd-3947ef67d24f admin admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:08:11.008938 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 1069/2129] 10.222.0.59 () {60 vars in 1152 bytes} [Thu Jun 2 16:08:10 2022] POST /identity/v3/projects => generated 385 bytes in 638 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 16:08:11.010313 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d13a4bfd-0862-4555-8782-694ab0fc84ef admin admin] Authenticating user token {{(pid=80396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:08:11.020387 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d13a4bfd-0862-4555-8782-694ab0fc84ef admin admin] Validating token access rules against request {{(pid=80396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:08:11.079273 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e801a9e-2213-4369-a7ca-51aa31627e89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f73d5a98be74242b45222df39fb6213', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:08:11.080214 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e801a9e-2213-4369-a7ca-51aa31627e89 admin admin] REQUEST_METHOD: `POST` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:08:11.080214 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e801a9e-2213-4369-a7ca-51aa31627e89 admin admin] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:08:11.080481 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e801a9e-2213-4369-a7ca-51aa31627e89 admin admin] PATH_INFO: `/v3/users` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:08:11.081260 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e801a9e-2213-4369-a7ca-51aa31627e89 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:08:11.083251 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e801a9e-2213-4369-a7ca-51aa31627e89 admin admin] RBAC: Authorization granted {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:08:11.267830 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87941e89-a0e9-4066-b7fd-3947ef67d24f admin admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:08:11.270102 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 1061/2130] 10.222.0.59 () {60 vars in 1143 bytes} [Thu Jun 2 16:08:11 2022] POST /identity/v3/users => generated 293 bytes in 257 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 02 16:08:11.284042 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87941e89-a0e9-4066-b7fd-3947ef67d24f admin admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:08:11.289861 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71b8bfef-3d48-4cc8-acc1-03987d16d31a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f73d5a98be74242b45222df39fb6213', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:08:11.290702 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b8bfef-3d48-4cc8-acc1-03987d16d31a admin admin] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:08:11.291105 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b8bfef-3d48-4cc8-acc1-03987d16d31a admin admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:08:11.291681 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b8bfef-3d48-4cc8-acc1-03987d16d31a admin admin] PATH_INFO: `/v3/roles` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:08:11.292636 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71b8bfef-3d48-4cc8-acc1-03987d16d31a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:08:11.294360 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71b8bfef-3d48-4cc8-acc1-03987d16d31a admin admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:08:11.307224 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 1070/2131] 10.222.0.59 () {58 vars in 1121 bytes} [Thu Jun 2 16:08:11 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 16:08:11.311118 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e801a9e-2213-4369-a7ca-51aa31627e89 admin admin] Authenticating user token {{(pid=80396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:08:11.322197 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e801a9e-2213-4369-a7ca-51aa31627e89 admin admin] Validating token access rules against request {{(pid=80396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:08:11.331535 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dca1ad1-9eed-4c34-95ff-e83b6c8d48db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f73d5a98be74242b45222df39fb6213', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:08:11.332477 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dca1ad1-9eed-4c34-95ff-e83b6c8d48db admin admin] REQUEST_METHOD: `GET` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:08:11.332964 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dca1ad1-9eed-4c34-95ff-e83b6c8d48db admin admin] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:08:11.333435 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dca1ad1-9eed-4c34-95ff-e83b6c8d48db admin admin] PATH_INFO: `/v3/roles` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:08:11.334459 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dca1ad1-9eed-4c34-95ff-e83b6c8d48db admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:08:11.336542 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dca1ad1-9eed-4c34-95ff-e83b6c8d48db admin admin] RBAC: Authorization granted {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:08:11.350814 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 1062/2132] 10.222.0.59 () {58 vars in 1121 bytes} [Thu Jun 2 16:08:11 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 16:08:11.355398 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71b8bfef-3d48-4cc8-acc1-03987d16d31a admin admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:08:11.367341 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG dbcounter [-] [80396] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 16:08:11.370843 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71b8bfef-3d48-4cc8-acc1-03987d16d31a admin admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:08:11.372884 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9926fa05-afad-4d24-b3d4-9c31d3ce3d01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f73d5a98be74242b45222df39fb6213', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:08:11.374223 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9926fa05-afad-4d24-b3d4-9c31d3ce3d01 admin admin] REQUEST_METHOD: `PUT` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:08:11.374582 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9926fa05-afad-4d24-b3d4-9c31d3ce3d01 admin admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:08:11.374929 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9926fa05-afad-4d24-b3d4-9c31d3ce3d01 admin admin] PATH_INFO: `/v3/projects/a695e0d41d524334aa77f478119263d3/users/1cefc85a09be40a6bc0b31ff4847e791/roles/649e0f2b5a264c419ea6a1441f123a03` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:08:11.391328 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9926fa05-afad-4d24-b3d4-9c31d3ce3d01 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a695e0d41d524334aa77f478119263d3, user_id=1cefc85a09be40a6bc0b31ff4847e791, role_id=649e0f2b5a264c419ea6a1441f123a03)` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:08:11.394330 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9926fa05-afad-4d24-b3d4-9c31d3ce3d01 admin admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:08:11.483459 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 1071/2133] 10.222.0.59 () {60 vars in 1482 bytes} [Thu Jun 2 16:08:11 2022] PUT /identity/v3/projects/a695e0d41d524334aa77f478119263d3/users/1cefc85a09be40a6bc0b31ff4847e791/roles/649e0f2b5a264c419ea6a1441f123a03 => generated 0 bytes in 128 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 16:08:11.496198 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d25cb06-11bc-4888-9c14-02c2412e568c None None] REQUEST_METHOD: `POST` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:08:11.496452 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d25cb06-11bc-4888-9c14-02c2412e568c None None] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:08:11.496740 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d25cb06-11bc-4888-9c14-02c2412e568c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:08:11.498787 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writing DB stats keystone:SELECT=100 {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 16:08:11.537198 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.auth.core [None req-6d25cb06-11bc-4888-9c14-02c2412e568c None None] MFA Rules not processed for user `1cefc85a09be40a6bc0b31ff4847e791`. Rule list: `[]` (Enabled: `True`). {{(pid=80396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 16:08:11.538747 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.fernet_utils [None req-6d25cb06-11bc-4888-9c14-02c2412e568c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:08:11.636164 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 1063/2134] 10.222.0.59 () {58 vars in 957 bytes} [Thu Jun 2 16:08:11 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 16:08:11.641247 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9926fa05-afad-4d24-b3d4-9c31d3ce3d01 admin admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:08:11.706845 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9926fa05-afad-4d24-b3d4-9c31d3ce3d01 admin admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:08:11.713843 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08fd6933-c9c3-446f-aac4-0c5ebb80aa58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f73d5a98be74242b45222df39fb6213', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:08:11.714604 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08fd6933-c9c3-446f-aac4-0c5ebb80aa58 admin admin] REQUEST_METHOD: `POST` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:08:11.714901 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08fd6933-c9c3-446f-aac4-0c5ebb80aa58 admin admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:08:11.715744 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08fd6933-c9c3-446f-aac4-0c5ebb80aa58 admin admin] PATH_INFO: `/v3/projects` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:08:11.715744 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08fd6933-c9c3-446f-aac4-0c5ebb80aa58 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:08:11.717709 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08fd6933-c9c3-446f-aac4-0c5ebb80aa58 admin admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:08:11.964268 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 1072/2135] 10.222.0.59 () {60 vars in 1152 bytes} [Thu Jun 2 16:08:11 2022] POST /identity/v3/projects => generated 385 bytes in 317 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 16:08:11.964486 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d25cb06-11bc-4888-9c14-02c2412e568c None None] Authenticating user token {{(pid=80396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:08:11.974804 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d25cb06-11bc-4888-9c14-02c2412e568c None None] Validating token access rules against request {{(pid=80396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:08:12.038025 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c522199-e96f-41d1-89f5-bad6918472a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f73d5a98be74242b45222df39fb6213', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:08:12.038773 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c522199-e96f-41d1-89f5-bad6918472a3 admin admin] REQUEST_METHOD: `POST` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:08:12.039064 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c522199-e96f-41d1-89f5-bad6918472a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:08:12.039343 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c522199-e96f-41d1-89f5-bad6918472a3 admin admin] PATH_INFO: `/v3/users` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:08:12.040074 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c522199-e96f-41d1-89f5-bad6918472a3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:08:12.042364 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c522199-e96f-41d1-89f5-bad6918472a3 admin admin] RBAC: Authorization granted {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:08:12.121428 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writing DB stats keystone:SELECT=90,keystone:INSERT=2,keystone:DELETE=8 {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 16:08:12.194336 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 1064/2136] 10.222.0.59 () {60 vars in 1143 bytes} [Thu Jun 2 16:08:11 2022] POST /identity/v3/users => generated 293 bytes in 232 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 16:08:12.199551 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08fd6933-c9c3-446f-aac4-0c5ebb80aa58 admin admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:08:12.210300 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08fd6933-c9c3-446f-aac4-0c5ebb80aa58 admin admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:08:12.216434 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf3c965c-c5dd-47d7-b2fc-f46b95c931e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f73d5a98be74242b45222df39fb6213', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:08:12.217319 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3c965c-c5dd-47d7-b2fc-f46b95c931e0 admin admin] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:08:12.217605 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3c965c-c5dd-47d7-b2fc-f46b95c931e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:08:12.217878 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3c965c-c5dd-47d7-b2fc-f46b95c931e0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:08:12.218770 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf3c965c-c5dd-47d7-b2fc-f46b95c931e0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:08:12.220538 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf3c965c-c5dd-47d7-b2fc-f46b95c931e0 admin admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:08:12.240888 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 1073/2137] 10.222.0.59 () {58 vars in 1121 bytes} [Thu Jun 2 16:08:12 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 16:08:12.250691 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c522199-e96f-41d1-89f5-bad6918472a3 admin admin] Authenticating user token {{(pid=80396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:08:12.267644 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c522199-e96f-41d1-89f5-bad6918472a3 admin admin] Validating token access rules against request {{(pid=80396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:08:12.273389 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-007b334f-ef07-4212-a65e-be28c4fc3281 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f73d5a98be74242b45222df39fb6213', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:08:12.273974 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007b334f-ef07-4212-a65e-be28c4fc3281 admin admin] REQUEST_METHOD: `GET` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:08:12.274350 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007b334f-ef07-4212-a65e-be28c4fc3281 admin admin] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:08:12.274528 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007b334f-ef07-4212-a65e-be28c4fc3281 admin admin] PATH_INFO: `/v3/roles` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:08:12.276530 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-007b334f-ef07-4212-a65e-be28c4fc3281 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:08:12.278268 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-007b334f-ef07-4212-a65e-be28c4fc3281 admin admin] RBAC: Authorization granted {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:08:12.289295 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 1065/2138] 10.222.0.59 () {58 vars in 1121 bytes} [Thu Jun 2 16:08:12 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 16:08:12.293227 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf3c965c-c5dd-47d7-b2fc-f46b95c931e0 admin admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:08:12.304756 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf3c965c-c5dd-47d7-b2fc-f46b95c931e0 admin admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:08:12.313394 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0096d9d-4926-4442-886b-99ae8d4842d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f73d5a98be74242b45222df39fb6213', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:08:12.323177 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0096d9d-4926-4442-886b-99ae8d4842d0 admin admin] REQUEST_METHOD: `PUT` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:08:12.323177 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0096d9d-4926-4442-886b-99ae8d4842d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:08:12.323177 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0096d9d-4926-4442-886b-99ae8d4842d0 admin admin] PATH_INFO: `/v3/projects/0e486667492047dcb8d895762ab1ff1e/users/f0da50c44bbe4433a31f48fb448e2f3c/roles/649e0f2b5a264c419ea6a1441f123a03` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:08:12.342049 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0096d9d-4926-4442-886b-99ae8d4842d0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0e486667492047dcb8d895762ab1ff1e, user_id=f0da50c44bbe4433a31f48fb448e2f3c, role_id=649e0f2b5a264c419ea6a1441f123a03)` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:08:12.345321 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0096d9d-4926-4442-886b-99ae8d4842d0 admin admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:08:12.429653 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a7bd872-d43f-4ecc-bff9-24adf33e5731 None None] REQUEST_METHOD: `POST` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:08:12.429882 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a7bd872-d43f-4ecc-bff9-24adf33e5731 None None] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:08:12.430357 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a7bd872-d43f-4ecc-bff9-24adf33e5731 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:08:12.455465 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG dbcounter [-] [80396] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 16:08:12.465258 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 1074/2139] 10.222.0.59 () {60 vars in 1482 bytes} [Thu Jun 2 16:08:12 2022] PUT /identity/v3/projects/0e486667492047dcb8d895762ab1ff1e/users/f0da50c44bbe4433a31f48fb448e2f3c/roles/649e0f2b5a264c419ea6a1441f123a03 => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 02 16:08:12.475866 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618bfaa4-4918-40b6-8560-ac762a367c1f None None] REQUEST_METHOD: `POST` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:08:12.476427 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618bfaa4-4918-40b6-8560-ac762a367c1f None None] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:08:12.476899 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618bfaa4-4918-40b6-8560-ac762a367c1f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:08:12.481616 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.auth.core [None req-8a7bd872-d43f-4ecc-bff9-24adf33e5731 None None] MFA Rules not processed for user `88d362d24ff54106b00d945599f2a61d`. Rule list: `[]` (Enabled: `True`). {{(pid=80396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 16:08:12.482947 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.fernet_utils [None req-8a7bd872-d43f-4ecc-bff9-24adf33e5731 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:08:12.506853 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.auth.core [None req-618bfaa4-4918-40b6-8560-ac762a367c1f None None] MFA Rules not processed for user `f0da50c44bbe4433a31f48fb448e2f3c`. Rule list: `[]` (Enabled: `True`). {{(pid=80395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 16:08:12.508307 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.fernet_utils [None req-618bfaa4-4918-40b6-8560-ac762a367c1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:08:12.555024 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 1066/2140] 10.222.0.59 () {58 vars in 957 bytes} [Thu Jun 2 16:08:12 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 16:08:12.594521 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 1075/2141] 10.222.0.59 () {58 vars in 957 bytes} [Thu Jun 2 16:08:12 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 16:08:12.597389 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a7bd872-d43f-4ecc-bff9-24adf33e5731 None None] Authenticating user token {{(pid=80396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:08:12.672159 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a7bd872-d43f-4ecc-bff9-24adf33e5731 None None] Validating token access rules against request {{(pid=80396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:08:12.678803 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2547285-4c1a-42ee-8b2b-f8a6665b5521 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f73d5a98be74242b45222df39fb6213', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:08:12.679476 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2547285-4c1a-42ee-8b2b-f8a6665b5521 admin admin] REQUEST_METHOD: `POST` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:08:12.682205 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2547285-4c1a-42ee-8b2b-f8a6665b5521 admin admin] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:08:12.682205 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2547285-4c1a-42ee-8b2b-f8a6665b5521 admin admin] PATH_INFO: `/v3/projects` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:08:12.682205 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2547285-4c1a-42ee-8b2b-f8a6665b5521 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:08:12.683083 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2547285-4c1a-42ee-8b2b-f8a6665b5521 admin admin] RBAC: Authorization granted {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:08:12.812751 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 1067/2142] 10.222.0.59 () {60 vars in 1152 bytes} [Thu Jun 2 16:08:12 2022] POST /identity/v3/projects => generated 383 bytes in 215 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 02 16:08:12.815904 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-618bfaa4-4918-40b6-8560-ac762a367c1f None None] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:08:12.827787 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-618bfaa4-4918-40b6-8560-ac762a367c1f None None] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:08:12.900518 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfcfff5f-c544-4a82-9a22-2d6e6758a626 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f73d5a98be74242b45222df39fb6213', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:08:12.901263 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfcfff5f-c544-4a82-9a22-2d6e6758a626 admin admin] REQUEST_METHOD: `POST` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:08:12.901550 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfcfff5f-c544-4a82-9a22-2d6e6758a626 admin admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:08:12.902446 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfcfff5f-c544-4a82-9a22-2d6e6758a626 admin admin] PATH_INFO: `/v3/users` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:08:12.903153 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfcfff5f-c544-4a82-9a22-2d6e6758a626 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:08:12.905109 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfcfff5f-c544-4a82-9a22-2d6e6758a626 admin admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:08:13.063457 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 1076/2143] 10.222.0.59 () {60 vars in 1143 bytes} [Thu Jun 2 16:08:12 2022] POST /identity/v3/users => generated 298 bytes in 245 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 16:08:13.064735 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2547285-4c1a-42ee-8b2b-f8a6665b5521 admin admin] Authenticating user token {{(pid=80396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:08:13.077254 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2547285-4c1a-42ee-8b2b-f8a6665b5521 admin admin] Validating token access rules against request {{(pid=80396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:08:13.082326 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08570fd6-cd9c-45c9-8631-f7a4a1209004 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f73d5a98be74242b45222df39fb6213', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:08:13.083016 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08570fd6-cd9c-45c9-8631-f7a4a1209004 admin admin] REQUEST_METHOD: `GET` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:08:13.083284 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08570fd6-cd9c-45c9-8631-f7a4a1209004 admin admin] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:08:13.083705 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08570fd6-cd9c-45c9-8631-f7a4a1209004 admin admin] PATH_INFO: `/v3/roles` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:08:13.084459 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08570fd6-cd9c-45c9-8631-f7a4a1209004 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:08:13.086415 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08570fd6-cd9c-45c9-8631-f7a4a1209004 admin admin] RBAC: Authorization granted {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:08:13.101303 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 1068/2144] 10.222.0.59 () {58 vars in 1121 bytes} [Thu Jun 2 16:08:13 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 16:08:13.105661 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfcfff5f-c544-4a82-9a22-2d6e6758a626 admin admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:08:13.116360 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfcfff5f-c544-4a82-9a22-2d6e6758a626 admin admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:08:13.122383 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96e3d49f-99dd-4701-b842-4b5f5dfbdb3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f73d5a98be74242b45222df39fb6213', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:08:13.123706 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e3d49f-99dd-4701-b842-4b5f5dfbdb3d admin admin] REQUEST_METHOD: `PUT` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:08:13.124082 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e3d49f-99dd-4701-b842-4b5f5dfbdb3d admin admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:08:13.124549 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e3d49f-99dd-4701-b842-4b5f5dfbdb3d admin admin] PATH_INFO: `/v3/projects/541f86e8ab9b43c5819c86272fdf568f/users/137991a17215477ab333731b6e6df70f/roles/f1e0c25f6e9049e897cb7350c7e54ab3` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:08:13.142107 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96e3d49f-99dd-4701-b842-4b5f5dfbdb3d admin admin] RBAC: Authorizing `identity:create_grant(project_id=541f86e8ab9b43c5819c86272fdf568f, user_id=137991a17215477ab333731b6e6df70f, role_id=f1e0c25f6e9049e897cb7350c7e54ab3)` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:08:13.144999 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96e3d49f-99dd-4701-b842-4b5f5dfbdb3d admin admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:08:13.259018 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 1077/2145] 10.222.0.59 () {60 vars in 1482 bytes} [Thu Jun 2 16:08:13 2022] PUT /identity/v3/projects/541f86e8ab9b43c5819c86272fdf568f/users/137991a17215477ab333731b6e6df70f/roles/f1e0c25f6e9049e897cb7350c7e54ab3 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 16:08:13.264505 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08570fd6-cd9c-45c9-8631-f7a4a1209004 admin admin] Authenticating user token {{(pid=80396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:08:13.278396 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08570fd6-cd9c-45c9-8631-f7a4a1209004 admin admin] Validating token access rules against request {{(pid=80396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:08:13.346325 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c103344-c03d-4e45-8da1-68d3914c193d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f73d5a98be74242b45222df39fb6213', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:08:13.347007 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c103344-c03d-4e45-8da1-68d3914c193d admin admin] REQUEST_METHOD: `GET` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:08:13.347286 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c103344-c03d-4e45-8da1-68d3914c193d admin admin] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:08:13.347600 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c103344-c03d-4e45-8da1-68d3914c193d admin admin] PATH_INFO: `/v3/roles` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:08:13.348533 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c103344-c03d-4e45-8da1-68d3914c193d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:08:13.350173 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c103344-c03d-4e45-8da1-68d3914c193d admin admin] RBAC: Authorization granted {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:08:13.362935 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 1069/2146] 10.222.0.59 () {58 vars in 1121 bytes} [Thu Jun 2 16:08:13 2022] GET /identity/v3/roles => generated 1420 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 16:08:13.367182 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96e3d49f-99dd-4701-b842-4b5f5dfbdb3d admin admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:08:13.379266 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96e3d49f-99dd-4701-b842-4b5f5dfbdb3d admin admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:08:13.379451 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG dbcounter [-] [80396] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 16:08:13.385718 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de0885b6-61e6-4403-bd84-2fc0476f6adb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f73d5a98be74242b45222df39fb6213', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:08:13.391459 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de0885b6-61e6-4403-bd84-2fc0476f6adb admin admin] REQUEST_METHOD: `PUT` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:08:13.391459 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de0885b6-61e6-4403-bd84-2fc0476f6adb admin admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:08:13.391459 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de0885b6-61e6-4403-bd84-2fc0476f6adb admin admin] PATH_INFO: `/v3/projects/541f86e8ab9b43c5819c86272fdf568f/users/137991a17215477ab333731b6e6df70f/roles/f1e0c25f6e9049e897cb7350c7e54ab3` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:08:13.391459 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de0885b6-61e6-4403-bd84-2fc0476f6adb admin admin] RBAC: Authorizing `identity:create_grant(project_id=541f86e8ab9b43c5819c86272fdf568f, user_id=137991a17215477ab333731b6e6df70f, role_id=f1e0c25f6e9049e897cb7350c7e54ab3)` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:08:13.392513 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de0885b6-61e6-4403-bd84-2fc0476f6adb admin admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:08:13.406431 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 1078/2147] 10.222.0.59 () {60 vars in 1482 bytes} [Thu Jun 2 16:08:13 2022] PUT /identity/v3/projects/541f86e8ab9b43c5819c86272fdf568f/users/137991a17215477ab333731b6e6df70f/roles/f1e0c25f6e9049e897cb7350c7e54ab3 => generated 0 bytes in 40 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 16:08:13.420938 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d1a6a8-b161-4086-af53-87b4e9b66754 None None] REQUEST_METHOD: `POST` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:08:13.421244 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d1a6a8-b161-4086-af53-87b4e9b66754 None None] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:08:13.439566 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d1a6a8-b161-4086-af53-87b4e9b66754 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:08:13.450444 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writing DB stats keystone:SELECT=95,keystone:DELETE=2,keystone:INSERT=3 {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 16:08:13.548565 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.auth.core [None req-07d1a6a8-b161-4086-af53-87b4e9b66754 None None] MFA Rules not processed for user `137991a17215477ab333731b6e6df70f`. Rule list: `[]` (Enabled: `True`). {{(pid=80396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 16:08:13.550010 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.fernet_utils [None req-07d1a6a8-b161-4086-af53-87b4e9b66754 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:08:13.714528 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 1070/2148] 10.222.0.59 () {58 vars in 957 bytes} [Thu Jun 2 16:08:13 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 297 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 16:08:13.759547 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de0885b6-61e6-4403-bd84-2fc0476f6adb admin admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:08:13.761642 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.fernet_utils [None req-de0885b6-61e6-4403-bd84-2fc0476f6adb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:08:13.825567 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de0885b6-61e6-4403-bd84-2fc0476f6adb admin admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:08:13.829631 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e17d061-d744-47ef-af3e-41bf1afb7f7f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6534961c369940a5b88f310c6450250b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c87c981909d4b8db02783421818c79b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:08:13.830437 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e17d061-d744-47ef-af3e-41bf1afb7f7f service cinder] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:08:13.830783 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e17d061-d744-47ef-af3e-41bf1afb7f7f service cinder] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:08:13.831155 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e17d061-d744-47ef-af3e-41bf1afb7f7f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:08:13.894549 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e17d061-d744-47ef-af3e-41bf1afb7f7f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:08:13.896077 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e17d061-d744-47ef-af3e-41bf1afb7f7f service cinder] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:08:13.907917 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 1079/2149] 10.222.0.59 () {60 vars in 1365 bytes} [Thu Jun 2 16:08:13 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 149 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 16:08:14.411652 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG dbcounter [-] [80396] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=80396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 16:08:15.651125 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writing DB stats keystone:SELECT=100 {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 16:08:16.327004 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writing DB stats keystone:SELECT=100 {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 16:08:16.576483 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG dbcounter [-] [80396] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=80396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 16:08:16.745089 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 16:08:17.418563 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG dbcounter [-] [80396] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 16:08:17.573770 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 16:08:17.635329 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07d1a6a8-b161-4086-af53-87b4e9b66754 None None] Authenticating user token {{(pid=80396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:08:17.635329 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.fernet_utils [None req-07d1a6a8-b161-4086-af53-87b4e9b66754 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:08:17.645921 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07d1a6a8-b161-4086-af53-87b4e9b66754 None None] Validating token access rules against request {{(pid=80396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:08:17.649480 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a9c70ca-e3cb-451f-bd68-12b5934d01ad service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6534961c369940a5b88f310c6450250b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c87c981909d4b8db02783421818c79b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:08:17.650643 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9c70ca-e3cb-451f-bd68-12b5934d01ad service cinder] REQUEST_METHOD: `GET` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:08:17.650939 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9c70ca-e3cb-451f-bd68-12b5934d01ad service cinder] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:08:17.651223 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9c70ca-e3cb-451f-bd68-12b5934d01ad service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:08:17.709461 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a9c70ca-e3cb-451f-bd68-12b5934d01ad service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:08:17.711191 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a9c70ca-e3cb-451f-bd68-12b5934d01ad service cinder] RBAC: Authorization granted {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:08:17.721032 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 1071/2150] 10.222.0.59 () {60 vars in 1365 bytes} [Thu Jun 2 16:08:17 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 16:08:17.755746 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG dbcounter [-] [80396] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=80396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 16:08:17.778460 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writing DB stats keystone:SELECT=90,keystone:INSERT=3,keystone:DELETE=7 {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 16:08:17.881289 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG dbcounter [-] [80396] Writing DB stats keystone:SELECT=92,keystone:DELETE=5,keystone:INSERT=3 {{(pid=80396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 16:08:18.245423 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writing DB stats keystone:INSERT=2,keystone:DELETE=10,keystone:SELECT=88 {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 16:08:18.878954 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG dbcounter [-] [80396] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=80396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 16:08:19.149484 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 16:08:19.387932 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG dbcounter [-] [80396] Writing DB stats keystone:SELECT=95,keystone:DELETE=2,keystone:INSERT=3 {{(pid=80396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 16:08:19.624183 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 16:08:19.858338 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG dbcounter [-] [80396] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 16:08:20.015733 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG dbcounter [-] [80396] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 16:08:24.068119 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e17d061-d744-47ef-af3e-41bf1afb7f7f service cinder] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:08:24.089771 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e17d061-d744-47ef-af3e-41bf1afb7f7f service cinder] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:08:24.093976 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed4a7e85-f41c-4eb3-8fdb-1d933315e8e9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6534961c369940a5b88f310c6450250b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c87c981909d4b8db02783421818c79b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:08:24.096915 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed4a7e85-f41c-4eb3-8fdb-1d933315e8e9 service cinder] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:08:24.096915 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed4a7e85-f41c-4eb3-8fdb-1d933315e8e9 service cinder] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:08:24.096915 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed4a7e85-f41c-4eb3-8fdb-1d933315e8e9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:08:24.127032 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed4a7e85-f41c-4eb3-8fdb-1d933315e8e9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:08:24.128405 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed4a7e85-f41c-4eb3-8fdb-1d933315e8e9 service cinder] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:08:24.138929 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 1080/2151] 10.222.0.59 () {60 vars in 1365 bytes} [Thu Jun 2 16:08:24 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 71 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 16:08:29.090958 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47714646-d1fd-4fb4-8c7e-5006011063f2 None None] REQUEST_METHOD: `POST` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:08:29.091837 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47714646-d1fd-4fb4-8c7e-5006011063f2 None None] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:08:29.092258 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47714646-d1fd-4fb4-8c7e-5006011063f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:08:29.124701 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.auth.core [None req-47714646-d1fd-4fb4-8c7e-5006011063f2 None None] MFA Rules not processed for user `11b714eb2dda4460a8ff52215e671bfa`. Rule list: `[]` (Enabled: `True`). {{(pid=80396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 16:08:29.125896 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.fernet_utils [None req-47714646-d1fd-4fb4-8c7e-5006011063f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:08:29.206945 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 1072/2152] 10.222.0.59 () {58 vars in 1009 bytes} [Thu Jun 2 16:08:29 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 16:08:29.223456 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed4a7e85-f41c-4eb3-8fdb-1d933315e8e9 service cinder] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:08:29.224893 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.fernet_utils [None req-ed4a7e85-f41c-4eb3-8fdb-1d933315e8e9 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:08:29.315249 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed4a7e85-f41c-4eb3-8fdb-1d933315e8e9 service cinder] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:08:29.329134 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc12c7a4-fd4f-4d7d-9708-e7441e1366fb service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31bd858bf7674f43a99b77d11bc3c1a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c87c981909d4b8db02783421818c79b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:08:29.330191 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc12c7a4-fd4f-4d7d-9708-e7441e1366fb service swift] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:08:29.342226 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc12c7a4-fd4f-4d7d-9708-e7441e1366fb service swift] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:08:29.342226 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc12c7a4-fd4f-4d7d-9708-e7441e1366fb service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:08:29.348850 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc12c7a4-fd4f-4d7d-9708-e7441e1366fb service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:08:29.357935 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc12c7a4-fd4f-4d7d-9708-e7441e1366fb service swift] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:08:29.376239 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 1081/2153] 10.222.0.59 () {60 vars in 1384 bytes} [Thu Jun 2 16:08:29 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 153 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 02 16:08:30.112981 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47714646-d1fd-4fb4-8c7e-5006011063f2 None None] Authenticating user token {{(pid=80396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:08:30.222174 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47714646-d1fd-4fb4-8c7e-5006011063f2 None None] Validating token access rules against request {{(pid=80396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:08:30.226824 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf80515e-8fab-4aa2-86a1-b39c5145a8f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f73d5a98be74242b45222df39fb6213', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:08:30.227688 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf80515e-8fab-4aa2-86a1-b39c5145a8f8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:08:30.227968 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf80515e-8fab-4aa2-86a1-b39c5145a8f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:08:30.228241 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf80515e-8fab-4aa2-86a1-b39c5145a8f8 admin admin] PATH_INFO: `/v3/users/1cefc85a09be40a6bc0b31ff4847e791` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:08:30.229540 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf80515e-8fab-4aa2-86a1-b39c5145a8f8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1cefc85a09be40a6bc0b31ff4847e791)` {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:08:30.231500 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf80515e-8fab-4aa2-86a1-b39c5145a8f8 admin admin] RBAC: Authorization granted {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:08:30.489843 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.notifications [None req-cf80515e-8fab-4aa2-86a1-b39c5145a8f8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1cefc85a09be40a6bc0b31ff4847e791'} {{(pid=80396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:08:30.490525 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.notifications [None req-cf80515e-8fab-4aa2-86a1-b39c5145a8f8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1cefc85a09be40a6bc0b31ff4847e791'} {{(pid=80396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:08:30.551533 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc12c7a4-fd4f-4d7d-9708-e7441e1366fb service swift] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:08:30.552919 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.fernet_utils [None req-cc12c7a4-fd4f-4d7d-9708-e7441e1366fb service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:08:30.566712 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writing DB stats keystone:SELECT=100 {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 16:08:30.582749 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc12c7a4-fd4f-4d7d-9708-e7441e1366fb service swift] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:08:30.588818 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7eed977-3d15-464c-916c-d060df9d533b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f73d5a98be74242b45222df39fb6213', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:08:30.589747 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7eed977-3d15-464c-916c-d060df9d533b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:08:30.590023 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7eed977-3d15-464c-916c-d060df9d533b admin admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:08:30.590341 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7eed977-3d15-464c-916c-d060df9d533b admin admin] PATH_INFO: `/v3/users/dafc55126ee74d75a02919e75cd7136c` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:08:30.591565 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7eed977-3d15-464c-916c-d060df9d533b admin admin] RBAC: Authorizing `identity:delete_user(user_id=dafc55126ee74d75a02919e75cd7136c)` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:08:30.593522 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7eed977-3d15-464c-916c-d060df9d533b admin admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:08:30.605626 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.notifications [None req-cf80515e-8fab-4aa2-86a1-b39c5145a8f8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1cefc85a09be40a6bc0b31ff4847e791'} {{(pid=80396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:08:30.612064 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG dbcounter [-] [80396] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=80396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 16:08:30.625949 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.notifications [None req-cf80515e-8fab-4aa2-86a1-b39c5145a8f8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1cefc85a09be40a6bc0b31ff4847e791'} {{(pid=80396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:08:30.639488 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.notifications [None req-cf80515e-8fab-4aa2-86a1-b39c5145a8f8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1cefc85a09be40a6bc0b31ff4847e791'} {{(pid=80396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:08:30.647282 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 1073/2154] 10.222.0.59 () {58 vars in 1223 bytes} [Thu Jun 2 16:08:30 2022] DELETE /identity/v3/users/1cefc85a09be40a6bc0b31ff4847e791 => generated 0 bytes in 535 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 16:08:30.651621 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297c00d4-3db0-42de-9752-f992f73900f7 None None] REQUEST_METHOD: `POST` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:08:30.651915 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297c00d4-3db0-42de-9752-f992f73900f7 None None] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:08:30.652372 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297c00d4-3db0-42de-9752-f992f73900f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:08:30.680527 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.auth.core [None req-297c00d4-3db0-42de-9752-f992f73900f7 None None] MFA Rules not processed for user `400d1f4db9de49638549e5db29a041e1`. Rule list: `[]` (Enabled: `True`). {{(pid=80396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 16:08:30.682657 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.fernet_utils [None req-297c00d4-3db0-42de-9752-f992f73900f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:08:30.748627 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 1074/2155] 10.222.0.59 () {58 vars in 957 bytes} [Thu Jun 2 16:08:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 02 16:08:30.759363 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-297c00d4-3db0-42de-9752-f992f73900f7 None None] Authenticating user token {{(pid=80396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:08:30.759555 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.fernet_utils [None req-297c00d4-3db0-42de-9752-f992f73900f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:08:30.792629 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.notifications [None req-c7eed977-3d15-464c-916c-d060df9d533b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dafc55126ee74d75a02919e75cd7136c'} {{(pid=80395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:08:30.845335 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-297c00d4-3db0-42de-9752-f992f73900f7 None None] Validating token access rules against request {{(pid=80396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:08:30.849209 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ae93e3b-2e8d-4093-9c10-55f531b5f15e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9af40ddfe9ff4be3887b068f13a28dc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c87c981909d4b8db02783421818c79b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:08:30.849853 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae93e3b-2e8d-4093-9c10-55f531b5f15e service neutron] REQUEST_METHOD: `GET` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:08:30.850163 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae93e3b-2e8d-4093-9c10-55f531b5f15e service neutron] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:08:30.850441 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae93e3b-2e8d-4093-9c10-55f531b5f15e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:08:30.859581 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ae93e3b-2e8d-4093-9c10-55f531b5f15e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:08:30.860994 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ae93e3b-2e8d-4093-9c10-55f531b5f15e service neutron] RBAC: Authorization granted {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:08:30.870697 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 1075/2156] 10.222.0.59 () {60 vars in 1365 bytes} [Thu Jun 2 16:08:30 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 02 16:08:30.892467 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.notifications [None req-c7eed977-3d15-464c-916c-d060df9d533b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dafc55126ee74d75a02919e75cd7136c'} {{(pid=80395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:08:30.921157 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.notifications [None req-c7eed977-3d15-464c-916c-d060df9d533b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dafc55126ee74d75a02919e75cd7136c'} {{(pid=80395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:08:30.921157 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.notifications [None req-c7eed977-3d15-464c-916c-d060df9d533b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dafc55126ee74d75a02919e75cd7136c'} {{(pid=80395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:08:30.924586 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.notifications [None req-c7eed977-3d15-464c-916c-d060df9d533b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dafc55126ee74d75a02919e75cd7136c'} {{(pid=80395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:08:30.934835 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 1082/2157] 10.222.0.59 () {58 vars in 1223 bytes} [Thu Jun 2 16:08:30 2022] DELETE /identity/v3/users/dafc55126ee74d75a02919e75cd7136c => generated 0 bytes in 384 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 16:08:30.940446 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e739332-1c12-4d16-9c9a-37f466e8dfc0 None None] REQUEST_METHOD: `POST` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:08:30.940739 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e739332-1c12-4d16-9c9a-37f466e8dfc0 None None] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:08:30.941081 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e739332-1c12-4d16-9c9a-37f466e8dfc0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:08:30.960910 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.auth.core [None req-2e739332-1c12-4d16-9c9a-37f466e8dfc0 None None] MFA Rules not processed for user `400d1f4db9de49638549e5db29a041e1`. Rule list: `[]` (Enabled: `True`). {{(pid=80396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 16:08:30.962391 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.fernet_utils [None req-2e739332-1c12-4d16-9c9a-37f466e8dfc0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:08:31.028756 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 1076/2158] 10.222.0.59 () {58 vars in 957 bytes} [Thu Jun 2 16:08:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 16:08:31.038361 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7eed977-3d15-464c-916c-d060df9d533b admin admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:08:31.039841 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.fernet_utils [None req-c7eed977-3d15-464c-916c-d060df9d533b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:08:31.108072 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7eed977-3d15-464c-916c-d060df9d533b admin admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:08:31.111785 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d60608d5-95bf-43fe-a385-a0778adb47a1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9af40ddfe9ff4be3887b068f13a28dc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c87c981909d4b8db02783421818c79b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:08:31.112529 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d60608d5-95bf-43fe-a385-a0778adb47a1 service neutron] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:08:31.112858 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d60608d5-95bf-43fe-a385-a0778adb47a1 service neutron] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:08:31.113150 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d60608d5-95bf-43fe-a385-a0778adb47a1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:08:31.123691 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d60608d5-95bf-43fe-a385-a0778adb47a1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:08:31.125143 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d60608d5-95bf-43fe-a385-a0778adb47a1 service neutron] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:08:31.142768 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 1083/2159] 10.222.0.59 () {60 vars in 1365 bytes} [Thu Jun 2 16:08:31 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 16:08:31.515570 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e739332-1c12-4d16-9c9a-37f466e8dfc0 None None] Authenticating user token {{(pid=80396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:08:31.516980 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.fernet_utils [None req-2e739332-1c12-4d16-9c9a-37f466e8dfc0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:08:31.558444 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e739332-1c12-4d16-9c9a-37f466e8dfc0 None None] Validating token access rules against request {{(pid=80396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:08:31.581545 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d32464e7-c8bc-4b16-ab54-c219609e1c43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f73d5a98be74242b45222df39fb6213', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:08:31.582457 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32464e7-c8bc-4b16-ab54-c219609e1c43 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:08:31.582741 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32464e7-c8bc-4b16-ab54-c219609e1c43 admin admin] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:08:31.583019 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32464e7-c8bc-4b16-ab54-c219609e1c43 admin admin] PATH_INFO: `/v3/projects/a695e0d41d524334aa77f478119263d3` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:08:31.584300 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d32464e7-c8bc-4b16-ab54-c219609e1c43 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a695e0d41d524334aa77f478119263d3)` {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:08:31.586256 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d32464e7-c8bc-4b16-ab54-c219609e1c43 admin admin] RBAC: Authorization granted {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:08:31.681533 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG dbcounter [-] [80396] Writing DB stats keystone:DELETE=2,keystone:SELECT=98 {{(pid=80396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 16:08:31.770241 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.notifications [None req-d32464e7-c8bc-4b16-ab54-c219609e1c43 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a695e0d41d524334aa77f478119263d3', 'request_id': 'req-d32464e7-c8bc-4b16-ab54-c219609e1c43'} {{(pid=80396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:08:31.786431 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.notifications [None req-d32464e7-c8bc-4b16-ab54-c219609e1c43 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a695e0d41d524334aa77f478119263d3', 'request_id': 'req-d32464e7-c8bc-4b16-ab54-c219609e1c43'} {{(pid=80396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:08:31.882476 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.notifications [None req-d32464e7-c8bc-4b16-ab54-c219609e1c43 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a695e0d41d524334aa77f478119263d3', 'request_id': 'req-d32464e7-c8bc-4b16-ab54-c219609e1c43'} {{(pid=80396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:08:31.898881 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.notifications [None req-d32464e7-c8bc-4b16-ab54-c219609e1c43 admin admin] The token cache is being invalidate because project a695e0d41d524334aa77f478119263d3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80396) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 02 16:08:31.899368 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.notifications [None req-d32464e7-c8bc-4b16-ab54-c219609e1c43 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:08:31.900141 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.notifications [None req-d32464e7-c8bc-4b16-ab54-c219609e1c43 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:08:31.902369 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 1077/2160] 10.222.0.59 () {58 vars in 1232 bytes} [Thu Jun 2 16:08:31 2022] DELETE /identity/v3/projects/a695e0d41d524334aa77f478119263d3 => generated 0 bytes in 387 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 16:08:31.906534 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d60608d5-95bf-43fe-a385-a0778adb47a1 service neutron] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:08:31.925435 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d60608d5-95bf-43fe-a385-a0778adb47a1 service neutron] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:08:32.075579 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53427ee1-dddc-4e79-8be5-2e6c313edd01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f73d5a98be74242b45222df39fb6213', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:08:32.076669 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53427ee1-dddc-4e79-8be5-2e6c313edd01 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:08:32.077728 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53427ee1-dddc-4e79-8be5-2e6c313edd01 admin admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:08:32.078225 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53427ee1-dddc-4e79-8be5-2e6c313edd01 admin admin] PATH_INFO: `/v3/users/f0da50c44bbe4433a31f48fb448e2f3c` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:08:32.078741 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d32464e7-c8bc-4b16-ab54-c219609e1c43 admin admin] Authenticating user token {{(pid=80396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:08:32.080230 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53427ee1-dddc-4e79-8be5-2e6c313edd01 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f0da50c44bbe4433a31f48fb448e2f3c)` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:08:32.080567 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.fernet_utils [None req-d32464e7-c8bc-4b16-ab54-c219609e1c43 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:08:32.082608 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53427ee1-dddc-4e79-8be5-2e6c313edd01 admin admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:08:32.111863 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 16:08:32.129363 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d32464e7-c8bc-4b16-ab54-c219609e1c43 admin admin] Validating token access rules against request {{(pid=80396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:08:32.143348 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a950d305-1a9f-4966-a60c-891b274e2e33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f73d5a98be74242b45222df39fb6213', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:08:32.143348 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a950d305-1a9f-4966-a60c-891b274e2e33 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:08:32.143348 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a950d305-1a9f-4966-a60c-891b274e2e33 admin admin] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:08:32.143348 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a950d305-1a9f-4966-a60c-891b274e2e33 admin admin] PATH_INFO: `/v3/projects/675dc5c023e945658e11602065a4006c` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:08:32.143815 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a950d305-1a9f-4966-a60c-891b274e2e33 admin admin] RBAC: Authorizing `identity:delete_project(project_id=675dc5c023e945658e11602065a4006c)` {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:08:32.151950 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a950d305-1a9f-4966-a60c-891b274e2e33 admin admin] RBAC: Authorization granted {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:08:32.434462 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.notifications [None req-53427ee1-dddc-4e79-8be5-2e6c313edd01 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f0da50c44bbe4433a31f48fb448e2f3c'} {{(pid=80395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:08:32.440447 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.notifications [None req-a950d305-1a9f-4966-a60c-891b274e2e33 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '675dc5c023e945658e11602065a4006c', 'request_id': 'req-a950d305-1a9f-4966-a60c-891b274e2e33'} {{(pid=80396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:08:32.454945 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.notifications [None req-a950d305-1a9f-4966-a60c-891b274e2e33 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '675dc5c023e945658e11602065a4006c', 'request_id': 'req-a950d305-1a9f-4966-a60c-891b274e2e33'} {{(pid=80396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:08:32.515994 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.notifications [None req-53427ee1-dddc-4e79-8be5-2e6c313edd01 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f0da50c44bbe4433a31f48fb448e2f3c'} {{(pid=80395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:08:32.529867 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.notifications [None req-53427ee1-dddc-4e79-8be5-2e6c313edd01 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f0da50c44bbe4433a31f48fb448e2f3c'} {{(pid=80395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:08:32.531642 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.notifications [None req-53427ee1-dddc-4e79-8be5-2e6c313edd01 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f0da50c44bbe4433a31f48fb448e2f3c'} {{(pid=80395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:08:32.537421 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.notifications [None req-53427ee1-dddc-4e79-8be5-2e6c313edd01 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f0da50c44bbe4433a31f48fb448e2f3c'} {{(pid=80395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:08:32.544783 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 1084/2161] 10.222.0.59 () {58 vars in 1223 bytes} [Thu Jun 2 16:08:31 2022] DELETE /identity/v3/users/f0da50c44bbe4433a31f48fb448e2f3c => generated 0 bytes in 638 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 16:08:32.612682 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.notifications [None req-a950d305-1a9f-4966-a60c-891b274e2e33 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '675dc5c023e945658e11602065a4006c', 'request_id': 'req-a950d305-1a9f-4966-a60c-891b274e2e33'} {{(pid=80396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:08:32.625881 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.notifications [None req-a950d305-1a9f-4966-a60c-891b274e2e33 admin admin] The token cache is being invalidate because project 675dc5c023e945658e11602065a4006c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80396) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 02 16:08:32.626253 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.notifications [None req-a950d305-1a9f-4966-a60c-891b274e2e33 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:08:32.627016 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.notifications [None req-a950d305-1a9f-4966-a60c-891b274e2e33 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:08:32.628911 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 1078/2162] 10.222.0.59 () {58 vars in 1232 bytes} [Thu Jun 2 16:08:32 2022] DELETE /identity/v3/projects/675dc5c023e945658e11602065a4006c => generated 0 bytes in 551 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 02 16:08:32.633573 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53427ee1-dddc-4e79-8be5-2e6c313edd01 admin admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:08:32.639489 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.fernet_utils [None req-53427ee1-dddc-4e79-8be5-2e6c313edd01 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:08:32.771125 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53427ee1-dddc-4e79-8be5-2e6c313edd01 admin admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:08:32.777958 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c4a81f8-2634-4d31-8016-b76e681c7563 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f73d5a98be74242b45222df39fb6213', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:08:32.778996 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4a81f8-2634-4d31-8016-b76e681c7563 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:08:32.779282 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4a81f8-2634-4d31-8016-b76e681c7563 admin admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:08:32.779560 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4a81f8-2634-4d31-8016-b76e681c7563 admin admin] PATH_INFO: `/v3/users/092a4bb6d19a4d1c99f17cd499326254` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:08:32.780919 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c4a81f8-2634-4d31-8016-b76e681c7563 admin admin] RBAC: Authorizing `identity:delete_user(user_id=092a4bb6d19a4d1c99f17cd499326254)` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:08:32.783078 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c4a81f8-2634-4d31-8016-b76e681c7563 admin admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:08:33.114516 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.notifications [None req-7c4a81f8-2634-4d31-8016-b76e681c7563 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '092a4bb6d19a4d1c99f17cd499326254'} {{(pid=80395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:08:33.147875 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a950d305-1a9f-4966-a60c-891b274e2e33 admin admin] Authenticating user token {{(pid=80396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:08:33.147875 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.fernet_utils [None req-a950d305-1a9f-4966-a60c-891b274e2e33 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:08:33.212641 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.notifications [None req-7c4a81f8-2634-4d31-8016-b76e681c7563 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '092a4bb6d19a4d1c99f17cd499326254'} {{(pid=80395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:08:33.234329 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.notifications [None req-7c4a81f8-2634-4d31-8016-b76e681c7563 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '092a4bb6d19a4d1c99f17cd499326254'} {{(pid=80395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:08:33.236559 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.notifications [None req-7c4a81f8-2634-4d31-8016-b76e681c7563 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '092a4bb6d19a4d1c99f17cd499326254'} {{(pid=80395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:08:33.265017 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a950d305-1a9f-4966-a60c-891b274e2e33 admin admin] Validating token access rules against request {{(pid=80396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:08:33.269270 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.notifications [None req-7c4a81f8-2634-4d31-8016-b76e681c7563 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '092a4bb6d19a4d1c99f17cd499326254'} {{(pid=80395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:08:33.270278 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c6793b1-b825-41a7-a0c3-72c766946f6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f73d5a98be74242b45222df39fb6213', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:08:33.273090 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c6793b1-b825-41a7-a0c3-72c766946f6a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:08:33.273415 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c6793b1-b825-41a7-a0c3-72c766946f6a admin admin] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:08:33.273687 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c6793b1-b825-41a7-a0c3-72c766946f6a admin admin] PATH_INFO: `/v3/projects/0e486667492047dcb8d895762ab1ff1e` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:08:33.275039 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c6793b1-b825-41a7-a0c3-72c766946f6a admin admin] RBAC: Authorizing `identity:delete_project(project_id=0e486667492047dcb8d895762ab1ff1e)` {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:08:33.277323 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c6793b1-b825-41a7-a0c3-72c766946f6a admin admin] RBAC: Authorization granted {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:08:33.279130 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG dbcounter [-] [80396] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 16:08:33.297248 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 1085/2163] 10.222.0.59 () {58 vars in 1223 bytes} [Thu Jun 2 16:08:32 2022] DELETE /identity/v3/users/092a4bb6d19a4d1c99f17cd499326254 => generated 0 bytes in 665 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 16:08:33.453794 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.notifications [None req-2c6793b1-b825-41a7-a0c3-72c766946f6a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0e486667492047dcb8d895762ab1ff1e', 'request_id': 'req-2c6793b1-b825-41a7-a0c3-72c766946f6a'} {{(pid=80396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:08:33.460809 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.notifications [None req-2c6793b1-b825-41a7-a0c3-72c766946f6a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0e486667492047dcb8d895762ab1ff1e', 'request_id': 'req-2c6793b1-b825-41a7-a0c3-72c766946f6a'} {{(pid=80396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:08:33.532677 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.notifications [None req-2c6793b1-b825-41a7-a0c3-72c766946f6a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0e486667492047dcb8d895762ab1ff1e', 'request_id': 'req-2c6793b1-b825-41a7-a0c3-72c766946f6a'} {{(pid=80396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:08:33.545990 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.notifications [None req-2c6793b1-b825-41a7-a0c3-72c766946f6a admin admin] The token cache is being invalidate because project 0e486667492047dcb8d895762ab1ff1e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80396) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 02 16:08:33.546490 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.notifications [None req-2c6793b1-b825-41a7-a0c3-72c766946f6a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:08:33.547256 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.notifications [None req-2c6793b1-b825-41a7-a0c3-72c766946f6a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:08:33.550123 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 1079/2164] 10.222.0.59 () {58 vars in 1232 bytes} [Thu Jun 2 16:08:33 2022] DELETE /identity/v3/projects/0e486667492047dcb8d895762ab1ff1e => generated 0 bytes in 403 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 02 16:08:33.553969 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c4a81f8-2634-4d31-8016-b76e681c7563 admin admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:08:33.556187 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.fernet_utils [None req-7c4a81f8-2634-4d31-8016-b76e681c7563 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:08:33.579210 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writing DB stats keystone:SELECT=79,keystone:DELETE=19,keystone:INSERT=2 {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 16:08:33.688484 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c4a81f8-2634-4d31-8016-b76e681c7563 admin admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:08:33.691087 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c6793b1-b825-41a7-a0c3-72c766946f6a admin admin] Authenticating user token {{(pid=80396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:08:33.694727 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.fernet_utils [None req-2c6793b1-b825-41a7-a0c3-72c766946f6a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:08:33.781883 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-655b7ed6-aed0-402c-a29f-96e9f3a82628 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f73d5a98be74242b45222df39fb6213', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:08:33.782940 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655b7ed6-aed0-402c-a29f-96e9f3a82628 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:08:33.783303 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655b7ed6-aed0-402c-a29f-96e9f3a82628 admin admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:08:33.790230 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655b7ed6-aed0-402c-a29f-96e9f3a82628 admin admin] PATH_INFO: `/v3/users/137991a17215477ab333731b6e6df70f` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:08:33.790230 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-655b7ed6-aed0-402c-a29f-96e9f3a82628 admin admin] RBAC: Authorizing `identity:delete_user(user_id=137991a17215477ab333731b6e6df70f)` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:08:33.790230 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-655b7ed6-aed0-402c-a29f-96e9f3a82628 admin admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:08:33.823999 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c6793b1-b825-41a7-a0c3-72c766946f6a admin admin] Validating token access rules against request {{(pid=80396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:08:33.837043 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e947d4-47e6-4dfd-b8b8-b282191ca229 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f73d5a98be74242b45222df39fb6213', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:08:33.837933 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e947d4-47e6-4dfd-b8b8-b282191ca229 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:08:33.838458 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e947d4-47e6-4dfd-b8b8-b282191ca229 admin admin] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:08:33.838737 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e947d4-47e6-4dfd-b8b8-b282191ca229 admin admin] PATH_INFO: `/v3/users/0d40bcbad6344bc6b1573669fa57ccd4` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:08:33.840766 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72e947d4-47e6-4dfd-b8b8-b282191ca229 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0d40bcbad6344bc6b1573669fa57ccd4)` {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:08:33.843378 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72e947d4-47e6-4dfd-b8b8-b282191ca229 admin admin] RBAC: Authorization granted {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:08:34.093890 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.notifications [None req-655b7ed6-aed0-402c-a29f-96e9f3a82628 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '137991a17215477ab333731b6e6df70f'} {{(pid=80395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:08:34.157730 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.notifications [None req-72e947d4-47e6-4dfd-b8b8-b282191ca229 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0d40bcbad6344bc6b1573669fa57ccd4'} {{(pid=80396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:08:34.158498 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.notifications [None req-72e947d4-47e6-4dfd-b8b8-b282191ca229 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0d40bcbad6344bc6b1573669fa57ccd4'} {{(pid=80396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:08:34.173117 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.notifications [None req-655b7ed6-aed0-402c-a29f-96e9f3a82628 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '137991a17215477ab333731b6e6df70f'} {{(pid=80395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:08:34.187589 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.notifications [None req-655b7ed6-aed0-402c-a29f-96e9f3a82628 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '137991a17215477ab333731b6e6df70f'} {{(pid=80395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:08:34.188248 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.notifications [None req-655b7ed6-aed0-402c-a29f-96e9f3a82628 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '137991a17215477ab333731b6e6df70f'} {{(pid=80395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:08:34.199052 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.notifications [None req-655b7ed6-aed0-402c-a29f-96e9f3a82628 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '137991a17215477ab333731b6e6df70f'} {{(pid=80395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:08:34.205391 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 1086/2165] 10.222.0.59 () {58 vars in 1223 bytes} [Thu Jun 2 16:08:33 2022] DELETE /identity/v3/users/137991a17215477ab333731b6e6df70f => generated 0 bytes in 652 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 16:08:34.209190 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-655b7ed6-aed0-402c-a29f-96e9f3a82628 admin admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:08:34.209449 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.fernet_utils [None req-655b7ed6-aed0-402c-a29f-96e9f3a82628 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:08:34.284899 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.notifications [None req-72e947d4-47e6-4dfd-b8b8-b282191ca229 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0d40bcbad6344bc6b1573669fa57ccd4'} {{(pid=80396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:08:34.302528 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-655b7ed6-aed0-402c-a29f-96e9f3a82628 admin admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:08:34.308681 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.notifications [None req-72e947d4-47e6-4dfd-b8b8-b282191ca229 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0d40bcbad6344bc6b1573669fa57ccd4'} {{(pid=80396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:08:34.309504 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-709009c6-5e1c-47c1-867e-65aa7326d3de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f73d5a98be74242b45222df39fb6213', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:08:34.310839 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709009c6-5e1c-47c1-867e-65aa7326d3de admin admin] REQUEST_METHOD: `DELETE` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:08:34.311132 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709009c6-5e1c-47c1-867e-65aa7326d3de admin admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:08:34.311409 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709009c6-5e1c-47c1-867e-65aa7326d3de admin admin] PATH_INFO: `/v3/projects/06a32d5dbd7446af8b3056920d848108` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:08:34.313215 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-709009c6-5e1c-47c1-867e-65aa7326d3de admin admin] RBAC: Authorizing `identity:delete_project(project_id=06a32d5dbd7446af8b3056920d848108)` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:08:34.315503 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-709009c6-5e1c-47c1-867e-65aa7326d3de admin admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:08:34.316915 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.notifications [None req-72e947d4-47e6-4dfd-b8b8-b282191ca229 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0d40bcbad6344bc6b1573669fa57ccd4'} {{(pid=80396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:08:34.335951 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 1080/2166] 10.222.0.59 () {58 vars in 1223 bytes} [Thu Jun 2 16:08:33 2022] DELETE /identity/v3/users/0d40bcbad6344bc6b1573669fa57ccd4 => generated 0 bytes in 646 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 02 16:08:34.346880 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d290c8-475d-400d-a0f5-b6a0dc297595 None None] REQUEST_METHOD: `POST` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:08:34.347362 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d290c8-475d-400d-a0f5-b6a0dc297595 None None] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:08:34.347697 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d290c8-475d-400d-a0f5-b6a0dc297595 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:08:34.374314 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.auth.core [None req-69d290c8-475d-400d-a0f5-b6a0dc297595 None None] MFA Rules not processed for user `400d1f4db9de49638549e5db29a041e1`. Rule list: `[]` (Enabled: `True`). {{(pid=80396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 16:08:34.375894 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.fernet_utils [None req-69d290c8-475d-400d-a0f5-b6a0dc297595 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:08:34.380463 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG dbcounter [-] [80396] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 16:08:34.455611 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 1081/2167] 10.222.0.59 () {58 vars in 957 bytes} [Thu Jun 2 16:08:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 16:08:34.490121 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.notifications [None req-709009c6-5e1c-47c1-867e-65aa7326d3de admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '06a32d5dbd7446af8b3056920d848108', 'request_id': 'req-709009c6-5e1c-47c1-867e-65aa7326d3de'} {{(pid=80395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:08:34.498701 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.notifications [None req-709009c6-5e1c-47c1-867e-65aa7326d3de admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '06a32d5dbd7446af8b3056920d848108', 'request_id': 'req-709009c6-5e1c-47c1-867e-65aa7326d3de'} {{(pid=80395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:08:34.522347 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 16:08:34.531168 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69d290c8-475d-400d-a0f5-b6a0dc297595 None None] Authenticating user token {{(pid=80396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:08:34.535103 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.fernet_utils [None req-69d290c8-475d-400d-a0f5-b6a0dc297595 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:08:34.613472 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.notifications [None req-709009c6-5e1c-47c1-867e-65aa7326d3de admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '06a32d5dbd7446af8b3056920d848108', 'request_id': 'req-709009c6-5e1c-47c1-867e-65aa7326d3de'} {{(pid=80395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:08:34.627303 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69d290c8-475d-400d-a0f5-b6a0dc297595 None None] Validating token access rules against request {{(pid=80396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:08:34.649851 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.notifications [None req-709009c6-5e1c-47c1-867e-65aa7326d3de admin admin] The token cache is being invalidate because project 06a32d5dbd7446af8b3056920d848108 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80395) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 02 16:08:34.650701 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.notifications [None req-709009c6-5e1c-47c1-867e-65aa7326d3de admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:08:34.653867 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.notifications [None req-709009c6-5e1c-47c1-867e-65aa7326d3de admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:08:34.657063 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 1087/2168] 10.222.0.59 () {58 vars in 1232 bytes} [Thu Jun 2 16:08:34 2022] DELETE /identity/v3/projects/06a32d5dbd7446af8b3056920d848108 => generated 0 bytes in 451 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 16:08:34.662115 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4cf6832-2a2a-4f91-a13c-54c212f5f373 None None] REQUEST_METHOD: `POST` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:08:34.662427 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4cf6832-2a2a-4f91-a13c-54c212f5f373 None None] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:08:34.665322 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4cf6832-2a2a-4f91-a13c-54c212f5f373 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:08:34.716607 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.auth.core [None req-e4cf6832-2a2a-4f91-a13c-54c212f5f373 None None] MFA Rules not processed for user `400d1f4db9de49638549e5db29a041e1`. Rule list: `[]` (Enabled: `True`). {{(pid=80395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 16:08:34.717771 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.fernet_utils [None req-e4cf6832-2a2a-4f91-a13c-54c212f5f373 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:08:34.742441 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2ddbb3c-58c3-42ca-a378-1be784f5efdf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9af40ddfe9ff4be3887b068f13a28dc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c87c981909d4b8db02783421818c79b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:08:34.743852 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ddbb3c-58c3-42ca-a378-1be784f5efdf service neutron] REQUEST_METHOD: `GET` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:08:34.744463 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ddbb3c-58c3-42ca-a378-1be784f5efdf service neutron] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:08:34.744945 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ddbb3c-58c3-42ca-a378-1be784f5efdf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:08:34.747598 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.fernet_utils [None req-b2ddbb3c-58c3-42ca-a378-1be784f5efdf service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:08:34.797882 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 1088/2169] 10.222.0.59 () {58 vars in 957 bytes} [Thu Jun 2 16:08:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 16:08:34.799758 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8357b0d-dd81-4ad2-a282-7ea533b52e47 None None] REQUEST_METHOD: `POST` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:08:34.800264 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8357b0d-dd81-4ad2-a282-7ea533b52e47 None None] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:08:34.800845 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8357b0d-dd81-4ad2-a282-7ea533b52e47 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:08:34.829499 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2ddbb3c-58c3-42ca-a378-1be784f5efdf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:08:34.829937 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.auth.core [None req-a8357b0d-dd81-4ad2-a282-7ea533b52e47 None None] MFA Rules not processed for user `400d1f4db9de49638549e5db29a041e1`. Rule list: `[]` (Enabled: `True`). {{(pid=80395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 16:08:34.831210 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.fernet_utils [None req-a8357b0d-dd81-4ad2-a282-7ea533b52e47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:08:34.831445 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2ddbb3c-58c3-42ca-a378-1be784f5efdf service neutron] RBAC: Authorization granted {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:08:34.842057 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 1089/2170] 10.222.0.59 () {58 vars in 957 bytes} [Thu Jun 2 16:08:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 16:08:34.851634 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8357b0d-dd81-4ad2-a282-7ea533b52e47 None None] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:08:34.859641 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 1082/2171] 10.222.0.59 () {60 vars in 1365 bytes} [Thu Jun 2 16:08:34 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 325 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 16:08:34.862463 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2ddbb3c-58c3-42ca-a378-1be784f5efdf service neutron] Authenticating user token {{(pid=80396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:08:34.863504 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8357b0d-dd81-4ad2-a282-7ea533b52e47 None None] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:08:34.867943 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.fernet_utils [None req-b2ddbb3c-58c3-42ca-a378-1be784f5efdf service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:08:34.873602 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e76d567b-5dd6-425f-af9f-c4d19d9ad8f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f73d5a98be74242b45222df39fb6213', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:08:34.874460 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76d567b-5dd6-425f-af9f-c4d19d9ad8f6 admin admin] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:08:34.874990 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76d567b-5dd6-425f-af9f-c4d19d9ad8f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:08:34.875361 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76d567b-5dd6-425f-af9f-c4d19d9ad8f6 admin admin] PATH_INFO: `/v3/domains` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:08:34.876199 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e76d567b-5dd6-425f-af9f-c4d19d9ad8f6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80395) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 16:08:34.876640 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e76d567b-5dd6-425f-af9f-c4d19d9ad8f6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:08:34.879069 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e76d567b-5dd6-425f-af9f-c4d19d9ad8f6 admin admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:08:34.901730 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2ddbb3c-58c3-42ca-a378-1be784f5efdf service neutron] Validating token access rules against request {{(pid=80396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:08:34.918082 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 1090/2172] 10.222.0.59 () {58 vars in 1152 bytes} [Thu Jun 2 16:08:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 16:08:34.922401 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04571d7c-4769-428e-8533-f010d96a5aa3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f73d5a98be74242b45222df39fb6213', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:08:34.923243 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04571d7c-4769-428e-8533-f010d96a5aa3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:08:34.923532 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04571d7c-4769-428e-8533-f010d96a5aa3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:08:34.923813 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04571d7c-4769-428e-8533-f010d96a5aa3 admin admin] PATH_INFO: `/v3/projects/541f86e8ab9b43c5819c86272fdf568f` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:08:34.925336 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e76d567b-5dd6-425f-af9f-c4d19d9ad8f6 admin admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:08:34.926902 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04571d7c-4769-428e-8533-f010d96a5aa3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=541f86e8ab9b43c5819c86272fdf568f)` {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:08:34.928837 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04571d7c-4769-428e-8533-f010d96a5aa3 admin admin] RBAC: Authorization granted {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:08:34.959474 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e76d567b-5dd6-425f-af9f-c4d19d9ad8f6 admin admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:08:34.971707 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c652c58-8a72-4b36-9cdc-117b5ba33485 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f73d5a98be74242b45222df39fb6213', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:08:34.972284 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c652c58-8a72-4b36-9cdc-117b5ba33485 admin admin] REQUEST_METHOD: `POST` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:08:34.972865 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c652c58-8a72-4b36-9cdc-117b5ba33485 admin admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:08:34.972865 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c652c58-8a72-4b36-9cdc-117b5ba33485 admin admin] PATH_INFO: `/v3/projects` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:08:34.974290 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c652c58-8a72-4b36-9cdc-117b5ba33485 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:08:34.976245 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c652c58-8a72-4b36-9cdc-117b5ba33485 admin admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:08:35.161209 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.notifications [None req-04571d7c-4769-428e-8533-f010d96a5aa3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '541f86e8ab9b43c5819c86272fdf568f', 'request_id': 'req-04571d7c-4769-428e-8533-f010d96a5aa3'} {{(pid=80396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:08:35.168845 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.notifications [None req-04571d7c-4769-428e-8533-f010d96a5aa3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '541f86e8ab9b43c5819c86272fdf568f', 'request_id': 'req-04571d7c-4769-428e-8533-f010d96a5aa3'} {{(pid=80396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:08:35.236927 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 1091/2173] 10.222.0.59 () {60 vars in 1152 bytes} [Thu Jun 2 16:08:34 2022] POST /identity/v3/projects => generated 369 bytes in 309 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 16:08:35.238047 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c652c58-8a72-4b36-9cdc-117b5ba33485 admin admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:08:35.361832 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c652c58-8a72-4b36-9cdc-117b5ba33485 admin admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:08:35.382356 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b785ebe5-9622-4979-8b2c-39106be67c44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f73d5a98be74242b45222df39fb6213', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:08:35.382356 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b785ebe5-9622-4979-8b2c-39106be67c44 admin admin] REQUEST_METHOD: `POST` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:08:35.382356 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b785ebe5-9622-4979-8b2c-39106be67c44 admin admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:08:35.382356 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b785ebe5-9622-4979-8b2c-39106be67c44 admin admin] PATH_INFO: `/v3/users` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:08:35.382653 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b785ebe5-9622-4979-8b2c-39106be67c44 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:08:35.382653 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b785ebe5-9622-4979-8b2c-39106be67c44 admin admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:08:35.413968 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.notifications [None req-04571d7c-4769-428e-8533-f010d96a5aa3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '541f86e8ab9b43c5819c86272fdf568f', 'request_id': 'req-04571d7c-4769-428e-8533-f010d96a5aa3'} {{(pid=80396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:08:35.438866 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.notifications [None req-04571d7c-4769-428e-8533-f010d96a5aa3 admin admin] The token cache is being invalidate because project 541f86e8ab9b43c5819c86272fdf568f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80396) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 02 16:08:35.439158 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.notifications [None req-04571d7c-4769-428e-8533-f010d96a5aa3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:08:35.439820 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.notifications [None req-04571d7c-4769-428e-8533-f010d96a5aa3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:08:35.441434 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 1083/2174] 10.222.0.59 () {58 vars in 1232 bytes} [Thu Jun 2 16:08:34 2022] DELETE /identity/v3/projects/541f86e8ab9b43c5819c86272fdf568f => generated 0 bytes in 580 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 16:08:35.446237 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66c4eed-be87-492e-9c76-fae065cd87fe None None] REQUEST_METHOD: `POST` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:08:35.446528 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66c4eed-be87-492e-9c76-fae065cd87fe None None] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:08:35.446811 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66c4eed-be87-492e-9c76-fae065cd87fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:08:35.486396 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.auth.core [None req-f66c4eed-be87-492e-9c76-fae065cd87fe None None] MFA Rules not processed for user `400d1f4db9de49638549e5db29a041e1`. Rule list: `[]` (Enabled: `True`). {{(pid=80396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 16:08:35.486396 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.fernet_utils [None req-f66c4eed-be87-492e-9c76-fae065cd87fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:08:35.492890 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 1084/2175] 10.222.0.59 () {58 vars in 957 bytes} [Thu Jun 2 16:08:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 02 16:08:35.501437 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85ed43a-132e-43df-8570-9cd9bde6e0a8 None None] REQUEST_METHOD: `POST` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:08:35.501707 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85ed43a-132e-43df-8570-9cd9bde6e0a8 None None] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:08:35.501999 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85ed43a-132e-43df-8570-9cd9bde6e0a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:08:35.522064 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.auth.core [None req-a85ed43a-132e-43df-8570-9cd9bde6e0a8 None None] MFA Rules not processed for user `400d1f4db9de49638549e5db29a041e1`. Rule list: `[]` (Enabled: `True`). {{(pid=80396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 16:08:35.523401 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.fernet_utils [None req-a85ed43a-132e-43df-8570-9cd9bde6e0a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:08:35.534263 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 1085/2176] 10.222.0.59 () {58 vars in 957 bytes} [Thu Jun 2 16:08:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 02 16:08:35.537361 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a85ed43a-132e-43df-8570-9cd9bde6e0a8 None None] Authenticating user token {{(pid=80396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:08:35.547417 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a85ed43a-132e-43df-8570-9cd9bde6e0a8 None None] Validating token access rules against request {{(pid=80396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:08:35.552172 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bc7fcce-7475-468a-95ba-aae683bdfb1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f73d5a98be74242b45222df39fb6213', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:08:35.552850 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc7fcce-7475-468a-95ba-aae683bdfb1b admin admin] REQUEST_METHOD: `GET` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:08:35.553128 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc7fcce-7475-468a-95ba-aae683bdfb1b admin admin] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:08:35.553401 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc7fcce-7475-468a-95ba-aae683bdfb1b admin admin] PATH_INFO: `/v3/domains` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:08:35.554183 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bc7fcce-7475-468a-95ba-aae683bdfb1b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80396) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 16:08:35.554507 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bc7fcce-7475-468a-95ba-aae683bdfb1b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:08:35.556087 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bc7fcce-7475-468a-95ba-aae683bdfb1b admin admin] RBAC: Authorization granted {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:08:35.568197 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 1092/2177] 10.222.0.59 () {60 vars in 1143 bytes} [Thu Jun 2 16:08:35 2022] POST /identity/v3/users => generated 285 bytes in 329 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 16:08:35.570709 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 1086/2178] 10.222.0.59 () {58 vars in 1152 bytes} [Thu Jun 2 16:08:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 16:08:35.575748 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b785ebe5-9622-4979-8b2c-39106be67c44 admin admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:08:35.575892 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bc7fcce-7475-468a-95ba-aae683bdfb1b admin admin] Authenticating user token {{(pid=80396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:08:35.577547 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.fernet_utils [None req-b785ebe5-9622-4979-8b2c-39106be67c44 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:08:35.585521 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bc7fcce-7475-468a-95ba-aae683bdfb1b admin admin] Validating token access rules against request {{(pid=80396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:08:35.590119 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b785ebe5-9622-4979-8b2c-39106be67c44 admin admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:08:35.590432 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c989d639-a767-4fea-bece-2306e85809c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f73d5a98be74242b45222df39fb6213', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:08:35.591108 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c989d639-a767-4fea-bece-2306e85809c1 admin admin] REQUEST_METHOD: `POST` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:08:35.591392 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c989d639-a767-4fea-bece-2306e85809c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:08:35.591677 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c989d639-a767-4fea-bece-2306e85809c1 admin admin] PATH_INFO: `/v3/projects` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:08:35.592364 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c989d639-a767-4fea-bece-2306e85809c1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:08:35.595374 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c989d639-a767-4fea-bece-2306e85809c1 admin admin] RBAC: Authorization granted {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:08:35.598466 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7d6b055-2ade-40f2-9e2e-e2f250ede3a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f73d5a98be74242b45222df39fb6213', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:08:35.599929 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d6b055-2ade-40f2-9e2e-e2f250ede3a4 admin admin] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:08:35.600362 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d6b055-2ade-40f2-9e2e-e2f250ede3a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:08:35.600691 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d6b055-2ade-40f2-9e2e-e2f250ede3a4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:08:35.601445 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7d6b055-2ade-40f2-9e2e-e2f250ede3a4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:08:35.615265 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7d6b055-2ade-40f2-9e2e-e2f250ede3a4 admin admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:08:35.640561 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 1093/2179] 10.222.0.59 () {58 vars in 1121 bytes} [Thu Jun 2 16:08:35 2022] GET /identity/v3/roles => generated 1420 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 16:08:35.641692 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7d6b055-2ade-40f2-9e2e-e2f250ede3a4 admin admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:08:35.656263 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.fernet_utils [None req-e7d6b055-2ade-40f2-9e2e-e2f250ede3a4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:08:35.675540 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7d6b055-2ade-40f2-9e2e-e2f250ede3a4 admin admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:08:35.676132 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG dbcounter [-] [80396] Writing DB stats keystone:SELECT=100 {{(pid=80396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 16:08:35.683868 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd2a5d5e-1130-4ae0-9b1d-b44dd1478e53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f73d5a98be74242b45222df39fb6213', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:08:35.684800 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2a5d5e-1130-4ae0-9b1d-b44dd1478e53 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:08:35.685161 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2a5d5e-1130-4ae0-9b1d-b44dd1478e53 admin admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:08:35.685521 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2a5d5e-1130-4ae0-9b1d-b44dd1478e53 admin admin] PATH_INFO: `/v3/projects/622c2570d7f54d0ca8951b3a57f13a9a` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:08:35.686939 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd2a5d5e-1130-4ae0-9b1d-b44dd1478e53 admin admin] RBAC: Authorizing `identity:delete_project(project_id=622c2570d7f54d0ca8951b3a57f13a9a)` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:08:35.689562 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd2a5d5e-1130-4ae0-9b1d-b44dd1478e53 admin admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:08:35.714519 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 1087/2180] 10.222.0.59 () {60 vars in 1152 bytes} [Thu Jun 2 16:08:35 2022] POST /identity/v3/projects => generated 373 bytes in 139 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 16:08:35.716075 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c989d639-a767-4fea-bece-2306e85809c1 admin admin] Authenticating user token {{(pid=80396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:08:35.733238 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 16:08:35.815872 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c989d639-a767-4fea-bece-2306e85809c1 admin admin] Validating token access rules against request {{(pid=80396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:08:35.824159 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcbf4ea6-cced-4d83-b2e5-98ce052d6353 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f73d5a98be74242b45222df39fb6213', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:08:35.825021 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcbf4ea6-cced-4d83-b2e5-98ce052d6353 admin admin] REQUEST_METHOD: `GET` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:08:35.825426 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcbf4ea6-cced-4d83-b2e5-98ce052d6353 admin admin] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:08:35.825745 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcbf4ea6-cced-4d83-b2e5-98ce052d6353 admin admin] PATH_INFO: `/v3/roles` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:08:35.826746 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcbf4ea6-cced-4d83-b2e5-98ce052d6353 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:08:35.828737 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcbf4ea6-cced-4d83-b2e5-98ce052d6353 admin admin] RBAC: Authorization granted {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:08:35.843042 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 1088/2181] 10.222.0.59 () {58 vars in 1121 bytes} [Thu Jun 2 16:08:35 2022] GET /identity/v3/roles => generated 1420 bytes in 126 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 16:08:35.843042 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcbf4ea6-cced-4d83-b2e5-98ce052d6353 admin admin] Authenticating user token {{(pid=80396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:08:35.898448 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcbf4ea6-cced-4d83-b2e5-98ce052d6353 admin admin] Validating token access rules against request {{(pid=80396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:08:35.898448 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70cbac1d-084f-4c80-9439-26d7e8c0d4fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f73d5a98be74242b45222df39fb6213', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:08:35.898448 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70cbac1d-084f-4c80-9439-26d7e8c0d4fe admin admin] REQUEST_METHOD: `POST` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:08:35.898448 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70cbac1d-084f-4c80-9439-26d7e8c0d4fe admin admin] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:08:35.899110 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70cbac1d-084f-4c80-9439-26d7e8c0d4fe admin admin] PATH_INFO: `/v3/users` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:08:35.899110 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70cbac1d-084f-4c80-9439-26d7e8c0d4fe admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:08:35.899110 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70cbac1d-084f-4c80-9439-26d7e8c0d4fe admin admin] RBAC: Authorization granted {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:08:36.613117 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.notifications [None req-bd2a5d5e-1130-4ae0-9b1d-b44dd1478e53 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '622c2570d7f54d0ca8951b3a57f13a9a', 'request_id': 'req-bd2a5d5e-1130-4ae0-9b1d-b44dd1478e53'} {{(pid=80395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:08:36.621455 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.notifications [None req-bd2a5d5e-1130-4ae0-9b1d-b44dd1478e53 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '622c2570d7f54d0ca8951b3a57f13a9a', 'request_id': 'req-bd2a5d5e-1130-4ae0-9b1d-b44dd1478e53'} {{(pid=80395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:08:36.946000 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 1089/2182] 10.222.0.59 () {60 vars in 1143 bytes} [Thu Jun 2 16:08:35 2022] POST /identity/v3/users => generated 287 bytes in 1101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 16:08:36.946000 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70cbac1d-084f-4c80-9439-26d7e8c0d4fe admin admin] Authenticating user token {{(pid=80396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:08:36.954390 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70cbac1d-084f-4c80-9439-26d7e8c0d4fe admin admin] Validating token access rules against request {{(pid=80396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:08:36.975883 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.notifications [None req-bd2a5d5e-1130-4ae0-9b1d-b44dd1478e53 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '622c2570d7f54d0ca8951b3a57f13a9a', 'request_id': 'req-bd2a5d5e-1130-4ae0-9b1d-b44dd1478e53'} {{(pid=80395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:08:36.994143 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.notifications [None req-bd2a5d5e-1130-4ae0-9b1d-b44dd1478e53 admin admin] The token cache is being invalidate because project 622c2570d7f54d0ca8951b3a57f13a9a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80395) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 02 16:08:36.997678 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.notifications [None req-bd2a5d5e-1130-4ae0-9b1d-b44dd1478e53 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:08:36.997678 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.notifications [None req-bd2a5d5e-1130-4ae0-9b1d-b44dd1478e53 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:08:36.997678 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 1094/2183] 10.222.0.59 () {58 vars in 1232 bytes} [Thu Jun 2 16:08:35 2022] DELETE /identity/v3/projects/622c2570d7f54d0ca8951b3a57f13a9a => generated 0 bytes in 1356 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 16:08:36.998575 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd2a5d5e-1130-4ae0-9b1d-b44dd1478e53 admin admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:08:36.999952 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.fernet_utils [None req-bd2a5d5e-1130-4ae0-9b1d-b44dd1478e53 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:08:37.044265 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95a5792f-4a35-470e-a15b-d2a3b0554626 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f73d5a98be74242b45222df39fb6213', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:08:37.045176 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a5792f-4a35-470e-a15b-d2a3b0554626 admin admin] REQUEST_METHOD: `PUT` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:08:37.045455 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a5792f-4a35-470e-a15b-d2a3b0554626 admin admin] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:08:37.045727 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a5792f-4a35-470e-a15b-d2a3b0554626 admin admin] PATH_INFO: `/v3/projects/354485209f3e44dcb6454d0f3ca39c7c/users/86dda97d39ef49ad971f386c349c1261/roles/649e0f2b5a264c419ea6a1441f123a03` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:08:37.062701 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95a5792f-4a35-470e-a15b-d2a3b0554626 admin admin] RBAC: Authorizing `identity:create_grant(project_id=354485209f3e44dcb6454d0f3ca39c7c, user_id=86dda97d39ef49ad971f386c349c1261, role_id=649e0f2b5a264c419ea6a1441f123a03)` {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:08:37.065442 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95a5792f-4a35-470e-a15b-d2a3b0554626 admin admin] RBAC: Authorization granted {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:08:37.096646 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG dbcounter [-] [80396] Writing DB stats keystone:SELECT=88,keystone:DELETE=7,keystone:INSERT=5 {{(pid=80396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 16:08:37.104534 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd2a5d5e-1130-4ae0-9b1d-b44dd1478e53 admin admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:08:37.109306 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d57bd12-618a-467b-8840-95c3993b1603 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f73d5a98be74242b45222df39fb6213', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:08:37.110004 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d57bd12-618a-467b-8840-95c3993b1603 admin admin] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:08:37.110326 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d57bd12-618a-467b-8840-95c3993b1603 admin admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:08:37.110605 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d57bd12-618a-467b-8840-95c3993b1603 admin admin] PATH_INFO: `/v3/roles` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:08:37.111342 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d57bd12-618a-467b-8840-95c3993b1603 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:08:37.113355 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d57bd12-618a-467b-8840-95c3993b1603 admin admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:08:37.132358 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 1095/2184] 10.222.0.59 () {58 vars in 1121 bytes} [Thu Jun 2 16:08:36 2022] GET /identity/v3/roles => generated 1420 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 16:08:37.133990 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5719dea-9aca-413f-8404-346ade623970 None None] REQUEST_METHOD: `POST` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:08:37.140882 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5719dea-9aca-413f-8404-346ade623970 None None] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:08:37.140882 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5719dea-9aca-413f-8404-346ade623970 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:08:37.172992 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.auth.core [None req-f5719dea-9aca-413f-8404-346ade623970 None None] MFA Rules not processed for user `400d1f4db9de49638549e5db29a041e1`. Rule list: `[]` (Enabled: `True`). {{(pid=80395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 16:08:37.174646 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.fernet_utils [None req-f5719dea-9aca-413f-8404-346ade623970 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:08:37.189864 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 1090/2185] 10.222.0.59 () {60 vars in 1482 bytes} [Thu Jun 2 16:08:36 2022] PUT /identity/v3/projects/354485209f3e44dcb6454d0f3ca39c7c/users/86dda97d39ef49ad971f386c349c1261/roles/649e0f2b5a264c419ea6a1441f123a03 => generated 0 bytes in 242 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 16:08:37.189864 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95a5792f-4a35-470e-a15b-d2a3b0554626 admin admin] Authenticating user token {{(pid=80396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:08:37.190462 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 1096/2186] 10.222.0.59 () {58 vars in 957 bytes} [Thu Jun 2 16:08:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 58 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 16:08:37.201245 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d452509-7cce-47e6-972a-892a829ba28f None None] REQUEST_METHOD: `POST` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:08:37.201688 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d452509-7cce-47e6-972a-892a829ba28f None None] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:08:37.202104 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d452509-7cce-47e6-972a-892a829ba28f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:08:37.247054 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.auth.core [None req-4d452509-7cce-47e6-972a-892a829ba28f None None] MFA Rules not processed for user `86dda97d39ef49ad971f386c349c1261`. Rule list: `[]` (Enabled: `True`). {{(pid=80395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 16:08:37.248550 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.fernet_utils [None req-4d452509-7cce-47e6-972a-892a829ba28f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:08:37.294650 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95a5792f-4a35-470e-a15b-d2a3b0554626 admin admin] Validating token access rules against request {{(pid=80396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:08:37.301138 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c85a597c-8fe8-4870-9b92-365286df4dd6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f73d5a98be74242b45222df39fb6213', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:08:37.301138 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c85a597c-8fe8-4870-9b92-365286df4dd6 admin admin] REQUEST_METHOD: `GET` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:08:37.301138 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c85a597c-8fe8-4870-9b92-365286df4dd6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:08:37.301138 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c85a597c-8fe8-4870-9b92-365286df4dd6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:08:37.301678 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c85a597c-8fe8-4870-9b92-365286df4dd6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:08:37.309789 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c85a597c-8fe8-4870-9b92-365286df4dd6 admin admin] RBAC: Authorization granted {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:08:37.316219 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 1091/2187] 10.222.0.59 () {58 vars in 1121 bytes} [Thu Jun 2 16:08:37 2022] GET /identity/v3/roles => generated 1420 bytes in 130 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 16:08:37.317669 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb952f23-bd21-43f5-bc92-5dabcea2ee3e None None] REQUEST_METHOD: `POST` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:08:37.317965 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb952f23-bd21-43f5-bc92-5dabcea2ee3e None None] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:08:37.318384 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb952f23-bd21-43f5-bc92-5dabcea2ee3e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:08:37.337325 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 1097/2188] 10.222.0.59 () {58 vars in 957 bytes} [Thu Jun 2 16:08:37 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 02 16:08:37.338893 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d452509-7cce-47e6-972a-892a829ba28f None None] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:08:37.352718 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d452509-7cce-47e6-972a-892a829ba28f None None] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:08:37.360172 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.auth.core [None req-bb952f23-bd21-43f5-bc92-5dabcea2ee3e None None] MFA Rules not processed for user `400d1f4db9de49638549e5db29a041e1`. Rule list: `[]` (Enabled: `True`). {{(pid=80396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 16:08:37.360518 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.fernet_utils [None req-bb952f23-bd21-43f5-bc92-5dabcea2ee3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:08:37.366352 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8dcf4f1-a300-4ecd-b264-f5fdff4a4d65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f73d5a98be74242b45222df39fb6213', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:08:37.367637 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8dcf4f1-a300-4ecd-b264-f5fdff4a4d65 admin admin] REQUEST_METHOD: `PUT` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:08:37.367928 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8dcf4f1-a300-4ecd-b264-f5fdff4a4d65 admin admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:08:37.368334 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8dcf4f1-a300-4ecd-b264-f5fdff4a4d65 admin admin] PATH_INFO: `/v3/projects/ae27b08b0e654bf29d7168dd6e4e3b06/users/38f9ef9081de4e8dac3baa12a69fe575/roles/649e0f2b5a264c419ea6a1441f123a03` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:08:37.371339 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 1092/2189] 10.222.0.59 () {58 vars in 957 bytes} [Thu Jun 2 16:08:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 55 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 16:08:37.372343 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb952f23-bd21-43f5-bc92-5dabcea2ee3e None None] Authenticating user token {{(pid=80396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:08:37.376219 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.fernet_utils [None req-bb952f23-bd21-43f5-bc92-5dabcea2ee3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:08:37.390450 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb952f23-bd21-43f5-bc92-5dabcea2ee3e None None] Validating token access rules against request {{(pid=80396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:08:37.390967 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8dcf4f1-a300-4ecd-b264-f5fdff4a4d65 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ae27b08b0e654bf29d7168dd6e4e3b06, user_id=38f9ef9081de4e8dac3baa12a69fe575, role_id=649e0f2b5a264c419ea6a1441f123a03)` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:08:37.393781 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8dcf4f1-a300-4ecd-b264-f5fdff4a4d65 admin admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:08:37.397702 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef0339f4-0679-4c3f-b582-3f7843f71035 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f73d5a98be74242b45222df39fb6213', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:08:37.398554 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0339f4-0679-4c3f-b582-3f7843f71035 admin admin] REQUEST_METHOD: `POST` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:08:37.399025 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0339f4-0679-4c3f-b582-3f7843f71035 admin admin] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:08:37.399521 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0339f4-0679-4c3f-b582-3f7843f71035 admin admin] PATH_INFO: `/v3/projects` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:08:37.400405 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef0339f4-0679-4c3f-b582-3f7843f71035 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:08:37.402479 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef0339f4-0679-4c3f-b582-3f7843f71035 admin admin] RBAC: Authorization granted {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:08:37.493117 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 1098/2190] 10.222.0.59 () {60 vars in 1482 bytes} [Thu Jun 2 16:08:37 2022] PUT /identity/v3/projects/ae27b08b0e654bf29d7168dd6e4e3b06/users/38f9ef9081de4e8dac3baa12a69fe575/roles/649e0f2b5a264c419ea6a1441f123a03 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 16:08:37.494016 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8dcf4f1-a300-4ecd-b264-f5fdff4a4d65 admin admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:08:37.524563 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 1093/2191] 10.222.0.59 () {60 vars in 1152 bytes} [Thu Jun 2 16:08:37 2022] POST /identity/v3/projects => generated 367 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 16:08:37.524563 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e3c83b-044c-448c-b231-724c0e06c622 None None] REQUEST_METHOD: `POST` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:08:37.524563 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e3c83b-044c-448c-b231-724c0e06c622 None None] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:08:37.524563 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e3c83b-044c-448c-b231-724c0e06c622 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:08:37.556517 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.auth.core [None req-b6e3c83b-044c-448c-b231-724c0e06c622 None None] MFA Rules not processed for user `38f9ef9081de4e8dac3baa12a69fe575`. Rule list: `[]` (Enabled: `True`). {{(pid=80396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 16:08:37.558990 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.fernet_utils [None req-b6e3c83b-044c-448c-b231-724c0e06c622 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:08:37.599977 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8dcf4f1-a300-4ecd-b264-f5fdff4a4d65 admin admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:08:37.669437 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-034c7065-8c2b-4556-8c3f-994e19b8765e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f73d5a98be74242b45222df39fb6213', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:08:37.670184 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-034c7065-8c2b-4556-8c3f-994e19b8765e admin admin] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:08:37.670428 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-034c7065-8c2b-4556-8c3f-994e19b8765e admin admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:08:37.670729 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-034c7065-8c2b-4556-8c3f-994e19b8765e admin admin] PATH_INFO: `/v3/domains` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:08:37.671464 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-034c7065-8c2b-4556-8c3f-994e19b8765e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80395) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 16:08:37.671767 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-034c7065-8c2b-4556-8c3f-994e19b8765e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:08:37.673374 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-034c7065-8c2b-4556-8c3f-994e19b8765e admin admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:08:37.678999 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 1094/2192] 10.222.0.59 () {58 vars in 957 bytes} [Thu Jun 2 16:08:37 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 16:08:37.680763 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6e3c83b-044c-448c-b231-724c0e06c622 None None] Authenticating user token {{(pid=80396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:08:37.684418 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 16:08:37.699220 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6e3c83b-044c-448c-b231-724c0e06c622 None None] Validating token access rules against request {{(pid=80396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:08:37.703558 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 1099/2193] 10.222.0.59 () {58 vars in 1152 bytes} [Thu Jun 2 16:08:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 16:08:37.715244 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-034c7065-8c2b-4556-8c3f-994e19b8765e admin admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:08:37.715631 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2e8b995-3979-47f7-b8c2-acc01b7412a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f73d5a98be74242b45222df39fb6213', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:08:37.715631 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e8b995-3979-47f7-b8c2-acc01b7412a0 admin admin] REQUEST_METHOD: `POST` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:08:37.715631 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e8b995-3979-47f7-b8c2-acc01b7412a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:08:37.715631 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e8b995-3979-47f7-b8c2-acc01b7412a0 admin admin] PATH_INFO: `/v3/users` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:08:37.715968 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.fernet_utils [None req-034c7065-8c2b-4556-8c3f-994e19b8765e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:08:37.716063 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2e8b995-3979-47f7-b8c2-acc01b7412a0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:08:37.716063 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2e8b995-3979-47f7-b8c2-acc01b7412a0 admin admin] RBAC: Authorization granted {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:08:37.796264 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-034c7065-8c2b-4556-8c3f-994e19b8765e admin admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:08:37.799952 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0099813-bf8f-4485-a331-7dc1cf50b15f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6534961c369940a5b88f310c6450250b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c87c981909d4b8db02783421818c79b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:08:37.800590 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0099813-bf8f-4485-a331-7dc1cf50b15f service cinder] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:08:37.800872 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0099813-bf8f-4485-a331-7dc1cf50b15f service cinder] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:08:37.801144 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0099813-bf8f-4485-a331-7dc1cf50b15f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:08:37.810724 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0099813-bf8f-4485-a331-7dc1cf50b15f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:08:37.812472 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0099813-bf8f-4485-a331-7dc1cf50b15f service cinder] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:08:37.822632 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 1100/2194] 10.222.0.59 () {60 vars in 1365 bytes} [Thu Jun 2 16:08:37 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 16:08:37.823424 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0099813-bf8f-4485-a331-7dc1cf50b15f service cinder] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:08:37.834833 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0099813-bf8f-4485-a331-7dc1cf50b15f service cinder] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:08:37.842767 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b29e397-a2a4-401f-8a48-a49b9599fe3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f73d5a98be74242b45222df39fb6213', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:08:37.843971 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b29e397-a2a4-401f-8a48-a49b9599fe3b admin admin] REQUEST_METHOD: `POST` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:08:37.844594 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b29e397-a2a4-401f-8a48-a49b9599fe3b admin admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:08:37.845024 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b29e397-a2a4-401f-8a48-a49b9599fe3b admin admin] PATH_INFO: `/v3/projects` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:08:37.846045 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b29e397-a2a4-401f-8a48-a49b9599fe3b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:08:37.848429 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b29e397-a2a4-401f-8a48-a49b9599fe3b admin admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:08:37.914718 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 1095/2195] 10.222.0.59 () {60 vars in 1143 bytes} [Thu Jun 2 16:08:37 2022] POST /identity/v3/users => generated 290 bytes in 235 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 16:08:37.915773 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2e8b995-3979-47f7-b8c2-acc01b7412a0 admin admin] Authenticating user token {{(pid=80396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:08:37.926594 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2e8b995-3979-47f7-b8c2-acc01b7412a0 admin admin] Validating token access rules against request {{(pid=80396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:08:37.931518 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a73520b4-3590-4fe0-8846-5851834c306b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f73d5a98be74242b45222df39fb6213', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:08:37.932678 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73520b4-3590-4fe0-8846-5851834c306b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:08:37.932964 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73520b4-3590-4fe0-8846-5851834c306b admin admin] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:08:37.933395 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73520b4-3590-4fe0-8846-5851834c306b admin admin] PATH_INFO: `/v3/users/38f9ef9081de4e8dac3baa12a69fe575` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:08:37.934679 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a73520b4-3590-4fe0-8846-5851834c306b admin admin] RBAC: Authorizing `identity:delete_user(user_id=38f9ef9081de4e8dac3baa12a69fe575)` {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:08:37.936605 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a73520b4-3590-4fe0-8846-5851834c306b admin admin] RBAC: Authorization granted {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:08:37.944522 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG dbcounter [-] [80396] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 16:08:37.953315 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 1101/2196] 10.222.0.59 () {60 vars in 1152 bytes} [Thu Jun 2 16:08:37 2022] POST /identity/v3/projects => generated 357 bytes in 129 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 16:08:37.953315 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b29e397-a2a4-401f-8a48-a49b9599fe3b admin admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:08:38.025267 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b29e397-a2a4-401f-8a48-a49b9599fe3b admin admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:08:38.031070 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b660480-4628-42ca-876f-8846ef6159d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f73d5a98be74242b45222df39fb6213', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:08:38.031679 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b660480-4628-42ca-876f-8846ef6159d4 admin admin] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:08:38.031965 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b660480-4628-42ca-876f-8846ef6159d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:08:38.032244 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b660480-4628-42ca-876f-8846ef6159d4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:08:38.032977 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b660480-4628-42ca-876f-8846ef6159d4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:08:38.034751 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b660480-4628-42ca-876f-8846ef6159d4 admin admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:08:38.046404 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 1102/2197] 10.222.0.59 () {58 vars in 1121 bytes} [Thu Jun 2 16:08:37 2022] GET /identity/v3/roles => generated 1420 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 16:08:38.051868 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b660480-4628-42ca-876f-8846ef6159d4 admin admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:08:38.056369 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b660480-4628-42ca-876f-8846ef6159d4 admin admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:08:38.061169 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db7a157e-87fc-4834-b662-7cc1b062ecc1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f73d5a98be74242b45222df39fb6213', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:08:38.061800 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7a157e-87fc-4834-b662-7cc1b062ecc1 admin admin] REQUEST_METHOD: `POST` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:08:38.062099 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7a157e-87fc-4834-b662-7cc1b062ecc1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:08:38.062387 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7a157e-87fc-4834-b662-7cc1b062ecc1 admin admin] PATH_INFO: `/v3/users` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:08:38.063064 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db7a157e-87fc-4834-b662-7cc1b062ecc1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:08:38.064984 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db7a157e-87fc-4834-b662-7cc1b062ecc1 admin admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:08:38.205855 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 1103/2198] 10.222.0.59 () {60 vars in 1143 bytes} [Thu Jun 2 16:08:38 2022] POST /identity/v3/users => generated 279 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 16:08:38.205855 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db7a157e-87fc-4834-b662-7cc1b062ecc1 admin admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:08:38.216229 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db7a157e-87fc-4834-b662-7cc1b062ecc1 admin admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:08:38.221784 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e9f6e05-4f98-4c05-8419-c721aaa608ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f73d5a98be74242b45222df39fb6213', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:08:38.223154 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9f6e05-4f98-4c05-8419-c721aaa608ba admin admin] REQUEST_METHOD: `PUT` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:08:38.223718 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9f6e05-4f98-4c05-8419-c721aaa608ba admin admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:08:38.223995 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9f6e05-4f98-4c05-8419-c721aaa608ba admin admin] PATH_INFO: `/v3/projects/735b0e28dfc44e4b9877f1264adb1849/users/ab03d9735d56498f817a30d6976e5c91/roles/f1e0c25f6e9049e897cb7350c7e54ab3` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:08:38.230740 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.notifications [None req-a73520b4-3590-4fe0-8846-5851834c306b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '38f9ef9081de4e8dac3baa12a69fe575'} {{(pid=80396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:08:38.231598 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.notifications [None req-a73520b4-3590-4fe0-8846-5851834c306b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '38f9ef9081de4e8dac3baa12a69fe575'} {{(pid=80396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:08:38.244124 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e9f6e05-4f98-4c05-8419-c721aaa608ba admin admin] RBAC: Authorizing `identity:create_grant(project_id=735b0e28dfc44e4b9877f1264adb1849, user_id=ab03d9735d56498f817a30d6976e5c91, role_id=f1e0c25f6e9049e897cb7350c7e54ab3)` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:08:38.255212 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e9f6e05-4f98-4c05-8419-c721aaa608ba admin admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:08:38.387409 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.notifications [None req-a73520b4-3590-4fe0-8846-5851834c306b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '38f9ef9081de4e8dac3baa12a69fe575'} {{(pid=80396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:08:38.408774 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.notifications [None req-a73520b4-3590-4fe0-8846-5851834c306b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '38f9ef9081de4e8dac3baa12a69fe575'} {{(pid=80396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:08:38.428846 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.notifications [None req-a73520b4-3590-4fe0-8846-5851834c306b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '38f9ef9081de4e8dac3baa12a69fe575'} {{(pid=80396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:08:38.435657 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 1096/2199] 10.222.0.59 () {58 vars in 1223 bytes} [Thu Jun 2 16:08:37 2022] DELETE /identity/v3/users/38f9ef9081de4e8dac3baa12a69fe575 => generated 0 bytes in 520 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 16:08:38.438659 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 1104/2200] 10.222.0.59 () {60 vars in 1482 bytes} [Thu Jun 2 16:08:38 2022] PUT /identity/v3/projects/735b0e28dfc44e4b9877f1264adb1849/users/ab03d9735d56498f817a30d6976e5c91/roles/f1e0c25f6e9049e897cb7350c7e54ab3 => generated 0 bytes in 233 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 16:08:38.438764 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a73520b4-3590-4fe0-8846-5851834c306b admin admin] Authenticating user token {{(pid=80396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:08:38.438764 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.fernet_utils [None req-a73520b4-3590-4fe0-8846-5851834c306b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:08:38.440097 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ea57d6-a4fb-4512-a055-5928df85ab53 None None] REQUEST_METHOD: `POST` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:08:38.440438 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ea57d6-a4fb-4512-a055-5928df85ab53 None None] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:08:38.440664 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ea57d6-a4fb-4512-a055-5928df85ab53 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:08:38.465769 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.auth.core [None req-11ea57d6-a4fb-4512-a055-5928df85ab53 None None] MFA Rules not processed for user `400d1f4db9de49638549e5db29a041e1`. Rule list: `[]` (Enabled: `True`). {{(pid=80395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 16:08:38.470181 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.fernet_utils [None req-11ea57d6-a4fb-4512-a055-5928df85ab53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:08:38.549992 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a73520b4-3590-4fe0-8846-5851834c306b admin admin] Validating token access rules against request {{(pid=80396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:08:38.569539 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47faae80-cce5-4d3d-9e1b-925266270d60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f73d5a98be74242b45222df39fb6213', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:08:38.570557 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47faae80-cce5-4d3d-9e1b-925266270d60 admin admin] REQUEST_METHOD: `GET` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:08:38.570557 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47faae80-cce5-4d3d-9e1b-925266270d60 admin admin] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:08:38.575734 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47faae80-cce5-4d3d-9e1b-925266270d60 admin admin] PATH_INFO: `/v3/roles` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:08:38.575734 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47faae80-cce5-4d3d-9e1b-925266270d60 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:08:38.575734 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47faae80-cce5-4d3d-9e1b-925266270d60 admin admin] RBAC: Authorization granted {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:08:38.586201 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 1097/2201] 10.222.0.59 () {58 vars in 1121 bytes} [Thu Jun 2 16:08:38 2022] GET /identity/v3/roles => generated 1420 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 16:08:38.587324 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47faae80-cce5-4d3d-9e1b-925266270d60 admin admin] Authenticating user token {{(pid=80396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:08:38.591068 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.fernet_utils [None req-47faae80-cce5-4d3d-9e1b-925266270d60 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:08:38.592941 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 1105/2202] 10.222.0.59 () {58 vars in 957 bytes} [Thu Jun 2 16:08:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 16:08:38.593830 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11ea57d6-a4fb-4512-a055-5928df85ab53 None None] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:08:38.603605 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11ea57d6-a4fb-4512-a055-5928df85ab53 None None] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:08:38.604642 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47faae80-cce5-4d3d-9e1b-925266270d60 admin admin] Validating token access rules against request {{(pid=80396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:08:38.608857 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1f7433b-6ef7-43df-b771-726a2bf45b64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f73d5a98be74242b45222df39fb6213', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:08:38.609488 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f7433b-6ef7-43df-b771-726a2bf45b64 admin admin] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:08:38.609874 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f7433b-6ef7-43df-b771-726a2bf45b64 admin admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:08:38.610260 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f7433b-6ef7-43df-b771-726a2bf45b64 admin admin] PATH_INFO: `/v3/roles` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:08:38.626436 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1f7433b-6ef7-43df-b771-726a2bf45b64 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:08:38.626581 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c542147d-5b8a-48e0-b4f6-0799a2212556 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f73d5a98be74242b45222df39fb6213', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:08:38.626581 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c542147d-5b8a-48e0-b4f6-0799a2212556 admin admin] REQUEST_METHOD: `GET` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:08:38.626581 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c542147d-5b8a-48e0-b4f6-0799a2212556 admin admin] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:08:38.626581 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c542147d-5b8a-48e0-b4f6-0799a2212556 admin admin] PATH_INFO: `/v3/roles` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:08:38.626883 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1f7433b-6ef7-43df-b771-726a2bf45b64 admin admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:08:38.626961 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c542147d-5b8a-48e0-b4f6-0799a2212556 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:08:38.626961 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c542147d-5b8a-48e0-b4f6-0799a2212556 admin admin] RBAC: Authorization granted {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:08:38.627099 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 1106/2203] 10.222.0.59 () {58 vars in 1121 bytes} [Thu Jun 2 16:08:38 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 16:08:38.627099 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1f7433b-6ef7-43df-b771-726a2bf45b64 admin admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:08:38.627250 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 1098/2204] 10.222.0.59 () {58 vars in 1121 bytes} [Thu Jun 2 16:08:38 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 16:08:38.631259 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c542147d-5b8a-48e0-b4f6-0799a2212556 admin admin] Authenticating user token {{(pid=80396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:08:38.634589 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.fernet_utils [None req-d1f7433b-6ef7-43df-b771-726a2bf45b64 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:08:38.640716 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c542147d-5b8a-48e0-b4f6-0799a2212556 admin admin] Validating token access rules against request {{(pid=80396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:08:38.659491 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b455a754-2d31-4116-85bd-46b45834d7a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f73d5a98be74242b45222df39fb6213', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:08:38.660544 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b455a754-2d31-4116-85bd-46b45834d7a5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:08:38.660812 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b455a754-2d31-4116-85bd-46b45834d7a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:08:38.661086 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b455a754-2d31-4116-85bd-46b45834d7a5 admin admin] PATH_INFO: `/v3/projects/45193ee53c3e4af6a1c8eafc86855a3c/users/3f98bffb59604efc9309e972406de55d/roles/649e0f2b5a264c419ea6a1441f123a03` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:08:38.669613 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 16:08:38.678572 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b455a754-2d31-4116-85bd-46b45834d7a5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=45193ee53c3e4af6a1c8eafc86855a3c, user_id=3f98bffb59604efc9309e972406de55d, role_id=649e0f2b5a264c419ea6a1441f123a03)` {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:08:38.681208 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b455a754-2d31-4116-85bd-46b45834d7a5 admin admin] RBAC: Authorization granted {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:08:38.703738 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1f7433b-6ef7-43df-b771-726a2bf45b64 admin admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:08:38.707635 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55e09154-78fc-4d85-aecd-123b7df58c08 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9af40ddfe9ff4be3887b068f13a28dc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c87c981909d4b8db02783421818c79b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:08:38.708409 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e09154-78fc-4d85-aecd-123b7df58c08 service neutron] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:08:38.708688 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e09154-78fc-4d85-aecd-123b7df58c08 service neutron] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:08:38.708965 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e09154-78fc-4d85-aecd-123b7df58c08 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:08:38.719414 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55e09154-78fc-4d85-aecd-123b7df58c08 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:08:38.721024 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55e09154-78fc-4d85-aecd-123b7df58c08 service neutron] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:08:38.733254 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 1107/2205] 10.222.0.59 () {60 vars in 1365 bytes} [Thu Jun 2 16:08:38 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 16:08:38.734147 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55e09154-78fc-4d85-aecd-123b7df58c08 service neutron] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:08:38.745173 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55e09154-78fc-4d85-aecd-123b7df58c08 service neutron] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:08:38.749891 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ba7ed32-faa9-4958-a81c-eee7eca4682b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f73d5a98be74242b45222df39fb6213', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:08:38.750801 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba7ed32-faa9-4958-a81c-eee7eca4682b admin admin] REQUEST_METHOD: `PUT` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:08:38.751080 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba7ed32-faa9-4958-a81c-eee7eca4682b admin admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:08:38.751352 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba7ed32-faa9-4958-a81c-eee7eca4682b admin admin] PATH_INFO: `/v3/projects/735b0e28dfc44e4b9877f1264adb1849/users/ab03d9735d56498f817a30d6976e5c91/roles/f1e0c25f6e9049e897cb7350c7e54ab3` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:08:38.753391 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ba7ed32-faa9-4958-a81c-eee7eca4682b admin admin] RBAC: Authorizing `identity:create_grant(project_id=735b0e28dfc44e4b9877f1264adb1849, user_id=ab03d9735d56498f817a30d6976e5c91, role_id=f1e0c25f6e9049e897cb7350c7e54ab3)` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:08:38.755973 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ba7ed32-faa9-4958-a81c-eee7eca4682b admin admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:08:38.767239 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 1108/2206] 10.222.0.59 () {60 vars in 1482 bytes} [Thu Jun 2 16:08:38 2022] PUT /identity/v3/projects/735b0e28dfc44e4b9877f1264adb1849/users/ab03d9735d56498f817a30d6976e5c91/roles/f1e0c25f6e9049e897cb7350c7e54ab3 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 16:08:38.783045 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7027ab-ff2f-4ff7-9fa0-72fbe08783a7 None None] REQUEST_METHOD: `POST` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:08:38.783411 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7027ab-ff2f-4ff7-9fa0-72fbe08783a7 None None] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:08:38.783607 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7027ab-ff2f-4ff7-9fa0-72fbe08783a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:08:38.790281 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 1099/2207] 10.222.0.59 () {60 vars in 1482 bytes} [Thu Jun 2 16:08:38 2022] PUT /identity/v3/projects/45193ee53c3e4af6a1c8eafc86855a3c/users/3f98bffb59604efc9309e972406de55d/roles/649e0f2b5a264c419ea6a1441f123a03 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 02 16:08:38.801543 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-936e043f-09b3-487f-b3c9-943140223838 None None] REQUEST_METHOD: `POST` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:08:38.802811 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-936e043f-09b3-487f-b3c9-943140223838 None None] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:08:38.802811 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-936e043f-09b3-487f-b3c9-943140223838 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:08:38.851424 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.auth.core [None req-de7027ab-ff2f-4ff7-9fa0-72fbe08783a7 None None] MFA Rules not processed for user `ab03d9735d56498f817a30d6976e5c91`. Rule list: `[]` (Enabled: `True`). {{(pid=80395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 16:08:38.852682 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.fernet_utils [None req-de7027ab-ff2f-4ff7-9fa0-72fbe08783a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:08:38.870880 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.auth.core [None req-936e043f-09b3-487f-b3c9-943140223838 None None] MFA Rules not processed for user `3f98bffb59604efc9309e972406de55d`. Rule list: `[]` (Enabled: `True`). {{(pid=80396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 16:08:38.872741 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.fernet_utils [None req-936e043f-09b3-487f-b3c9-943140223838 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:08:38.913382 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG dbcounter [-] [80396] Writing DB stats keystone:INSERT=4,keystone:SELECT=86,keystone:DELETE=10 {{(pid=80396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 16:08:38.929286 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 16:08:38.999153 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 1109/2208] 10.222.0.59 () {58 vars in 957 bytes} [Thu Jun 2 16:08:38 2022] POST /identity/v3/auth/tokens => generated 3301 bytes in 214 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 16:08:38.999368 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 1100/2209] 10.222.0.59 () {58 vars in 957 bytes} [Thu Jun 2 16:08:38 2022] POST /identity/v3/auth/tokens => generated 3224 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 02 16:08:39.015165 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de7027ab-ff2f-4ff7-9fa0-72fbe08783a7 None None] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:08:39.018253 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.fernet_utils [None req-de7027ab-ff2f-4ff7-9fa0-72fbe08783a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:08:39.040892 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-936e043f-09b3-487f-b3c9-943140223838 None None] Authenticating user token {{(pid=80396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:08:39.043577 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.fernet_utils [None req-936e043f-09b3-487f-b3c9-943140223838 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:08:39.153809 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de7027ab-ff2f-4ff7-9fa0-72fbe08783a7 None None] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:08:39.158526 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-296ecb8f-f8bf-4a40-9d76-af2539ff1f3c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6534961c369940a5b88f310c6450250b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c87c981909d4b8db02783421818c79b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:08:39.171440 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-936e043f-09b3-487f-b3c9-943140223838 None None] Validating token access rules against request {{(pid=80396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:08:39.171613 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296ecb8f-f8bf-4a40-9d76-af2539ff1f3c service cinder] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:08:39.171613 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296ecb8f-f8bf-4a40-9d76-af2539ff1f3c service cinder] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:08:39.171613 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296ecb8f-f8bf-4a40-9d76-af2539ff1f3c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:08:39.171850 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5d8daa0-be8c-4ab4-9f82-63b9a18f015b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6534961c369940a5b88f310c6450250b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c87c981909d4b8db02783421818c79b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:08:39.171850 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d8daa0-be8c-4ab4-9f82-63b9a18f015b service cinder] REQUEST_METHOD: `GET` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:08:39.171850 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d8daa0-be8c-4ab4-9f82-63b9a18f015b service cinder] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:08:39.171850 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d8daa0-be8c-4ab4-9f82-63b9a18f015b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:08:39.181069 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5d8daa0-be8c-4ab4-9f82-63b9a18f015b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:08:39.182903 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5d8daa0-be8c-4ab4-9f82-63b9a18f015b service cinder] RBAC: Authorization granted {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:08:39.184002 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-296ecb8f-f8bf-4a40-9d76-af2539ff1f3c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:08:39.195496 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-296ecb8f-f8bf-4a40-9d76-af2539ff1f3c service cinder] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:08:39.214324 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 1101/2210] 10.222.0.59 () {60 vars in 1365 bytes} [Thu Jun 2 16:08:39 2022] GET /identity/v3/auth/tokens => generated 3224 bytes in 174 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 02 16:08:39.229110 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5d8daa0-be8c-4ab4-9f82-63b9a18f015b service cinder] Authenticating user token {{(pid=80396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:08:39.230407 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 1110/2211] 10.222.0.59 () {60 vars in 1365 bytes} [Thu Jun 2 16:08:39 2022] GET /identity/v3/auth/tokens => generated 3301 bytes in 216 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 16:08:39.265425 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 16:08:39.384149 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5d8daa0-be8c-4ab4-9f82-63b9a18f015b service cinder] Validating token access rules against request {{(pid=80396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:08:39.390116 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5b5a3bb-62ff-4617-bc36-60b34787d32c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f73d5a98be74242b45222df39fb6213', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:08:39.391005 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b5a3bb-62ff-4617-bc36-60b34787d32c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:08:39.391319 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b5a3bb-62ff-4617-bc36-60b34787d32c admin admin] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:08:39.391604 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b5a3bb-62ff-4617-bc36-60b34787d32c admin admin] PATH_INFO: `/v3/users/3f98bffb59604efc9309e972406de55d` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:08:39.392842 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5b5a3bb-62ff-4617-bc36-60b34787d32c admin admin] RBAC: Authorizing `identity:delete_user(user_id=3f98bffb59604efc9309e972406de55d)` {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:08:39.394782 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5b5a3bb-62ff-4617-bc36-60b34787d32c admin admin] RBAC: Authorization granted {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:08:39.437435 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-296ecb8f-f8bf-4a40-9d76-af2539ff1f3c service cinder] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:08:39.456573 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-296ecb8f-f8bf-4a40-9d76-af2539ff1f3c service cinder] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:08:39.456573 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb25f4d0-5481-4ba9-baff-c837f377896a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6534961c369940a5b88f310c6450250b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c87c981909d4b8db02783421818c79b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:08:39.456573 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb25f4d0-5481-4ba9-baff-c837f377896a service cinder] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:08:39.456573 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb25f4d0-5481-4ba9-baff-c837f377896a service cinder] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:08:39.456948 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb25f4d0-5481-4ba9-baff-c837f377896a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:08:39.458725 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.fernet_utils [None req-cb25f4d0-5481-4ba9-baff-c837f377896a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:08:39.565493 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb25f4d0-5481-4ba9-baff-c837f377896a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:08:39.568482 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb25f4d0-5481-4ba9-baff-c837f377896a service cinder] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:08:39.592162 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 1111/2212] 10.222.0.59 () {60 vars in 1365 bytes} [Thu Jun 2 16:08:39 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 155 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 16:08:39.592959 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb25f4d0-5481-4ba9-baff-c837f377896a service cinder] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:08:39.594428 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.fernet_utils [None req-cb25f4d0-5481-4ba9-baff-c837f377896a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:08:39.620334 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb25f4d0-5481-4ba9-baff-c837f377896a service cinder] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:08:39.626878 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a51546cc-4b13-4dfc-afeb-4d644e8b001e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f73d5a98be74242b45222df39fb6213', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:08:39.627895 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51546cc-4b13-4dfc-afeb-4d644e8b001e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:08:39.628154 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51546cc-4b13-4dfc-afeb-4d644e8b001e admin admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:08:39.628376 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51546cc-4b13-4dfc-afeb-4d644e8b001e admin admin] PATH_INFO: `/v3/projects/ae27b08b0e654bf29d7168dd6e4e3b06` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:08:39.630714 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a51546cc-4b13-4dfc-afeb-4d644e8b001e admin admin] RBAC: Authorizing `identity:delete_project(project_id=ae27b08b0e654bf29d7168dd6e4e3b06)` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:08:39.632606 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a51546cc-4b13-4dfc-afeb-4d644e8b001e admin admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:08:39.655892 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.notifications [None req-a5b5a3bb-62ff-4617-bc36-60b34787d32c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3f98bffb59604efc9309e972406de55d'} {{(pid=80396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:08:39.657045 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.notifications [None req-a5b5a3bb-62ff-4617-bc36-60b34787d32c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3f98bffb59604efc9309e972406de55d'} {{(pid=80396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:08:39.794084 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.notifications [None req-a51546cc-4b13-4dfc-afeb-4d644e8b001e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ae27b08b0e654bf29d7168dd6e4e3b06', 'request_id': 'req-a51546cc-4b13-4dfc-afeb-4d644e8b001e'} {{(pid=80395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:08:39.799098 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.notifications [None req-a51546cc-4b13-4dfc-afeb-4d644e8b001e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ae27b08b0e654bf29d7168dd6e4e3b06', 'request_id': 'req-a51546cc-4b13-4dfc-afeb-4d644e8b001e'} {{(pid=80395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:08:39.804834 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.notifications [None req-a5b5a3bb-62ff-4617-bc36-60b34787d32c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3f98bffb59604efc9309e972406de55d'} {{(pid=80396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:08:39.811960 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG dbcounter [-] [80396] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=80396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 16:08:39.821245 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.notifications [None req-a5b5a3bb-62ff-4617-bc36-60b34787d32c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3f98bffb59604efc9309e972406de55d'} {{(pid=80396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:08:39.830050 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.notifications [None req-a5b5a3bb-62ff-4617-bc36-60b34787d32c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3f98bffb59604efc9309e972406de55d'} {{(pid=80396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:08:39.842463 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 1102/2213] 10.222.0.59 () {58 vars in 1223 bytes} [Thu Jun 2 16:08:39 2022] DELETE /identity/v3/users/3f98bffb59604efc9309e972406de55d => generated 0 bytes in 622 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 16:08:39.843999 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50aa18d4-2add-439c-b822-353671aa7cde None None] REQUEST_METHOD: `POST` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:08:39.844306 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50aa18d4-2add-439c-b822-353671aa7cde None None] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:08:39.844586 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50aa18d4-2add-439c-b822-353671aa7cde None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:08:39.862613 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.auth.core [None req-50aa18d4-2add-439c-b822-353671aa7cde None None] MFA Rules not processed for user `400d1f4db9de49638549e5db29a041e1`. Rule list: `[]` (Enabled: `True`). {{(pid=80396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 16:08:39.863814 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.fernet_utils [None req-50aa18d4-2add-439c-b822-353671aa7cde None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:08:39.927672 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.notifications [None req-a51546cc-4b13-4dfc-afeb-4d644e8b001e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ae27b08b0e654bf29d7168dd6e4e3b06', 'request_id': 'req-a51546cc-4b13-4dfc-afeb-4d644e8b001e'} {{(pid=80395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:08:39.930215 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 1103/2214] 10.222.0.59 () {58 vars in 957 bytes} [Thu Jun 2 16:08:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 16:08:39.940855 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50aa18d4-2add-439c-b822-353671aa7cde None None] Authenticating user token {{(pid=80396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:08:39.942427 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.fernet_utils [None req-50aa18d4-2add-439c-b822-353671aa7cde None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:08:39.951476 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.notifications [None req-a51546cc-4b13-4dfc-afeb-4d644e8b001e admin admin] The token cache is being invalidate because project ae27b08b0e654bf29d7168dd6e4e3b06 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80395) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 02 16:08:39.952168 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.notifications [None req-a51546cc-4b13-4dfc-afeb-4d644e8b001e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:08:39.953179 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.notifications [None req-a51546cc-4b13-4dfc-afeb-4d644e8b001e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:08:39.955299 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 1112/2215] 10.222.0.59 () {58 vars in 1232 bytes} [Thu Jun 2 16:08:39 2022] DELETE /identity/v3/projects/ae27b08b0e654bf29d7168dd6e4e3b06 => generated 0 bytes in 363 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 16:08:39.964076 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49cdacb-b08c-4adb-82b0-1c159c608186 None None] REQUEST_METHOD: `POST` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:08:39.964470 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49cdacb-b08c-4adb-82b0-1c159c608186 None None] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:08:39.964802 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49cdacb-b08c-4adb-82b0-1c159c608186 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:08:40.011909 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.auth.core [None req-f49cdacb-b08c-4adb-82b0-1c159c608186 None None] MFA Rules not processed for user `400d1f4db9de49638549e5db29a041e1`. Rule list: `[]` (Enabled: `True`). {{(pid=80395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 16:08:40.017431 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.fernet_utils [None req-f49cdacb-b08c-4adb-82b0-1c159c608186 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:08:40.020568 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50aa18d4-2add-439c-b822-353671aa7cde None None] Validating token access rules against request {{(pid=80396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:08:40.021469 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 1113/2216] 10.222.0.59 () {58 vars in 957 bytes} [Thu Jun 2 16:08:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 62 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 16:08:40.024692 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaa49a83-ebd9-4c69-ade3-173d182db6d7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9af40ddfe9ff4be3887b068f13a28dc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c87c981909d4b8db02783421818c79b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:08:40.025347 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa49a83-ebd9-4c69-ade3-173d182db6d7 service neutron] REQUEST_METHOD: `GET` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:08:40.026512 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa49a83-ebd9-4c69-ade3-173d182db6d7 service neutron] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:08:40.026854 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa49a83-ebd9-4c69-ade3-173d182db6d7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:08:40.030043 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a02483c-1a2c-4580-a66d-904417c78a8d None None] REQUEST_METHOD: `POST` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:08:40.030404 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a02483c-1a2c-4580-a66d-904417c78a8d None None] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:08:40.030685 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a02483c-1a2c-4580-a66d-904417c78a8d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:08:40.032577 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.fernet_utils [None req-aaa49a83-ebd9-4c69-ade3-173d182db6d7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:08:40.063586 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.auth.core [None req-4a02483c-1a2c-4580-a66d-904417c78a8d None None] MFA Rules not processed for user `400d1f4db9de49638549e5db29a041e1`. Rule list: `[]` (Enabled: `True`). {{(pid=80395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 16:08:40.063586 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.fernet_utils [None req-4a02483c-1a2c-4580-a66d-904417c78a8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:08:40.063829 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaa49a83-ebd9-4c69-ade3-173d182db6d7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:08:40.063829 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaa49a83-ebd9-4c69-ade3-173d182db6d7 service neutron] RBAC: Authorization granted {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:08:40.066672 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 1114/2217] 10.222.0.59 () {58 vars in 957 bytes} [Thu Jun 2 16:08:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 02 16:08:40.079583 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a02483c-1a2c-4580-a66d-904417c78a8d None None] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:08:40.089740 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a02483c-1a2c-4580-a66d-904417c78a8d None None] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:08:40.096742 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 1104/2218] 10.222.0.59 () {60 vars in 1365 bytes} [Thu Jun 2 16:08:39 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 156 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 02 16:08:40.107166 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6404593-3d9b-49b2-96bb-89cf3d660ae4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f73d5a98be74242b45222df39fb6213', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:08:40.108232 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6404593-3d9b-49b2-96bb-89cf3d660ae4 admin admin] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:08:40.108755 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6404593-3d9b-49b2-96bb-89cf3d660ae4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:08:40.109296 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6404593-3d9b-49b2-96bb-89cf3d660ae4 admin admin] PATH_INFO: `/v3/domains` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:08:40.110389 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6404593-3d9b-49b2-96bb-89cf3d660ae4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80395) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 16:08:40.111234 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6404593-3d9b-49b2-96bb-89cf3d660ae4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:08:40.126933 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6404593-3d9b-49b2-96bb-89cf3d660ae4 admin admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:08:40.141843 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 1115/2219] 10.222.0.59 () {58 vars in 1152 bytes} [Thu Jun 2 16:08:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 16:08:40.146669 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaa49a83-ebd9-4c69-ade3-173d182db6d7 service neutron] Authenticating user token {{(pid=80396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:08:40.165848 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaa49a83-ebd9-4c69-ade3-173d182db6d7 service neutron] Validating token access rules against request {{(pid=80396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:08:40.179928 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b88612a8-a36b-441a-b24f-6f4c997b838c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f73d5a98be74242b45222df39fb6213', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:08:40.180683 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b88612a8-a36b-441a-b24f-6f4c997b838c admin admin] REQUEST_METHOD: `POST` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:08:40.181038 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b88612a8-a36b-441a-b24f-6f4c997b838c admin admin] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:08:40.181383 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b88612a8-a36b-441a-b24f-6f4c997b838c admin admin] PATH_INFO: `/v3/projects` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:08:40.182309 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b88612a8-a36b-441a-b24f-6f4c997b838c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:08:40.184328 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b88612a8-a36b-441a-b24f-6f4c997b838c admin admin] RBAC: Authorization granted {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:08:40.331000 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 1105/2220] 10.222.0.59 () {60 vars in 1152 bytes} [Thu Jun 2 16:08:40 2022] POST /identity/v3/projects => generated 389 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 16:08:40.335582 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6404593-3d9b-49b2-96bb-89cf3d660ae4 admin admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:08:40.347631 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6404593-3d9b-49b2-96bb-89cf3d660ae4 admin admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:08:40.440223 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 16:08:40.467147 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0140eb37-f2a8-4c67-82cf-bfa66ae2e740 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f73d5a98be74242b45222df39fb6213', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:08:40.467938 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0140eb37-f2a8-4c67-82cf-bfa66ae2e740 admin admin] REQUEST_METHOD: `POST` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:08:40.468345 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0140eb37-f2a8-4c67-82cf-bfa66ae2e740 admin admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:08:40.469005 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0140eb37-f2a8-4c67-82cf-bfa66ae2e740 admin admin] PATH_INFO: `/v3/users` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:08:40.469854 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0140eb37-f2a8-4c67-82cf-bfa66ae2e740 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:08:40.478770 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0140eb37-f2a8-4c67-82cf-bfa66ae2e740 admin admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:08:40.604382 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 1116/2221] 10.222.0.59 () {60 vars in 1143 bytes} [Thu Jun 2 16:08:40 2022] POST /identity/v3/users => generated 295 bytes in 269 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 16:08:40.608941 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b88612a8-a36b-441a-b24f-6f4c997b838c admin admin] Authenticating user token {{(pid=80396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:08:40.624256 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b88612a8-a36b-441a-b24f-6f4c997b838c admin admin] Validating token access rules against request {{(pid=80396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:08:40.629775 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f779eccb-b4cc-4c42-941c-41aca5163a94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f73d5a98be74242b45222df39fb6213', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:08:40.630495 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f779eccb-b4cc-4c42-941c-41aca5163a94 admin admin] REQUEST_METHOD: `GET` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:08:40.630892 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f779eccb-b4cc-4c42-941c-41aca5163a94 admin admin] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:08:40.631074 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f779eccb-b4cc-4c42-941c-41aca5163a94 admin admin] PATH_INFO: `/v3/roles` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:08:40.631788 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f779eccb-b4cc-4c42-941c-41aca5163a94 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:08:40.633561 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f779eccb-b4cc-4c42-941c-41aca5163a94 admin admin] RBAC: Authorization granted {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:08:40.663060 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 1106/2222] 10.222.0.59 () {58 vars in 1121 bytes} [Thu Jun 2 16:08:40 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 02 16:08:40.664889 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0140eb37-f2a8-4c67-82cf-bfa66ae2e740 admin admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:08:40.691140 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0140eb37-f2a8-4c67-82cf-bfa66ae2e740 admin admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:08:40.704227 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-713ed2af-bbfb-479b-aeb4-fe5801cdb702 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f73d5a98be74242b45222df39fb6213', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:08:40.704925 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713ed2af-bbfb-479b-aeb4-fe5801cdb702 admin admin] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:08:40.705210 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713ed2af-bbfb-479b-aeb4-fe5801cdb702 admin admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:08:40.705490 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713ed2af-bbfb-479b-aeb4-fe5801cdb702 admin admin] PATH_INFO: `/v3/roles` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:08:40.706262 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-713ed2af-bbfb-479b-aeb4-fe5801cdb702 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:08:40.709285 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-713ed2af-bbfb-479b-aeb4-fe5801cdb702 admin admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:08:40.730168 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f779eccb-b4cc-4c42-941c-41aca5163a94 admin admin] Authenticating user token {{(pid=80396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:08:40.734823 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 1117/2223] 10.222.0.59 () {58 vars in 1121 bytes} [Thu Jun 2 16:08:40 2022] GET /identity/v3/roles => generated 1420 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 16:08:40.734955 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.fernet_utils [None req-f779eccb-b4cc-4c42-941c-41aca5163a94 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:08:40.737601 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-713ed2af-bbfb-479b-aeb4-fe5801cdb702 admin admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:08:40.752818 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f779eccb-b4cc-4c42-941c-41aca5163a94 admin admin] Validating token access rules against request {{(pid=80396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:08:40.761420 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-713ed2af-bbfb-479b-aeb4-fe5801cdb702 admin admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:08:40.763996 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-632dfe44-0804-45fd-80ae-783ec31f48cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f73d5a98be74242b45222df39fb6213', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:08:40.768533 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-632dfe44-0804-45fd-80ae-783ec31f48cc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:08:40.768533 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-632dfe44-0804-45fd-80ae-783ec31f48cc admin admin] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:08:40.768533 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-632dfe44-0804-45fd-80ae-783ec31f48cc admin admin] PATH_INFO: `/v3/projects/45193ee53c3e4af6a1c8eafc86855a3c` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:08:40.768533 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-632dfe44-0804-45fd-80ae-783ec31f48cc admin admin] RBAC: Authorizing `identity:delete_project(project_id=45193ee53c3e4af6a1c8eafc86855a3c)` {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:08:40.770494 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-632dfe44-0804-45fd-80ae-783ec31f48cc admin admin] RBAC: Authorization granted {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:08:40.793578 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dd6e955-015a-4c03-8f59-cbbeb3f8c03b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f73d5a98be74242b45222df39fb6213', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:08:40.801333 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd6e955-015a-4c03-8f59-cbbeb3f8c03b admin admin] REQUEST_METHOD: `PUT` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:08:40.801333 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd6e955-015a-4c03-8f59-cbbeb3f8c03b admin admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:08:40.801333 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd6e955-015a-4c03-8f59-cbbeb3f8c03b admin admin] PATH_INFO: `/v3/projects/cd455e3c8f5446d2b10bdf1c1e460a87/users/d15b0fa025674425b20b4383b1b8ec54/roles/649e0f2b5a264c419ea6a1441f123a03` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:08:40.849362 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dd6e955-015a-4c03-8f59-cbbeb3f8c03b admin admin] RBAC: Authorizing `identity:create_grant(project_id=cd455e3c8f5446d2b10bdf1c1e460a87, user_id=d15b0fa025674425b20b4383b1b8ec54, role_id=649e0f2b5a264c419ea6a1441f123a03)` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:08:40.852792 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dd6e955-015a-4c03-8f59-cbbeb3f8c03b admin admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:08:41.026124 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 1118/2224] 10.222.0.59 () {60 vars in 1482 bytes} [Thu Jun 2 16:08:40 2022] PUT /identity/v3/projects/cd455e3c8f5446d2b10bdf1c1e460a87/users/d15b0fa025674425b20b4383b1b8ec54/roles/649e0f2b5a264c419ea6a1441f123a03 => generated 0 bytes in 284 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 16:08:41.032111 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f995c92-5590-4aff-9279-1534bcda4af8 None None] REQUEST_METHOD: `POST` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:08:41.032389 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f995c92-5590-4aff-9279-1534bcda4af8 None None] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:08:41.032668 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f995c92-5590-4aff-9279-1534bcda4af8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:08:41.033562 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG dbcounter [-] [80396] Writing DB stats keystone:DELETE=5,keystone:SELECT=94,keystone:INSERT=1 {{(pid=80396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 16:08:41.041031 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.notifications [None req-632dfe44-0804-45fd-80ae-783ec31f48cc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '45193ee53c3e4af6a1c8eafc86855a3c', 'request_id': 'req-632dfe44-0804-45fd-80ae-783ec31f48cc'} {{(pid=80396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:08:41.048382 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.notifications [None req-632dfe44-0804-45fd-80ae-783ec31f48cc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '45193ee53c3e4af6a1c8eafc86855a3c', 'request_id': 'req-632dfe44-0804-45fd-80ae-783ec31f48cc'} {{(pid=80396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:08:41.066184 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.auth.core [None req-4f995c92-5590-4aff-9279-1534bcda4af8 None None] MFA Rules not processed for user `d15b0fa025674425b20b4383b1b8ec54`. Rule list: `[]` (Enabled: `True`). {{(pid=80395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 16:08:41.067391 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.fernet_utils [None req-4f995c92-5590-4aff-9279-1534bcda4af8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:08:41.134588 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 1119/2225] 10.222.0.59 () {58 vars in 957 bytes} [Thu Jun 2 16:08:41 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 16:08:41.145715 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f995c92-5590-4aff-9279-1534bcda4af8 None None] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:08:41.147080 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.fernet_utils [None req-4f995c92-5590-4aff-9279-1534bcda4af8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:08:41.156002 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.notifications [None req-632dfe44-0804-45fd-80ae-783ec31f48cc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '45193ee53c3e4af6a1c8eafc86855a3c', 'request_id': 'req-632dfe44-0804-45fd-80ae-783ec31f48cc'} {{(pid=80396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:08:41.168692 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.notifications [None req-632dfe44-0804-45fd-80ae-783ec31f48cc admin admin] The token cache is being invalidate because project 45193ee53c3e4af6a1c8eafc86855a3c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80396) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 02 16:08:41.168991 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.notifications [None req-632dfe44-0804-45fd-80ae-783ec31f48cc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:08:41.169630 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.notifications [None req-632dfe44-0804-45fd-80ae-783ec31f48cc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:08:41.171493 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 1107/2226] 10.222.0.59 () {58 vars in 1232 bytes} [Thu Jun 2 16:08:40 2022] DELETE /identity/v3/projects/45193ee53c3e4af6a1c8eafc86855a3c => generated 0 bytes in 442 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 02 16:08:41.177161 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa02400-9ea7-4f12-a8f0-58acb5def040 None None] REQUEST_METHOD: `POST` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:08:41.177320 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa02400-9ea7-4f12-a8f0-58acb5def040 None None] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:08:41.177574 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa02400-9ea7-4f12-a8f0-58acb5def040 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:08:41.198741 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.auth.core [None req-cfa02400-9ea7-4f12-a8f0-58acb5def040 None None] MFA Rules not processed for user `400d1f4db9de49638549e5db29a041e1`. Rule list: `[]` (Enabled: `True`). {{(pid=80396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 16:08:41.200020 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.fernet_utils [None req-cfa02400-9ea7-4f12-a8f0-58acb5def040 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:08:41.215072 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f995c92-5590-4aff-9279-1534bcda4af8 None None] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:08:41.218603 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-769d3f03-b569-40fb-b2f1-27ba41d2f253 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6534961c369940a5b88f310c6450250b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c87c981909d4b8db02783421818c79b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:08:41.219315 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769d3f03-b569-40fb-b2f1-27ba41d2f253 service cinder] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:08:41.219662 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769d3f03-b569-40fb-b2f1-27ba41d2f253 service cinder] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:08:41.219999 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769d3f03-b569-40fb-b2f1-27ba41d2f253 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:08:41.221888 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.fernet_utils [None req-769d3f03-b569-40fb-b2f1-27ba41d2f253 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:08:41.233638 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-769d3f03-b569-40fb-b2f1-27ba41d2f253 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:08:41.235267 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-769d3f03-b569-40fb-b2f1-27ba41d2f253 service cinder] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:08:41.244421 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 1120/2227] 10.222.0.59 () {60 vars in 1365 bytes} [Thu Jun 2 16:08:41 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 02 16:08:41.267076 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 1108/2228] 10.222.0.59 () {58 vars in 957 bytes} [Thu Jun 2 16:08:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 02 16:08:41.271942 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1cc8201-0ee3-49bb-b90d-58e7e9fc9eeb None None] REQUEST_METHOD: `POST` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:08:41.272267 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1cc8201-0ee3-49bb-b90d-58e7e9fc9eeb None None] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:08:41.272553 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1cc8201-0ee3-49bb-b90d-58e7e9fc9eeb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:08:41.294259 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.auth.core [None req-d1cc8201-0ee3-49bb-b90d-58e7e9fc9eeb None None] MFA Rules not processed for user `400d1f4db9de49638549e5db29a041e1`. Rule list: `[]` (Enabled: `True`). {{(pid=80395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 16:08:41.295906 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.fernet_utils [None req-d1cc8201-0ee3-49bb-b90d-58e7e9fc9eeb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:08:41.304680 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 1121/2229] 10.222.0.59 () {58 vars in 957 bytes} [Thu Jun 2 16:08:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 16:08:41.308990 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfa02400-9ea7-4f12-a8f0-58acb5def040 None None] Authenticating user token {{(pid=80396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:08:41.318767 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfa02400-9ea7-4f12-a8f0-58acb5def040 None None] Validating token access rules against request {{(pid=80396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:08:41.324071 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d4dfca-7304-47b2-8557-d3deb065b8d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f73d5a98be74242b45222df39fb6213', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:08:41.330194 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d4dfca-7304-47b2-8557-d3deb065b8d2 admin admin] REQUEST_METHOD: `GET` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:08:41.330194 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d4dfca-7304-47b2-8557-d3deb065b8d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:08:41.330194 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d4dfca-7304-47b2-8557-d3deb065b8d2 admin admin] PATH_INFO: `/v3/domains` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:08:41.330194 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63d4dfca-7304-47b2-8557-d3deb065b8d2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80396) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 16:08:41.330194 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63d4dfca-7304-47b2-8557-d3deb065b8d2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:08:41.330194 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63d4dfca-7304-47b2-8557-d3deb065b8d2 admin admin] RBAC: Authorization granted {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:08:41.344236 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 1109/2230] 10.222.0.59 () {58 vars in 1152 bytes} [Thu Jun 2 16:08:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 16:08:41.345448 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1cc8201-0ee3-49bb-b90d-58e7e9fc9eeb None None] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:08:41.356253 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1cc8201-0ee3-49bb-b90d-58e7e9fc9eeb None None] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:08:41.361522 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0b8ad13-4606-4a24-8f74-2ee1350c0499 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f73d5a98be74242b45222df39fb6213', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:08:41.362311 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b8ad13-4606-4a24-8f74-2ee1350c0499 admin admin] REQUEST_METHOD: `POST` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:08:41.362653 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b8ad13-4606-4a24-8f74-2ee1350c0499 admin admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:08:41.362986 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b8ad13-4606-4a24-8f74-2ee1350c0499 admin admin] PATH_INFO: `/v3/projects` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:08:41.363749 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0b8ad13-4606-4a24-8f74-2ee1350c0499 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:08:41.365844 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0b8ad13-4606-4a24-8f74-2ee1350c0499 admin admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:08:41.380929 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 16:08:41.521456 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 1122/2231] 10.222.0.59 () {60 vars in 1152 bytes} [Thu Jun 2 16:08:41 2022] POST /identity/v3/projects => generated 369 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 16:08:41.522565 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d4dfca-7304-47b2-8557-d3deb065b8d2 admin admin] Authenticating user token {{(pid=80396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:08:41.533726 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d4dfca-7304-47b2-8557-d3deb065b8d2 admin admin] Validating token access rules against request {{(pid=80396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:08:41.590535 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebd7ad74-8766-41a7-b7ba-6a11fb591a30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f73d5a98be74242b45222df39fb6213', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:08:41.591196 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd7ad74-8766-41a7-b7ba-6a11fb591a30 admin admin] REQUEST_METHOD: `POST` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:08:41.591479 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd7ad74-8766-41a7-b7ba-6a11fb591a30 admin admin] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:08:41.591755 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd7ad74-8766-41a7-b7ba-6a11fb591a30 admin admin] PATH_INFO: `/v3/users` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:08:41.592559 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebd7ad74-8766-41a7-b7ba-6a11fb591a30 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:08:41.594532 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebd7ad74-8766-41a7-b7ba-6a11fb591a30 admin admin] RBAC: Authorization granted {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:08:41.696245 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 1110/2232] 10.222.0.59 () {60 vars in 1143 bytes} [Thu Jun 2 16:08:41 2022] POST /identity/v3/users => generated 285 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 02 16:08:41.698408 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0b8ad13-4606-4a24-8f74-2ee1350c0499 admin admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:08:41.712142 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0b8ad13-4606-4a24-8f74-2ee1350c0499 admin admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:08:41.717596 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57bd3d3d-9424-46f1-afaa-dc706fe4d0f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f73d5a98be74242b45222df39fb6213', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:08:41.718299 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57bd3d3d-9424-46f1-afaa-dc706fe4d0f6 admin admin] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:08:41.718586 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57bd3d3d-9424-46f1-afaa-dc706fe4d0f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:08:41.718866 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57bd3d3d-9424-46f1-afaa-dc706fe4d0f6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:08:41.719655 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57bd3d3d-9424-46f1-afaa-dc706fe4d0f6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:08:41.721577 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57bd3d3d-9424-46f1-afaa-dc706fe4d0f6 admin admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:08:41.733359 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 1123/2233] 10.222.0.59 () {58 vars in 1121 bytes} [Thu Jun 2 16:08:41 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 16:08:41.746281 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebd7ad74-8766-41a7-b7ba-6a11fb591a30 admin admin] Authenticating user token {{(pid=80396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:08:41.748337 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebd7ad74-8766-41a7-b7ba-6a11fb591a30 admin admin] Validating token access rules against request {{(pid=80396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:08:41.753379 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57037fc2-cfc1-47d4-8d96-264738104e5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f73d5a98be74242b45222df39fb6213', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:08:41.754061 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57037fc2-cfc1-47d4-8d96-264738104e5b admin admin] REQUEST_METHOD: `GET` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:08:41.754483 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57037fc2-cfc1-47d4-8d96-264738104e5b admin admin] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:08:41.754769 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57037fc2-cfc1-47d4-8d96-264738104e5b admin admin] PATH_INFO: `/v3/roles` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:08:41.755504 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57037fc2-cfc1-47d4-8d96-264738104e5b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:08:41.757097 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57037fc2-cfc1-47d4-8d96-264738104e5b admin admin] RBAC: Authorization granted {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:08:41.769622 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 1111/2234] 10.222.0.59 () {58 vars in 1121 bytes} [Thu Jun 2 16:08:41 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 16:08:41.773668 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57bd3d3d-9424-46f1-afaa-dc706fe4d0f6 admin admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:08:41.784540 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57bd3d3d-9424-46f1-afaa-dc706fe4d0f6 admin admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:08:41.789455 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f9542ec-6755-4ea2-95ee-d36f09a41857 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f73d5a98be74242b45222df39fb6213', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:08:41.790431 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f9542ec-6755-4ea2-95ee-d36f09a41857 admin admin] REQUEST_METHOD: `PUT` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:08:41.790718 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f9542ec-6755-4ea2-95ee-d36f09a41857 admin admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:08:41.791000 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f9542ec-6755-4ea2-95ee-d36f09a41857 admin admin] PATH_INFO: `/v3/projects/39083e40d5cf4d1ea0bc63c8515bf11a/users/1bd07b1ffc3f40dd95840d636e41a70e/roles/649e0f2b5a264c419ea6a1441f123a03` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:08:41.806917 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f9542ec-6755-4ea2-95ee-d36f09a41857 admin admin] RBAC: Authorizing `identity:create_grant(project_id=39083e40d5cf4d1ea0bc63c8515bf11a, user_id=1bd07b1ffc3f40dd95840d636e41a70e, role_id=649e0f2b5a264c419ea6a1441f123a03)` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:08:41.809604 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f9542ec-6755-4ea2-95ee-d36f09a41857 admin admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:08:42.020316 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 1124/2235] 10.222.0.59 () {60 vars in 1482 bytes} [Thu Jun 2 16:08:41 2022] PUT /identity/v3/projects/39083e40d5cf4d1ea0bc63c8515bf11a/users/1bd07b1ffc3f40dd95840d636e41a70e/roles/649e0f2b5a264c419ea6a1441f123a03 => generated 0 bytes in 239 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 16:08:42.024173 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9528c8b-3ee8-4496-ba35-b1a453cbabdd None None] REQUEST_METHOD: `POST` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:08:42.024482 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9528c8b-3ee8-4496-ba35-b1a453cbabdd None None] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:08:42.024769 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9528c8b-3ee8-4496-ba35-b1a453cbabdd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:08:42.066172 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.auth.core [None req-e9528c8b-3ee8-4496-ba35-b1a453cbabdd None None] MFA Rules not processed for user `1bd07b1ffc3f40dd95840d636e41a70e`. Rule list: `[]` (Enabled: `True`). {{(pid=80396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 16:08:42.066172 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.fernet_utils [None req-e9528c8b-3ee8-4496-ba35-b1a453cbabdd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:08:42.087752 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG dbcounter [-] [80396] Writing DB stats keystone:SELECT=92,keystone:DELETE=4,keystone:INSERT=4 {{(pid=80396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 16:08:42.159362 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 1112/2236] 10.222.0.59 () {58 vars in 957 bytes} [Thu Jun 2 16:08:42 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 16:08:42.175296 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f9542ec-6755-4ea2-95ee-d36f09a41857 admin admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:08:42.178516 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.fernet_utils [None req-9f9542ec-6755-4ea2-95ee-d36f09a41857 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:08:42.268344 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f9542ec-6755-4ea2-95ee-d36f09a41857 admin admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:08:42.272226 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fa25ca3-76d5-4fe5-ab94-3169d2ee2292 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e673e7e0a4bf4c77bdb3e5325d0d3275', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c87c981909d4b8db02783421818c79b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:08:42.272980 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa25ca3-76d5-4fe5-ab94-3169d2ee2292 service glance] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:08:42.273685 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa25ca3-76d5-4fe5-ab94-3169d2ee2292 service glance] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:08:42.273871 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa25ca3-76d5-4fe5-ab94-3169d2ee2292 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:08:42.286753 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fa25ca3-76d5-4fe5-ab94-3169d2ee2292 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:08:42.288208 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fa25ca3-76d5-4fe5-ab94-3169d2ee2292 service glance] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:08:42.299889 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 1125/2237] 10.222.0.59 () {60 vars in 1365 bytes} [Thu Jun 2 16:08:42 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 125 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 16:08:45.409712 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9528c8b-3ee8-4496-ba35-b1a453cbabdd None None] Authenticating user token {{(pid=80396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:08:45.411231 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.fernet_utils [None req-e9528c8b-3ee8-4496-ba35-b1a453cbabdd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:08:45.490493 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9528c8b-3ee8-4496-ba35-b1a453cbabdd None None] Validating token access rules against request {{(pid=80396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:08:45.495444 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37b63387-6687-4378-a5cf-dd2fe3b2ba4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f73d5a98be74242b45222df39fb6213', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:08:45.496639 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b63387-6687-4378-a5cf-dd2fe3b2ba4f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:08:45.496976 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b63387-6687-4378-a5cf-dd2fe3b2ba4f admin admin] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:08:45.497340 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b63387-6687-4378-a5cf-dd2fe3b2ba4f admin admin] PATH_INFO: `/v3/users/86dda97d39ef49ad971f386c349c1261` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:08:45.498700 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37b63387-6687-4378-a5cf-dd2fe3b2ba4f admin admin] RBAC: Authorizing `identity:delete_user(user_id=86dda97d39ef49ad971f386c349c1261)` {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:08:45.500762 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37b63387-6687-4378-a5cf-dd2fe3b2ba4f admin admin] RBAC: Authorization granted {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:08:45.805670 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.notifications [None req-37b63387-6687-4378-a5cf-dd2fe3b2ba4f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '86dda97d39ef49ad971f386c349c1261'} {{(pid=80396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:08:45.806352 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.notifications [None req-37b63387-6687-4378-a5cf-dd2fe3b2ba4f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '86dda97d39ef49ad971f386c349c1261'} {{(pid=80396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:08:45.942132 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.notifications [None req-37b63387-6687-4378-a5cf-dd2fe3b2ba4f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '86dda97d39ef49ad971f386c349c1261'} {{(pid=80396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:08:45.957148 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.notifications [None req-37b63387-6687-4378-a5cf-dd2fe3b2ba4f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '86dda97d39ef49ad971f386c349c1261'} {{(pid=80396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:08:45.965168 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.notifications [None req-37b63387-6687-4378-a5cf-dd2fe3b2ba4f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '86dda97d39ef49ad971f386c349c1261'} {{(pid=80396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:08:45.971242 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 1113/2238] 10.222.0.59 () {58 vars in 1223 bytes} [Thu Jun 2 16:08:45 2022] DELETE /identity/v3/users/86dda97d39ef49ad971f386c349c1261 => generated 0 bytes in 562 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 16:08:45.975930 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6430ef4-850e-4d96-9c34-33b9b306adc2 None None] REQUEST_METHOD: `POST` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:08:45.976470 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6430ef4-850e-4d96-9c34-33b9b306adc2 None None] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:08:45.976470 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6430ef4-850e-4d96-9c34-33b9b306adc2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:08:45.994670 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.auth.core [None req-d6430ef4-850e-4d96-9c34-33b9b306adc2 None None] MFA Rules not processed for user `400d1f4db9de49638549e5db29a041e1`. Rule list: `[]` (Enabled: `True`). {{(pid=80395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 16:08:45.996143 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.fernet_utils [None req-d6430ef4-850e-4d96-9c34-33b9b306adc2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:08:46.057297 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 1126/2239] 10.222.0.59 () {58 vars in 957 bytes} [Thu Jun 2 16:08:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 16:08:46.067127 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37b63387-6687-4378-a5cf-dd2fe3b2ba4f admin admin] Authenticating user token {{(pid=80396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:08:46.068594 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.fernet_utils [None req-37b63387-6687-4378-a5cf-dd2fe3b2ba4f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:08:46.132662 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG dbcounter [-] [80396] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 16:08:46.144218 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37b63387-6687-4378-a5cf-dd2fe3b2ba4f admin admin] Validating token access rules against request {{(pid=80396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:08:46.148442 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6937530f-36de-480a-bdec-32345c832aec service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9af40ddfe9ff4be3887b068f13a28dc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c87c981909d4b8db02783421818c79b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:08:46.149089 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6937530f-36de-480a-bdec-32345c832aec service neutron] REQUEST_METHOD: `GET` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:08:46.149372 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6937530f-36de-480a-bdec-32345c832aec service neutron] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:08:46.151724 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6937530f-36de-480a-bdec-32345c832aec service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:08:46.160095 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6937530f-36de-480a-bdec-32345c832aec service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:08:46.161527 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6937530f-36de-480a-bdec-32345c832aec service neutron] RBAC: Authorization granted {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:08:46.174778 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 1114/2240] 10.222.0.59 () {60 vars in 1365 bytes} [Thu Jun 2 16:08:46 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 16:08:46.743962 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6430ef4-850e-4d96-9c34-33b9b306adc2 None None] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:08:46.746501 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.fernet_utils [None req-d6430ef4-850e-4d96-9c34-33b9b306adc2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:08:46.762613 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6430ef4-850e-4d96-9c34-33b9b306adc2 None None] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:08:46.773073 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95c2db1b-2bcb-4d46-8ca4-455d99005061 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f73d5a98be74242b45222df39fb6213', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:08:46.775698 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c2db1b-2bcb-4d46-8ca4-455d99005061 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:08:46.776011 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c2db1b-2bcb-4d46-8ca4-455d99005061 admin admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:08:46.776372 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c2db1b-2bcb-4d46-8ca4-455d99005061 admin admin] PATH_INFO: `/v3/projects/354485209f3e44dcb6454d0f3ca39c7c` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:08:46.777723 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95c2db1b-2bcb-4d46-8ca4-455d99005061 admin admin] RBAC: Authorizing `identity:delete_project(project_id=354485209f3e44dcb6454d0f3ca39c7c)` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:08:46.788452 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95c2db1b-2bcb-4d46-8ca4-455d99005061 admin admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:08:46.934211 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.notifications [None req-95c2db1b-2bcb-4d46-8ca4-455d99005061 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '354485209f3e44dcb6454d0f3ca39c7c', 'request_id': 'req-95c2db1b-2bcb-4d46-8ca4-455d99005061'} {{(pid=80395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:08:46.941618 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.notifications [None req-95c2db1b-2bcb-4d46-8ca4-455d99005061 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '354485209f3e44dcb6454d0f3ca39c7c', 'request_id': 'req-95c2db1b-2bcb-4d46-8ca4-455d99005061'} {{(pid=80395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:08:46.948600 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writing DB stats keystone:SELECT=93,keystone:INSERT=2,keystone:DELETE=5 {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 16:08:47.006863 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.notifications [None req-95c2db1b-2bcb-4d46-8ca4-455d99005061 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '354485209f3e44dcb6454d0f3ca39c7c', 'request_id': 'req-95c2db1b-2bcb-4d46-8ca4-455d99005061'} {{(pid=80395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:08:47.021456 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.notifications [None req-95c2db1b-2bcb-4d46-8ca4-455d99005061 admin admin] The token cache is being invalidate because project 354485209f3e44dcb6454d0f3ca39c7c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80395) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 02 16:08:47.023059 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.notifications [None req-95c2db1b-2bcb-4d46-8ca4-455d99005061 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:08:47.023227 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.notifications [None req-95c2db1b-2bcb-4d46-8ca4-455d99005061 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:08:47.029334 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 1127/2241] 10.222.0.59 () {58 vars in 1232 bytes} [Thu Jun 2 16:08:46 2022] DELETE /identity/v3/projects/354485209f3e44dcb6454d0f3ca39c7c => generated 0 bytes in 282 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 16:08:47.030691 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6937530f-36de-480a-bdec-32345c832aec service neutron] Authenticating user token {{(pid=80396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:08:47.042405 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6937530f-36de-480a-bdec-32345c832aec service neutron] Validating token access rules against request {{(pid=80396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:08:47.109729 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b20b94a-9393-4d10-920d-88fa08daf378 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f73d5a98be74242b45222df39fb6213', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:08:47.110644 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b20b94a-9393-4d10-920d-88fa08daf378 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:08:47.110926 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b20b94a-9393-4d10-920d-88fa08daf378 admin admin] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:08:47.111203 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b20b94a-9393-4d10-920d-88fa08daf378 admin admin] PATH_INFO: `/v3/users/ab03d9735d56498f817a30d6976e5c91` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:08:47.112397 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b20b94a-9393-4d10-920d-88fa08daf378 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ab03d9735d56498f817a30d6976e5c91)` {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:08:47.114336 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b20b94a-9393-4d10-920d-88fa08daf378 admin admin] RBAC: Authorization granted {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:08:47.327827 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.notifications [None req-6b20b94a-9393-4d10-920d-88fa08daf378 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ab03d9735d56498f817a30d6976e5c91'} {{(pid=80396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:08:47.328488 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.notifications [None req-6b20b94a-9393-4d10-920d-88fa08daf378 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ab03d9735d56498f817a30d6976e5c91'} {{(pid=80396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:08:47.453144 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.notifications [None req-6b20b94a-9393-4d10-920d-88fa08daf378 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ab03d9735d56498f817a30d6976e5c91'} {{(pid=80396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:08:47.467295 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.notifications [None req-6b20b94a-9393-4d10-920d-88fa08daf378 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ab03d9735d56498f817a30d6976e5c91'} {{(pid=80396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:08:47.474496 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.notifications [None req-6b20b94a-9393-4d10-920d-88fa08daf378 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ab03d9735d56498f817a30d6976e5c91'} {{(pid=80396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:08:47.480621 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 1115/2242] 10.222.0.59 () {58 vars in 1223 bytes} [Thu Jun 2 16:08:47 2022] DELETE /identity/v3/users/ab03d9735d56498f817a30d6976e5c91 => generated 0 bytes in 451 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 16:08:47.991266 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95c2db1b-2bcb-4d46-8ca4-455d99005061 admin admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:08:47.992760 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.fernet_utils [None req-95c2db1b-2bcb-4d46-8ca4-455d99005061 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:08:48.008081 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95c2db1b-2bcb-4d46-8ca4-455d99005061 admin admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:08:48.090017 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2257b529-4a58-4b5b-b908-865cf7d74e23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f73d5a98be74242b45222df39fb6213', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:08:48.090922 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2257b529-4a58-4b5b-b908-865cf7d74e23 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:08:48.091208 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2257b529-4a58-4b5b-b908-865cf7d74e23 admin admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:08:48.091488 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2257b529-4a58-4b5b-b908-865cf7d74e23 admin admin] PATH_INFO: `/v3/projects/735b0e28dfc44e4b9877f1264adb1849` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:08:48.092716 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2257b529-4a58-4b5b-b908-865cf7d74e23 admin admin] RBAC: Authorizing `identity:delete_project(project_id=735b0e28dfc44e4b9877f1264adb1849)` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:08:48.094720 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2257b529-4a58-4b5b-b908-865cf7d74e23 admin admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:08:48.272642 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.notifications [None req-2257b529-4a58-4b5b-b908-865cf7d74e23 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '735b0e28dfc44e4b9877f1264adb1849', 'request_id': 'req-2257b529-4a58-4b5b-b908-865cf7d74e23'} {{(pid=80395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:08:48.279814 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.notifications [None req-2257b529-4a58-4b5b-b908-865cf7d74e23 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '735b0e28dfc44e4b9877f1264adb1849', 'request_id': 'req-2257b529-4a58-4b5b-b908-865cf7d74e23'} {{(pid=80395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:08:48.410295 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.notifications [None req-2257b529-4a58-4b5b-b908-865cf7d74e23 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '735b0e28dfc44e4b9877f1264adb1849', 'request_id': 'req-2257b529-4a58-4b5b-b908-865cf7d74e23'} {{(pid=80395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:08:48.422232 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.notifications [None req-2257b529-4a58-4b5b-b908-865cf7d74e23 admin admin] The token cache is being invalidate because project 735b0e28dfc44e4b9877f1264adb1849 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80395) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 02 16:08:48.422520 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.notifications [None req-2257b529-4a58-4b5b-b908-865cf7d74e23 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:08:48.423146 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.notifications [None req-2257b529-4a58-4b5b-b908-865cf7d74e23 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:08:48.424703 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 1128/2243] 10.222.0.59 () {58 vars in 1232 bytes} [Thu Jun 2 16:08:47 2022] DELETE /identity/v3/projects/735b0e28dfc44e4b9877f1264adb1849 => generated 0 bytes in 434 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 16:08:48.430256 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7690081f-f209-4eb8-8943-68cd0e307b4e None None] REQUEST_METHOD: `POST` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:08:48.430755 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7690081f-f209-4eb8-8943-68cd0e307b4e None None] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:08:48.431024 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7690081f-f209-4eb8-8943-68cd0e307b4e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:08:48.454406 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.auth.core [None req-7690081f-f209-4eb8-8943-68cd0e307b4e None None] MFA Rules not processed for user `400d1f4db9de49638549e5db29a041e1`. Rule list: `[]` (Enabled: `True`). {{(pid=80396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 16:08:48.455602 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.fernet_utils [None req-7690081f-f209-4eb8-8943-68cd0e307b4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:08:48.516782 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 1116/2244] 10.222.0.59 () {58 vars in 957 bytes} [Thu Jun 2 16:08:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 02 16:08:48.524573 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f6f7a1a-0b9f-46eb-ab68-860a416e23c6 None None] REQUEST_METHOD: `POST` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:08:48.524864 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f6f7a1a-0b9f-46eb-ab68-860a416e23c6 None None] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:08:48.525142 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f6f7a1a-0b9f-46eb-ab68-860a416e23c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:08:48.544798 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.auth.core [None req-5f6f7a1a-0b9f-46eb-ab68-860a416e23c6 None None] MFA Rules not processed for user `400d1f4db9de49638549e5db29a041e1`. Rule list: `[]` (Enabled: `True`). {{(pid=80395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 16:08:48.546034 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.fernet_utils [None req-5f6f7a1a-0b9f-46eb-ab68-860a416e23c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:08:48.554180 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 1129/2245] 10.222.0.59 () {58 vars in 957 bytes} [Thu Jun 2 16:08:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 16:08:48.558483 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7690081f-f209-4eb8-8943-68cd0e307b4e None None] Authenticating user token {{(pid=80396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:08:48.569328 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7690081f-f209-4eb8-8943-68cd0e307b4e None None] Validating token access rules against request {{(pid=80396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:08:48.574143 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e303722-ed8d-4d2c-8a97-4b674f5f9db4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f73d5a98be74242b45222df39fb6213', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:08:48.574820 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e303722-ed8d-4d2c-8a97-4b674f5f9db4 admin admin] REQUEST_METHOD: `GET` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:08:48.575104 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e303722-ed8d-4d2c-8a97-4b674f5f9db4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:08:48.575385 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e303722-ed8d-4d2c-8a97-4b674f5f9db4 admin admin] PATH_INFO: `/v3/domains` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:08:48.576452 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e303722-ed8d-4d2c-8a97-4b674f5f9db4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80396) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 16:08:48.576452 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e303722-ed8d-4d2c-8a97-4b674f5f9db4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:08:48.578031 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e303722-ed8d-4d2c-8a97-4b674f5f9db4 admin admin] RBAC: Authorization granted {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:08:48.579695 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG dbcounter [-] [80396] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 16:08:48.591723 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 1117/2246] 10.222.0.59 () {58 vars in 1152 bytes} [Thu Jun 2 16:08:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 16:08:48.601171 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f6f7a1a-0b9f-46eb-ab68-860a416e23c6 None None] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:08:48.611550 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f6f7a1a-0b9f-46eb-ab68-860a416e23c6 None None] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:08:48.616422 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-136099d0-22ee-4441-944c-b7200e4b4d0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f73d5a98be74242b45222df39fb6213', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:08:48.617210 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-136099d0-22ee-4441-944c-b7200e4b4d0a admin admin] REQUEST_METHOD: `POST` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:08:48.617502 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-136099d0-22ee-4441-944c-b7200e4b4d0a admin admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:08:48.618423 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-136099d0-22ee-4441-944c-b7200e4b4d0a admin admin] PATH_INFO: `/v3/projects` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:08:48.619171 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-136099d0-22ee-4441-944c-b7200e4b4d0a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:08:48.621140 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-136099d0-22ee-4441-944c-b7200e4b4d0a admin admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:08:48.738419 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 1130/2247] 10.222.0.59 () {60 vars in 1152 bytes} [Thu Jun 2 16:08:48 2022] POST /identity/v3/projects => generated 379 bytes in 143 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 16:08:48.742516 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e303722-ed8d-4d2c-8a97-4b674f5f9db4 admin admin] Authenticating user token {{(pid=80396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:08:48.753309 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e303722-ed8d-4d2c-8a97-4b674f5f9db4 admin admin] Validating token access rules against request {{(pid=80396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:08:48.816327 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c65fb3b9-8234-4897-8f20-1f766f34af32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f73d5a98be74242b45222df39fb6213', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:08:48.817084 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65fb3b9-8234-4897-8f20-1f766f34af32 admin admin] REQUEST_METHOD: `POST` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:08:48.817255 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65fb3b9-8234-4897-8f20-1f766f34af32 admin admin] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:08:48.817531 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65fb3b9-8234-4897-8f20-1f766f34af32 admin admin] PATH_INFO: `/v3/users` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:08:48.818329 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c65fb3b9-8234-4897-8f20-1f766f34af32 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:08:48.820238 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c65fb3b9-8234-4897-8f20-1f766f34af32 admin admin] RBAC: Authorization granted {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:08:48.944264 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 1118/2248] 10.222.0.59 () {60 vars in 1143 bytes} [Thu Jun 2 16:08:48 2022] POST /identity/v3/users => generated 290 bytes in 202 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 16:08:48.948620 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-136099d0-22ee-4441-944c-b7200e4b4d0a admin admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:08:48.958882 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-136099d0-22ee-4441-944c-b7200e4b4d0a admin admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:08:48.963940 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a850c2e5-6d88-419e-81ba-d374d949088e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f73d5a98be74242b45222df39fb6213', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:08:48.964620 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a850c2e5-6d88-419e-81ba-d374d949088e admin admin] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:08:48.964907 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a850c2e5-6d88-419e-81ba-d374d949088e admin admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:08:48.965206 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a850c2e5-6d88-419e-81ba-d374d949088e admin admin] PATH_INFO: `/v3/roles` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:08:48.965939 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a850c2e5-6d88-419e-81ba-d374d949088e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:08:48.967615 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a850c2e5-6d88-419e-81ba-d374d949088e admin admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:08:48.979490 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 1131/2249] 10.222.0.59 () {58 vars in 1121 bytes} [Thu Jun 2 16:08:48 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 16:08:48.983623 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c65fb3b9-8234-4897-8f20-1f766f34af32 admin admin] Authenticating user token {{(pid=80396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:08:48.993772 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c65fb3b9-8234-4897-8f20-1f766f34af32 admin admin] Validating token access rules against request {{(pid=80396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:08:48.999378 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b77b9c08-d67c-4e46-b8ce-40235f81927f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f73d5a98be74242b45222df39fb6213', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:08:49.000026 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77b9c08-d67c-4e46-b8ce-40235f81927f admin admin] REQUEST_METHOD: `GET` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:08:49.000377 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77b9c08-d67c-4e46-b8ce-40235f81927f admin admin] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:08:49.000629 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77b9c08-d67c-4e46-b8ce-40235f81927f admin admin] PATH_INFO: `/v3/roles` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:08:49.001370 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b77b9c08-d67c-4e46-b8ce-40235f81927f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:08:49.003037 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b77b9c08-d67c-4e46-b8ce-40235f81927f admin admin] RBAC: Authorization granted {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:08:49.013327 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 1119/2250] 10.222.0.59 () {58 vars in 1121 bytes} [Thu Jun 2 16:08:48 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 02 16:08:49.017471 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a850c2e5-6d88-419e-81ba-d374d949088e admin admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:08:49.027586 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a850c2e5-6d88-419e-81ba-d374d949088e admin admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:08:49.032084 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a8eddf0-7031-4f5e-be2f-f7e890c89307 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f73d5a98be74242b45222df39fb6213', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:08:49.032957 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a8eddf0-7031-4f5e-be2f-f7e890c89307 admin admin] REQUEST_METHOD: `PUT` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:08:49.033235 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a8eddf0-7031-4f5e-be2f-f7e890c89307 admin admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:08:49.033506 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a8eddf0-7031-4f5e-be2f-f7e890c89307 admin admin] PATH_INFO: `/v3/projects/e5dafeb23e21452188747ae7b1e6bda4/users/548b6b1cfde24c8e80745ba7a066635a/roles/649e0f2b5a264c419ea6a1441f123a03` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:08:49.049805 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a8eddf0-7031-4f5e-be2f-f7e890c89307 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e5dafeb23e21452188747ae7b1e6bda4, user_id=548b6b1cfde24c8e80745ba7a066635a, role_id=649e0f2b5a264c419ea6a1441f123a03)` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:08:49.052676 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a8eddf0-7031-4f5e-be2f-f7e890c89307 admin admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:08:49.145605 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 1132/2251] 10.222.0.59 () {60 vars in 1482 bytes} [Thu Jun 2 16:08:49 2022] PUT /identity/v3/projects/e5dafeb23e21452188747ae7b1e6bda4/users/548b6b1cfde24c8e80745ba7a066635a/roles/649e0f2b5a264c419ea6a1441f123a03 => generated 0 bytes in 129 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 16:08:49.157269 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92104e28-0c6b-4906-814f-4d9f50df8abc None None] REQUEST_METHOD: `POST` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:08:49.157553 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92104e28-0c6b-4906-814f-4d9f50df8abc None None] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:08:49.157933 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92104e28-0c6b-4906-814f-4d9f50df8abc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:08:49.197257 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.auth.core [None req-92104e28-0c6b-4906-814f-4d9f50df8abc None None] MFA Rules not processed for user `548b6b1cfde24c8e80745ba7a066635a`. Rule list: `[]` (Enabled: `True`). {{(pid=80396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 16:08:49.198614 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.fernet_utils [None req-92104e28-0c6b-4906-814f-4d9f50df8abc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:08:49.273050 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 1120/2252] 10.222.0.59 () {58 vars in 957 bytes} [Thu Jun 2 16:08:49 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 16:08:49.278265 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a8eddf0-7031-4f5e-be2f-f7e890c89307 admin admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:08:49.292961 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writing DB stats keystone:SELECT=88,keystone:DELETE=9,keystone:INSERT=3 {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 16:08:49.343230 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a8eddf0-7031-4f5e-be2f-f7e890c89307 admin admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:08:49.347909 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17ebe1f2-ad2a-48df-ba55-daf744754a8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f73d5a98be74242b45222df39fb6213', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:08:49.348571 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ebe1f2-ad2a-48df-ba55-daf744754a8b admin admin] REQUEST_METHOD: `POST` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:08:49.348856 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ebe1f2-ad2a-48df-ba55-daf744754a8b admin admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:08:49.349133 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ebe1f2-ad2a-48df-ba55-daf744754a8b admin admin] PATH_INFO: `/v3/projects` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:08:49.349835 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17ebe1f2-ad2a-48df-ba55-daf744754a8b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:08:49.351821 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17ebe1f2-ad2a-48df-ba55-daf744754a8b admin admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:08:49.437251 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 1133/2253] 10.222.0.59 () {60 vars in 1152 bytes} [Thu Jun 2 16:08:49 2022] POST /identity/v3/projects => generated 379 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 02 16:08:49.441424 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92104e28-0c6b-4906-814f-4d9f50df8abc None None] Authenticating user token {{(pid=80396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:08:49.453215 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92104e28-0c6b-4906-814f-4d9f50df8abc None None] Validating token access rules against request {{(pid=80396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:08:49.511645 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e371c558-be40-4d9c-a6c7-566580405dbb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f73d5a98be74242b45222df39fb6213', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:08:49.512304 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e371c558-be40-4d9c-a6c7-566580405dbb admin admin] REQUEST_METHOD: `POST` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:08:49.512918 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e371c558-be40-4d9c-a6c7-566580405dbb admin admin] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:08:49.513194 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e371c558-be40-4d9c-a6c7-566580405dbb admin admin] PATH_INFO: `/v3/users` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:08:49.513876 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e371c558-be40-4d9c-a6c7-566580405dbb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:08:49.515897 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e371c558-be40-4d9c-a6c7-566580405dbb admin admin] RBAC: Authorization granted {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:08:49.523834 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG dbcounter [-] [80396] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 16:08:49.636171 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 1121/2254] 10.222.0.59 () {60 vars in 1143 bytes} [Thu Jun 2 16:08:49 2022] POST /identity/v3/users => generated 296 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 16:08:49.640244 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17ebe1f2-ad2a-48df-ba55-daf744754a8b admin admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:08:49.650512 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17ebe1f2-ad2a-48df-ba55-daf744754a8b admin admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:08:49.654933 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c9845c-89e8-4eac-8ac0-d741a6f69a87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f73d5a98be74242b45222df39fb6213', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:08:49.655597 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c9845c-89e8-4eac-8ac0-d741a6f69a87 admin admin] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:08:49.655857 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c9845c-89e8-4eac-8ac0-d741a6f69a87 admin admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:08:49.656134 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c9845c-89e8-4eac-8ac0-d741a6f69a87 admin admin] PATH_INFO: `/v3/roles` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:08:49.656853 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1c9845c-89e8-4eac-8ac0-d741a6f69a87 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:08:49.658475 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1c9845c-89e8-4eac-8ac0-d741a6f69a87 admin admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:08:49.669754 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 1134/2255] 10.222.0.59 () {58 vars in 1121 bytes} [Thu Jun 2 16:08:49 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 16:08:49.673901 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e371c558-be40-4d9c-a6c7-566580405dbb admin admin] Authenticating user token {{(pid=80396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:08:49.684941 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e371c558-be40-4d9c-a6c7-566580405dbb admin admin] Validating token access rules against request {{(pid=80396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:08:49.689763 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-591cc2a0-afd9-4043-b047-b6595e34fd7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f73d5a98be74242b45222df39fb6213', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:08:49.690684 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591cc2a0-afd9-4043-b047-b6595e34fd7a admin admin] REQUEST_METHOD: `PUT` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:08:49.691013 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591cc2a0-afd9-4043-b047-b6595e34fd7a admin admin] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:08:49.691286 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591cc2a0-afd9-4043-b047-b6595e34fd7a admin admin] PATH_INFO: `/v3/projects/1162f8fbfdc8496889c733fcde86f781/users/57ad6789d1d4475088826c5d4267a2d7/roles/f1e0c25f6e9049e897cb7350c7e54ab3` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:08:49.706443 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-591cc2a0-afd9-4043-b047-b6595e34fd7a admin admin] RBAC: Authorizing `identity:create_grant(project_id=1162f8fbfdc8496889c733fcde86f781, user_id=57ad6789d1d4475088826c5d4267a2d7, role_id=f1e0c25f6e9049e897cb7350c7e54ab3)` {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:08:49.709278 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-591cc2a0-afd9-4043-b047-b6595e34fd7a admin admin] RBAC: Authorization granted {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:08:49.830709 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 1122/2256] 10.222.0.59 () {60 vars in 1482 bytes} [Thu Jun 2 16:08:49 2022] PUT /identity/v3/projects/1162f8fbfdc8496889c733fcde86f781/users/57ad6789d1d4475088826c5d4267a2d7/roles/f1e0c25f6e9049e897cb7350c7e54ab3 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 16:08:49.834579 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c9845c-89e8-4eac-8ac0-d741a6f69a87 admin admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:08:49.850393 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c9845c-89e8-4eac-8ac0-d741a6f69a87 admin admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:08:49.901132 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-904682c0-2faf-405a-9d43-85e85cc953ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f73d5a98be74242b45222df39fb6213', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:08:49.901846 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904682c0-2faf-405a-9d43-85e85cc953ae admin admin] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:08:49.902161 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904682c0-2faf-405a-9d43-85e85cc953ae admin admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:08:49.902434 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904682c0-2faf-405a-9d43-85e85cc953ae admin admin] PATH_INFO: `/v3/roles` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:08:49.903149 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-904682c0-2faf-405a-9d43-85e85cc953ae admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:08:49.904740 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-904682c0-2faf-405a-9d43-85e85cc953ae admin admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:08:49.914411 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 1135/2257] 10.222.0.59 () {58 vars in 1121 bytes} [Thu Jun 2 16:08:49 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 16:08:49.919626 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-591cc2a0-afd9-4043-b047-b6595e34fd7a admin admin] Authenticating user token {{(pid=80396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:08:49.929771 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-591cc2a0-afd9-4043-b047-b6595e34fd7a admin admin] Validating token access rules against request {{(pid=80396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:08:49.934456 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35e1c576-e846-44a0-8a6f-0dde0809e9e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f73d5a98be74242b45222df39fb6213', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:08:49.935322 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e1c576-e846-44a0-8a6f-0dde0809e9e7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:08:49.935607 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e1c576-e846-44a0-8a6f-0dde0809e9e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:08:49.935886 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e1c576-e846-44a0-8a6f-0dde0809e9e7 admin admin] PATH_INFO: `/v3/projects/1162f8fbfdc8496889c733fcde86f781/users/57ad6789d1d4475088826c5d4267a2d7/roles/f1e0c25f6e9049e897cb7350c7e54ab3` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:08:49.937938 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35e1c576-e846-44a0-8a6f-0dde0809e9e7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1162f8fbfdc8496889c733fcde86f781, user_id=57ad6789d1d4475088826c5d4267a2d7, role_id=f1e0c25f6e9049e897cb7350c7e54ab3)` {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:08:49.940610 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35e1c576-e846-44a0-8a6f-0dde0809e9e7 admin admin] RBAC: Authorization granted {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:08:49.950912 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 1123/2258] 10.222.0.59 () {60 vars in 1482 bytes} [Thu Jun 2 16:08:49 2022] PUT /identity/v3/projects/1162f8fbfdc8496889c733fcde86f781/users/57ad6789d1d4475088826c5d4267a2d7/roles/f1e0c25f6e9049e897cb7350c7e54ab3 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 16:08:49.960949 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b87dd7b6-c6f2-4f2b-8d1e-3590991f492f None None] REQUEST_METHOD: `POST` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:08:49.961245 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b87dd7b6-c6f2-4f2b-8d1e-3590991f492f None None] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:08:49.961532 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b87dd7b6-c6f2-4f2b-8d1e-3590991f492f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:08:49.988713 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.auth.core [None req-b87dd7b6-c6f2-4f2b-8d1e-3590991f492f None None] MFA Rules not processed for user `57ad6789d1d4475088826c5d4267a2d7`. Rule list: `[]` (Enabled: `True`). {{(pid=80395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 16:08:49.989914 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.fernet_utils [None req-b87dd7b6-c6f2-4f2b-8d1e-3590991f492f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:08:50.058623 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 1136/2259] 10.222.0.59 () {58 vars in 957 bytes} [Thu Jun 2 16:08:49 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 16:08:50.070853 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35e1c576-e846-44a0-8a6f-0dde0809e9e7 admin admin] Authenticating user token {{(pid=80396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:08:50.072567 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.fernet_utils [None req-35e1c576-e846-44a0-8a6f-0dde0809e9e7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:08:50.130830 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35e1c576-e846-44a0-8a6f-0dde0809e9e7 admin admin] Validating token access rules against request {{(pid=80396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:08:50.134621 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5911b9a-ef59-48e4-a6a0-f37d41959f10 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6534961c369940a5b88f310c6450250b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c87c981909d4b8db02783421818c79b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:08:50.135375 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5911b9a-ef59-48e4-a6a0-f37d41959f10 service cinder] REQUEST_METHOD: `GET` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:08:50.135656 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5911b9a-ef59-48e4-a6a0-f37d41959f10 service cinder] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:08:50.135932 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5911b9a-ef59-48e4-a6a0-f37d41959f10 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:08:50.144903 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5911b9a-ef59-48e4-a6a0-f37d41959f10 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:08:50.146357 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5911b9a-ef59-48e4-a6a0-f37d41959f10 service cinder] RBAC: Authorization granted {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:08:50.156194 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 1124/2260] 10.222.0.59 () {60 vars in 1365 bytes} [Thu Jun 2 16:08:50 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 16:08:51.300754 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b87dd7b6-c6f2-4f2b-8d1e-3590991f492f None None] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:08:51.310909 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b87dd7b6-c6f2-4f2b-8d1e-3590991f492f None None] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:08:51.315727 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36a184d3-46b4-430b-83e4-1be5aaa88514 tempest-VolumeQuotaClassesTest-676046900 tempest-VolumeQuotaClassesTest-676046900-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57ad6789d1d4475088826c5d4267a2d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1162f8fbfdc8496889c733fcde86f781', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:08:51.316373 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a184d3-46b4-430b-83e4-1be5aaa88514 tempest-VolumeQuotaClassesTest-676046900 tempest-VolumeQuotaClassesTest-676046900-project-admin] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:08:51.316718 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a184d3-46b4-430b-83e4-1be5aaa88514 tempest-VolumeQuotaClassesTest-676046900 tempest-VolumeQuotaClassesTest-676046900-project-admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:08:51.316974 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a184d3-46b4-430b-83e4-1be5aaa88514 tempest-VolumeQuotaClassesTest-676046900 tempest-VolumeQuotaClassesTest-676046900-project-admin] PATH_INFO: `/v3/domains` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:08:51.317698 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36a184d3-46b4-430b-83e4-1be5aaa88514 tempest-VolumeQuotaClassesTest-676046900 tempest-VolumeQuotaClassesTest-676046900-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=80395) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 16:08:51.318006 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36a184d3-46b4-430b-83e4-1be5aaa88514 tempest-VolumeQuotaClassesTest-676046900 tempest-VolumeQuotaClassesTest-676046900-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:08:51.319669 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36a184d3-46b4-430b-83e4-1be5aaa88514 tempest-VolumeQuotaClassesTest-676046900 tempest-VolumeQuotaClassesTest-676046900-project-admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:08:51.322019 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 16:08:51.332099 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 1137/2261] 10.222.0.59 () {58 vars in 1152 bytes} [Thu Jun 2 16:08:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 16:08:51.336232 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5911b9a-ef59-48e4-a6a0-f37d41959f10 service cinder] Authenticating user token {{(pid=80396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:08:51.346617 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5911b9a-ef59-48e4-a6a0-f37d41959f10 service cinder] Validating token access rules against request {{(pid=80396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:08:51.351511 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e6be61-f66e-4b98-a1b6-935022c263d3 tempest-VolumeQuotaClassesTest-676046900 tempest-VolumeQuotaClassesTest-676046900-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57ad6789d1d4475088826c5d4267a2d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1162f8fbfdc8496889c733fcde86f781', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:08:51.352156 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e6be61-f66e-4b98-a1b6-935022c263d3 tempest-VolumeQuotaClassesTest-676046900 tempest-VolumeQuotaClassesTest-676046900-project-admin] REQUEST_METHOD: `POST` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:08:51.352435 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e6be61-f66e-4b98-a1b6-935022c263d3 tempest-VolumeQuotaClassesTest-676046900 tempest-VolumeQuotaClassesTest-676046900-project-admin] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:08:51.352853 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e6be61-f66e-4b98-a1b6-935022c263d3 tempest-VolumeQuotaClassesTest-676046900 tempest-VolumeQuotaClassesTest-676046900-project-admin] PATH_INFO: `/v3/projects` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:08:51.353674 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72e6be61-f66e-4b98-a1b6-935022c263d3 tempest-VolumeQuotaClassesTest-676046900 tempest-VolumeQuotaClassesTest-676046900-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:08:51.355927 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72e6be61-f66e-4b98-a1b6-935022c263d3 tempest-VolumeQuotaClassesTest-676046900 tempest-VolumeQuotaClassesTest-676046900-project-admin] RBAC: Authorization granted {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:08:51.483476 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 1125/2262] 10.222.0.59 () {60 vars in 1152 bytes} [Thu Jun 2 16:08:51 2022] POST /identity/v3/projects => generated 355 bytes in 148 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 02 16:08:51.487615 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36a184d3-46b4-430b-83e4-1be5aaa88514 tempest-VolumeQuotaClassesTest-676046900 tempest-VolumeQuotaClassesTest-676046900-project-admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:08:51.498323 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36a184d3-46b4-430b-83e4-1be5aaa88514 tempest-VolumeQuotaClassesTest-676046900 tempest-VolumeQuotaClassesTest-676046900-project-admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:08:51.583460 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02e0a6f1-0be0-4ade-9801-411cfc0e2e53 tempest-VolumeQuotaClassesTest-676046900 tempest-VolumeQuotaClassesTest-676046900-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57ad6789d1d4475088826c5d4267a2d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1162f8fbfdc8496889c733fcde86f781', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:08:51.584231 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e0a6f1-0be0-4ade-9801-411cfc0e2e53 tempest-VolumeQuotaClassesTest-676046900 tempest-VolumeQuotaClassesTest-676046900-project-admin] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:08:51.584587 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e0a6f1-0be0-4ade-9801-411cfc0e2e53 tempest-VolumeQuotaClassesTest-676046900 tempest-VolumeQuotaClassesTest-676046900-project-admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:08:51.584942 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e0a6f1-0be0-4ade-9801-411cfc0e2e53 tempest-VolumeQuotaClassesTest-676046900 tempest-VolumeQuotaClassesTest-676046900-project-admin] PATH_INFO: `/v3/domains` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:08:51.585820 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02e0a6f1-0be0-4ade-9801-411cfc0e2e53 tempest-VolumeQuotaClassesTest-676046900 tempest-VolumeQuotaClassesTest-676046900-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=80395) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 16:08:51.586164 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02e0a6f1-0be0-4ade-9801-411cfc0e2e53 tempest-VolumeQuotaClassesTest-676046900 tempest-VolumeQuotaClassesTest-676046900-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:08:51.588093 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02e0a6f1-0be0-4ade-9801-411cfc0e2e53 tempest-VolumeQuotaClassesTest-676046900 tempest-VolumeQuotaClassesTest-676046900-project-admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:08:51.600718 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 1138/2263] 10.222.0.59 () {58 vars in 1152 bytes} [Thu Jun 2 16:08:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 114 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 16:08:51.645459 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e6be61-f66e-4b98-a1b6-935022c263d3 tempest-VolumeQuotaClassesTest-676046900 tempest-VolumeQuotaClassesTest-676046900-project-admin] Authenticating user token {{(pid=80396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:08:51.656284 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e6be61-f66e-4b98-a1b6-935022c263d3 tempest-VolumeQuotaClassesTest-676046900 tempest-VolumeQuotaClassesTest-676046900-project-admin] Validating token access rules against request {{(pid=80396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:08:51.660924 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6129df55-3e7d-40a3-9154-826a4f9f056f tempest-VolumeQuotaClassesTest-676046900 tempest-VolumeQuotaClassesTest-676046900-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57ad6789d1d4475088826c5d4267a2d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1162f8fbfdc8496889c733fcde86f781', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:08:51.661775 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6129df55-3e7d-40a3-9154-826a4f9f056f tempest-VolumeQuotaClassesTest-676046900 tempest-VolumeQuotaClassesTest-676046900-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:08:51.662065 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6129df55-3e7d-40a3-9154-826a4f9f056f tempest-VolumeQuotaClassesTest-676046900 tempest-VolumeQuotaClassesTest-676046900-project-admin] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:08:51.662509 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6129df55-3e7d-40a3-9154-826a4f9f056f tempest-VolumeQuotaClassesTest-676046900 tempest-VolumeQuotaClassesTest-676046900-project-admin] PATH_INFO: `/v3/projects/04fb2ba7ee9744d59d7ddd0350b955fc` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:08:51.663596 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6129df55-3e7d-40a3-9154-826a4f9f056f tempest-VolumeQuotaClassesTest-676046900 tempest-VolumeQuotaClassesTest-676046900-project-admin] RBAC: Authorizing `identity:delete_project(project_id=04fb2ba7ee9744d59d7ddd0350b955fc)` {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:08:51.665524 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6129df55-3e7d-40a3-9154-826a4f9f056f tempest-VolumeQuotaClassesTest-676046900 tempest-VolumeQuotaClassesTest-676046900-project-admin] RBAC: Authorization granted {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:08:51.784860 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.notifications [None req-6129df55-3e7d-40a3-9154-826a4f9f056f tempest-VolumeQuotaClassesTest-676046900 tempest-VolumeQuotaClassesTest-676046900-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '04fb2ba7ee9744d59d7ddd0350b955fc', 'request_id': 'req-6129df55-3e7d-40a3-9154-826a4f9f056f'} {{(pid=80396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:08:51.793275 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.notifications [None req-6129df55-3e7d-40a3-9154-826a4f9f056f tempest-VolumeQuotaClassesTest-676046900 tempest-VolumeQuotaClassesTest-676046900-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '04fb2ba7ee9744d59d7ddd0350b955fc', 'request_id': 'req-6129df55-3e7d-40a3-9154-826a4f9f056f'} {{(pid=80396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:08:51.875535 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.notifications [None req-6129df55-3e7d-40a3-9154-826a4f9f056f tempest-VolumeQuotaClassesTest-676046900 tempest-VolumeQuotaClassesTest-676046900-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '04fb2ba7ee9744d59d7ddd0350b955fc', 'request_id': 'req-6129df55-3e7d-40a3-9154-826a4f9f056f'} {{(pid=80396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:08:51.886313 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.notifications [None req-6129df55-3e7d-40a3-9154-826a4f9f056f tempest-VolumeQuotaClassesTest-676046900 tempest-VolumeQuotaClassesTest-676046900-project-admin] The token cache is being invalidate because project 04fb2ba7ee9744d59d7ddd0350b955fc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80396) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 02 16:08:51.886599 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.notifications [None req-6129df55-3e7d-40a3-9154-826a4f9f056f tempest-VolumeQuotaClassesTest-676046900 tempest-VolumeQuotaClassesTest-676046900-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:08:51.887223 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.notifications [None req-6129df55-3e7d-40a3-9154-826a4f9f056f tempest-VolumeQuotaClassesTest-676046900 tempest-VolumeQuotaClassesTest-676046900-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:08:51.888798 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 1126/2264] 10.222.0.59 () {58 vars in 1232 bytes} [Thu Jun 2 16:08:51 2022] DELETE /identity/v3/projects/04fb2ba7ee9744d59d7ddd0350b955fc => generated 0 bytes in 244 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 16:08:52.549594 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02e0a6f1-0be0-4ade-9801-411cfc0e2e53 tempest-VolumeQuotaClassesTest-676046900 tempest-VolumeQuotaClassesTest-676046900-project-admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:08:52.551762 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.fernet_utils [None req-02e0a6f1-0be0-4ade-9801-411cfc0e2e53 tempest-VolumeQuotaClassesTest-676046900 tempest-VolumeQuotaClassesTest-676046900-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:08:52.627180 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02e0a6f1-0be0-4ade-9801-411cfc0e2e53 tempest-VolumeQuotaClassesTest-676046900 tempest-VolumeQuotaClassesTest-676046900-project-admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:08:52.690317 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-434c0d16-723c-456a-b0b8-bda092306381 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f73d5a98be74242b45222df39fb6213', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:08:52.690879 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434c0d16-723c-456a-b0b8-bda092306381 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:08:52.691186 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434c0d16-723c-456a-b0b8-bda092306381 admin admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:08:52.691508 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434c0d16-723c-456a-b0b8-bda092306381 admin admin] PATH_INFO: `/v3/users/548b6b1cfde24c8e80745ba7a066635a` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:08:52.692744 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-434c0d16-723c-456a-b0b8-bda092306381 admin admin] RBAC: Authorizing `identity:delete_user(user_id=548b6b1cfde24c8e80745ba7a066635a)` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:08:52.694871 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-434c0d16-723c-456a-b0b8-bda092306381 admin admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:08:52.899878 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 16:08:52.906636 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.notifications [None req-434c0d16-723c-456a-b0b8-bda092306381 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '548b6b1cfde24c8e80745ba7a066635a'} {{(pid=80395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:08:52.995675 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.notifications [None req-434c0d16-723c-456a-b0b8-bda092306381 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '548b6b1cfde24c8e80745ba7a066635a'} {{(pid=80395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:08:53.009426 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.notifications [None req-434c0d16-723c-456a-b0b8-bda092306381 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '548b6b1cfde24c8e80745ba7a066635a'} {{(pid=80395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:08:53.011450 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.notifications [None req-434c0d16-723c-456a-b0b8-bda092306381 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '548b6b1cfde24c8e80745ba7a066635a'} {{(pid=80395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:08:53.018327 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.notifications [None req-434c0d16-723c-456a-b0b8-bda092306381 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '548b6b1cfde24c8e80745ba7a066635a'} {{(pid=80395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:08:53.025108 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 1139/2265] 10.222.0.59 () {58 vars in 1223 bytes} [Thu Jun 2 16:08:52 2022] DELETE /identity/v3/users/548b6b1cfde24c8e80745ba7a066635a => generated 0 bytes in 476 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 16:08:53.029594 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9a6a67-04c4-43ec-b148-f5ad3908b7bf None None] REQUEST_METHOD: `POST` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:08:53.030049 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9a6a67-04c4-43ec-b148-f5ad3908b7bf None None] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:08:53.030168 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9a6a67-04c4-43ec-b148-f5ad3908b7bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:08:53.047721 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.auth.core [None req-8a9a6a67-04c4-43ec-b148-f5ad3908b7bf None None] MFA Rules not processed for user `400d1f4db9de49638549e5db29a041e1`. Rule list: `[]` (Enabled: `True`). {{(pid=80396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 16:08:53.048909 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.fernet_utils [None req-8a9a6a67-04c4-43ec-b148-f5ad3908b7bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:08:53.061584 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG dbcounter [-] [80396] Writing DB stats keystone:INSERT=6,keystone:SELECT=87,keystone:DELETE=7 {{(pid=80396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 16:08:53.111276 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 1127/2266] 10.222.0.59 () {58 vars in 957 bytes} [Thu Jun 2 16:08:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 16:08:53.121668 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-434c0d16-723c-456a-b0b8-bda092306381 admin admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:08:53.123151 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.fernet_utils [None req-434c0d16-723c-456a-b0b8-bda092306381 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:08:53.189920 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-434c0d16-723c-456a-b0b8-bda092306381 admin admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:08:53.189920 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48de56d8-7151-43e7-bf46-6136cc6b0e34 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9af40ddfe9ff4be3887b068f13a28dc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c87c981909d4b8db02783421818c79b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:08:53.192631 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48de56d8-7151-43e7-bf46-6136cc6b0e34 service neutron] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:08:53.192631 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48de56d8-7151-43e7-bf46-6136cc6b0e34 service neutron] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:08:53.192631 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48de56d8-7151-43e7-bf46-6136cc6b0e34 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:08:53.200828 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48de56d8-7151-43e7-bf46-6136cc6b0e34 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:08:53.202299 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48de56d8-7151-43e7-bf46-6136cc6b0e34 service neutron] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:08:53.212520 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 1140/2267] 10.222.0.59 () {60 vars in 1365 bytes} [Thu Jun 2 16:08:53 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 16:08:53.665811 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a9a6a67-04c4-43ec-b148-f5ad3908b7bf None None] Authenticating user token {{(pid=80396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:08:53.668274 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.fernet_utils [None req-8a9a6a67-04c4-43ec-b148-f5ad3908b7bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:08:53.685831 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a9a6a67-04c4-43ec-b148-f5ad3908b7bf None None] Validating token access rules against request {{(pid=80396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:08:53.691011 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bae26b2-ff2e-4f3f-bd39-40359cd6945b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f73d5a98be74242b45222df39fb6213', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:08:53.691867 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bae26b2-ff2e-4f3f-bd39-40359cd6945b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:08:53.692151 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bae26b2-ff2e-4f3f-bd39-40359cd6945b admin admin] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:08:53.692462 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bae26b2-ff2e-4f3f-bd39-40359cd6945b admin admin] PATH_INFO: `/v3/projects/e5dafeb23e21452188747ae7b1e6bda4` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:08:53.693708 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bae26b2-ff2e-4f3f-bd39-40359cd6945b admin admin] RBAC: Authorizing `identity:delete_project(project_id=e5dafeb23e21452188747ae7b1e6bda4)` {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:08:53.695739 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bae26b2-ff2e-4f3f-bd39-40359cd6945b admin admin] RBAC: Authorization granted {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:08:53.855647 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.notifications [None req-5bae26b2-ff2e-4f3f-bd39-40359cd6945b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e5dafeb23e21452188747ae7b1e6bda4', 'request_id': 'req-5bae26b2-ff2e-4f3f-bd39-40359cd6945b'} {{(pid=80396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:08:53.862117 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.notifications [None req-5bae26b2-ff2e-4f3f-bd39-40359cd6945b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e5dafeb23e21452188747ae7b1e6bda4', 'request_id': 'req-5bae26b2-ff2e-4f3f-bd39-40359cd6945b'} {{(pid=80396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:08:54.029758 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.notifications [None req-5bae26b2-ff2e-4f3f-bd39-40359cd6945b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e5dafeb23e21452188747ae7b1e6bda4', 'request_id': 'req-5bae26b2-ff2e-4f3f-bd39-40359cd6945b'} {{(pid=80396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:08:54.042057 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.notifications [None req-5bae26b2-ff2e-4f3f-bd39-40359cd6945b admin admin] The token cache is being invalidate because project e5dafeb23e21452188747ae7b1e6bda4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80396) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 02 16:08:54.042376 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.notifications [None req-5bae26b2-ff2e-4f3f-bd39-40359cd6945b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:08:54.043021 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.notifications [None req-5bae26b2-ff2e-4f3f-bd39-40359cd6945b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:08:54.044602 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 1128/2268] 10.222.0.59 () {58 vars in 1232 bytes} [Thu Jun 2 16:08:53 2022] DELETE /identity/v3/projects/e5dafeb23e21452188747ae7b1e6bda4 => generated 0 bytes in 380 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 16:08:54.054715 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48de56d8-7151-43e7-bf46-6136cc6b0e34 service neutron] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:08:54.064866 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48de56d8-7151-43e7-bf46-6136cc6b0e34 service neutron] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:08:54.122204 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d95f677e-49cc-4916-b0ef-6f70e8e490ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f73d5a98be74242b45222df39fb6213', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:08:54.123062 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d95f677e-49cc-4916-b0ef-6f70e8e490ef admin admin] REQUEST_METHOD: `DELETE` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:08:54.123348 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d95f677e-49cc-4916-b0ef-6f70e8e490ef admin admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:08:54.123621 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d95f677e-49cc-4916-b0ef-6f70e8e490ef admin admin] PATH_INFO: `/v3/users/57ad6789d1d4475088826c5d4267a2d7` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:08:54.124781 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d95f677e-49cc-4916-b0ef-6f70e8e490ef admin admin] RBAC: Authorizing `identity:delete_user(user_id=57ad6789d1d4475088826c5d4267a2d7)` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:08:54.126724 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d95f677e-49cc-4916-b0ef-6f70e8e490ef admin admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:08:54.330376 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.notifications [None req-d95f677e-49cc-4916-b0ef-6f70e8e490ef admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '57ad6789d1d4475088826c5d4267a2d7'} {{(pid=80395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:08:54.441355 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.notifications [None req-d95f677e-49cc-4916-b0ef-6f70e8e490ef admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '57ad6789d1d4475088826c5d4267a2d7'} {{(pid=80395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:08:54.452392 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writing DB stats keystone:DELETE=14,keystone:SELECT=84,keystone:INSERT=2 {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 16:08:54.463106 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.notifications [None req-d95f677e-49cc-4916-b0ef-6f70e8e490ef admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '57ad6789d1d4475088826c5d4267a2d7'} {{(pid=80395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:08:54.464090 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.notifications [None req-d95f677e-49cc-4916-b0ef-6f70e8e490ef admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '57ad6789d1d4475088826c5d4267a2d7'} {{(pid=80395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:08:54.470995 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.notifications [None req-d95f677e-49cc-4916-b0ef-6f70e8e490ef admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '57ad6789d1d4475088826c5d4267a2d7'} {{(pid=80395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:08:54.478202 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 1141/2269] 10.222.0.59 () {58 vars in 1223 bytes} [Thu Jun 2 16:08:54 2022] DELETE /identity/v3/users/57ad6789d1d4475088826c5d4267a2d7 => generated 0 bytes in 423 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 16:08:55.509100 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bae26b2-ff2e-4f3f-bd39-40359cd6945b admin admin] Authenticating user token {{(pid=80396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:08:55.514900 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.fernet_utils [None req-5bae26b2-ff2e-4f3f-bd39-40359cd6945b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:08:55.537492 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bae26b2-ff2e-4f3f-bd39-40359cd6945b admin admin] Validating token access rules against request {{(pid=80396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:08:55.684630 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b8a1dba-ea01-4829-a748-41d738ff121d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f73d5a98be74242b45222df39fb6213', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:08:55.685922 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b8a1dba-ea01-4829-a748-41d738ff121d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:08:55.686258 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b8a1dba-ea01-4829-a748-41d738ff121d admin admin] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:08:55.686546 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b8a1dba-ea01-4829-a748-41d738ff121d admin admin] PATH_INFO: `/v3/projects/1162f8fbfdc8496889c733fcde86f781` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:08:55.687986 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b8a1dba-ea01-4829-a748-41d738ff121d admin admin] RBAC: Authorizing `identity:delete_project(project_id=1162f8fbfdc8496889c733fcde86f781)` {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:08:55.689983 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b8a1dba-ea01-4829-a748-41d738ff121d admin admin] RBAC: Authorization granted {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:08:55.861759 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG dbcounter [-] [80396] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 16:08:55.867369 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.notifications [None req-9b8a1dba-ea01-4829-a748-41d738ff121d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1162f8fbfdc8496889c733fcde86f781', 'request_id': 'req-9b8a1dba-ea01-4829-a748-41d738ff121d'} {{(pid=80396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:08:55.875956 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.notifications [None req-9b8a1dba-ea01-4829-a748-41d738ff121d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1162f8fbfdc8496889c733fcde86f781', 'request_id': 'req-9b8a1dba-ea01-4829-a748-41d738ff121d'} {{(pid=80396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:08:55.970616 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.notifications [None req-9b8a1dba-ea01-4829-a748-41d738ff121d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1162f8fbfdc8496889c733fcde86f781', 'request_id': 'req-9b8a1dba-ea01-4829-a748-41d738ff121d'} {{(pid=80396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:08:55.983603 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.notifications [None req-9b8a1dba-ea01-4829-a748-41d738ff121d admin admin] The token cache is being invalidate because project 1162f8fbfdc8496889c733fcde86f781 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80396) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 02 16:08:55.984047 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.notifications [None req-9b8a1dba-ea01-4829-a748-41d738ff121d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:08:55.986657 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.notifications [None req-9b8a1dba-ea01-4829-a748-41d738ff121d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:08:55.988438 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 1129/2270] 10.222.0.59 () {58 vars in 1232 bytes} [Thu Jun 2 16:08:55 2022] DELETE /identity/v3/projects/1162f8fbfdc8496889c733fcde86f781 => generated 0 bytes in 480 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 16:08:55.993399 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a8237b-8e33-48d2-8fca-d47695f4a81b None None] REQUEST_METHOD: `POST` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:08:55.993998 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a8237b-8e33-48d2-8fca-d47695f4a81b None None] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:08:55.993998 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a8237b-8e33-48d2-8fca-d47695f4a81b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:08:56.012116 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.auth.core [None req-a6a8237b-8e33-48d2-8fca-d47695f4a81b None None] MFA Rules not processed for user `400d1f4db9de49638549e5db29a041e1`. Rule list: `[]` (Enabled: `True`). {{(pid=80395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 16:08:56.013866 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.fernet_utils [None req-a6a8237b-8e33-48d2-8fca-d47695f4a81b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:08:56.075295 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 1142/2271] 10.222.0.59 () {58 vars in 957 bytes} [Thu Jun 2 16:08:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 16:08:56.083146 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df5d9d95-72a5-491b-829d-272a6909bf11 None None] REQUEST_METHOD: `POST` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:08:56.083504 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df5d9d95-72a5-491b-829d-272a6909bf11 None None] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:08:56.088482 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df5d9d95-72a5-491b-829d-272a6909bf11 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:08:56.110224 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.auth.core [None req-df5d9d95-72a5-491b-829d-272a6909bf11 None None] MFA Rules not processed for user `400d1f4db9de49638549e5db29a041e1`. Rule list: `[]` (Enabled: `True`). {{(pid=80396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 16:08:56.112496 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.fernet_utils [None req-df5d9d95-72a5-491b-829d-272a6909bf11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:08:56.124058 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 1130/2272] 10.222.0.59 () {58 vars in 957 bytes} [Thu Jun 2 16:08:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 02 16:08:56.137816 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6a8237b-8e33-48d2-8fca-d47695f4a81b None None] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:08:56.145995 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6a8237b-8e33-48d2-8fca-d47695f4a81b None None] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:08:56.153034 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32315d2a-d5f1-4fd3-8852-fceda1298cd4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f73d5a98be74242b45222df39fb6213', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:08:56.154026 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32315d2a-d5f1-4fd3-8852-fceda1298cd4 admin admin] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:08:56.154614 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32315d2a-d5f1-4fd3-8852-fceda1298cd4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:08:56.154966 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32315d2a-d5f1-4fd3-8852-fceda1298cd4 admin admin] PATH_INFO: `/v3/domains` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:08:56.155831 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32315d2a-d5f1-4fd3-8852-fceda1298cd4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80395) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 16:08:56.156268 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32315d2a-d5f1-4fd3-8852-fceda1298cd4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:08:56.158251 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32315d2a-d5f1-4fd3-8852-fceda1298cd4 admin admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:08:56.177088 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 1143/2273] 10.222.0.59 () {58 vars in 1152 bytes} [Thu Jun 2 16:08:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 16:08:56.177912 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df5d9d95-72a5-491b-829d-272a6909bf11 None None] Authenticating user token {{(pid=80396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:08:56.188017 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df5d9d95-72a5-491b-829d-272a6909bf11 None None] Validating token access rules against request {{(pid=80396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:08:56.192976 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a502f15-c9c6-466f-a8ce-3a7f65e19203 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f73d5a98be74242b45222df39fb6213', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:08:56.193721 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a502f15-c9c6-466f-a8ce-3a7f65e19203 admin admin] REQUEST_METHOD: `POST` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:08:56.194324 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a502f15-c9c6-466f-a8ce-3a7f65e19203 admin admin] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:08:56.195714 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a502f15-c9c6-466f-a8ce-3a7f65e19203 admin admin] PATH_INFO: `/v3/projects` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:08:56.196506 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a502f15-c9c6-466f-a8ce-3a7f65e19203 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:08:56.198600 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a502f15-c9c6-466f-a8ce-3a7f65e19203 admin admin] RBAC: Authorization granted {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:08:56.375773 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 1131/2274] 10.222.0.59 () {60 vars in 1152 bytes} [Thu Jun 2 16:08:56 2022] POST /identity/v3/projects => generated 383 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 16:08:56.377267 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32315d2a-d5f1-4fd3-8852-fceda1298cd4 admin admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:08:56.390376 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32315d2a-d5f1-4fd3-8852-fceda1298cd4 admin admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:08:56.455641 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25ab844a-cc3b-4216-8c50-466a891b1510 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f73d5a98be74242b45222df39fb6213', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:08:56.456315 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ab844a-cc3b-4216-8c50-466a891b1510 admin admin] REQUEST_METHOD: `POST` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:08:56.456602 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ab844a-cc3b-4216-8c50-466a891b1510 admin admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:08:56.456886 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ab844a-cc3b-4216-8c50-466a891b1510 admin admin] PATH_INFO: `/v3/users` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:08:56.457578 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25ab844a-cc3b-4216-8c50-466a891b1510 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:08:56.459544 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25ab844a-cc3b-4216-8c50-466a891b1510 admin admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:08:56.559394 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 1144/2275] 10.222.0.59 () {60 vars in 1143 bytes} [Thu Jun 2 16:08:56 2022] POST /identity/v3/users => generated 292 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 16:08:56.563572 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a502f15-c9c6-466f-a8ce-3a7f65e19203 admin admin] Authenticating user token {{(pid=80396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:08:56.574662 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a502f15-c9c6-466f-a8ce-3a7f65e19203 admin admin] Validating token access rules against request {{(pid=80396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:08:56.579128 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29cde867-8fa3-41a6-b76d-57802b64eaf6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f73d5a98be74242b45222df39fb6213', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:08:56.579778 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29cde867-8fa3-41a6-b76d-57802b64eaf6 admin admin] REQUEST_METHOD: `GET` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:08:56.580060 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29cde867-8fa3-41a6-b76d-57802b64eaf6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:08:56.580339 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29cde867-8fa3-41a6-b76d-57802b64eaf6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:08:56.581059 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29cde867-8fa3-41a6-b76d-57802b64eaf6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:08:56.582710 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29cde867-8fa3-41a6-b76d-57802b64eaf6 admin admin] RBAC: Authorization granted {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:08:56.593977 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 1132/2276] 10.222.0.59 () {58 vars in 1121 bytes} [Thu Jun 2 16:08:56 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 16:08:56.598391 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25ab844a-cc3b-4216-8c50-466a891b1510 admin admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:08:56.609156 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25ab844a-cc3b-4216-8c50-466a891b1510 admin admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:08:56.614052 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfa9111f-ea1b-414c-8656-6f5ad539b7b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f73d5a98be74242b45222df39fb6213', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:08:56.614929 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa9111f-ea1b-414c-8656-6f5ad539b7b7 admin admin] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:08:56.615247 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa9111f-ea1b-414c-8656-6f5ad539b7b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:08:56.615529 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa9111f-ea1b-414c-8656-6f5ad539b7b7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:08:56.616267 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfa9111f-ea1b-414c-8656-6f5ad539b7b7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:08:56.617870 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfa9111f-ea1b-414c-8656-6f5ad539b7b7 admin admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:08:56.632827 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 1145/2277] 10.222.0.59 () {58 vars in 1121 bytes} [Thu Jun 2 16:08:56 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 16:08:56.633761 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29cde867-8fa3-41a6-b76d-57802b64eaf6 admin admin] Authenticating user token {{(pid=80396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:08:56.645005 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29cde867-8fa3-41a6-b76d-57802b64eaf6 admin admin] Validating token access rules against request {{(pid=80396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:08:56.649614 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60241076-fb31-45ba-b7bd-9ccf29db1a35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f73d5a98be74242b45222df39fb6213', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:08:56.650575 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60241076-fb31-45ba-b7bd-9ccf29db1a35 admin admin] REQUEST_METHOD: `PUT` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:08:56.651032 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60241076-fb31-45ba-b7bd-9ccf29db1a35 admin admin] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:08:56.651312 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60241076-fb31-45ba-b7bd-9ccf29db1a35 admin admin] PATH_INFO: `/v3/projects/b8697dec67dc47c5a78dc3bd61fb4492/users/b6608174d5824726b614bd454a286428/roles/649e0f2b5a264c419ea6a1441f123a03` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:08:56.668865 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60241076-fb31-45ba-b7bd-9ccf29db1a35 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b8697dec67dc47c5a78dc3bd61fb4492, user_id=b6608174d5824726b614bd454a286428, role_id=649e0f2b5a264c419ea6a1441f123a03)` {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:08:56.671905 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60241076-fb31-45ba-b7bd-9ccf29db1a35 admin admin] RBAC: Authorization granted {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:08:56.749520 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 1133/2278] 10.222.0.59 () {60 vars in 1482 bytes} [Thu Jun 2 16:08:56 2022] PUT /identity/v3/projects/b8697dec67dc47c5a78dc3bd61fb4492/users/b6608174d5824726b614bd454a286428/roles/649e0f2b5a264c419ea6a1441f123a03 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 16:08:56.763512 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad5231e3-e435-4708-b6a2-0f855fdc30eb None None] REQUEST_METHOD: `POST` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:08:56.763994 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad5231e3-e435-4708-b6a2-0f855fdc30eb None None] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:08:56.764419 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad5231e3-e435-4708-b6a2-0f855fdc30eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:08:56.796985 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.auth.core [None req-ad5231e3-e435-4708-b6a2-0f855fdc30eb None None] MFA Rules not processed for user `b6608174d5824726b614bd454a286428`. Rule list: `[]` (Enabled: `True`). {{(pid=80395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 16:08:56.799186 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.fernet_utils [None req-ad5231e3-e435-4708-b6a2-0f855fdc30eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:08:56.849647 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writing DB stats keystone:SELECT=96,keystone:DELETE=1,keystone:INSERT=3 {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 16:08:56.884222 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 1146/2279] 10.222.0.59 () {58 vars in 957 bytes} [Thu Jun 2 16:08:56 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 16:08:56.896544 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60241076-fb31-45ba-b7bd-9ccf29db1a35 admin admin] Authenticating user token {{(pid=80396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:08:56.898669 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.fernet_utils [None req-60241076-fb31-45ba-b7bd-9ccf29db1a35 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:08:56.956587 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60241076-fb31-45ba-b7bd-9ccf29db1a35 admin admin] Validating token access rules against request {{(pid=80396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:08:56.960538 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b14e435-0ed7-45b6-837e-1db31b11e848 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6534961c369940a5b88f310c6450250b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c87c981909d4b8db02783421818c79b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:08:56.961174 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b14e435-0ed7-45b6-837e-1db31b11e848 service cinder] REQUEST_METHOD: `GET` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:08:56.961457 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b14e435-0ed7-45b6-837e-1db31b11e848 service cinder] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:08:56.961732 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b14e435-0ed7-45b6-837e-1db31b11e848 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:08:56.971415 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b14e435-0ed7-45b6-837e-1db31b11e848 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:08:56.976439 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b14e435-0ed7-45b6-837e-1db31b11e848 service cinder] RBAC: Authorization granted {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:08:56.982280 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 1134/2280] 10.222.0.59 () {60 vars in 1365 bytes} [Thu Jun 2 16:08:56 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 02 16:08:57.003318 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad5231e3-e435-4708-b6a2-0f855fdc30eb None None] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:08:57.067596 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad5231e3-e435-4708-b6a2-0f855fdc30eb None None] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:08:57.073266 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a663c4fc-f2a3-4a83-a25b-e5571de39da4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f73d5a98be74242b45222df39fb6213', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:08:57.074196 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a663c4fc-f2a3-4a83-a25b-e5571de39da4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:08:57.074483 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a663c4fc-f2a3-4a83-a25b-e5571de39da4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:08:57.074760 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a663c4fc-f2a3-4a83-a25b-e5571de39da4 admin admin] PATH_INFO: `/v3/users/b6608174d5824726b614bd454a286428` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:08:57.075962 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a663c4fc-f2a3-4a83-a25b-e5571de39da4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b6608174d5824726b614bd454a286428)` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:08:57.077879 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a663c4fc-f2a3-4a83-a25b-e5571de39da4 admin admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:08:57.324712 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.notifications [None req-a663c4fc-f2a3-4a83-a25b-e5571de39da4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b6608174d5824726b614bd454a286428'} {{(pid=80395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:08:57.435276 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.notifications [None req-a663c4fc-f2a3-4a83-a25b-e5571de39da4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b6608174d5824726b614bd454a286428'} {{(pid=80395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:08:57.448395 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.notifications [None req-a663c4fc-f2a3-4a83-a25b-e5571de39da4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b6608174d5824726b614bd454a286428'} {{(pid=80395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:08:57.449076 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.notifications [None req-a663c4fc-f2a3-4a83-a25b-e5571de39da4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b6608174d5824726b614bd454a286428'} {{(pid=80395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:08:57.455869 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.notifications [None req-a663c4fc-f2a3-4a83-a25b-e5571de39da4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b6608174d5824726b614bd454a286428'} {{(pid=80395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:08:57.461698 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 1147/2281] 10.222.0.59 () {58 vars in 1223 bytes} [Thu Jun 2 16:08:57 2022] DELETE /identity/v3/users/b6608174d5824726b614bd454a286428 => generated 0 bytes in 459 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 16:08:57.466593 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4212a20-3e5c-45e1-bad2-79f119c6ae17 None None] REQUEST_METHOD: `POST` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:08:57.466949 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4212a20-3e5c-45e1-bad2-79f119c6ae17 None None] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:08:57.467249 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4212a20-3e5c-45e1-bad2-79f119c6ae17 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:08:57.485393 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.auth.core [None req-a4212a20-3e5c-45e1-bad2-79f119c6ae17 None None] MFA Rules not processed for user `400d1f4db9de49638549e5db29a041e1`. Rule list: `[]` (Enabled: `True`). {{(pid=80396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 16:08:57.486633 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.fernet_utils [None req-a4212a20-3e5c-45e1-bad2-79f119c6ae17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:08:57.549216 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 1135/2282] 10.222.0.59 () {58 vars in 957 bytes} [Thu Jun 2 16:08:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 02 16:08:57.560099 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a663c4fc-f2a3-4a83-a25b-e5571de39da4 admin admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:08:57.561581 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.fernet_utils [None req-a663c4fc-f2a3-4a83-a25b-e5571de39da4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:08:57.622706 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a663c4fc-f2a3-4a83-a25b-e5571de39da4 admin admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:08:57.626310 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-290861c9-30e4-451d-a213-c8d158ccf2b0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9af40ddfe9ff4be3887b068f13a28dc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c87c981909d4b8db02783421818c79b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:08:57.626968 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290861c9-30e4-451d-a213-c8d158ccf2b0 service neutron] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:08:57.627254 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290861c9-30e4-451d-a213-c8d158ccf2b0 service neutron] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:08:57.627532 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290861c9-30e4-451d-a213-c8d158ccf2b0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:08:57.635385 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 16:08:57.637977 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-290861c9-30e4-451d-a213-c8d158ccf2b0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:08:57.639464 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-290861c9-30e4-451d-a213-c8d158ccf2b0 service neutron] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:08:57.649654 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 1148/2283] 10.222.0.59 () {60 vars in 1365 bytes} [Thu Jun 2 16:08:57 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 16:08:58.315899 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4212a20-3e5c-45e1-bad2-79f119c6ae17 None None] Authenticating user token {{(pid=80396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:08:58.317528 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.fernet_utils [None req-a4212a20-3e5c-45e1-bad2-79f119c6ae17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:08:58.334499 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4212a20-3e5c-45e1-bad2-79f119c6ae17 None None] Validating token access rules against request {{(pid=80396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:08:58.340490 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22fb742c-8507-4287-9cc9-87c2a70fd478 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f73d5a98be74242b45222df39fb6213', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:08:58.341350 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22fb742c-8507-4287-9cc9-87c2a70fd478 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:08:58.341628 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22fb742c-8507-4287-9cc9-87c2a70fd478 admin admin] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:08:58.341900 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22fb742c-8507-4287-9cc9-87c2a70fd478 admin admin] PATH_INFO: `/v3/projects/b8697dec67dc47c5a78dc3bd61fb4492` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:08:58.343116 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22fb742c-8507-4287-9cc9-87c2a70fd478 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b8697dec67dc47c5a78dc3bd61fb4492)` {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:08:58.345081 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22fb742c-8507-4287-9cc9-87c2a70fd478 admin admin] RBAC: Authorization granted {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:08:58.351931 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG dbcounter [-] [80396] Writing DB stats keystone:SELECT=93,keystone:DELETE=4,keystone:INSERT=3 {{(pid=80396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 16:08:58.481818 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.notifications [None req-22fb742c-8507-4287-9cc9-87c2a70fd478 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b8697dec67dc47c5a78dc3bd61fb4492', 'request_id': 'req-22fb742c-8507-4287-9cc9-87c2a70fd478'} {{(pid=80396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:08:58.487962 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.notifications [None req-22fb742c-8507-4287-9cc9-87c2a70fd478 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b8697dec67dc47c5a78dc3bd61fb4492', 'request_id': 'req-22fb742c-8507-4287-9cc9-87c2a70fd478'} {{(pid=80396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:08:58.598713 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.notifications [None req-22fb742c-8507-4287-9cc9-87c2a70fd478 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b8697dec67dc47c5a78dc3bd61fb4492', 'request_id': 'req-22fb742c-8507-4287-9cc9-87c2a70fd478'} {{(pid=80396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:08:58.609366 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.notifications [None req-22fb742c-8507-4287-9cc9-87c2a70fd478 admin admin] The token cache is being invalidate because project b8697dec67dc47c5a78dc3bd61fb4492 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80396) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 02 16:08:58.609658 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.notifications [None req-22fb742c-8507-4287-9cc9-87c2a70fd478 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:08:58.610313 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.notifications [None req-22fb742c-8507-4287-9cc9-87c2a70fd478 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:08:58.611926 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 1136/2284] 10.222.0.59 () {58 vars in 1232 bytes} [Thu Jun 2 16:08:58 2022] DELETE /identity/v3/projects/b8697dec67dc47c5a78dc3bd61fb4492 => generated 0 bytes in 297 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 16:08:58.617035 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-274ba807-73be-455a-9a51-6e56c75cb257 None None] REQUEST_METHOD: `POST` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:08:58.617579 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-274ba807-73be-455a-9a51-6e56c75cb257 None None] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:08:58.617579 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-274ba807-73be-455a-9a51-6e56c75cb257 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:08:58.637459 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.auth.core [None req-274ba807-73be-455a-9a51-6e56c75cb257 None None] MFA Rules not processed for user `400d1f4db9de49638549e5db29a041e1`. Rule list: `[]` (Enabled: `True`). {{(pid=80395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 16:08:58.638683 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.fernet_utils [None req-274ba807-73be-455a-9a51-6e56c75cb257 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:08:58.700434 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 1149/2285] 10.222.0.59 () {58 vars in 957 bytes} [Thu Jun 2 16:08:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 16:08:58.714457 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5825e7cc-3120-4d23-ae30-8fc7357ce1b4 None None] REQUEST_METHOD: `POST` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:08:58.714836 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5825e7cc-3120-4d23-ae30-8fc7357ce1b4 None None] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:08:58.715122 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5825e7cc-3120-4d23-ae30-8fc7357ce1b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:08:58.733996 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.auth.core [None req-5825e7cc-3120-4d23-ae30-8fc7357ce1b4 None None] MFA Rules not processed for user `400d1f4db9de49638549e5db29a041e1`. Rule list: `[]` (Enabled: `True`). {{(pid=80396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 16:08:58.735213 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.fernet_utils [None req-5825e7cc-3120-4d23-ae30-8fc7357ce1b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:08:58.743171 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 1137/2286] 10.222.0.59 () {58 vars in 957 bytes} [Thu Jun 2 16:08:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 16:08:58.747473 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-274ba807-73be-455a-9a51-6e56c75cb257 None None] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:08:58.757373 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-274ba807-73be-455a-9a51-6e56c75cb257 None None] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:08:58.763641 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae462d83-f9f3-40c4-8ab8-f77a89cc5793 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f73d5a98be74242b45222df39fb6213', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:08:58.764477 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae462d83-f9f3-40c4-8ab8-f77a89cc5793 admin admin] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:08:58.764767 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae462d83-f9f3-40c4-8ab8-f77a89cc5793 admin admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:08:58.765092 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae462d83-f9f3-40c4-8ab8-f77a89cc5793 admin admin] PATH_INFO: `/v3/domains` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:08:58.765776 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae462d83-f9f3-40c4-8ab8-f77a89cc5793 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80395) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 16:08:58.766188 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae462d83-f9f3-40c4-8ab8-f77a89cc5793 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:08:58.767781 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae462d83-f9f3-40c4-8ab8-f77a89cc5793 admin admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:08:58.781329 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 1150/2287] 10.222.0.59 () {58 vars in 1152 bytes} [Thu Jun 2 16:08:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 16:08:58.785754 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5825e7cc-3120-4d23-ae30-8fc7357ce1b4 None None] Authenticating user token {{(pid=80396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:08:58.796651 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5825e7cc-3120-4d23-ae30-8fc7357ce1b4 None None] Validating token access rules against request {{(pid=80396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:08:58.802868 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27f0f5c5-55fb-4354-92db-bb97e28314ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f73d5a98be74242b45222df39fb6213', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:08:58.805211 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f0f5c5-55fb-4354-92db-bb97e28314ad admin admin] REQUEST_METHOD: `POST` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:08:58.805211 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f0f5c5-55fb-4354-92db-bb97e28314ad admin admin] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:08:58.805211 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f0f5c5-55fb-4354-92db-bb97e28314ad admin admin] PATH_INFO: `/v3/projects` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:08:58.805211 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27f0f5c5-55fb-4354-92db-bb97e28314ad admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:08:58.807553 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27f0f5c5-55fb-4354-92db-bb97e28314ad admin admin] RBAC: Authorization granted {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:08:58.911686 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 1138/2288] 10.222.0.59 () {60 vars in 1152 bytes} [Thu Jun 2 16:08:58 2022] POST /identity/v3/projects => generated 377 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 02 16:08:58.915829 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae462d83-f9f3-40c4-8ab8-f77a89cc5793 admin admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:08:58.926336 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae462d83-f9f3-40c4-8ab8-f77a89cc5793 admin admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:08:58.987276 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9250dfb5-733f-4264-a0ec-dd7717eeb86a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f73d5a98be74242b45222df39fb6213', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:08:58.987947 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9250dfb5-733f-4264-a0ec-dd7717eeb86a admin admin] REQUEST_METHOD: `POST` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:08:58.988234 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9250dfb5-733f-4264-a0ec-dd7717eeb86a admin admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:08:58.988516 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9250dfb5-733f-4264-a0ec-dd7717eeb86a admin admin] PATH_INFO: `/v3/users` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:08:58.989220 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9250dfb5-733f-4264-a0ec-dd7717eeb86a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:08:58.991194 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9250dfb5-733f-4264-a0ec-dd7717eeb86a admin admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:08:59.088793 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 1151/2289] 10.222.0.59 () {60 vars in 1143 bytes} [Thu Jun 2 16:08:58 2022] POST /identity/v3/users => generated 289 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 16:08:59.093922 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27f0f5c5-55fb-4354-92db-bb97e28314ad admin admin] Authenticating user token {{(pid=80396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:08:59.105159 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27f0f5c5-55fb-4354-92db-bb97e28314ad admin admin] Validating token access rules against request {{(pid=80396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:08:59.109977 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42eb23b2-c7ff-4730-9e2a-8ea8bd052359 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f73d5a98be74242b45222df39fb6213', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:08:59.110726 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42eb23b2-c7ff-4730-9e2a-8ea8bd052359 admin admin] REQUEST_METHOD: `GET` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:08:59.111055 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42eb23b2-c7ff-4730-9e2a-8ea8bd052359 admin admin] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:08:59.111394 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42eb23b2-c7ff-4730-9e2a-8ea8bd052359 admin admin] PATH_INFO: `/v3/roles` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:08:59.112157 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42eb23b2-c7ff-4730-9e2a-8ea8bd052359 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:08:59.113891 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42eb23b2-c7ff-4730-9e2a-8ea8bd052359 admin admin] RBAC: Authorization granted {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:08:59.125663 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 1139/2290] 10.222.0.59 () {58 vars in 1121 bytes} [Thu Jun 2 16:08:59 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 16:08:59.130276 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9250dfb5-733f-4264-a0ec-dd7717eeb86a admin admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:08:59.144102 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9250dfb5-733f-4264-a0ec-dd7717eeb86a admin admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:08:59.149673 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9004bab3-2b7f-4119-876b-90c7803225fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f73d5a98be74242b45222df39fb6213', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:08:59.150595 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9004bab3-2b7f-4119-876b-90c7803225fa admin admin] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:08:59.150943 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9004bab3-2b7f-4119-876b-90c7803225fa admin admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:08:59.151303 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9004bab3-2b7f-4119-876b-90c7803225fa admin admin] PATH_INFO: `/v3/roles` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:08:59.152172 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9004bab3-2b7f-4119-876b-90c7803225fa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:08:59.154119 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9004bab3-2b7f-4119-876b-90c7803225fa admin admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:08:59.174495 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 1152/2291] 10.222.0.59 () {58 vars in 1121 bytes} [Thu Jun 2 16:08:59 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 16:08:59.177091 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42eb23b2-c7ff-4730-9e2a-8ea8bd052359 admin admin] Authenticating user token {{(pid=80396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:08:59.188724 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42eb23b2-c7ff-4730-9e2a-8ea8bd052359 admin admin] Validating token access rules against request {{(pid=80396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:08:59.194253 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fb8b218-435b-4ea1-ad3b-9d93ef45e4fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f73d5a98be74242b45222df39fb6213', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:08:59.196535 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb8b218-435b-4ea1-ad3b-9d93ef45e4fe admin admin] REQUEST_METHOD: `PUT` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:08:59.197768 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb8b218-435b-4ea1-ad3b-9d93ef45e4fe admin admin] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:08:59.197768 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb8b218-435b-4ea1-ad3b-9d93ef45e4fe admin admin] PATH_INFO: `/v3/projects/4b280a4292c04e8896778ac2649b4151/users/6ec1a412f8a6403ba59845b0559a81d2/roles/649e0f2b5a264c419ea6a1441f123a03` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:08:59.216336 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fb8b218-435b-4ea1-ad3b-9d93ef45e4fe admin admin] RBAC: Authorizing `identity:create_grant(project_id=4b280a4292c04e8896778ac2649b4151, user_id=6ec1a412f8a6403ba59845b0559a81d2, role_id=649e0f2b5a264c419ea6a1441f123a03)` {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:08:59.219155 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fb8b218-435b-4ea1-ad3b-9d93ef45e4fe admin admin] RBAC: Authorization granted {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:08:59.299967 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 1140/2292] 10.222.0.59 () {60 vars in 1482 bytes} [Thu Jun 2 16:08:59 2022] PUT /identity/v3/projects/4b280a4292c04e8896778ac2649b4151/users/6ec1a412f8a6403ba59845b0559a81d2/roles/649e0f2b5a264c419ea6a1441f123a03 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 02 16:08:59.311399 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16465c17-0206-4c30-89af-fff5bc38809e None None] REQUEST_METHOD: `POST` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:08:59.311533 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16465c17-0206-4c30-89af-fff5bc38809e None None] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:08:59.311785 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16465c17-0206-4c30-89af-fff5bc38809e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:08:59.341349 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.auth.core [None req-16465c17-0206-4c30-89af-fff5bc38809e None None] MFA Rules not processed for user `6ec1a412f8a6403ba59845b0559a81d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 16:08:59.342858 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.fernet_utils [None req-16465c17-0206-4c30-89af-fff5bc38809e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:08:59.391136 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 16:08:59.407728 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 1153/2293] 10.222.0.59 () {58 vars in 957 bytes} [Thu Jun 2 16:08:59 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 16:08:59.419808 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fb8b218-435b-4ea1-ad3b-9d93ef45e4fe admin admin] Authenticating user token {{(pid=80396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:08:59.421689 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.fernet_utils [None req-5fb8b218-435b-4ea1-ad3b-9d93ef45e4fe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:08:59.503835 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fb8b218-435b-4ea1-ad3b-9d93ef45e4fe admin admin] Validating token access rules against request {{(pid=80396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:08:59.507561 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7b8a451-7d4b-4a53-98a9-680a4569275c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6534961c369940a5b88f310c6450250b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c87c981909d4b8db02783421818c79b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:08:59.508245 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b8a451-7d4b-4a53-98a9-680a4569275c service cinder] REQUEST_METHOD: `GET` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:08:59.508537 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b8a451-7d4b-4a53-98a9-680a4569275c service cinder] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:08:59.508814 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b8a451-7d4b-4a53-98a9-680a4569275c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:08:59.517500 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7b8a451-7d4b-4a53-98a9-680a4569275c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:08:59.518957 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7b8a451-7d4b-4a53-98a9-680a4569275c service cinder] RBAC: Authorization granted {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:08:59.527732 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 1141/2294] 10.222.0.59 () {60 vars in 1365 bytes} [Thu Jun 2 16:08:59 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 16:09:09.492405 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writing DB stats keystone:SELECT=4 {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 16:09:09.523672 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG dbcounter [-] [80396] Writing DB stats keystone:SELECT=84,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 16:09:11.561792 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-876069b5-4ea6-4dcc-b9ad-7b0274965dbe None None] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:09:11.562348 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-876069b5-4ea6-4dcc-b9ad-7b0274965dbe None None] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:09:11.562596 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-876069b5-4ea6-4dcc-b9ad-7b0274965dbe None None] PATH_INFO: `/` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:09:11.564116 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 1154/2295] 10.222.0.59 () {54 vars in 921 bytes} [Thu Jun 2 16:09:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 16:09:11.574704 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9929249c-3406-4b88-aab8-01fa1356c2a2 None None] REQUEST_METHOD: `POST` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:09:11.575564 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9929249c-3406-4b88-aab8-01fa1356c2a2 None None] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:09:11.575852 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9929249c-3406-4b88-aab8-01fa1356c2a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:09:11.653718 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.auth.core [None req-9929249c-3406-4b88-aab8-01fa1356c2a2 None None] MFA Rules not processed for user `52f9fe4b13574516bb0a8e2aa11a61e8`. Rule list: `[]` (Enabled: `True`). {{(pid=80396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 16:09:11.655611 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.fernet_utils [None req-9929249c-3406-4b88-aab8-01fa1356c2a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:09:11.744997 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 1142/2296] 10.222.0.59 () {58 vars in 1018 bytes} [Thu Jun 2 16:09:11 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 16:09:11.757122 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-876069b5-4ea6-4dcc-b9ad-7b0274965dbe None None] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:09:11.758934 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.fernet_utils [None req-876069b5-4ea6-4dcc-b9ad-7b0274965dbe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:09:11.778172 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-876069b5-4ea6-4dcc-b9ad-7b0274965dbe None None] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:09:11.783893 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-968a8ef9-f50e-420c-ba96-3449fa7e4e2c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52f9fe4b13574516bb0a8e2aa11a61e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c87c981909d4b8db02783421818c79b', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:09:11.784544 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-968a8ef9-f50e-420c-ba96-3449fa7e4e2c service nova] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:09:11.784823 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-968a8ef9-f50e-420c-ba96-3449fa7e4e2c service nova] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:09:11.785101 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-968a8ef9-f50e-420c-ba96-3449fa7e4e2c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:09:11.795126 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-968a8ef9-f50e-420c-ba96-3449fa7e4e2c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:09:11.796753 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-968a8ef9-f50e-420c-ba96-3449fa7e4e2c service nova] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:09:11.809053 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 1155/2297] 10.222.0.59 () {60 vars in 1365 bytes} [Thu Jun 2 16:09:11 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 16:09:21.741831 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG dbcounter [-] [80396] Writing DB stats keystone:SELECT=53 {{(pid=80396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 16:09:21.803202 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writing DB stats keystone:SELECT=6 {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 16:09:33.417812 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9929249c-3406-4b88-aab8-01fa1356c2a2 None None] Authenticating user token {{(pid=80396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:09:33.419276 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.fernet_utils [None req-9929249c-3406-4b88-aab8-01fa1356c2a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:09:33.505257 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9929249c-3406-4b88-aab8-01fa1356c2a2 None None] Validating token access rules against request {{(pid=80396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:09:33.511570 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5b58f3e-16db-4837-a51a-69e610374c67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f73d5a98be74242b45222df39fb6213', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:09:33.512441 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b58f3e-16db-4837-a51a-69e610374c67 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:09:33.512720 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b58f3e-16db-4837-a51a-69e610374c67 admin admin] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:09:33.512993 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b58f3e-16db-4837-a51a-69e610374c67 admin admin] PATH_INFO: `/v3/users/d15b0fa025674425b20b4383b1b8ec54` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:09:33.514317 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5b58f3e-16db-4837-a51a-69e610374c67 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d15b0fa025674425b20b4383b1b8ec54)` {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:09:33.516556 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5b58f3e-16db-4837-a51a-69e610374c67 admin admin] RBAC: Authorization granted {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:09:33.718802 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.notifications [None req-a5b58f3e-16db-4837-a51a-69e610374c67 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd15b0fa025674425b20b4383b1b8ec54'} {{(pid=80396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:09:33.719380 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.notifications [None req-a5b58f3e-16db-4837-a51a-69e610374c67 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd15b0fa025674425b20b4383b1b8ec54'} {{(pid=80396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:09:33.788050 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.notifications [None req-a5b58f3e-16db-4837-a51a-69e610374c67 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd15b0fa025674425b20b4383b1b8ec54'} {{(pid=80396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:09:33.801271 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.notifications [None req-a5b58f3e-16db-4837-a51a-69e610374c67 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd15b0fa025674425b20b4383b1b8ec54'} {{(pid=80396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:09:33.808471 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.notifications [None req-a5b58f3e-16db-4837-a51a-69e610374c67 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd15b0fa025674425b20b4383b1b8ec54'} {{(pid=80396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:09:33.815302 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 1143/2298] 10.222.0.59 () {58 vars in 1223 bytes} [Thu Jun 2 16:09:33 2022] DELETE /identity/v3/users/d15b0fa025674425b20b4383b1b8ec54 => generated 0 bytes in 398 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 16:09:33.819638 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9689765-9207-44bd-83d7-b1703a8e4792 None None] REQUEST_METHOD: `POST` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:09:33.820128 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9689765-9207-44bd-83d7-b1703a8e4792 None None] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:09:33.820241 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9689765-9207-44bd-83d7-b1703a8e4792 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:09:33.823109 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5b58f3e-16db-4837-a51a-69e610374c67 admin admin] Authenticating user token {{(pid=80396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:09:33.824509 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.fernet_utils [None req-a5b58f3e-16db-4837-a51a-69e610374c67 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:09:33.847749 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.auth.core [None req-c9689765-9207-44bd-83d7-b1703a8e4792 None None] MFA Rules not processed for user `400d1f4db9de49638549e5db29a041e1`. Rule list: `[]` (Enabled: `True`). {{(pid=80395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 16:09:33.849159 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.fernet_utils [None req-c9689765-9207-44bd-83d7-b1703a8e4792 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:09:33.922562 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 1156/2299] 10.222.0.59 () {58 vars in 957 bytes} [Thu Jun 2 16:09:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 02 16:09:33.932468 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9689765-9207-44bd-83d7-b1703a8e4792 None None] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:09:33.934044 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.fernet_utils [None req-c9689765-9207-44bd-83d7-b1703a8e4792 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:09:33.952704 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG dbcounter [-] [80396] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 16:09:33.958403 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5b58f3e-16db-4837-a51a-69e610374c67 admin admin] Validating token access rules against request {{(pid=80396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:09:33.972740 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dd38084-6f84-475a-843a-a155961a6d2e service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b700f6d94374ba4b362a8f0d5b35796', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c87c981909d4b8db02783421818c79b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:09:33.973567 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd38084-6f84-475a-843a-a155961a6d2e service placement] REQUEST_METHOD: `GET` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:09:33.974034 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd38084-6f84-475a-843a-a155961a6d2e service placement] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:09:33.974384 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd38084-6f84-475a-843a-a155961a6d2e service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:09:33.977505 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.fernet_utils [None req-7dd38084-6f84-475a-843a-a155961a6d2e service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:09:33.992374 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dd38084-6f84-475a-843a-a155961a6d2e service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:09:33.994683 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dd38084-6f84-475a-843a-a155961a6d2e service placement] RBAC: Authorization granted {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:09:34.005979 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 1144/2300] 10.222.0.59 () {60 vars in 1365 bytes} [Thu Jun 2 16:09:33 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 183 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 16:09:34.010699 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9689765-9207-44bd-83d7-b1703a8e4792 None None] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:09:34.021150 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d5e1165-e9a6-40e0-87f2-e8a8b5b70b79 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9af40ddfe9ff4be3887b068f13a28dc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c87c981909d4b8db02783421818c79b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:09:34.021883 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d5e1165-e9a6-40e0-87f2-e8a8b5b70b79 service neutron] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:09:34.022271 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d5e1165-e9a6-40e0-87f2-e8a8b5b70b79 service neutron] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:09:34.022861 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d5e1165-e9a6-40e0-87f2-e8a8b5b70b79 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:09:34.033957 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d5e1165-e9a6-40e0-87f2-e8a8b5b70b79 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:09:34.035557 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d5e1165-e9a6-40e0-87f2-e8a8b5b70b79 service neutron] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:09:34.046923 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 1157/2301] 10.222.0.59 () {60 vars in 1365 bytes} [Thu Jun 2 16:09:33 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 02 16:09:34.571367 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dd38084-6f84-475a-843a-a155961a6d2e service placement] Authenticating user token {{(pid=80396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:09:34.574446 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.fernet_utils [None req-7dd38084-6f84-475a-843a-a155961a6d2e service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:09:34.597059 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dd38084-6f84-475a-843a-a155961a6d2e service placement] Validating token access rules against request {{(pid=80396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:09:34.602368 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e8c25ee-2771-4385-a3aa-0a3a9123351c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f73d5a98be74242b45222df39fb6213', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:09:34.603718 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e8c25ee-2771-4385-a3aa-0a3a9123351c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:09:34.604111 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e8c25ee-2771-4385-a3aa-0a3a9123351c admin admin] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:09:34.604521 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e8c25ee-2771-4385-a3aa-0a3a9123351c admin admin] PATH_INFO: `/v3/projects/cd455e3c8f5446d2b10bdf1c1e460a87` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:09:34.606463 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e8c25ee-2771-4385-a3aa-0a3a9123351c admin admin] RBAC: Authorizing `identity:delete_project(project_id=cd455e3c8f5446d2b10bdf1c1e460a87)` {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:09:34.607808 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e8c25ee-2771-4385-a3aa-0a3a9123351c admin admin] RBAC: Authorization granted {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:09:34.731641 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.notifications [None req-1e8c25ee-2771-4385-a3aa-0a3a9123351c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cd455e3c8f5446d2b10bdf1c1e460a87', 'request_id': 'req-1e8c25ee-2771-4385-a3aa-0a3a9123351c'} {{(pid=80396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:09:34.738598 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.notifications [None req-1e8c25ee-2771-4385-a3aa-0a3a9123351c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cd455e3c8f5446d2b10bdf1c1e460a87', 'request_id': 'req-1e8c25ee-2771-4385-a3aa-0a3a9123351c'} {{(pid=80396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:09:34.936356 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.notifications [None req-1e8c25ee-2771-4385-a3aa-0a3a9123351c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cd455e3c8f5446d2b10bdf1c1e460a87', 'request_id': 'req-1e8c25ee-2771-4385-a3aa-0a3a9123351c'} {{(pid=80396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:09:34.948882 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.notifications [None req-1e8c25ee-2771-4385-a3aa-0a3a9123351c admin admin] The token cache is being invalidate because project cd455e3c8f5446d2b10bdf1c1e460a87 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80396) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 02 16:09:34.949183 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.notifications [None req-1e8c25ee-2771-4385-a3aa-0a3a9123351c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:09:34.949876 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.notifications [None req-1e8c25ee-2771-4385-a3aa-0a3a9123351c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:09:34.951551 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 1145/2302] 10.222.0.59 () {58 vars in 1232 bytes} [Thu Jun 2 16:09:34 2022] DELETE /identity/v3/projects/cd455e3c8f5446d2b10bdf1c1e460a87 => generated 0 bytes in 381 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 16:09:40.621022 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1121e76-302c-4fd1-a74d-895158d97636 None None] REQUEST_METHOD: `POST` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:09:40.621532 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1121e76-302c-4fd1-a74d-895158d97636 None None] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:09:40.621642 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1121e76-302c-4fd1-a74d-895158d97636 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:09:40.640241 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.auth.core [None req-d1121e76-302c-4fd1-a74d-895158d97636 None None] MFA Rules not processed for user `a8658730ea2a4a06b7b4070976c6397f`. Rule list: `[]` (Enabled: `True`). {{(pid=80395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 16:09:40.641447 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.fernet_utils [None req-d1121e76-302c-4fd1-a74d-895158d97636 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:09:40.695951 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 1158/2303] 10.222.0.59 () {58 vars in 957 bytes} [Thu Jun 2 16:09:40 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 16:09:44.944290 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG dbcounter [-] [80396] Writing DB stats keystone:SELECT=32,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 16:09:50.689288 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writing DB stats keystone:SELECT=78 {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 16:09:56.404692 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e8c25ee-2771-4385-a3aa-0a3a9123351c admin admin] Authenticating user token {{(pid=80396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:09:56.406361 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.fernet_utils [None req-1e8c25ee-2771-4385-a3aa-0a3a9123351c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:09:56.477635 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e8c25ee-2771-4385-a3aa-0a3a9123351c admin admin] Validating token access rules against request {{(pid=80396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:09:56.483449 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-262b7e6c-07f9-41ed-9ac4-e978accc5db0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f73d5a98be74242b45222df39fb6213', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:09:56.484323 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262b7e6c-07f9-41ed-9ac4-e978accc5db0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:09:56.484606 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262b7e6c-07f9-41ed-9ac4-e978accc5db0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:09:56.484877 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262b7e6c-07f9-41ed-9ac4-e978accc5db0 admin admin] PATH_INFO: `/v3/users/6ec1a412f8a6403ba59845b0559a81d2` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:09:56.486096 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-262b7e6c-07f9-41ed-9ac4-e978accc5db0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6ec1a412f8a6403ba59845b0559a81d2)` {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:09:56.488017 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-262b7e6c-07f9-41ed-9ac4-e978accc5db0 admin admin] RBAC: Authorization granted {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:09:56.652986 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1121e76-302c-4fd1-a74d-895158d97636 None None] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:09:56.654451 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.fernet_utils [None req-d1121e76-302c-4fd1-a74d-895158d97636 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:09:56.667632 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1121e76-302c-4fd1-a74d-895158d97636 None None] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:09:56.672014 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-651af904-1957-445a-b7a4-7cb508e13239 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f73d5a98be74242b45222df39fb6213', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:09:56.672864 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-651af904-1957-445a-b7a4-7cb508e13239 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:09:56.679240 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-651af904-1957-445a-b7a4-7cb508e13239 admin admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:09:56.679240 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-651af904-1957-445a-b7a4-7cb508e13239 admin admin] PATH_INFO: `/v3/users/5413eb32f0a04b2996a78f974877c52e` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:09:56.679240 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-651af904-1957-445a-b7a4-7cb508e13239 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5413eb32f0a04b2996a78f974877c52e)` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:09:56.679240 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-651af904-1957-445a-b7a4-7cb508e13239 admin admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:09:56.752478 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.notifications [None req-262b7e6c-07f9-41ed-9ac4-e978accc5db0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6ec1a412f8a6403ba59845b0559a81d2'} {{(pid=80396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:09:56.753136 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.notifications [None req-262b7e6c-07f9-41ed-9ac4-e978accc5db0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6ec1a412f8a6403ba59845b0559a81d2'} {{(pid=80396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:09:56.867681 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.notifications [None req-262b7e6c-07f9-41ed-9ac4-e978accc5db0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6ec1a412f8a6403ba59845b0559a81d2'} {{(pid=80396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:09:56.880725 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.notifications [None req-262b7e6c-07f9-41ed-9ac4-e978accc5db0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6ec1a412f8a6403ba59845b0559a81d2'} {{(pid=80396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:09:56.888698 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.notifications [None req-262b7e6c-07f9-41ed-9ac4-e978accc5db0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6ec1a412f8a6403ba59845b0559a81d2'} {{(pid=80396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:09:56.894706 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 1146/2304] 10.222.0.59 () {58 vars in 1223 bytes} [Thu Jun 2 16:09:56 2022] DELETE /identity/v3/users/6ec1a412f8a6403ba59845b0559a81d2 => generated 0 bytes in 490 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 16:09:56.899538 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b30734-5f68-4f47-b303-4964e6de2920 None None] REQUEST_METHOD: `POST` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:09:56.899828 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b30734-5f68-4f47-b303-4964e6de2920 None None] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:09:56.900107 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b30734-5f68-4f47-b303-4964e6de2920 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:09:56.920132 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.auth.core [None req-a6b30734-5f68-4f47-b303-4964e6de2920 None None] MFA Rules not processed for user `400d1f4db9de49638549e5db29a041e1`. Rule list: `[]` (Enabled: `True`). {{(pid=80396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 16:09:56.921392 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.fernet_utils [None req-a6b30734-5f68-4f47-b303-4964e6de2920 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:09:56.938405 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.notifications [None req-651af904-1957-445a-b7a4-7cb508e13239 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5413eb32f0a04b2996a78f974877c52e'} {{(pid=80395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:09:56.988223 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 1147/2305] 10.222.0.59 () {58 vars in 957 bytes} [Thu Jun 2 16:09:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 02 16:09:56.998097 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6b30734-5f68-4f47-b303-4964e6de2920 None None] Authenticating user token {{(pid=80396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:09:56.999414 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.fernet_utils [None req-a6b30734-5f68-4f47-b303-4964e6de2920 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:09:57.021005 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG dbcounter [-] [80396] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 16:09:57.054497 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6b30734-5f68-4f47-b303-4964e6de2920 None None] Validating token access rules against request {{(pid=80396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:09:57.058734 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48c25f83-a8cf-4719-bcad-dc57ef99d359 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9af40ddfe9ff4be3887b068f13a28dc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c87c981909d4b8db02783421818c79b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:09:57.059814 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c25f83-a8cf-4719-bcad-dc57ef99d359 service neutron] REQUEST_METHOD: `GET` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:09:57.060326 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c25f83-a8cf-4719-bcad-dc57ef99d359 service neutron] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:09:57.060841 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c25f83-a8cf-4719-bcad-dc57ef99d359 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:09:57.069852 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48c25f83-a8cf-4719-bcad-dc57ef99d359 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:09:57.071406 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48c25f83-a8cf-4719-bcad-dc57ef99d359 service neutron] RBAC: Authorization granted {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:09:57.081541 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 1148/2306] 10.222.0.59 () {60 vars in 1365 bytes} [Thu Jun 2 16:09:56 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 02 16:09:57.087457 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.notifications [None req-651af904-1957-445a-b7a4-7cb508e13239 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5413eb32f0a04b2996a78f974877c52e'} {{(pid=80395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:09:57.100616 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.notifications [None req-651af904-1957-445a-b7a4-7cb508e13239 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5413eb32f0a04b2996a78f974877c52e'} {{(pid=80395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:09:57.101288 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.notifications [None req-651af904-1957-445a-b7a4-7cb508e13239 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5413eb32f0a04b2996a78f974877c52e'} {{(pid=80395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:09:57.108824 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.notifications [None req-651af904-1957-445a-b7a4-7cb508e13239 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5413eb32f0a04b2996a78f974877c52e'} {{(pid=80395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:09:57.115061 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 1159/2307] 10.222.0.59 () {58 vars in 1223 bytes} [Thu Jun 2 16:09:56 2022] DELETE /identity/v3/users/5413eb32f0a04b2996a78f974877c52e => generated 0 bytes in 463 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 16:09:57.119623 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5496807-11c7-4990-b4a5-5c59058788f1 None None] REQUEST_METHOD: `POST` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:09:57.120099 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5496807-11c7-4990-b4a5-5c59058788f1 None None] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:09:57.120936 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5496807-11c7-4990-b4a5-5c59058788f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:09:57.140271 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.auth.core [None req-a5496807-11c7-4990-b4a5-5c59058788f1 None None] MFA Rules not processed for user `400d1f4db9de49638549e5db29a041e1`. Rule list: `[]` (Enabled: `True`). {{(pid=80396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 16:09:57.141427 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.fernet_utils [None req-a5496807-11c7-4990-b4a5-5c59058788f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:09:57.210035 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 1149/2308] 10.222.0.59 () {58 vars in 957 bytes} [Thu Jun 2 16:09:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 16:09:57.220341 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-651af904-1957-445a-b7a4-7cb508e13239 admin admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:09:57.221760 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.fernet_utils [None req-651af904-1957-445a-b7a4-7cb508e13239 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:09:57.290446 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-651af904-1957-445a-b7a4-7cb508e13239 admin admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:09:57.294541 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aef80ff-af6d-4bed-9dc9-1d0d255d238c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9af40ddfe9ff4be3887b068f13a28dc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c87c981909d4b8db02783421818c79b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:09:57.295198 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aef80ff-af6d-4bed-9dc9-1d0d255d238c service neutron] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:09:57.295485 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aef80ff-af6d-4bed-9dc9-1d0d255d238c service neutron] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:09:57.295765 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aef80ff-af6d-4bed-9dc9-1d0d255d238c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:09:57.310874 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aef80ff-af6d-4bed-9dc9-1d0d255d238c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:09:57.313665 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aef80ff-af6d-4bed-9dc9-1d0d255d238c service neutron] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:09:57.329606 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 1160/2309] 10.222.0.59 () {60 vars in 1365 bytes} [Thu Jun 2 16:09:57 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 16:09:57.565250 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5496807-11c7-4990-b4a5-5c59058788f1 None None] Authenticating user token {{(pid=80396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:09:57.567324 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.fernet_utils [None req-a5496807-11c7-4990-b4a5-5c59058788f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:09:57.579597 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5496807-11c7-4990-b4a5-5c59058788f1 None None] Validating token access rules against request {{(pid=80396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:09:57.586820 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f90b8be5-7971-4e86-b3ef-5abb39585ae2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f73d5a98be74242b45222df39fb6213', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:09:57.586820 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f90b8be5-7971-4e86-b3ef-5abb39585ae2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:09:57.586820 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f90b8be5-7971-4e86-b3ef-5abb39585ae2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:09:57.586820 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f90b8be5-7971-4e86-b3ef-5abb39585ae2 admin admin] PATH_INFO: `/v3/projects/4b280a4292c04e8896778ac2649b4151` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:09:57.587649 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f90b8be5-7971-4e86-b3ef-5abb39585ae2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4b280a4292c04e8896778ac2649b4151)` {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:09:57.590439 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f90b8be5-7971-4e86-b3ef-5abb39585ae2 admin admin] RBAC: Authorization granted {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:09:57.723793 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.notifications [None req-f90b8be5-7971-4e86-b3ef-5abb39585ae2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4b280a4292c04e8896778ac2649b4151', 'request_id': 'req-f90b8be5-7971-4e86-b3ef-5abb39585ae2'} {{(pid=80396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:09:57.730635 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.notifications [None req-f90b8be5-7971-4e86-b3ef-5abb39585ae2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4b280a4292c04e8896778ac2649b4151', 'request_id': 'req-f90b8be5-7971-4e86-b3ef-5abb39585ae2'} {{(pid=80396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:09:57.820245 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aef80ff-af6d-4bed-9dc9-1d0d255d238c service neutron] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:09:57.820245 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.fernet_utils [None req-2aef80ff-af6d-4bed-9dc9-1d0d255d238c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:09:57.834552 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aef80ff-af6d-4bed-9dc9-1d0d255d238c service neutron] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:09:57.843038 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.notifications [None req-f90b8be5-7971-4e86-b3ef-5abb39585ae2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4b280a4292c04e8896778ac2649b4151', 'request_id': 'req-f90b8be5-7971-4e86-b3ef-5abb39585ae2'} {{(pid=80396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:09:57.858276 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.notifications [None req-f90b8be5-7971-4e86-b3ef-5abb39585ae2 admin admin] The token cache is being invalidate because project 4b280a4292c04e8896778ac2649b4151 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80396) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 02 16:09:57.858573 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.notifications [None req-f90b8be5-7971-4e86-b3ef-5abb39585ae2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:09:57.859540 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.notifications [None req-f90b8be5-7971-4e86-b3ef-5abb39585ae2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:09:57.861190 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 1150/2310] 10.222.0.59 () {58 vars in 1232 bytes} [Thu Jun 2 16:09:57 2022] DELETE /identity/v3/projects/4b280a4292c04e8896778ac2649b4151 => generated 0 bytes in 296 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 16:09:57.865995 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb94acc-170a-4dfd-a29d-a61556bb770f None None] REQUEST_METHOD: `POST` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:09:57.866467 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb94acc-170a-4dfd-a29d-a61556bb770f None None] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:09:57.866701 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb94acc-170a-4dfd-a29d-a61556bb770f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:09:57.885049 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.auth.core [None req-bfb94acc-170a-4dfd-a29d-a61556bb770f None None] MFA Rules not processed for user `400d1f4db9de49638549e5db29a041e1`. Rule list: `[]` (Enabled: `True`). {{(pid=80396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 16:09:57.886533 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.fernet_utils [None req-bfb94acc-170a-4dfd-a29d-a61556bb770f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:09:57.897801 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a54e288-9bf7-4bba-9c13-c5632cf0b705 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f73d5a98be74242b45222df39fb6213', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:09:57.898766 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a54e288-9bf7-4bba-9c13-c5632cf0b705 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:09:57.899049 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a54e288-9bf7-4bba-9c13-c5632cf0b705 admin admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:09:57.902224 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a54e288-9bf7-4bba-9c13-c5632cf0b705 admin admin] PATH_INFO: `/v3/projects/e8ab89e9e7d2411a9a83575058cf908b` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:09:57.902224 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a54e288-9bf7-4bba-9c13-c5632cf0b705 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e8ab89e9e7d2411a9a83575058cf908b)` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:09:57.903674 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a54e288-9bf7-4bba-9c13-c5632cf0b705 admin admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:09:57.921701 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 16:09:57.932999 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG dbcounter [-] [80396] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 16:09:57.950194 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 1151/2311] 10.222.0.59 () {58 vars in 957 bytes} [Thu Jun 2 16:09:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 02 16:09:57.957505 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ce8098-d46a-4b57-b2ff-f290f168a467 None None] REQUEST_METHOD: `POST` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:09:57.957797 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ce8098-d46a-4b57-b2ff-f290f168a467 None None] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:09:57.958100 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ce8098-d46a-4b57-b2ff-f290f168a467 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:09:57.977056 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.auth.core [None req-55ce8098-d46a-4b57-b2ff-f290f168a467 None None] MFA Rules not processed for user `400d1f4db9de49638549e5db29a041e1`. Rule list: `[]` (Enabled: `True`). {{(pid=80396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 16:09:57.978429 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.fernet_utils [None req-55ce8098-d46a-4b57-b2ff-f290f168a467 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:09:57.987960 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 1152/2312] 10.222.0.59 () {58 vars in 957 bytes} [Thu Jun 2 16:09:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 02 16:09:57.991757 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55ce8098-d46a-4b57-b2ff-f290f168a467 None None] Authenticating user token {{(pid=80396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:09:58.000651 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55ce8098-d46a-4b57-b2ff-f290f168a467 None None] Validating token access rules against request {{(pid=80396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:09:58.005273 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e264643b-0ff9-4dab-85e5-3ebc1bc4221c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f73d5a98be74242b45222df39fb6213', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:09:58.005945 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e264643b-0ff9-4dab-85e5-3ebc1bc4221c admin admin] REQUEST_METHOD: `GET` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:09:58.006244 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e264643b-0ff9-4dab-85e5-3ebc1bc4221c admin admin] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:09:58.006530 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e264643b-0ff9-4dab-85e5-3ebc1bc4221c admin admin] PATH_INFO: `/v3/domains` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:09:58.007286 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e264643b-0ff9-4dab-85e5-3ebc1bc4221c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80396) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 16:09:58.007617 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e264643b-0ff9-4dab-85e5-3ebc1bc4221c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:09:58.009233 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e264643b-0ff9-4dab-85e5-3ebc1bc4221c admin admin] RBAC: Authorization granted {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:09:58.025563 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 1153/2313] 10.222.0.59 () {58 vars in 1152 bytes} [Thu Jun 2 16:09:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 16:09:58.025708 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.notifications [None req-4a54e288-9bf7-4bba-9c13-c5632cf0b705 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e8ab89e9e7d2411a9a83575058cf908b', 'request_id': 'req-4a54e288-9bf7-4bba-9c13-c5632cf0b705'} {{(pid=80395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:09:58.027677 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e264643b-0ff9-4dab-85e5-3ebc1bc4221c admin admin] Authenticating user token {{(pid=80396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:09:58.029598 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.notifications [None req-4a54e288-9bf7-4bba-9c13-c5632cf0b705 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e8ab89e9e7d2411a9a83575058cf908b', 'request_id': 'req-4a54e288-9bf7-4bba-9c13-c5632cf0b705'} {{(pid=80395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:09:58.037762 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e264643b-0ff9-4dab-85e5-3ebc1bc4221c admin admin] Validating token access rules against request {{(pid=80396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:09:58.093867 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3930296-eaf4-4857-9c65-cce8de6815cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f73d5a98be74242b45222df39fb6213', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:09:58.094649 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3930296-eaf4-4857-9c65-cce8de6815cb admin admin] REQUEST_METHOD: `POST` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:09:58.094943 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3930296-eaf4-4857-9c65-cce8de6815cb admin admin] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:09:58.095222 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3930296-eaf4-4857-9c65-cce8de6815cb admin admin] PATH_INFO: `/v3/projects` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:09:58.095910 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3930296-eaf4-4857-9c65-cce8de6815cb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:09:58.098125 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3930296-eaf4-4857-9c65-cce8de6815cb admin admin] RBAC: Authorization granted {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:09:58.115852 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.notifications [None req-4a54e288-9bf7-4bba-9c13-c5632cf0b705 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e8ab89e9e7d2411a9a83575058cf908b', 'request_id': 'req-4a54e288-9bf7-4bba-9c13-c5632cf0b705'} {{(pid=80395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:09:58.127052 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.notifications [None req-4a54e288-9bf7-4bba-9c13-c5632cf0b705 admin admin] The token cache is being invalidate because project e8ab89e9e7d2411a9a83575058cf908b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80395) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 02 16:09:58.127344 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.notifications [None req-4a54e288-9bf7-4bba-9c13-c5632cf0b705 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:09:58.128037 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.notifications [None req-4a54e288-9bf7-4bba-9c13-c5632cf0b705 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:09:58.129575 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 1161/2314] 10.222.0.59 () {58 vars in 1232 bytes} [Thu Jun 2 16:09:57 2022] DELETE /identity/v3/projects/e8ab89e9e7d2411a9a83575058cf908b => generated 0 bytes in 312 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 02 16:09:58.134323 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b7d3f2-07ac-4b94-a783-0e561ada0cc2 None None] REQUEST_METHOD: `POST` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:09:58.134617 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b7d3f2-07ac-4b94-a783-0e561ada0cc2 None None] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:09:58.134902 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b7d3f2-07ac-4b94-a783-0e561ada0cc2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:09:58.154635 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.auth.core [None req-68b7d3f2-07ac-4b94-a783-0e561ada0cc2 None None] MFA Rules not processed for user `400d1f4db9de49638549e5db29a041e1`. Rule list: `[]` (Enabled: `True`). {{(pid=80395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 16:09:58.155836 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.fernet_utils [None req-68b7d3f2-07ac-4b94-a783-0e561ada0cc2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:09:58.164356 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 1162/2315] 10.222.0.59 () {58 vars in 957 bytes} [Thu Jun 2 16:09:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 02 16:09:58.171915 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43c9a41-37ce-42f1-81b8-eb7e4b08452a None None] REQUEST_METHOD: `POST` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:09:58.172213 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43c9a41-37ce-42f1-81b8-eb7e4b08452a None None] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:09:58.172495 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43c9a41-37ce-42f1-81b8-eb7e4b08452a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:09:58.191720 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.auth.core [None req-d43c9a41-37ce-42f1-81b8-eb7e4b08452a None None] MFA Rules not processed for user `400d1f4db9de49638549e5db29a041e1`. Rule list: `[]` (Enabled: `True`). {{(pid=80395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 16:09:58.192912 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.fernet_utils [None req-d43c9a41-37ce-42f1-81b8-eb7e4b08452a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:09:58.202104 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 1163/2316] 10.222.0.59 () {58 vars in 957 bytes} [Thu Jun 2 16:09:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 02 16:09:58.206146 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d43c9a41-37ce-42f1-81b8-eb7e4b08452a None None] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:09:58.207745 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 1154/2317] 10.222.0.59 () {60 vars in 1152 bytes} [Thu Jun 2 16:09:58 2022] POST /identity/v3/projects => generated 371 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 16:09:58.208698 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3930296-eaf4-4857-9c65-cce8de6815cb admin admin] Authenticating user token {{(pid=80396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:09:58.210563 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.fernet_utils [None req-c3930296-eaf4-4857-9c65-cce8de6815cb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:09:58.216172 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d43c9a41-37ce-42f1-81b8-eb7e4b08452a None None] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:09:58.270592 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b624746-09d2-4874-9596-1620f99e1926 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f73d5a98be74242b45222df39fb6213', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:09:58.271406 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b624746-09d2-4874-9596-1620f99e1926 admin admin] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:09:58.271689 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b624746-09d2-4874-9596-1620f99e1926 admin admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:09:58.271962 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b624746-09d2-4874-9596-1620f99e1926 admin admin] PATH_INFO: `/v3/domains` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:09:58.272761 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b624746-09d2-4874-9596-1620f99e1926 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80395) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 16:09:58.273063 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b624746-09d2-4874-9596-1620f99e1926 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:09:58.274688 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b624746-09d2-4874-9596-1620f99e1926 admin admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:09:58.274820 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3930296-eaf4-4857-9c65-cce8de6815cb admin admin] Validating token access rules against request {{(pid=80396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:09:58.280164 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25871aac-f13f-4225-9b50-53bfa77ba366 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f73d5a98be74242b45222df39fb6213', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:09:58.280823 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25871aac-f13f-4225-9b50-53bfa77ba366 admin admin] REQUEST_METHOD: `POST` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:09:58.281106 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25871aac-f13f-4225-9b50-53bfa77ba366 admin admin] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:09:58.281381 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25871aac-f13f-4225-9b50-53bfa77ba366 admin admin] PATH_INFO: `/v3/users` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:09:58.282109 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25871aac-f13f-4225-9b50-53bfa77ba366 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:09:58.284036 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25871aac-f13f-4225-9b50-53bfa77ba366 admin admin] RBAC: Authorization granted {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:09:58.287474 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 1164/2318] 10.222.0.59 () {58 vars in 1152 bytes} [Thu Jun 2 16:09:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 16:09:58.291358 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b624746-09d2-4874-9596-1620f99e1926 admin admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:09:58.301830 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b624746-09d2-4874-9596-1620f99e1926 admin admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:09:58.306669 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a63d52a4-2433-4ddb-906f-e0667d84733e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f73d5a98be74242b45222df39fb6213', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:09:58.307394 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a63d52a4-2433-4ddb-906f-e0667d84733e admin admin] REQUEST_METHOD: `POST` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:09:58.307671 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a63d52a4-2433-4ddb-906f-e0667d84733e admin admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:09:58.307976 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a63d52a4-2433-4ddb-906f-e0667d84733e admin admin] PATH_INFO: `/v3/projects` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:09:58.308666 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a63d52a4-2433-4ddb-906f-e0667d84733e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:09:58.310569 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a63d52a4-2433-4ddb-906f-e0667d84733e admin admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:09:58.385512 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 1155/2319] 10.222.0.59 () {60 vars in 1143 bytes} [Thu Jun 2 16:09:58 2022] POST /identity/v3/users => generated 286 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 02 16:09:58.390292 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25871aac-f13f-4225-9b50-53bfa77ba366 admin admin] Authenticating user token {{(pid=80396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:09:58.399716 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25871aac-f13f-4225-9b50-53bfa77ba366 admin admin] Validating token access rules against request {{(pid=80396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:09:58.405692 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4bf67bb-4a2f-448c-85ae-21d9268d17fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f73d5a98be74242b45222df39fb6213', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:09:58.406379 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4bf67bb-4a2f-448c-85ae-21d9268d17fe admin admin] REQUEST_METHOD: `GET` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:09:58.406666 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4bf67bb-4a2f-448c-85ae-21d9268d17fe admin admin] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:09:58.406952 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4bf67bb-4a2f-448c-85ae-21d9268d17fe admin admin] PATH_INFO: `/v3/roles` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:09:58.407675 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4bf67bb-4a2f-448c-85ae-21d9268d17fe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:09:58.409263 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4bf67bb-4a2f-448c-85ae-21d9268d17fe admin admin] RBAC: Authorization granted {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:09:58.420328 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 1165/2320] 10.222.0.59 () {60 vars in 1152 bytes} [Thu Jun 2 16:09:58 2022] POST /identity/v3/projects => generated 371 bytes in 129 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 02 16:09:58.421049 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 1156/2321] 10.222.0.59 () {58 vars in 1121 bytes} [Thu Jun 2 16:09:58 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 02 16:09:58.424537 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a63d52a4-2433-4ddb-906f-e0667d84733e admin admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:09:58.424676 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4bf67bb-4a2f-448c-85ae-21d9268d17fe admin admin] Authenticating user token {{(pid=80396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:09:58.435048 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4bf67bb-4a2f-448c-85ae-21d9268d17fe admin admin] Validating token access rules against request {{(pid=80396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:09:58.470502 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG dbcounter [-] [80396] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 16:09:58.492697 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a63d52a4-2433-4ddb-906f-e0667d84733e admin admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:09:58.498682 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1fbb17a-8372-4601-8fda-3cb078aba2eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f73d5a98be74242b45222df39fb6213', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:09:58.499346 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1fbb17a-8372-4601-8fda-3cb078aba2eb admin admin] REQUEST_METHOD: `POST` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:09:58.499632 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1fbb17a-8372-4601-8fda-3cb078aba2eb admin admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:09:58.499915 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1fbb17a-8372-4601-8fda-3cb078aba2eb admin admin] PATH_INFO: `/v3/users` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:09:58.500653 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1fbb17a-8372-4601-8fda-3cb078aba2eb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:09:58.503669 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1fbb17a-8372-4601-8fda-3cb078aba2eb admin admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:09:58.510701 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-189fa44f-2352-45b8-867e-2dcc4eb59af6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f73d5a98be74242b45222df39fb6213', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:09:58.512211 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-189fa44f-2352-45b8-867e-2dcc4eb59af6 admin admin] REQUEST_METHOD: `GET` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:09:58.523016 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-189fa44f-2352-45b8-867e-2dcc4eb59af6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:09:58.523016 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-189fa44f-2352-45b8-867e-2dcc4eb59af6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:09:58.523224 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 16:09:58.523322 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-189fa44f-2352-45b8-867e-2dcc4eb59af6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:09:58.523322 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-189fa44f-2352-45b8-867e-2dcc4eb59af6 admin admin] RBAC: Authorization granted {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:09:58.527141 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 1157/2322] 10.222.0.59 () {58 vars in 1121 bytes} [Thu Jun 2 16:09:58 2022] GET /identity/v3/roles => generated 1420 bytes in 103 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 02 16:09:58.531192 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-189fa44f-2352-45b8-867e-2dcc4eb59af6 admin admin] Authenticating user token {{(pid=80396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:09:58.541119 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-189fa44f-2352-45b8-867e-2dcc4eb59af6 admin admin] Validating token access rules against request {{(pid=80396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:09:58.546790 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0a150a7-bd43-437f-8f08-a9373d08500e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f73d5a98be74242b45222df39fb6213', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:09:58.547663 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a150a7-bd43-437f-8f08-a9373d08500e admin admin] REQUEST_METHOD: `PUT` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:09:58.548054 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a150a7-bd43-437f-8f08-a9373d08500e admin admin] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:09:58.548334 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a150a7-bd43-437f-8f08-a9373d08500e admin admin] PATH_INFO: `/v3/projects/b42e4a202a4942818fd25d0f25abe9de/users/e1dbb393020e452fb78d212cf60a2a72/roles/649e0f2b5a264c419ea6a1441f123a03` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:09:58.566502 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0a150a7-bd43-437f-8f08-a9373d08500e admin admin] RBAC: Authorizing `identity:create_grant(project_id=b42e4a202a4942818fd25d0f25abe9de, user_id=e1dbb393020e452fb78d212cf60a2a72, role_id=649e0f2b5a264c419ea6a1441f123a03)` {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:09:58.569307 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0a150a7-bd43-437f-8f08-a9373d08500e admin admin] RBAC: Authorization granted {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:09:58.617303 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 1166/2323] 10.222.0.59 () {60 vars in 1143 bytes} [Thu Jun 2 16:09:58 2022] POST /identity/v3/users => generated 286 bytes in 193 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 16:09:58.621171 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1fbb17a-8372-4601-8fda-3cb078aba2eb admin admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:09:58.631016 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1fbb17a-8372-4601-8fda-3cb078aba2eb admin admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:09:58.637220 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa3d3c20-afb5-4d3d-a08a-e412de5bb835 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f73d5a98be74242b45222df39fb6213', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:09:58.638154 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa3d3c20-afb5-4d3d-a08a-e412de5bb835 admin admin] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:09:58.638442 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa3d3c20-afb5-4d3d-a08a-e412de5bb835 admin admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:09:58.638715 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa3d3c20-afb5-4d3d-a08a-e412de5bb835 admin admin] PATH_INFO: `/v3/roles` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:09:58.639443 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa3d3c20-afb5-4d3d-a08a-e412de5bb835 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:09:58.641035 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa3d3c20-afb5-4d3d-a08a-e412de5bb835 admin admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:09:58.656290 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 1167/2324] 10.222.0.59 () {58 vars in 1121 bytes} [Thu Jun 2 16:09:58 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 02 16:09:58.657421 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa3d3c20-afb5-4d3d-a08a-e412de5bb835 admin admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:09:58.663206 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 1158/2325] 10.222.0.59 () {60 vars in 1482 bytes} [Thu Jun 2 16:09:58 2022] PUT /identity/v3/projects/b42e4a202a4942818fd25d0f25abe9de/users/e1dbb393020e452fb78d212cf60a2a72/roles/649e0f2b5a264c419ea6a1441f123a03 => generated 0 bytes in 132 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 02 16:09:58.668821 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa3d3c20-afb5-4d3d-a08a-e412de5bb835 admin admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:09:58.669061 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f2cb9e4-c0ac-4858-9c45-fa2be95b6b1f None None] REQUEST_METHOD: `POST` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:09:58.669482 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f2cb9e4-c0ac-4858-9c45-fa2be95b6b1f None None] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:09:58.669846 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f2cb9e4-c0ac-4858-9c45-fa2be95b6b1f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:09:58.692676 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.auth.core [None req-3f2cb9e4-c0ac-4858-9c45-fa2be95b6b1f None None] MFA Rules not processed for user `400d1f4db9de49638549e5db29a041e1`. Rule list: `[]` (Enabled: `True`). {{(pid=80396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 16:09:58.693858 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.fernet_utils [None req-3f2cb9e4-c0ac-4858-9c45-fa2be95b6b1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:09:58.738037 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa9c46ec-456b-48af-844d-0d0db7cabe42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f73d5a98be74242b45222df39fb6213', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:09:58.739269 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9c46ec-456b-48af-844d-0d0db7cabe42 admin admin] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:09:58.739657 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9c46ec-456b-48af-844d-0d0db7cabe42 admin admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:09:58.740040 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9c46ec-456b-48af-844d-0d0db7cabe42 admin admin] PATH_INFO: `/v3/roles` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:09:58.741312 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa9c46ec-456b-48af-844d-0d0db7cabe42 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:09:58.743518 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa9c46ec-456b-48af-844d-0d0db7cabe42 admin admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:09:58.757550 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 1168/2326] 10.222.0.59 () {58 vars in 1121 bytes} [Thu Jun 2 16:09:58 2022] GET /identity/v3/roles => generated 1420 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 16:09:58.758946 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa9c46ec-456b-48af-844d-0d0db7cabe42 admin admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:09:58.762382 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 1159/2327] 10.222.0.59 () {58 vars in 957 bytes} [Thu Jun 2 16:09:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 02 16:09:58.770470 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa9c46ec-456b-48af-844d-0d0db7cabe42 admin admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:09:58.774997 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f2cb9e4-c0ac-4858-9c45-fa2be95b6b1f None None] Authenticating user token {{(pid=80396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:09:58.775318 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3be98736-5f61-4dba-b994-8fcb390c4bb4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f73d5a98be74242b45222df39fb6213', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:09:58.776205 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be98736-5f61-4dba-b994-8fcb390c4bb4 admin admin] REQUEST_METHOD: `PUT` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:09:58.776360 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.fernet_utils [None req-3f2cb9e4-c0ac-4858-9c45-fa2be95b6b1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:09:58.777082 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be98736-5f61-4dba-b994-8fcb390c4bb4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:09:58.777472 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be98736-5f61-4dba-b994-8fcb390c4bb4 admin admin] PATH_INFO: `/v3/projects/aa7bcb5f489f4a2db902c2035d9879a5/users/2f09d7a733fa43a7a45f56176c752447/roles/649e0f2b5a264c419ea6a1441f123a03` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:09:58.796954 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3be98736-5f61-4dba-b994-8fcb390c4bb4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=aa7bcb5f489f4a2db902c2035d9879a5, user_id=2f09d7a733fa43a7a45f56176c752447, role_id=649e0f2b5a264c419ea6a1441f123a03)` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:09:58.800600 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3be98736-5f61-4dba-b994-8fcb390c4bb4 admin admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:09:58.836708 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f2cb9e4-c0ac-4858-9c45-fa2be95b6b1f None None] Validating token access rules against request {{(pid=80396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:09:58.841738 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c04d381-eefc-44c8-8c2f-e72422ede398 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9af40ddfe9ff4be3887b068f13a28dc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c87c981909d4b8db02783421818c79b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:09:58.842427 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c04d381-eefc-44c8-8c2f-e72422ede398 service neutron] REQUEST_METHOD: `GET` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:09:58.842714 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c04d381-eefc-44c8-8c2f-e72422ede398 service neutron] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:09:58.842995 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c04d381-eefc-44c8-8c2f-e72422ede398 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:09:58.852722 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c04d381-eefc-44c8-8c2f-e72422ede398 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:09:58.854329 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c04d381-eefc-44c8-8c2f-e72422ede398 service neutron] RBAC: Authorization granted {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:09:58.864351 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 1160/2328] 10.222.0.59 () {60 vars in 1365 bytes} [Thu Jun 2 16:09:58 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 02 16:09:58.891644 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 1169/2329] 10.222.0.59 () {60 vars in 1482 bytes} [Thu Jun 2 16:09:58 2022] PUT /identity/v3/projects/aa7bcb5f489f4a2db902c2035d9879a5/users/2f09d7a733fa43a7a45f56176c752447/roles/649e0f2b5a264c419ea6a1441f123a03 => generated 0 bytes in 133 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 16:09:58.896689 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-710cbe86-0be3-4bac-8faf-e4bea71d0c81 None None] REQUEST_METHOD: `POST` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:09:58.896981 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-710cbe86-0be3-4bac-8faf-e4bea71d0c81 None None] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:09:58.897271 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-710cbe86-0be3-4bac-8faf-e4bea71d0c81 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:09:58.917309 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.auth.core [None req-710cbe86-0be3-4bac-8faf-e4bea71d0c81 None None] MFA Rules not processed for user `400d1f4db9de49638549e5db29a041e1`. Rule list: `[]` (Enabled: `True`). {{(pid=80396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 16:09:58.918885 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.fernet_utils [None req-710cbe86-0be3-4bac-8faf-e4bea71d0c81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:09:58.960443 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG dbcounter [-] [80396] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 16:09:58.978655 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 1161/2330] 10.222.0.59 () {58 vars in 957 bytes} [Thu Jun 2 16:09:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 16:09:58.988463 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3be98736-5f61-4dba-b994-8fcb390c4bb4 admin admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:09:58.990416 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.fernet_utils [None req-3be98736-5f61-4dba-b994-8fcb390c4bb4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:09:59.050273 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3be98736-5f61-4dba-b994-8fcb390c4bb4 admin admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:09:59.054333 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f39e77f-58f4-4ae1-a29e-5e1e1d7141e7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9af40ddfe9ff4be3887b068f13a28dc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c87c981909d4b8db02783421818c79b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:09:59.054993 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f39e77f-58f4-4ae1-a29e-5e1e1d7141e7 service neutron] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:09:59.055268 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f39e77f-58f4-4ae1-a29e-5e1e1d7141e7 service neutron] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:09:59.055554 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f39e77f-58f4-4ae1-a29e-5e1e1d7141e7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:09:59.069334 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f39e77f-58f4-4ae1-a29e-5e1e1d7141e7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:09:59.070847 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f39e77f-58f4-4ae1-a29e-5e1e1d7141e7 service neutron] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:09:59.082459 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 1170/2331] 10.222.0.59 () {60 vars in 1365 bytes} [Thu Jun 2 16:09:58 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 16:10:00.449143 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef5f1a88-4906-4174-bbf3-71c82192f7be None None] REQUEST_METHOD: `POST` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:10:00.450246 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef5f1a88-4906-4174-bbf3-71c82192f7be None None] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:10:00.450551 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef5f1a88-4906-4174-bbf3-71c82192f7be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:10:00.485811 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.auth.core [None req-ef5f1a88-4906-4174-bbf3-71c82192f7be None None] MFA Rules not processed for user `e1dbb393020e452fb78d212cf60a2a72`. Rule list: `[]` (Enabled: `True`). {{(pid=80396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 16:10:00.487071 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.fernet_utils [None req-ef5f1a88-4906-4174-bbf3-71c82192f7be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:10:00.559395 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 1162/2332] 10.222.0.59 () {58 vars in 957 bytes} [Thu Jun 2 16:10:00 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 16:10:00.569868 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f39e77f-58f4-4ae1-a29e-5e1e1d7141e7 service neutron] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:10:00.571334 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.fernet_utils [None req-2f39e77f-58f4-4ae1-a29e-5e1e1d7141e7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:10:00.631931 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f39e77f-58f4-4ae1-a29e-5e1e1d7141e7 service neutron] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:10:00.636768 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1db9af31-5221-4e80-9572-b5745285bdb7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6534961c369940a5b88f310c6450250b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c87c981909d4b8db02783421818c79b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:10:00.639101 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db9af31-5221-4e80-9572-b5745285bdb7 service cinder] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:10:00.639539 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db9af31-5221-4e80-9572-b5745285bdb7 service cinder] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:10:00.639828 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db9af31-5221-4e80-9572-b5745285bdb7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:10:00.649412 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1db9af31-5221-4e80-9572-b5745285bdb7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:10:00.651064 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1db9af31-5221-4e80-9572-b5745285bdb7 service cinder] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:10:00.656554 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writing DB stats keystone:INSERT=2,keystone:SELECT=98 {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 16:10:00.661345 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 1171/2333] 10.222.0.59 () {60 vars in 1365 bytes} [Thu Jun 2 16:10:00 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 16:10:03.717336 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290c477b-3af4-453b-900f-dab095a6bdc9 None None] REQUEST_METHOD: `POST` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:10:03.717776 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290c477b-3af4-453b-900f-dab095a6bdc9 None None] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:10:03.718116 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290c477b-3af4-453b-900f-dab095a6bdc9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:10:03.733047 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1db9af31-5221-4e80-9572-b5745285bdb7 service cinder] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:10:03.741724 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.auth.core [None req-290c477b-3af4-453b-900f-dab095a6bdc9 None None] MFA Rules not processed for user `e1dbb393020e452fb78d212cf60a2a72`. Rule list: `[]` (Enabled: `True`). {{(pid=80396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 16:10:03.743011 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1db9af31-5221-4e80-9572-b5745285bdb7 service cinder] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:10:03.743322 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.fernet_utils [None req-290c477b-3af4-453b-900f-dab095a6bdc9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:10:03.749863 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fe0ae43-ff3a-45dc-8c38-6d04f0f28e2f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9af40ddfe9ff4be3887b068f13a28dc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c87c981909d4b8db02783421818c79b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:10:03.750804 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe0ae43-ff3a-45dc-8c38-6d04f0f28e2f service neutron] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:10:03.751291 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe0ae43-ff3a-45dc-8c38-6d04f0f28e2f service neutron] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:10:03.751768 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe0ae43-ff3a-45dc-8c38-6d04f0f28e2f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:10:03.753949 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.fernet_utils [None req-6fe0ae43-ff3a-45dc-8c38-6d04f0f28e2f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:10:03.763979 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 1163/2334] 10.222.0.59 () {58 vars in 957 bytes} [Thu Jun 2 16:10:03 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 16:10:03.915503 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fe0ae43-ff3a-45dc-8c38-6d04f0f28e2f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:10:03.917724 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fe0ae43-ff3a-45dc-8c38-6d04f0f28e2f service neutron] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:10:03.946552 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 1172/2335] 10.222.0.59 () {60 vars in 1365 bytes} [Thu Jun 2 16:10:03 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 211 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 16:10:05.730625 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ff4ff7-0efb-44e0-bf24-202486577fb9 None None] REQUEST_METHOD: `POST` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:10:05.731097 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ff4ff7-0efb-44e0-bf24-202486577fb9 None None] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:10:05.731232 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ff4ff7-0efb-44e0-bf24-202486577fb9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:10:05.767756 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.auth.core [None req-72ff4ff7-0efb-44e0-bf24-202486577fb9 None None] MFA Rules not processed for user `2f09d7a733fa43a7a45f56176c752447`. Rule list: `[]` (Enabled: `True`). {{(pid=80396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 16:10:05.769365 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.fernet_utils [None req-72ff4ff7-0efb-44e0-bf24-202486577fb9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:10:05.868902 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 1164/2336] 10.222.0.59 () {58 vars in 957 bytes} [Thu Jun 2 16:10:05 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 16:10:05.873529 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fe0ae43-ff3a-45dc-8c38-6d04f0f28e2f service neutron] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:10:05.885041 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fe0ae43-ff3a-45dc-8c38-6d04f0f28e2f service neutron] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:10:05.890430 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdf4acb2-b2aa-49f4-ae12-1056f7c4421b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f73d5a98be74242b45222df39fb6213', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:10:05.891085 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf4acb2-b2aa-49f4-ae12-1056f7c4421b admin admin] REQUEST_METHOD: `POST` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:10:05.896046 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf4acb2-b2aa-49f4-ae12-1056f7c4421b admin admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:10:05.896046 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf4acb2-b2aa-49f4-ae12-1056f7c4421b admin admin] PATH_INFO: `/v3/projects` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:10:05.896046 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdf4acb2-b2aa-49f4-ae12-1056f7c4421b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:10:05.896046 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdf4acb2-b2aa-49f4-ae12-1056f7c4421b admin admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:10:06.023156 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 1173/2337] 10.222.0.59 () {60 vars in 1152 bytes} [Thu Jun 2 16:10:05 2022] POST /identity/v3/projects => generated 373 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 16:10:06.027865 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72ff4ff7-0efb-44e0-bf24-202486577fb9 None None] Authenticating user token {{(pid=80396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:10:06.049832 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72ff4ff7-0efb-44e0-bf24-202486577fb9 None None] Validating token access rules against request {{(pid=80396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:10:06.283176 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-718e0263-893f-4444-96b4-d5113c45d79a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f73d5a98be74242b45222df39fb6213', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:10:06.283952 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-718e0263-893f-4444-96b4-d5113c45d79a admin admin] REQUEST_METHOD: `POST` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:10:06.284508 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-718e0263-893f-4444-96b4-d5113c45d79a admin admin] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:10:06.284628 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-718e0263-893f-4444-96b4-d5113c45d79a admin admin] PATH_INFO: `/v3/users` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:10:06.285387 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-718e0263-893f-4444-96b4-d5113c45d79a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:10:06.287496 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-718e0263-893f-4444-96b4-d5113c45d79a admin admin] RBAC: Authorization granted {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:10:06.295767 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG dbcounter [-] [80396] Writing DB stats keystone:SELECT=100 {{(pid=80396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 16:10:06.424466 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 1165/2338] 10.222.0.59 () {60 vars in 1143 bytes} [Thu Jun 2 16:10:06 2022] POST /identity/v3/users => generated 293 bytes in 397 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 16:10:06.428027 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdf4acb2-b2aa-49f4-ae12-1056f7c4421b admin admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:10:06.439031 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdf4acb2-b2aa-49f4-ae12-1056f7c4421b admin admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:10:06.443808 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27550be4-ad19-45ad-8c1e-567252071942 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f73d5a98be74242b45222df39fb6213', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:10:06.445104 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27550be4-ad19-45ad-8c1e-567252071942 admin admin] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:10:06.445104 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27550be4-ad19-45ad-8c1e-567252071942 admin admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:10:06.445104 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27550be4-ad19-45ad-8c1e-567252071942 admin admin] PATH_INFO: `/v3/roles` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:10:06.445731 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27550be4-ad19-45ad-8c1e-567252071942 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:10:06.454667 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27550be4-ad19-45ad-8c1e-567252071942 admin admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:10:06.469400 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 1174/2339] 10.222.0.59 () {58 vars in 1121 bytes} [Thu Jun 2 16:10:06 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 02 16:10:06.473556 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-718e0263-893f-4444-96b4-d5113c45d79a admin admin] Authenticating user token {{(pid=80396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:10:06.487916 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-718e0263-893f-4444-96b4-d5113c45d79a admin admin] Validating token access rules against request {{(pid=80396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:10:06.497942 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cbf8e52-b82f-4a36-b0ce-c33c79e29b40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f73d5a98be74242b45222df39fb6213', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:10:06.499003 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cbf8e52-b82f-4a36-b0ce-c33c79e29b40 admin admin] REQUEST_METHOD: `PUT` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:10:06.499360 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cbf8e52-b82f-4a36-b0ce-c33c79e29b40 admin admin] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:10:06.499714 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cbf8e52-b82f-4a36-b0ce-c33c79e29b40 admin admin] PATH_INFO: `/v3/projects/347c963f7ce64b1395a727389b88afe0/users/5c74b6deafc74a7ca85b145628e0731b/roles/f1e0c25f6e9049e897cb7350c7e54ab3` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:10:06.521259 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cbf8e52-b82f-4a36-b0ce-c33c79e29b40 admin admin] RBAC: Authorizing `identity:create_grant(project_id=347c963f7ce64b1395a727389b88afe0, user_id=5c74b6deafc74a7ca85b145628e0731b, role_id=f1e0c25f6e9049e897cb7350c7e54ab3)` {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:10:06.524157 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cbf8e52-b82f-4a36-b0ce-c33c79e29b40 admin admin] RBAC: Authorization granted {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:10:06.643416 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 1166/2340] 10.222.0.59 () {60 vars in 1482 bytes} [Thu Jun 2 16:10:06 2022] PUT /identity/v3/projects/347c963f7ce64b1395a727389b88afe0/users/5c74b6deafc74a7ca85b145628e0731b/roles/f1e0c25f6e9049e897cb7350c7e54ab3 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 16:10:06.647638 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27550be4-ad19-45ad-8c1e-567252071942 admin admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:10:06.659047 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27550be4-ad19-45ad-8c1e-567252071942 admin admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:10:06.723030 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6bd0f2d-2b7e-442f-b13e-e913c8e45568 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f73d5a98be74242b45222df39fb6213', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:10:06.723743 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6bd0f2d-2b7e-442f-b13e-e913c8e45568 admin admin] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:10:06.724067 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6bd0f2d-2b7e-442f-b13e-e913c8e45568 admin admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:10:06.724343 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6bd0f2d-2b7e-442f-b13e-e913c8e45568 admin admin] PATH_INFO: `/v3/roles` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:10:06.725179 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6bd0f2d-2b7e-442f-b13e-e913c8e45568 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:10:06.726823 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6bd0f2d-2b7e-442f-b13e-e913c8e45568 admin admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:10:06.739351 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 1175/2341] 10.222.0.59 () {58 vars in 1121 bytes} [Thu Jun 2 16:10:06 2022] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 16:10:06.745200 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cbf8e52-b82f-4a36-b0ce-c33c79e29b40 admin admin] Authenticating user token {{(pid=80396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:10:06.757287 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cbf8e52-b82f-4a36-b0ce-c33c79e29b40 admin admin] Validating token access rules against request {{(pid=80396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:10:06.762934 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36ca37bc-5196-4001-9b7c-795728be1ab5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f73d5a98be74242b45222df39fb6213', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:10:06.765812 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ca37bc-5196-4001-9b7c-795728be1ab5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:10:06.765812 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ca37bc-5196-4001-9b7c-795728be1ab5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:10:06.765812 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ca37bc-5196-4001-9b7c-795728be1ab5 admin admin] PATH_INFO: `/v3/projects/347c963f7ce64b1395a727389b88afe0/users/5c74b6deafc74a7ca85b145628e0731b/roles/f1e0c25f6e9049e897cb7350c7e54ab3` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:10:06.767002 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36ca37bc-5196-4001-9b7c-795728be1ab5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=347c963f7ce64b1395a727389b88afe0, user_id=5c74b6deafc74a7ca85b145628e0731b, role_id=f1e0c25f6e9049e897cb7350c7e54ab3)` {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:10:06.770020 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36ca37bc-5196-4001-9b7c-795728be1ab5 admin admin] RBAC: Authorization granted {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:10:06.783363 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 1167/2342] 10.222.0.59 () {60 vars in 1482 bytes} [Thu Jun 2 16:10:06 2022] PUT /identity/v3/projects/347c963f7ce64b1395a727389b88afe0/users/5c74b6deafc74a7ca85b145628e0731b/roles/f1e0c25f6e9049e897cb7350c7e54ab3 => generated 0 bytes in 40 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 02 16:10:07.967659 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6bd0f2d-2b7e-442f-b13e-e913c8e45568 admin admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:10:07.969487 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.fernet_utils [None req-f6bd0f2d-2b7e-442f-b13e-e913c8e45568 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:10:07.991451 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6bd0f2d-2b7e-442f-b13e-e913c8e45568 admin admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:10:08.070817 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 16:10:08.080128 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-135650bf-882f-4389-b863-6650c06e810c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f73d5a98be74242b45222df39fb6213', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:10:08.081204 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135650bf-882f-4389-b863-6650c06e810c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:10:08.081565 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135650bf-882f-4389-b863-6650c06e810c admin admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:10:08.081846 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135650bf-882f-4389-b863-6650c06e810c admin admin] PATH_INFO: `/v3/users/1bd07b1ffc3f40dd95840d636e41a70e` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:10:08.083315 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-135650bf-882f-4389-b863-6650c06e810c admin admin] RBAC: Authorizing `identity:delete_user(user_id=1bd07b1ffc3f40dd95840d636e41a70e)` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:10:08.085924 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-135650bf-882f-4389-b863-6650c06e810c admin admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:10:08.383542 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.notifications [None req-135650bf-882f-4389-b863-6650c06e810c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1bd07b1ffc3f40dd95840d636e41a70e'} {{(pid=80395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:10:08.551152 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.notifications [None req-135650bf-882f-4389-b863-6650c06e810c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1bd07b1ffc3f40dd95840d636e41a70e'} {{(pid=80395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:10:08.580882 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.notifications [None req-135650bf-882f-4389-b863-6650c06e810c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1bd07b1ffc3f40dd95840d636e41a70e'} {{(pid=80395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:10:08.581991 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.notifications [None req-135650bf-882f-4389-b863-6650c06e810c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1bd07b1ffc3f40dd95840d636e41a70e'} {{(pid=80395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:10:08.606666 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.notifications [None req-135650bf-882f-4389-b863-6650c06e810c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1bd07b1ffc3f40dd95840d636e41a70e'} {{(pid=80395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:10:08.622022 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 1176/2343] 10.222.0.59 () {58 vars in 1223 bytes} [Thu Jun 2 16:10:07 2022] DELETE /identity/v3/users/1bd07b1ffc3f40dd95840d636e41a70e => generated 0 bytes in 655 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 16:10:08.626809 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82aa2484-76ff-4496-a6ca-870a41fc9b6a None None] REQUEST_METHOD: `POST` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:10:08.627308 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82aa2484-76ff-4496-a6ca-870a41fc9b6a None None] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:10:08.627407 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82aa2484-76ff-4496-a6ca-870a41fc9b6a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:10:08.662981 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.auth.core [None req-82aa2484-76ff-4496-a6ca-870a41fc9b6a None None] MFA Rules not processed for user `400d1f4db9de49638549e5db29a041e1`. Rule list: `[]` (Enabled: `True`). {{(pid=80396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 16:10:08.664324 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.fernet_utils [None req-82aa2484-76ff-4496-a6ca-870a41fc9b6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:10:08.765838 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 1168/2344] 10.222.0.59 () {58 vars in 957 bytes} [Thu Jun 2 16:10:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 16:10:08.775941 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-135650bf-882f-4389-b863-6650c06e810c admin admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:10:08.777771 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.fernet_utils [None req-135650bf-882f-4389-b863-6650c06e810c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:10:08.861537 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-135650bf-882f-4389-b863-6650c06e810c admin admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:10:08.865660 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95d26f4e-ffc3-4c33-8980-1a9cf72dc03a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9af40ddfe9ff4be3887b068f13a28dc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c87c981909d4b8db02783421818c79b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:10:08.866586 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d26f4e-ffc3-4c33-8980-1a9cf72dc03a service neutron] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:10:08.866882 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d26f4e-ffc3-4c33-8980-1a9cf72dc03a service neutron] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:10:08.867160 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d26f4e-ffc3-4c33-8980-1a9cf72dc03a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:10:08.880694 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95d26f4e-ffc3-4c33-8980-1a9cf72dc03a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:10:08.882293 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95d26f4e-ffc3-4c33-8980-1a9cf72dc03a service neutron] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:10:08.893957 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 1177/2345] 10.222.0.59 () {60 vars in 1365 bytes} [Thu Jun 2 16:10:08 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 16:10:09.798489 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82aa2484-76ff-4496-a6ca-870a41fc9b6a None None] Authenticating user token {{(pid=80396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:10:09.800839 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.fernet_utils [None req-82aa2484-76ff-4496-a6ca-870a41fc9b6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:10:09.823197 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82aa2484-76ff-4496-a6ca-870a41fc9b6a None None] Validating token access rules against request {{(pid=80396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:10:09.842118 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4280f1c-6b61-4398-8d40-a47a1c551acc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f73d5a98be74242b45222df39fb6213', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:10:09.843214 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4280f1c-6b61-4398-8d40-a47a1c551acc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:10:09.843980 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4280f1c-6b61-4398-8d40-a47a1c551acc admin admin] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:10:09.844264 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4280f1c-6b61-4398-8d40-a47a1c551acc admin admin] PATH_INFO: `/v3/projects/39083e40d5cf4d1ea0bc63c8515bf11a` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:10:09.845945 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4280f1c-6b61-4398-8d40-a47a1c551acc admin admin] RBAC: Authorizing `identity:delete_project(project_id=39083e40d5cf4d1ea0bc63c8515bf11a)` {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:10:09.852616 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4280f1c-6b61-4398-8d40-a47a1c551acc admin admin] RBAC: Authorization granted {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:10:10.117854 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.notifications [None req-c4280f1c-6b61-4398-8d40-a47a1c551acc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '39083e40d5cf4d1ea0bc63c8515bf11a', 'request_id': 'req-c4280f1c-6b61-4398-8d40-a47a1c551acc'} {{(pid=80396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:10:10.125808 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.notifications [None req-c4280f1c-6b61-4398-8d40-a47a1c551acc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '39083e40d5cf4d1ea0bc63c8515bf11a', 'request_id': 'req-c4280f1c-6b61-4398-8d40-a47a1c551acc'} {{(pid=80396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:10:10.227287 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.notifications [None req-c4280f1c-6b61-4398-8d40-a47a1c551acc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '39083e40d5cf4d1ea0bc63c8515bf11a', 'request_id': 'req-c4280f1c-6b61-4398-8d40-a47a1c551acc'} {{(pid=80396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:10:10.247959 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.notifications [None req-c4280f1c-6b61-4398-8d40-a47a1c551acc admin admin] The token cache is being invalidate because project 39083e40d5cf4d1ea0bc63c8515bf11a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80396) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 02 16:10:10.248249 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.notifications [None req-c4280f1c-6b61-4398-8d40-a47a1c551acc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:10:10.250428 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.notifications [None req-c4280f1c-6b61-4398-8d40-a47a1c551acc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:10:10.257915 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 1169/2346] 10.222.0.59 () {58 vars in 1232 bytes} [Thu Jun 2 16:10:09 2022] DELETE /identity/v3/projects/39083e40d5cf4d1ea0bc63c8515bf11a => generated 0 bytes in 460 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 16:10:10.262999 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9776ba92-59cf-46ae-a73f-6b26b1efca0e None None] REQUEST_METHOD: `POST` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:10:10.267895 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9776ba92-59cf-46ae-a73f-6b26b1efca0e None None] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:10:10.267895 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9776ba92-59cf-46ae-a73f-6b26b1efca0e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:10:10.301823 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.auth.core [None req-9776ba92-59cf-46ae-a73f-6b26b1efca0e None None] MFA Rules not processed for user `400d1f4db9de49638549e5db29a041e1`. Rule list: `[]` (Enabled: `True`). {{(pid=80395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 16:10:10.303142 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.fernet_utils [None req-9776ba92-59cf-46ae-a73f-6b26b1efca0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:10:10.423454 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 1178/2347] 10.222.0.59 () {58 vars in 957 bytes} [Thu Jun 2 16:10:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 16:10:10.430880 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6cdd852-8113-4409-bd9d-67c071576432 None None] REQUEST_METHOD: `POST` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:10:10.431185 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6cdd852-8113-4409-bd9d-67c071576432 None None] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:10:10.431468 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6cdd852-8113-4409-bd9d-67c071576432 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:10:10.475353 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.auth.core [None req-f6cdd852-8113-4409-bd9d-67c071576432 None None] MFA Rules not processed for user `400d1f4db9de49638549e5db29a041e1`. Rule list: `[]` (Enabled: `True`). {{(pid=80396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 16:10:10.480436 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.fernet_utils [None req-f6cdd852-8113-4409-bd9d-67c071576432 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:10:10.497382 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 1170/2348] 10.222.0.59 () {58 vars in 957 bytes} [Thu Jun 2 16:10:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 68 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 16:10:10.501526 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9776ba92-59cf-46ae-a73f-6b26b1efca0e None None] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:10:10.519255 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9776ba92-59cf-46ae-a73f-6b26b1efca0e None None] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:10:10.531292 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b905c02-dac6-433a-9dd8-53b859667cea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f73d5a98be74242b45222df39fb6213', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:10:10.532044 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b905c02-dac6-433a-9dd8-53b859667cea admin admin] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:10:10.532330 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b905c02-dac6-433a-9dd8-53b859667cea admin admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:10:10.532673 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b905c02-dac6-433a-9dd8-53b859667cea admin admin] PATH_INFO: `/v3/domains` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:10:10.533419 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b905c02-dac6-433a-9dd8-53b859667cea admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80395) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 16:10:10.534359 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b905c02-dac6-433a-9dd8-53b859667cea admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:10:10.536897 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b905c02-dac6-433a-9dd8-53b859667cea admin admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:10:10.553284 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 1179/2349] 10.222.0.59 () {58 vars in 1152 bytes} [Thu Jun 2 16:10:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 16:10:10.557386 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6cdd852-8113-4409-bd9d-67c071576432 None None] Authenticating user token {{(pid=80396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:10:10.570455 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6cdd852-8113-4409-bd9d-67c071576432 None None] Validating token access rules against request {{(pid=80396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:10:10.576977 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0588374c-b209-4ad5-8c36-dbb9b4ffed75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f73d5a98be74242b45222df39fb6213', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:10:10.577682 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0588374c-b209-4ad5-8c36-dbb9b4ffed75 admin admin] REQUEST_METHOD: `POST` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:10:10.577963 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0588374c-b209-4ad5-8c36-dbb9b4ffed75 admin admin] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:10:10.578303 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0588374c-b209-4ad5-8c36-dbb9b4ffed75 admin admin] PATH_INFO: `/v3/projects` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:10:10.578998 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0588374c-b209-4ad5-8c36-dbb9b4ffed75 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:10:10.581067 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0588374c-b209-4ad5-8c36-dbb9b4ffed75 admin admin] RBAC: Authorization granted {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:10:10.681131 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 1171/2350] 10.222.0.59 () {60 vars in 1152 bytes} [Thu Jun 2 16:10:10 2022] POST /identity/v3/projects => generated 373 bytes in 124 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 16:10:10.688590 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b905c02-dac6-433a-9dd8-53b859667cea admin admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:10:10.713322 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b905c02-dac6-433a-9dd8-53b859667cea admin admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:10:10.722178 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 16:10:10.814051 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5376595a-cd7f-4ae8-9d3f-fb169093e68b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f73d5a98be74242b45222df39fb6213', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:10:10.815839 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5376595a-cd7f-4ae8-9d3f-fb169093e68b admin admin] REQUEST_METHOD: `POST` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:10:10.815839 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5376595a-cd7f-4ae8-9d3f-fb169093e68b admin admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:10:10.815839 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5376595a-cd7f-4ae8-9d3f-fb169093e68b admin admin] PATH_INFO: `/v3/users` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:10:10.816344 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5376595a-cd7f-4ae8-9d3f-fb169093e68b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:10:10.818451 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5376595a-cd7f-4ae8-9d3f-fb169093e68b admin admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:10:10.981257 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 1180/2351] 10.222.0.59 () {60 vars in 1143 bytes} [Thu Jun 2 16:10:10 2022] POST /identity/v3/users => generated 287 bytes in 295 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 02 16:10:10.985171 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0588374c-b209-4ad5-8c36-dbb9b4ffed75 admin admin] Authenticating user token {{(pid=80396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:10:11.009259 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0588374c-b209-4ad5-8c36-dbb9b4ffed75 admin admin] Validating token access rules against request {{(pid=80396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:10:11.027072 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e14a633b-cdb7-48c1-a0bc-b842200b4bcb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f73d5a98be74242b45222df39fb6213', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:10:11.028089 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e14a633b-cdb7-48c1-a0bc-b842200b4bcb admin admin] REQUEST_METHOD: `GET` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:10:11.028381 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e14a633b-cdb7-48c1-a0bc-b842200b4bcb admin admin] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:10:11.028685 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e14a633b-cdb7-48c1-a0bc-b842200b4bcb admin admin] PATH_INFO: `/v3/roles` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:10:11.029452 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e14a633b-cdb7-48c1-a0bc-b842200b4bcb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:10:11.031332 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e14a633b-cdb7-48c1-a0bc-b842200b4bcb admin admin] RBAC: Authorization granted {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:10:11.033153 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG dbcounter [-] [80396] Writing DB stats keystone:INSERT=7,keystone:SELECT=86,keystone:DELETE=7 {{(pid=80396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 16:10:11.057132 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 1172/2352] 10.222.0.59 () {58 vars in 1121 bytes} [Thu Jun 2 16:10:10 2022] GET /identity/v3/roles => generated 1420 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 16:10:11.061958 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5376595a-cd7f-4ae8-9d3f-fb169093e68b admin admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:10:11.075364 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5376595a-cd7f-4ae8-9d3f-fb169093e68b admin admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:10:11.081410 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c029dcd-a8da-49cf-b0de-8a754d9c424a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f73d5a98be74242b45222df39fb6213', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:10:11.082119 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c029dcd-a8da-49cf-b0de-8a754d9c424a admin admin] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:10:11.082410 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c029dcd-a8da-49cf-b0de-8a754d9c424a admin admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:10:11.082691 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c029dcd-a8da-49cf-b0de-8a754d9c424a admin admin] PATH_INFO: `/v3/roles` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:10:11.083432 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c029dcd-a8da-49cf-b0de-8a754d9c424a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:10:11.085167 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c029dcd-a8da-49cf-b0de-8a754d9c424a admin admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:10:11.099463 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 1181/2353] 10.222.0.59 () {58 vars in 1121 bytes} [Thu Jun 2 16:10:11 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 16:10:11.103342 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e14a633b-cdb7-48c1-a0bc-b842200b4bcb admin admin] Authenticating user token {{(pid=80396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:10:11.116481 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e14a633b-cdb7-48c1-a0bc-b842200b4bcb admin admin] Validating token access rules against request {{(pid=80396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:10:11.130634 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d4b2f64-8431-4361-bc57-3543a0fa7fd1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f73d5a98be74242b45222df39fb6213', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:10:11.131535 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d4b2f64-8431-4361-bc57-3543a0fa7fd1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:10:11.131832 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d4b2f64-8431-4361-bc57-3543a0fa7fd1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:10:11.132147 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d4b2f64-8431-4361-bc57-3543a0fa7fd1 admin admin] PATH_INFO: `/v3/projects/0c053fa2e3254a849acdb5116ec9644b/users/c622005135854b0c9984f5851b300e8e/roles/649e0f2b5a264c419ea6a1441f123a03` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:10:11.182692 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d4b2f64-8431-4361-bc57-3543a0fa7fd1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0c053fa2e3254a849acdb5116ec9644b, user_id=c622005135854b0c9984f5851b300e8e, role_id=649e0f2b5a264c419ea6a1441f123a03)` {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:10:11.203673 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d4b2f64-8431-4361-bc57-3543a0fa7fd1 admin admin] RBAC: Authorization granted {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:10:11.306266 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 1173/2354] 10.222.0.59 () {60 vars in 1482 bytes} [Thu Jun 2 16:10:11 2022] PUT /identity/v3/projects/0c053fa2e3254a849acdb5116ec9644b/users/c622005135854b0c9984f5851b300e8e/roles/649e0f2b5a264c419ea6a1441f123a03 => generated 0 bytes in 204 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 02 16:10:11.319942 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9229f28-7a1d-479c-8d02-79216e0da467 None None] REQUEST_METHOD: `POST` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:10:11.321062 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9229f28-7a1d-479c-8d02-79216e0da467 None None] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:10:11.321387 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9229f28-7a1d-479c-8d02-79216e0da467 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:10:11.361270 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.auth.core [None req-d9229f28-7a1d-479c-8d02-79216e0da467 None None] MFA Rules not processed for user `c622005135854b0c9984f5851b300e8e`. Rule list: `[]` (Enabled: `True`). {{(pid=80395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 16:10:11.362938 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.fernet_utils [None req-d9229f28-7a1d-479c-8d02-79216e0da467 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:10:11.493008 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 1182/2355] 10.222.0.59 () {58 vars in 957 bytes} [Thu Jun 2 16:10:11 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 16:10:11.499691 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d4b2f64-8431-4361-bc57-3543a0fa7fd1 admin admin] Authenticating user token {{(pid=80396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:10:11.502258 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.fernet_utils [None req-2d4b2f64-8431-4361-bc57-3543a0fa7fd1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:10:11.587340 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d4b2f64-8431-4361-bc57-3543a0fa7fd1 admin admin] Validating token access rules against request {{(pid=80396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:10:11.591959 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c663a37-6c5f-4331-9e1f-7acb8a2dc797 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6534961c369940a5b88f310c6450250b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c87c981909d4b8db02783421818c79b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:10:11.592710 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c663a37-6c5f-4331-9e1f-7acb8a2dc797 service cinder] REQUEST_METHOD: `GET` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:10:11.593121 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c663a37-6c5f-4331-9e1f-7acb8a2dc797 service cinder] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:10:11.593505 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c663a37-6c5f-4331-9e1f-7acb8a2dc797 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:10:11.612060 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c663a37-6c5f-4331-9e1f-7acb8a2dc797 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:10:11.617434 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c663a37-6c5f-4331-9e1f-7acb8a2dc797 service cinder] RBAC: Authorization granted {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:10:11.638435 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 1174/2356] 10.222.0.59 () {60 vars in 1365 bytes} [Thu Jun 2 16:10:11 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 139 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 16:10:14.789264 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bffea979-6f45-4bab-a1d4-d50157ddcd52 None None] REQUEST_METHOD: `POST` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:10:14.789264 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bffea979-6f45-4bab-a1d4-d50157ddcd52 None None] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:10:14.789264 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bffea979-6f45-4bab-a1d4-d50157ddcd52 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:10:14.824899 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.auth.core [None req-bffea979-6f45-4bab-a1d4-d50157ddcd52 None None] MFA Rules not processed for user `c622005135854b0c9984f5851b300e8e`. Rule list: `[]` (Enabled: `True`). {{(pid=80395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 16:10:14.826658 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.fernet_utils [None req-bffea979-6f45-4bab-a1d4-d50157ddcd52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:10:14.842983 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 1183/2357] 10.222.0.59 () {58 vars in 957 bytes} [Thu Jun 2 16:10:14 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 60 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 16:10:16.762290 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5550ea52-b71c-49c7-9c66-acc6f417c4dd None None] REQUEST_METHOD: `POST` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:10:16.762290 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5550ea52-b71c-49c7-9c66-acc6f417c4dd None None] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:10:16.762290 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5550ea52-b71c-49c7-9c66-acc6f417c4dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:10:16.790050 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.auth.core [None req-5550ea52-b71c-49c7-9c66-acc6f417c4dd None None] MFA Rules not processed for user `5c74b6deafc74a7ca85b145628e0731b`. Rule list: `[]` (Enabled: `True`). {{(pid=80396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 16:10:16.791389 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.fernet_utils [None req-5550ea52-b71c-49c7-9c66-acc6f417c4dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:10:16.864186 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 1175/2358] 10.222.0.59 () {58 vars in 957 bytes} [Thu Jun 2 16:10:16 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 16:10:16.877693 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bffea979-6f45-4bab-a1d4-d50157ddcd52 None None] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:10:16.879123 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.fernet_utils [None req-bffea979-6f45-4bab-a1d4-d50157ddcd52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:10:16.953276 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bffea979-6f45-4bab-a1d4-d50157ddcd52 None None] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:10:16.958978 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c1838bf-95a7-486b-b063-e4421e1aa0c0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52f9fe4b13574516bb0a8e2aa11a61e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c87c981909d4b8db02783421818c79b', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:10:16.959625 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c1838bf-95a7-486b-b063-e4421e1aa0c0 service nova] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:10:16.959911 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c1838bf-95a7-486b-b063-e4421e1aa0c0 service nova] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:10:16.960264 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c1838bf-95a7-486b-b063-e4421e1aa0c0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:10:16.962269 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.fernet_utils [None req-5c1838bf-95a7-486b-b063-e4421e1aa0c0 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:10:16.968622 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 16:10:17.027651 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c1838bf-95a7-486b-b063-e4421e1aa0c0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:10:17.036198 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c1838bf-95a7-486b-b063-e4421e1aa0c0 service nova] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:10:17.039774 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 1184/2359] 10.222.0.59 () {60 vars in 1365 bytes} [Thu Jun 2 16:10:16 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 163 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 16:10:20.561465 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288d8250-d98a-4edb-a90b-1a376839e4ad None None] REQUEST_METHOD: `POST` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:10:20.562857 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288d8250-d98a-4edb-a90b-1a376839e4ad None None] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:10:20.563381 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288d8250-d98a-4edb-a90b-1a376839e4ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:10:20.583689 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.auth.core [None req-288d8250-d98a-4edb-a90b-1a376839e4ad None None] MFA Rules not processed for user `2f09d7a733fa43a7a45f56176c752447`. Rule list: `[]` (Enabled: `True`). {{(pid=80396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 16:10:20.584910 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.fernet_utils [None req-288d8250-d98a-4edb-a90b-1a376839e4ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:10:20.592919 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 1176/2360] 10.222.0.59 () {58 vars in 957 bytes} [Thu Jun 2 16:10:20 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 16:10:28.597336 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writing DB stats keystone:SELECT=25 {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 16:10:30.577318 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG dbcounter [-] [80396] Writing DB stats keystone:SELECT=75,keystone:INSERT=1 {{(pid=80396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 16:10:38.094444 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e87893a-2141-433c-9cea-50c580b38483 None None] REQUEST_METHOD: `POST` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:10:38.094964 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e87893a-2141-433c-9cea-50c580b38483 None None] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:10:38.095244 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e87893a-2141-433c-9cea-50c580b38483 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:10:38.118430 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.auth.core [None req-1e87893a-2141-433c-9cea-50c580b38483 None None] MFA Rules not processed for user `e1dbb393020e452fb78d212cf60a2a72`. Rule list: `[]` (Enabled: `True`). {{(pid=80395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 16:10:38.119647 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.fernet_utils [None req-1e87893a-2141-433c-9cea-50c580b38483 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:10:38.190167 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 1185/2361] 10.222.0.59 () {58 vars in 957 bytes} [Thu Jun 2 16:10:38 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 16:10:40.276406 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17387179-9944-4ec0-8266-fbda0ae9856a None None] REQUEST_METHOD: `POST` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:10:40.277380 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17387179-9944-4ec0-8266-fbda0ae9856a None None] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:10:40.277491 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17387179-9944-4ec0-8266-fbda0ae9856a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:10:40.326934 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.auth.core [None req-17387179-9944-4ec0-8266-fbda0ae9856a None None] MFA Rules not processed for user `11b714eb2dda4460a8ff52215e671bfa`. Rule list: `[]` (Enabled: `True`). {{(pid=80396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 16:10:40.328160 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.fernet_utils [None req-17387179-9944-4ec0-8266-fbda0ae9856a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:10:40.400945 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 1177/2362] 10.222.0.59 () {58 vars in 1009 bytes} [Thu Jun 2 16:10:40 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 16:10:40.442803 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e87893a-2141-433c-9cea-50c580b38483 None None] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:10:40.444201 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.fernet_utils [None req-1e87893a-2141-433c-9cea-50c580b38483 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:10:40.538173 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e87893a-2141-433c-9cea-50c580b38483 None None] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:10:40.543498 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7923e0b3-4311-43da-80a9-83f33f84f07b service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31bd858bf7674f43a99b77d11bc3c1a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c87c981909d4b8db02783421818c79b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:10:40.548642 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7923e0b3-4311-43da-80a9-83f33f84f07b service swift] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:10:40.548642 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7923e0b3-4311-43da-80a9-83f33f84f07b service swift] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:10:40.548642 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7923e0b3-4311-43da-80a9-83f33f84f07b service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:10:40.553268 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7923e0b3-4311-43da-80a9-83f33f84f07b service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:10:40.555362 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7923e0b3-4311-43da-80a9-83f33f84f07b service swift] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:10:40.564679 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 1186/2363] 10.222.0.59 () {60 vars in 1384 bytes} [Thu Jun 2 16:10:40 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 122 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 02 16:10:41.539061 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-797b8d54-1d44-4fb0-b1e0-d98cc834ebb2 None None] REQUEST_METHOD: `POST` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:10:41.539537 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-797b8d54-1d44-4fb0-b1e0-d98cc834ebb2 None None] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:10:41.539537 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-797b8d54-1d44-4fb0-b1e0-d98cc834ebb2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:10:41.557972 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.auth.core [None req-797b8d54-1d44-4fb0-b1e0-d98cc834ebb2 None None] MFA Rules not processed for user `11b714eb2dda4460a8ff52215e671bfa`. Rule list: `[]` (Enabled: `True`). {{(pid=80396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 16:10:41.559365 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.fernet_utils [None req-797b8d54-1d44-4fb0-b1e0-d98cc834ebb2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:10:41.566451 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 1178/2364] 10.222.0.59 () {58 vars in 967 bytes} [Thu Jun 2 16:10:41 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 16:10:41.579964 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7923e0b3-4311-43da-80a9-83f33f84f07b service swift] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:10:41.592162 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7923e0b3-4311-43da-80a9-83f33f84f07b service swift] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:10:41.598119 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c75c23f-3345-4703-97c4-514a8ebf05db service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31bd858bf7674f43a99b77d11bc3c1a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c87c981909d4b8db02783421818c79b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:10:41.598864 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c75c23f-3345-4703-97c4-514a8ebf05db service swift] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:10:41.599219 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c75c23f-3345-4703-97c4-514a8ebf05db service swift] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:10:41.599578 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c75c23f-3345-4703-97c4-514a8ebf05db service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:10:41.608949 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c75c23f-3345-4703-97c4-514a8ebf05db service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:10:41.610673 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c75c23f-3345-4703-97c4-514a8ebf05db service swift] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:10:41.619694 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 1187/2365] 10.222.0.59 () {60 vars in 1384 bytes} [Thu Jun 2 16:10:41 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 02 16:10:42.367798 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcfd8b18-d92d-473f-beb7-c93d60507fb9 None None] REQUEST_METHOD: `POST` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:10:42.368079 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcfd8b18-d92d-473f-beb7-c93d60507fb9 None None] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:10:42.368396 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcfd8b18-d92d-473f-beb7-c93d60507fb9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:10:42.387731 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.auth.core [None req-dcfd8b18-d92d-473f-beb7-c93d60507fb9 None None] MFA Rules not processed for user `11b714eb2dda4460a8ff52215e671bfa`. Rule list: `[]` (Enabled: `True`). {{(pid=80396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 16:10:42.388918 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.fernet_utils [None req-dcfd8b18-d92d-473f-beb7-c93d60507fb9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:10:42.396187 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 1179/2366] 10.222.0.59 () {58 vars in 1009 bytes} [Thu Jun 2 16:10:42 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 16:10:42.408445 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c75c23f-3345-4703-97c4-514a8ebf05db service swift] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:10:42.418672 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c75c23f-3345-4703-97c4-514a8ebf05db service swift] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:10:42.423600 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc3499a3-b7e8-4160-87da-c860cb91bc5d service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31bd858bf7674f43a99b77d11bc3c1a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c87c981909d4b8db02783421818c79b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:10:42.424259 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc3499a3-b7e8-4160-87da-c860cb91bc5d service swift] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:10:42.424536 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc3499a3-b7e8-4160-87da-c860cb91bc5d service swift] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:10:42.424806 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc3499a3-b7e8-4160-87da-c860cb91bc5d service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:10:42.434562 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc3499a3-b7e8-4160-87da-c860cb91bc5d service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:10:42.436202 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc3499a3-b7e8-4160-87da-c860cb91bc5d service swift] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:10:42.444701 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 1188/2367] 10.222.0.59 () {60 vars in 1384 bytes} [Thu Jun 2 16:10:42 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 02 16:10:43.074726 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-927ec17c-3cce-4181-a52b-6a09bfdf650c None None] REQUEST_METHOD: `POST` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:10:43.075226 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-927ec17c-3cce-4181-a52b-6a09bfdf650c None None] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:10:43.075226 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-927ec17c-3cce-4181-a52b-6a09bfdf650c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:10:43.092998 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.auth.core [None req-927ec17c-3cce-4181-a52b-6a09bfdf650c None None] MFA Rules not processed for user `11b714eb2dda4460a8ff52215e671bfa`. Rule list: `[]` (Enabled: `True`). {{(pid=80396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 16:10:43.094351 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.fernet_utils [None req-927ec17c-3cce-4181-a52b-6a09bfdf650c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:10:43.101899 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 1180/2368] 10.222.0.59 () {58 vars in 967 bytes} [Thu Jun 2 16:10:43 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 16:10:43.114388 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc3499a3-b7e8-4160-87da-c860cb91bc5d service swift] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:10:43.125417 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc3499a3-b7e8-4160-87da-c860cb91bc5d service swift] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:10:43.130392 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba74f195-316f-40cb-aa87-c828e22d950e service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31bd858bf7674f43a99b77d11bc3c1a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c87c981909d4b8db02783421818c79b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:10:43.131026 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba74f195-316f-40cb-aa87-c828e22d950e service swift] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:10:43.131307 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba74f195-316f-40cb-aa87-c828e22d950e service swift] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:10:43.131582 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba74f195-316f-40cb-aa87-c828e22d950e service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:10:43.140686 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba74f195-316f-40cb-aa87-c828e22d950e service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:10:43.142295 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba74f195-316f-40cb-aa87-c828e22d950e service swift] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:10:43.150311 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 1189/2369] 10.222.0.59 () {60 vars in 1384 bytes} [Thu Jun 2 16:10:43 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 02 16:10:46.350846 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-927ec17c-3cce-4181-a52b-6a09bfdf650c None None] Authenticating user token {{(pid=80396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:10:46.414648 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-927ec17c-3cce-4181-a52b-6a09bfdf650c None None] Validating token access rules against request {{(pid=80396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:10:46.419555 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-347aac28-6f60-458a-b186-af2ea1afdd10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f73d5a98be74242b45222df39fb6213', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:10:46.420416 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347aac28-6f60-458a-b186-af2ea1afdd10 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:10:46.420699 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347aac28-6f60-458a-b186-af2ea1afdd10 admin admin] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:10:46.420976 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347aac28-6f60-458a-b186-af2ea1afdd10 admin admin] PATH_INFO: `/v3/users/c622005135854b0c9984f5851b300e8e` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:10:46.422189 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-347aac28-6f60-458a-b186-af2ea1afdd10 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c622005135854b0c9984f5851b300e8e)` {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:10:46.424097 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-347aac28-6f60-458a-b186-af2ea1afdd10 admin admin] RBAC: Authorization granted {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:10:46.697484 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.notifications [None req-347aac28-6f60-458a-b186-af2ea1afdd10 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c622005135854b0c9984f5851b300e8e'} {{(pid=80396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:10:46.698169 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.notifications [None req-347aac28-6f60-458a-b186-af2ea1afdd10 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c622005135854b0c9984f5851b300e8e'} {{(pid=80396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:10:46.807889 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.notifications [None req-347aac28-6f60-458a-b186-af2ea1afdd10 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c622005135854b0c9984f5851b300e8e'} {{(pid=80396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:10:46.811920 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG dbcounter [-] [80396] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=80396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 16:10:46.822465 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.notifications [None req-347aac28-6f60-458a-b186-af2ea1afdd10 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c622005135854b0c9984f5851b300e8e'} {{(pid=80396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:10:46.829906 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.notifications [None req-347aac28-6f60-458a-b186-af2ea1afdd10 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c622005135854b0c9984f5851b300e8e'} {{(pid=80396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:10:46.836046 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 1181/2370] 10.222.0.59 () {58 vars in 1223 bytes} [Thu Jun 2 16:10:46 2022] DELETE /identity/v3/users/c622005135854b0c9984f5851b300e8e => generated 0 bytes in 486 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 16:10:46.841010 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561392e6-a102-4995-8bee-7b8e2d114015 None None] REQUEST_METHOD: `POST` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:10:46.841765 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561392e6-a102-4995-8bee-7b8e2d114015 None None] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:10:46.842045 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561392e6-a102-4995-8bee-7b8e2d114015 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:10:46.860666 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.auth.core [None req-561392e6-a102-4995-8bee-7b8e2d114015 None None] MFA Rules not processed for user `400d1f4db9de49638549e5db29a041e1`. Rule list: `[]` (Enabled: `True`). {{(pid=80395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 16:10:46.861870 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.fernet_utils [None req-561392e6-a102-4995-8bee-7b8e2d114015 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:10:46.896516 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writing DB stats keystone:SELECT=100 {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 16:10:46.925250 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 1190/2371] 10.222.0.59 () {58 vars in 957 bytes} [Thu Jun 2 16:10:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 16:10:46.935471 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-347aac28-6f60-458a-b186-af2ea1afdd10 admin admin] Authenticating user token {{(pid=80396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:10:46.936941 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.fernet_utils [None req-347aac28-6f60-458a-b186-af2ea1afdd10 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:10:46.993929 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-347aac28-6f60-458a-b186-af2ea1afdd10 admin admin] Validating token access rules against request {{(pid=80396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:10:46.998499 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdd59d45-252c-40d2-be29-dc093d47fa8a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9af40ddfe9ff4be3887b068f13a28dc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c87c981909d4b8db02783421818c79b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:10:46.999154 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd59d45-252c-40d2-be29-dc093d47fa8a service neutron] REQUEST_METHOD: `GET` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:10:46.999439 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd59d45-252c-40d2-be29-dc093d47fa8a service neutron] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:10:46.999714 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd59d45-252c-40d2-be29-dc093d47fa8a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:10:47.011968 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdd59d45-252c-40d2-be29-dc093d47fa8a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:10:47.011968 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdd59d45-252c-40d2-be29-dc093d47fa8a service neutron] RBAC: Authorization granted {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:10:47.021371 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 1182/2372] 10.222.0.59 () {60 vars in 1365 bytes} [Thu Jun 2 16:10:46 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 16:10:47.267248 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-561392e6-a102-4995-8bee-7b8e2d114015 None None] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:10:47.268756 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.fernet_utils [None req-561392e6-a102-4995-8bee-7b8e2d114015 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:10:47.282441 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-561392e6-a102-4995-8bee-7b8e2d114015 None None] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:10:47.286603 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23e1e2a5-271b-4c4a-b965-2f85ea275e24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f73d5a98be74242b45222df39fb6213', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:10:47.287479 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e1e2a5-271b-4c4a-b965-2f85ea275e24 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:10:47.287792 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e1e2a5-271b-4c4a-b965-2f85ea275e24 admin admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:10:47.288074 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e1e2a5-271b-4c4a-b965-2f85ea275e24 admin admin] PATH_INFO: `/v3/projects/0c053fa2e3254a849acdb5116ec9644b` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:10:47.289280 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23e1e2a5-271b-4c4a-b965-2f85ea275e24 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0c053fa2e3254a849acdb5116ec9644b)` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:10:47.291256 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23e1e2a5-271b-4c4a-b965-2f85ea275e24 admin admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:10:47.425499 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.notifications [None req-23e1e2a5-271b-4c4a-b965-2f85ea275e24 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0c053fa2e3254a849acdb5116ec9644b', 'request_id': 'req-23e1e2a5-271b-4c4a-b965-2f85ea275e24'} {{(pid=80395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:10:47.431678 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.notifications [None req-23e1e2a5-271b-4c4a-b965-2f85ea275e24 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0c053fa2e3254a849acdb5116ec9644b', 'request_id': 'req-23e1e2a5-271b-4c4a-b965-2f85ea275e24'} {{(pid=80395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:10:47.560097 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.notifications [None req-23e1e2a5-271b-4c4a-b965-2f85ea275e24 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0c053fa2e3254a849acdb5116ec9644b', 'request_id': 'req-23e1e2a5-271b-4c4a-b965-2f85ea275e24'} {{(pid=80395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:10:47.572186 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.notifications [None req-23e1e2a5-271b-4c4a-b965-2f85ea275e24 admin admin] The token cache is being invalidate because project 0c053fa2e3254a849acdb5116ec9644b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80395) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 02 16:10:47.572479 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.notifications [None req-23e1e2a5-271b-4c4a-b965-2f85ea275e24 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:10:47.573202 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.notifications [None req-23e1e2a5-271b-4c4a-b965-2f85ea275e24 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:10:47.575410 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 1191/2373] 10.222.0.59 () {58 vars in 1232 bytes} [Thu Jun 2 16:10:47 2022] DELETE /identity/v3/projects/0c053fa2e3254a849acdb5116ec9644b => generated 0 bytes in 309 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 16:10:57.060197 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG dbcounter [-] [80396] Writing DB stats keystone:SELECT=37,keystone:DELETE=2 {{(pid=80396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 16:10:57.568373 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writing DB stats keystone:SELECT=38,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 16:11:09.390052 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9b16b3-2741-4c0a-9f4f-3014e8f8ad81 None None] REQUEST_METHOD: `POST` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:11:09.390572 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9b16b3-2741-4c0a-9f4f-3014e8f8ad81 None None] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:11:09.390650 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9b16b3-2741-4c0a-9f4f-3014e8f8ad81 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:11:09.411203 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.auth.core [None req-ac9b16b3-2741-4c0a-9f4f-3014e8f8ad81 None None] MFA Rules not processed for user `11b714eb2dda4460a8ff52215e671bfa`. Rule list: `[]` (Enabled: `True`). {{(pid=80396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 16:11:09.412417 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.fernet_utils [None req-ac9b16b3-2741-4c0a-9f4f-3014e8f8ad81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:11:09.478644 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 1183/2374] 10.222.0.59 () {58 vars in 1009 bytes} [Thu Jun 2 16:11:09 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 16:11:09.492505 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23e1e2a5-271b-4c4a-b965-2f85ea275e24 admin admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:11:09.494727 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.fernet_utils [None req-23e1e2a5-271b-4c4a-b965-2f85ea275e24 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:11:09.567352 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23e1e2a5-271b-4c4a-b965-2f85ea275e24 admin admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:11:09.572285 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ab321c2-4991-4101-bd1e-16bf8fdee458 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31bd858bf7674f43a99b77d11bc3c1a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c87c981909d4b8db02783421818c79b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:11:09.572933 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab321c2-4991-4101-bd1e-16bf8fdee458 service swift] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:11:09.573217 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab321c2-4991-4101-bd1e-16bf8fdee458 service swift] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:11:09.573494 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab321c2-4991-4101-bd1e-16bf8fdee458 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:11:09.581944 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ab321c2-4991-4101-bd1e-16bf8fdee458 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:11:09.583585 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ab321c2-4991-4101-bd1e-16bf8fdee458 service swift] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:11:09.592555 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 1192/2375] 10.222.0.59 () {60 vars in 1384 bytes} [Thu Jun 2 16:11:09 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 02 16:11:17.868564 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac9b16b3-2741-4c0a-9f4f-3014e8f8ad81 None None] Authenticating user token {{(pid=80396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:11:17.871304 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.fernet_utils [None req-ac9b16b3-2741-4c0a-9f4f-3014e8f8ad81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:11:17.994934 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac9b16b3-2741-4c0a-9f4f-3014e8f8ad81 None None] Validating token access rules against request {{(pid=80396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:11:18.006316 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23992bd4-d611-4244-b191-4fc296b10c6f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9af40ddfe9ff4be3887b068f13a28dc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c87c981909d4b8db02783421818c79b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:11:18.007990 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23992bd4-d611-4244-b191-4fc296b10c6f service neutron] REQUEST_METHOD: `GET` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:11:18.010540 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23992bd4-d611-4244-b191-4fc296b10c6f service neutron] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:11:18.011856 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23992bd4-d611-4244-b191-4fc296b10c6f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:11:18.016887 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.fernet_utils [None req-23992bd4-d611-4244-b191-4fc296b10c6f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:11:18.111221 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23992bd4-d611-4244-b191-4fc296b10c6f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:11:18.113642 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23992bd4-d611-4244-b191-4fc296b10c6f service neutron] RBAC: Authorization granted {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:11:18.138435 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 1184/2376] 10.222.0.59 () {60 vars in 1365 bytes} [Thu Jun 2 16:11:17 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 270 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 16:11:19.588497 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writing DB stats keystone:SELECT=32 {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 16:11:27.558971 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3d6d8a-e41c-41ce-92cb-45e178235e30 None None] REQUEST_METHOD: `POST` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:11:27.559612 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3d6d8a-e41c-41ce-92cb-45e178235e30 None None] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:11:27.559612 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3d6d8a-e41c-41ce-92cb-45e178235e30 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:11:27.578193 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.auth.core [None req-ed3d6d8a-e41c-41ce-92cb-45e178235e30 None None] MFA Rules not processed for user `11b714eb2dda4460a8ff52215e671bfa`. Rule list: `[]` (Enabled: `True`). {{(pid=80395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 16:11:27.579372 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.fernet_utils [None req-ed3d6d8a-e41c-41ce-92cb-45e178235e30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:11:27.586586 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 1193/2377] 10.222.0.59 () {58 vars in 967 bytes} [Thu Jun 2 16:11:27 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 16:11:27.599844 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23992bd4-d611-4244-b191-4fc296b10c6f service neutron] Authenticating user token {{(pid=80396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:11:27.611562 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23992bd4-d611-4244-b191-4fc296b10c6f service neutron] Validating token access rules against request {{(pid=80396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:11:27.616457 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cd77966-d10f-4a27-a3f0-fcc6ed19ee0c service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31bd858bf7674f43a99b77d11bc3c1a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c87c981909d4b8db02783421818c79b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:11:27.617083 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd77966-d10f-4a27-a3f0-fcc6ed19ee0c service swift] REQUEST_METHOD: `GET` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:11:27.617394 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd77966-d10f-4a27-a3f0-fcc6ed19ee0c service swift] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:11:27.617672 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd77966-d10f-4a27-a3f0-fcc6ed19ee0c service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:11:27.625705 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cd77966-d10f-4a27-a3f0-fcc6ed19ee0c service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:11:27.627314 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cd77966-d10f-4a27-a3f0-fcc6ed19ee0c service swift] RBAC: Authorization granted {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:11:27.635307 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 1185/2378] 10.222.0.59 () {60 vars in 1384 bytes} [Thu Jun 2 16:11:27 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 02 16:11:27.706721 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed3d6d8a-e41c-41ce-92cb-45e178235e30 None None] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:11:27.708098 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.fernet_utils [None req-ed3d6d8a-e41c-41ce-92cb-45e178235e30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:11:27.720161 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed3d6d8a-e41c-41ce-92cb-45e178235e30 None None] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:11:27.723849 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-017d3e80-1c11-4179-ac5a-b2d9a138c510 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9af40ddfe9ff4be3887b068f13a28dc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c87c981909d4b8db02783421818c79b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:11:27.724478 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-017d3e80-1c11-4179-ac5a-b2d9a138c510 service neutron] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:11:27.724760 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-017d3e80-1c11-4179-ac5a-b2d9a138c510 service neutron] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:11:27.725035 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-017d3e80-1c11-4179-ac5a-b2d9a138c510 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:11:27.726727 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.fernet_utils [None req-017d3e80-1c11-4179-ac5a-b2d9a138c510 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:11:27.795977 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-017d3e80-1c11-4179-ac5a-b2d9a138c510 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:11:27.797408 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-017d3e80-1c11-4179-ac5a-b2d9a138c510 service neutron] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:11:27.808320 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 1194/2379] 10.222.0.59 () {60 vars in 1365 bytes} [Thu Jun 2 16:11:27 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 16:11:28.982052 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cd77966-d10f-4a27-a3f0-fcc6ed19ee0c service swift] Authenticating user token {{(pid=80396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:11:28.991603 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cd77966-d10f-4a27-a3f0-fcc6ed19ee0c service swift] Validating token access rules against request {{(pid=80396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:11:28.995920 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06491914-765c-4275-b47c-d59a522c459a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9af40ddfe9ff4be3887b068f13a28dc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c87c981909d4b8db02783421818c79b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:11:28.996580 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06491914-765c-4275-b47c-d59a522c459a service neutron] REQUEST_METHOD: `GET` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:11:28.996865 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06491914-765c-4275-b47c-d59a522c459a service neutron] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:11:28.997143 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06491914-765c-4275-b47c-d59a522c459a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:11:28.998954 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.fernet_utils [None req-06491914-765c-4275-b47c-d59a522c459a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:11:29.012763 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06491914-765c-4275-b47c-d59a522c459a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:11:29.014188 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06491914-765c-4275-b47c-d59a522c459a service neutron] RBAC: Authorization granted {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:11:29.024710 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 1186/2380] 10.222.0.59 () {60 vars in 1365 bytes} [Thu Jun 2 16:11:28 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 16:11:31.088370 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387762b7-fa76-4832-a942-dc7ba691167e None None] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:11:31.089383 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387762b7-fa76-4832-a942-dc7ba691167e None None] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:11:31.089682 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387762b7-fa76-4832-a942-dc7ba691167e None None] PATH_INFO: `/` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:11:31.091106 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 1195/2381] 10.222.0.59 () {54 vars in 921 bytes} [Thu Jun 2 16:11:31 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 16:11:31.100480 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f7c323-e5ba-489e-a244-24f52588e848 None None] REQUEST_METHOD: `POST` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:11:31.100930 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f7c323-e5ba-489e-a244-24f52588e848 None None] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:11:31.101259 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f7c323-e5ba-489e-a244-24f52588e848 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:11:31.137959 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.auth.core [None req-e4f7c323-e5ba-489e-a244-24f52588e848 None None] MFA Rules not processed for user `2b700f6d94374ba4b362a8f0d5b35796`. Rule list: `[]` (Enabled: `True`). {{(pid=80396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 16:11:31.139345 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.fernet_utils [None req-e4f7c323-e5ba-489e-a244-24f52588e848 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:11:31.149297 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG dbcounter [-] [80396] Writing DB stats keystone:SELECT=100 {{(pid=80396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 16:11:31.203088 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 1187/2382] 10.222.0.59 () {58 vars in 1018 bytes} [Thu Jun 2 16:11:31 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 16:11:31.214324 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-387762b7-fa76-4832-a942-dc7ba691167e None None] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:11:31.216161 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.fernet_utils [None req-387762b7-fa76-4832-a942-dc7ba691167e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:11:31.233256 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-387762b7-fa76-4832-a942-dc7ba691167e None None] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:11:31.238158 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96238c8a-203f-431d-838e-8c50de2b0297 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b700f6d94374ba4b362a8f0d5b35796', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c87c981909d4b8db02783421818c79b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:11:31.238790 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96238c8a-203f-431d-838e-8c50de2b0297 service placement] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:11:31.239069 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96238c8a-203f-431d-838e-8c50de2b0297 service placement] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:11:31.239342 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96238c8a-203f-431d-838e-8c50de2b0297 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:11:31.247772 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96238c8a-203f-431d-838e-8c50de2b0297 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:11:31.249413 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96238c8a-203f-431d-838e-8c50de2b0297 service placement] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:11:31.258887 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 1196/2383] 10.222.0.59 () {60 vars in 1365 bytes} [Thu Jun 2 16:11:31 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 16:11:31.303882 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4f7c323-e5ba-489e-a244-24f52588e848 None None] Authenticating user token {{(pid=80396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:11:31.305274 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.fernet_utils [None req-e4f7c323-e5ba-489e-a244-24f52588e848 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:11:31.371874 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4f7c323-e5ba-489e-a244-24f52588e848 None None] Validating token access rules against request {{(pid=80396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:11:31.376405 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63f23e1b-565d-4c41-988d-0c9c216fd060 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f73d5a98be74242b45222df39fb6213', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:11:31.377254 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f23e1b-565d-4c41-988d-0c9c216fd060 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:11:31.377571 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f23e1b-565d-4c41-988d-0c9c216fd060 admin admin] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:11:31.377803 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f23e1b-565d-4c41-988d-0c9c216fd060 admin admin] PATH_INFO: `/v3/users/e1dbb393020e452fb78d212cf60a2a72` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:11:31.379024 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63f23e1b-565d-4c41-988d-0c9c216fd060 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e1dbb393020e452fb78d212cf60a2a72)` {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:11:31.380908 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63f23e1b-565d-4c41-988d-0c9c216fd060 admin admin] RBAC: Authorization granted {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:11:31.618936 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.notifications [None req-63f23e1b-565d-4c41-988d-0c9c216fd060 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e1dbb393020e452fb78d212cf60a2a72'} {{(pid=80396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:11:31.619516 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.notifications [None req-63f23e1b-565d-4c41-988d-0c9c216fd060 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e1dbb393020e452fb78d212cf60a2a72'} {{(pid=80396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:11:31.777154 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.notifications [None req-63f23e1b-565d-4c41-988d-0c9c216fd060 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e1dbb393020e452fb78d212cf60a2a72'} {{(pid=80396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:11:31.790017 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.notifications [None req-63f23e1b-565d-4c41-988d-0c9c216fd060 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e1dbb393020e452fb78d212cf60a2a72'} {{(pid=80396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:11:31.796843 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.notifications [None req-63f23e1b-565d-4c41-988d-0c9c216fd060 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e1dbb393020e452fb78d212cf60a2a72'} {{(pid=80396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:11:31.802698 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 1188/2384] 10.222.0.59 () {58 vars in 1223 bytes} [Thu Jun 2 16:11:31 2022] DELETE /identity/v3/users/e1dbb393020e452fb78d212cf60a2a72 => generated 0 bytes in 499 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 16:11:32.191010 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96238c8a-203f-431d-838e-8c50de2b0297 service placement] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:11:32.203874 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96238c8a-203f-431d-838e-8c50de2b0297 service placement] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:11:32.265869 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-670973da-3b52-4320-9530-05bdcea503d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f73d5a98be74242b45222df39fb6213', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:11:32.266961 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670973da-3b52-4320-9530-05bdcea503d4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:11:32.267242 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670973da-3b52-4320-9530-05bdcea503d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:11:32.267518 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670973da-3b52-4320-9530-05bdcea503d4 admin admin] PATH_INFO: `/v3/projects/b42e4a202a4942818fd25d0f25abe9de` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:11:32.268746 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-670973da-3b52-4320-9530-05bdcea503d4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b42e4a202a4942818fd25d0f25abe9de)` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:11:32.273101 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-670973da-3b52-4320-9530-05bdcea503d4 admin admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:11:32.481372 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.notifications [None req-670973da-3b52-4320-9530-05bdcea503d4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b42e4a202a4942818fd25d0f25abe9de', 'request_id': 'req-670973da-3b52-4320-9530-05bdcea503d4'} {{(pid=80395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:11:32.487646 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.notifications [None req-670973da-3b52-4320-9530-05bdcea503d4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b42e4a202a4942818fd25d0f25abe9de', 'request_id': 'req-670973da-3b52-4320-9530-05bdcea503d4'} {{(pid=80395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:11:32.616298 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.notifications [None req-670973da-3b52-4320-9530-05bdcea503d4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b42e4a202a4942818fd25d0f25abe9de', 'request_id': 'req-670973da-3b52-4320-9530-05bdcea503d4'} {{(pid=80395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:11:32.622164 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 16:11:32.628426 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.notifications [None req-670973da-3b52-4320-9530-05bdcea503d4 admin admin] The token cache is being invalidate because project b42e4a202a4942818fd25d0f25abe9de was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80395) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 02 16:11:32.655791 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.notifications [None req-670973da-3b52-4320-9530-05bdcea503d4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:11:32.655791 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.notifications [None req-670973da-3b52-4320-9530-05bdcea503d4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:11:32.655791 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 1197/2385] 10.222.0.59 () {58 vars in 1232 bytes} [Thu Jun 2 16:11:32 2022] DELETE /identity/v3/projects/b42e4a202a4942818fd25d0f25abe9de => generated 0 bytes in 441 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 16:11:32.656093 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d5dd0f5-973d-454c-b22e-97f15977d24e None None] REQUEST_METHOD: `POST` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:11:32.656093 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d5dd0f5-973d-454c-b22e-97f15977d24e None None] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:11:32.656093 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d5dd0f5-973d-454c-b22e-97f15977d24e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:11:32.656625 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.auth.core [None req-3d5dd0f5-973d-454c-b22e-97f15977d24e None None] MFA Rules not processed for user `400d1f4db9de49638549e5db29a041e1`. Rule list: `[]` (Enabled: `True`). {{(pid=80396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 16:11:32.657591 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.fernet_utils [None req-3d5dd0f5-973d-454c-b22e-97f15977d24e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:11:32.687018 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG dbcounter [-] [80396] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 16:11:32.722359 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 1189/2386] 10.222.0.59 () {58 vars in 957 bytes} [Thu Jun 2 16:11:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 16:11:32.737955 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3c29d7-09e0-4d2d-ba13-27d0fe467e0b None None] REQUEST_METHOD: `POST` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:11:32.738277 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3c29d7-09e0-4d2d-ba13-27d0fe467e0b None None] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:11:32.738561 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3c29d7-09e0-4d2d-ba13-27d0fe467e0b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:11:32.757536 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.auth.core [None req-0d3c29d7-09e0-4d2d-ba13-27d0fe467e0b None None] MFA Rules not processed for user `400d1f4db9de49638549e5db29a041e1`. Rule list: `[]` (Enabled: `True`). {{(pid=80395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 16:11:32.758772 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.fernet_utils [None req-0d3c29d7-09e0-4d2d-ba13-27d0fe467e0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:11:32.768820 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 1198/2387] 10.222.0.59 () {58 vars in 957 bytes} [Thu Jun 2 16:11:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 16:11:32.779677 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d5dd0f5-973d-454c-b22e-97f15977d24e None None] Authenticating user token {{(pid=80396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:11:32.789321 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d5dd0f5-973d-454c-b22e-97f15977d24e None None] Validating token access rules against request {{(pid=80396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:11:32.794627 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01d0b469-907b-4fc0-9b7e-b2725d68b0ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f73d5a98be74242b45222df39fb6213', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:11:32.795289 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d0b469-907b-4fc0-9b7e-b2725d68b0ba admin admin] REQUEST_METHOD: `GET` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:11:32.795574 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d0b469-907b-4fc0-9b7e-b2725d68b0ba admin admin] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:11:32.795852 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d0b469-907b-4fc0-9b7e-b2725d68b0ba admin admin] PATH_INFO: `/v3/domains` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:11:32.796580 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01d0b469-907b-4fc0-9b7e-b2725d68b0ba admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80396) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 16:11:32.796888 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01d0b469-907b-4fc0-9b7e-b2725d68b0ba admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:11:32.798512 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01d0b469-907b-4fc0-9b7e-b2725d68b0ba admin admin] RBAC: Authorization granted {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:11:32.812163 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 1190/2388] 10.222.0.59 () {58 vars in 1152 bytes} [Thu Jun 2 16:11:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 16:11:32.819733 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d3c29d7-09e0-4d2d-ba13-27d0fe467e0b None None] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:11:32.829809 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d3c29d7-09e0-4d2d-ba13-27d0fe467e0b None None] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:11:32.834592 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f205b292-b714-40c1-887c-ebc7c4264a9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f73d5a98be74242b45222df39fb6213', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:11:32.835320 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f205b292-b714-40c1-887c-ebc7c4264a9c admin admin] REQUEST_METHOD: `POST` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:11:32.835604 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f205b292-b714-40c1-887c-ebc7c4264a9c admin admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:11:32.835880 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f205b292-b714-40c1-887c-ebc7c4264a9c admin admin] PATH_INFO: `/v3/projects` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:11:32.836579 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f205b292-b714-40c1-887c-ebc7c4264a9c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:11:32.838516 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f205b292-b714-40c1-887c-ebc7c4264a9c admin admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:11:32.987328 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 1199/2389] 10.222.0.59 () {60 vars in 1152 bytes} [Thu Jun 2 16:11:32 2022] POST /identity/v3/projects => generated 383 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 16:11:32.991612 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01d0b469-907b-4fc0-9b7e-b2725d68b0ba admin admin] Authenticating user token {{(pid=80396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:11:33.002258 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01d0b469-907b-4fc0-9b7e-b2725d68b0ba admin admin] Validating token access rules against request {{(pid=80396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:11:33.062548 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5b763be-96f2-4c18-8ad8-0265918752a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f73d5a98be74242b45222df39fb6213', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:11:33.063228 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b763be-96f2-4c18-8ad8-0265918752a4 admin admin] REQUEST_METHOD: `POST` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:11:33.063513 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b763be-96f2-4c18-8ad8-0265918752a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:11:33.063792 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b763be-96f2-4c18-8ad8-0265918752a4 admin admin] PATH_INFO: `/v3/users` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:11:33.064506 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5b763be-96f2-4c18-8ad8-0265918752a4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:11:33.066500 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5b763be-96f2-4c18-8ad8-0265918752a4 admin admin] RBAC: Authorization granted {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:11:33.163472 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 1191/2390] 10.222.0.59 () {60 vars in 1143 bytes} [Thu Jun 2 16:11:32 2022] POST /identity/v3/users => generated 292 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 16:11:33.171435 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f205b292-b714-40c1-887c-ebc7c4264a9c admin admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:11:33.184287 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f205b292-b714-40c1-887c-ebc7c4264a9c admin admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:11:33.192119 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d9a14e6-09b7-43e4-b116-91582955ee5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f73d5a98be74242b45222df39fb6213', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:11:33.192812 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9a14e6-09b7-43e4-b116-91582955ee5f admin admin] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:11:33.193104 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9a14e6-09b7-43e4-b116-91582955ee5f admin admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:11:33.193380 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9a14e6-09b7-43e4-b116-91582955ee5f admin admin] PATH_INFO: `/v3/roles` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:11:33.194163 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d9a14e6-09b7-43e4-b116-91582955ee5f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:11:33.195804 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d9a14e6-09b7-43e4-b116-91582955ee5f admin admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:11:33.208871 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 1200/2391] 10.222.0.59 () {58 vars in 1121 bytes} [Thu Jun 2 16:11:33 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 16:11:33.212752 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5b763be-96f2-4c18-8ad8-0265918752a4 admin admin] Authenticating user token {{(pid=80396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:11:33.226597 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5b763be-96f2-4c18-8ad8-0265918752a4 admin admin] Validating token access rules against request {{(pid=80396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:11:33.231684 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65e11293-9bf0-4394-9dd3-698d1bdf6b52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f73d5a98be74242b45222df39fb6213', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:11:33.232522 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e11293-9bf0-4394-9dd3-698d1bdf6b52 admin admin] REQUEST_METHOD: `GET` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:11:33.232935 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e11293-9bf0-4394-9dd3-698d1bdf6b52 admin admin] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:11:33.233300 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e11293-9bf0-4394-9dd3-698d1bdf6b52 admin admin] PATH_INFO: `/v3/roles` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:11:33.234207 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65e11293-9bf0-4394-9dd3-698d1bdf6b52 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:11:33.235921 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65e11293-9bf0-4394-9dd3-698d1bdf6b52 admin admin] RBAC: Authorization granted {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:11:33.248055 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 1192/2392] 10.222.0.59 () {58 vars in 1121 bytes} [Thu Jun 2 16:11:33 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 16:11:33.251924 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d9a14e6-09b7-43e4-b116-91582955ee5f admin admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:11:33.266681 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d9a14e6-09b7-43e4-b116-91582955ee5f admin admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:11:33.271629 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50cc7ef4-36a0-4cfe-ad42-b39316dfe04f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f73d5a98be74242b45222df39fb6213', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:11:33.272611 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50cc7ef4-36a0-4cfe-ad42-b39316dfe04f admin admin] REQUEST_METHOD: `PUT` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:11:33.272962 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50cc7ef4-36a0-4cfe-ad42-b39316dfe04f admin admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:11:33.273306 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50cc7ef4-36a0-4cfe-ad42-b39316dfe04f admin admin] PATH_INFO: `/v3/projects/2f6f5c694bf1472fbbca4a6f09ab69b7/users/af127872599f470bba3b99be8dc0aabe/roles/649e0f2b5a264c419ea6a1441f123a03` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:11:33.289216 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50cc7ef4-36a0-4cfe-ad42-b39316dfe04f admin admin] RBAC: Authorizing `identity:create_grant(project_id=2f6f5c694bf1472fbbca4a6f09ab69b7, user_id=af127872599f470bba3b99be8dc0aabe, role_id=649e0f2b5a264c419ea6a1441f123a03)` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:11:33.301771 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50cc7ef4-36a0-4cfe-ad42-b39316dfe04f admin admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:11:33.493699 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 1201/2393] 10.222.0.59 () {60 vars in 1482 bytes} [Thu Jun 2 16:11:33 2022] PUT /identity/v3/projects/2f6f5c694bf1472fbbca4a6f09ab69b7/users/af127872599f470bba3b99be8dc0aabe/roles/649e0f2b5a264c419ea6a1441f123a03 => generated 0 bytes in 242 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 16:11:33.504032 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a34e85b1-74b2-4035-8030-2d000131f746 None None] REQUEST_METHOD: `POST` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:11:33.504324 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a34e85b1-74b2-4035-8030-2d000131f746 None None] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:11:33.504678 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a34e85b1-74b2-4035-8030-2d000131f746 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:11:33.531987 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.auth.core [None req-a34e85b1-74b2-4035-8030-2d000131f746 None None] MFA Rules not processed for user `af127872599f470bba3b99be8dc0aabe`. Rule list: `[]` (Enabled: `True`). {{(pid=80396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 16:11:33.533228 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.fernet_utils [None req-a34e85b1-74b2-4035-8030-2d000131f746 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:11:33.597776 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 1193/2394] 10.222.0.59 () {58 vars in 957 bytes} [Thu Jun 2 16:11:33 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 16:11:33.609887 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50cc7ef4-36a0-4cfe-ad42-b39316dfe04f admin admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:11:33.611591 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.fernet_utils [None req-50cc7ef4-36a0-4cfe-ad42-b39316dfe04f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:11:33.670849 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50cc7ef4-36a0-4cfe-ad42-b39316dfe04f admin admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:11:33.674863 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0aa7969-c967-4298-afe2-770591528fd2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6534961c369940a5b88f310c6450250b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c87c981909d4b8db02783421818c79b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:11:33.675539 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0aa7969-c967-4298-afe2-770591528fd2 service cinder] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:11:33.676243 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0aa7969-c967-4298-afe2-770591528fd2 service cinder] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:11:33.676243 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0aa7969-c967-4298-afe2-770591528fd2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:11:33.684949 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0aa7969-c967-4298-afe2-770591528fd2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:11:33.686686 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0aa7969-c967-4298-afe2-770591528fd2 service cinder] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:11:33.695773 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 1202/2395] 10.222.0.59 () {60 vars in 1365 bytes} [Thu Jun 2 16:11:33 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 16:11:37.937976 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a34e85b1-74b2-4035-8030-2d000131f746 None None] Authenticating user token {{(pid=80396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:11:37.970599 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG dbcounter [-] [80396] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 16:11:38.004608 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a34e85b1-74b2-4035-8030-2d000131f746 None None] Validating token access rules against request {{(pid=80396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:11:38.009471 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abd1dc5c-e09b-4cb6-bc1f-17ddae4336fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f73d5a98be74242b45222df39fb6213', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:11:38.010445 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd1dc5c-e09b-4cb6-bc1f-17ddae4336fb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:11:38.010740 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd1dc5c-e09b-4cb6-bc1f-17ddae4336fb admin admin] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:11:38.011018 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd1dc5c-e09b-4cb6-bc1f-17ddae4336fb admin admin] PATH_INFO: `/v3/users/af127872599f470bba3b99be8dc0aabe` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:11:38.014192 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abd1dc5c-e09b-4cb6-bc1f-17ddae4336fb admin admin] RBAC: Authorizing `identity:delete_user(user_id=af127872599f470bba3b99be8dc0aabe)` {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:11:38.014192 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abd1dc5c-e09b-4cb6-bc1f-17ddae4336fb admin admin] RBAC: Authorization granted {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:11:38.203967 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.notifications [None req-abd1dc5c-e09b-4cb6-bc1f-17ddae4336fb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'af127872599f470bba3b99be8dc0aabe'} {{(pid=80396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:11:38.204639 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.notifications [None req-abd1dc5c-e09b-4cb6-bc1f-17ddae4336fb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'af127872599f470bba3b99be8dc0aabe'} {{(pid=80396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:11:38.312786 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.notifications [None req-abd1dc5c-e09b-4cb6-bc1f-17ddae4336fb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'af127872599f470bba3b99be8dc0aabe'} {{(pid=80396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:11:38.326972 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.notifications [None req-abd1dc5c-e09b-4cb6-bc1f-17ddae4336fb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'af127872599f470bba3b99be8dc0aabe'} {{(pid=80396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:11:38.333843 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.notifications [None req-abd1dc5c-e09b-4cb6-bc1f-17ddae4336fb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'af127872599f470bba3b99be8dc0aabe'} {{(pid=80396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:11:38.341220 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 1194/2396] 10.222.0.59 () {58 vars in 1223 bytes} [Thu Jun 2 16:11:37 2022] DELETE /identity/v3/users/af127872599f470bba3b99be8dc0aabe => generated 0 bytes in 404 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 16:11:38.346020 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ce178b-97b6-434f-9493-73ad57a6adf6 None None] REQUEST_METHOD: `POST` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:11:38.346526 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ce178b-97b6-434f-9493-73ad57a6adf6 None None] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:11:38.346782 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ce178b-97b6-434f-9493-73ad57a6adf6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:11:38.364005 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.auth.core [None req-f8ce178b-97b6-434f-9493-73ad57a6adf6 None None] MFA Rules not processed for user `400d1f4db9de49638549e5db29a041e1`. Rule list: `[]` (Enabled: `True`). {{(pid=80395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 16:11:38.365180 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.fernet_utils [None req-f8ce178b-97b6-434f-9493-73ad57a6adf6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:11:38.428459 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 1203/2397] 10.222.0.59 () {58 vars in 957 bytes} [Thu Jun 2 16:11:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 16:11:38.435804 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abd1dc5c-e09b-4cb6-bc1f-17ddae4336fb admin admin] Authenticating user token {{(pid=80396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:11:38.437301 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.fernet_utils [None req-abd1dc5c-e09b-4cb6-bc1f-17ddae4336fb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:11:38.497028 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abd1dc5c-e09b-4cb6-bc1f-17ddae4336fb admin admin] Validating token access rules against request {{(pid=80396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:11:38.500705 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d64fc9b3-c2f5-45d4-93b2-99c9bbaa5e63 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9af40ddfe9ff4be3887b068f13a28dc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c87c981909d4b8db02783421818c79b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:11:38.501352 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64fc9b3-c2f5-45d4-93b2-99c9bbaa5e63 service neutron] REQUEST_METHOD: `GET` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:11:38.501636 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64fc9b3-c2f5-45d4-93b2-99c9bbaa5e63 service neutron] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:11:38.501917 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64fc9b3-c2f5-45d4-93b2-99c9bbaa5e63 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:11:38.512199 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d64fc9b3-c2f5-45d4-93b2-99c9bbaa5e63 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:11:38.513632 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d64fc9b3-c2f5-45d4-93b2-99c9bbaa5e63 service neutron] RBAC: Authorization granted {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:11:38.523376 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 1195/2398] 10.222.0.59 () {60 vars in 1365 bytes} [Thu Jun 2 16:11:38 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 16:11:39.020904 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8ce178b-97b6-434f-9493-73ad57a6adf6 None None] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:11:39.022583 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.fernet_utils [None req-f8ce178b-97b6-434f-9493-73ad57a6adf6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:11:39.039121 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8ce178b-97b6-434f-9493-73ad57a6adf6 None None] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:11:39.045990 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08bfe4a4-c476-4a23-9fa8-c68adb0696fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f73d5a98be74242b45222df39fb6213', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:11:39.047093 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08bfe4a4-c476-4a23-9fa8-c68adb0696fb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:11:39.047353 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08bfe4a4-c476-4a23-9fa8-c68adb0696fb admin admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:11:39.047656 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08bfe4a4-c476-4a23-9fa8-c68adb0696fb admin admin] PATH_INFO: `/v3/projects/2f6f5c694bf1472fbbca4a6f09ab69b7` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:11:39.049328 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08bfe4a4-c476-4a23-9fa8-c68adb0696fb admin admin] RBAC: Authorizing `identity:delete_project(project_id=2f6f5c694bf1472fbbca4a6f09ab69b7)` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:11:39.052225 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08bfe4a4-c476-4a23-9fa8-c68adb0696fb admin admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:11:39.190563 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writing DB stats keystone:SELECT=96,keystone:INSERT=2,keystone:DELETE=2 {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 16:11:39.204073 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.notifications [None req-08bfe4a4-c476-4a23-9fa8-c68adb0696fb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2f6f5c694bf1472fbbca4a6f09ab69b7', 'request_id': 'req-08bfe4a4-c476-4a23-9fa8-c68adb0696fb'} {{(pid=80395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:11:39.210257 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.notifications [None req-08bfe4a4-c476-4a23-9fa8-c68adb0696fb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2f6f5c694bf1472fbbca4a6f09ab69b7', 'request_id': 'req-08bfe4a4-c476-4a23-9fa8-c68adb0696fb'} {{(pid=80395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:11:39.316569 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.notifications [None req-08bfe4a4-c476-4a23-9fa8-c68adb0696fb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2f6f5c694bf1472fbbca4a6f09ab69b7', 'request_id': 'req-08bfe4a4-c476-4a23-9fa8-c68adb0696fb'} {{(pid=80395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:11:39.329748 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.notifications [None req-08bfe4a4-c476-4a23-9fa8-c68adb0696fb admin admin] The token cache is being invalidate because project 2f6f5c694bf1472fbbca4a6f09ab69b7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80395) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 02 16:11:39.330199 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.notifications [None req-08bfe4a4-c476-4a23-9fa8-c68adb0696fb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:11:39.330909 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.notifications [None req-08bfe4a4-c476-4a23-9fa8-c68adb0696fb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:11:39.332797 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 1204/2399] 10.222.0.59 () {58 vars in 1232 bytes} [Thu Jun 2 16:11:39 2022] DELETE /identity/v3/projects/2f6f5c694bf1472fbbca4a6f09ab69b7 => generated 0 bytes in 313 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 16:11:43.006616 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c637f184-3c09-4eb5-8079-7867f04b15e8 None None] REQUEST_METHOD: `POST` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:11:43.007119 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c637f184-3c09-4eb5-8079-7867f04b15e8 None None] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:11:43.007221 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c637f184-3c09-4eb5-8079-7867f04b15e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:11:43.025416 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.auth.core [None req-c637f184-3c09-4eb5-8079-7867f04b15e8 None None] MFA Rules not processed for user `11b714eb2dda4460a8ff52215e671bfa`. Rule list: `[]` (Enabled: `True`). {{(pid=80396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 16:11:43.027529 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.fernet_utils [None req-c637f184-3c09-4eb5-8079-7867f04b15e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:11:43.071014 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG dbcounter [-] [80396] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 16:11:43.082573 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 1196/2400] 10.222.0.59 () {58 vars in 1009 bytes} [Thu Jun 2 16:11:43 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 16:11:43.105278 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08bfe4a4-c476-4a23-9fa8-c68adb0696fb admin admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:11:43.106715 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.fernet_utils [None req-08bfe4a4-c476-4a23-9fa8-c68adb0696fb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:11:43.179496 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08bfe4a4-c476-4a23-9fa8-c68adb0696fb admin admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:11:43.185284 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b64ae685-f764-4375-a4fc-4e96754fee6a service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31bd858bf7674f43a99b77d11bc3c1a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c87c981909d4b8db02783421818c79b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:11:43.186240 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64ae685-f764-4375-a4fc-4e96754fee6a service swift] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:11:43.186355 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64ae685-f764-4375-a4fc-4e96754fee6a service swift] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:11:43.187293 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64ae685-f764-4375-a4fc-4e96754fee6a service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:11:43.196213 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b64ae685-f764-4375-a4fc-4e96754fee6a service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:11:43.198680 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b64ae685-f764-4375-a4fc-4e96754fee6a service swift] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:11:43.208125 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 1205/2401] 10.222.0.59 () {60 vars in 1384 bytes} [Thu Jun 2 16:11:43 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 02 16:11:53.203950 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writing DB stats keystone:SELECT=45,keystone:DELETE=5,keystone:INSERT=1 {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 16:11:53.204621 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG dbcounter [-] [80396] Writing DB stats keystone:SELECT=3 {{(pid=80396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 16:11:57.425737 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c637f184-3c09-4eb5-8079-7867f04b15e8 None None] Authenticating user token {{(pid=80396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:11:57.427811 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.fernet_utils [None req-c637f184-3c09-4eb5-8079-7867f04b15e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:11:57.489499 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c637f184-3c09-4eb5-8079-7867f04b15e8 None None] Validating token access rules against request {{(pid=80396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:11:57.493210 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12d6cd8f-9c96-4065-8cca-cfbeb2a31a9f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9af40ddfe9ff4be3887b068f13a28dc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c87c981909d4b8db02783421818c79b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:11:57.493887 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d6cd8f-9c96-4065-8cca-cfbeb2a31a9f service neutron] REQUEST_METHOD: `GET` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:11:57.494182 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d6cd8f-9c96-4065-8cca-cfbeb2a31a9f service neutron] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:11:57.494451 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d6cd8f-9c96-4065-8cca-cfbeb2a31a9f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:11:57.496915 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.fernet_utils [None req-12d6cd8f-9c96-4065-8cca-cfbeb2a31a9f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:11:57.506936 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12d6cd8f-9c96-4065-8cca-cfbeb2a31a9f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:11:57.508672 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12d6cd8f-9c96-4065-8cca-cfbeb2a31a9f service neutron] RBAC: Authorization granted {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:11:57.517008 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 1197/2402] 10.222.0.59 () {60 vars in 1365 bytes} [Thu Jun 2 16:11:57 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 16:12:02.555819 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b64ae685-f764-4375-a4fc-4e96754fee6a service swift] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:12:02.564944 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b64ae685-f764-4375-a4fc-4e96754fee6a service swift] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:12:02.568461 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e50ae8d1-cd3c-446f-8659-d6ab455b7bbe service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9af40ddfe9ff4be3887b068f13a28dc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c87c981909d4b8db02783421818c79b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:12:02.569080 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e50ae8d1-cd3c-446f-8659-d6ab455b7bbe service neutron] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:12:02.569358 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e50ae8d1-cd3c-446f-8659-d6ab455b7bbe service neutron] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:12:02.569629 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e50ae8d1-cd3c-446f-8659-d6ab455b7bbe service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:12:02.571396 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.fernet_utils [None req-e50ae8d1-cd3c-446f-8659-d6ab455b7bbe service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:12:02.580983 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e50ae8d1-cd3c-446f-8659-d6ab455b7bbe service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:12:02.582427 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e50ae8d1-cd3c-446f-8659-d6ab455b7bbe service neutron] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:12:02.590749 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 1206/2403] 10.222.0.59 () {60 vars in 1365 bytes} [Thu Jun 2 16:12:02 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 16:12:02.884275 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c2a2d0-3713-449e-92d1-3cfa8048da79 None None] REQUEST_METHOD: `GET` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:12:02.884770 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c2a2d0-3713-449e-92d1-3cfa8048da79 None None] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:12:02.885098 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c2a2d0-3713-449e-92d1-3cfa8048da79 None None] PATH_INFO: `/` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:12:02.887813 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 1198/2404] 10.222.0.59 () {54 vars in 921 bytes} [Thu Jun 2 16:12:02 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 16:12:02.893929 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e15a09f-f85f-488a-8977-e0a862b3b4b7 None None] REQUEST_METHOD: `POST` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:12:02.894279 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e15a09f-f85f-488a-8977-e0a862b3b4b7 None None] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:12:02.894561 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e15a09f-f85f-488a-8977-e0a862b3b4b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:12:02.913359 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.auth.core [None req-0e15a09f-f85f-488a-8977-e0a862b3b4b7 None None] MFA Rules not processed for user `52f9fe4b13574516bb0a8e2aa11a61e8`. Rule list: `[]` (Enabled: `True`). {{(pid=80395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 16:12:02.914599 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.fernet_utils [None req-0e15a09f-f85f-488a-8977-e0a862b3b4b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:12:02.983150 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 1207/2405] 10.222.0.59 () {58 vars in 1018 bytes} [Thu Jun 2 16:12:02 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 16:12:02.995021 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49c2a2d0-3713-449e-92d1-3cfa8048da79 None None] Authenticating user token {{(pid=80396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:12:02.997506 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.fernet_utils [None req-49c2a2d0-3713-449e-92d1-3cfa8048da79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:12:03.075659 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49c2a2d0-3713-449e-92d1-3cfa8048da79 None None] Validating token access rules against request {{(pid=80396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:12:03.079083 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f2b497f-8289-4c0d-9de2-bd6875263958 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e673e7e0a4bf4c77bdb3e5325d0d3275', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c87c981909d4b8db02783421818c79b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:12:03.079718 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f2b497f-8289-4c0d-9de2-bd6875263958 service glance] REQUEST_METHOD: `GET` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:12:03.080004 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f2b497f-8289-4c0d-9de2-bd6875263958 service glance] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:12:03.080277 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f2b497f-8289-4c0d-9de2-bd6875263958 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:12:03.090402 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f2b497f-8289-4c0d-9de2-bd6875263958 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:12:03.091827 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f2b497f-8289-4c0d-9de2-bd6875263958 service glance] RBAC: Authorization granted {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:12:03.102556 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 1199/2406] 10.222.0.59 () {60 vars in 1365 bytes} [Thu Jun 2 16:12:02 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 16:12:03.360884 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a85d71-f42f-4bb9-94a9-8d54830bc682 None None] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:12:03.361098 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a85d71-f42f-4bb9-94a9-8d54830bc682 None None] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:12:03.361379 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a85d71-f42f-4bb9-94a9-8d54830bc682 None None] PATH_INFO: `/` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:12:03.362785 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 1208/2407] 10.222.0.59 () {54 vars in 921 bytes} [Thu Jun 2 16:12:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 16:12:03.367525 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c9d3b0-73d9-4b82-b313-5ac71b03e167 None None] REQUEST_METHOD: `POST` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:12:03.367813 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c9d3b0-73d9-4b82-b313-5ac71b03e167 None None] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:12:03.368088 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c9d3b0-73d9-4b82-b313-5ac71b03e167 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:12:03.386896 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.auth.core [None req-52c9d3b0-73d9-4b82-b313-5ac71b03e167 None None] MFA Rules not processed for user `9af40ddfe9ff4be3887b068f13a28dc0`. Rule list: `[]` (Enabled: `True`). {{(pid=80396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 16:12:03.388075 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.fernet_utils [None req-52c9d3b0-73d9-4b82-b313-5ac71b03e167 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:12:03.394547 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 1200/2408] 10.222.0.59 () {58 vars in 1018 bytes} [Thu Jun 2 16:12:03 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 16:12:03.406001 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9a85d71-f42f-4bb9-94a9-8d54830bc682 None None] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:12:03.416886 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9a85d71-f42f-4bb9-94a9-8d54830bc682 None None] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:12:03.420992 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-005d0bdf-375e-4851-b98c-3d04cb6edd21 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9af40ddfe9ff4be3887b068f13a28dc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c87c981909d4b8db02783421818c79b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:12:03.421619 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-005d0bdf-375e-4851-b98c-3d04cb6edd21 service neutron] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:12:03.421899 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-005d0bdf-375e-4851-b98c-3d04cb6edd21 service neutron] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:12:03.422213 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-005d0bdf-375e-4851-b98c-3d04cb6edd21 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:12:03.429137 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-005d0bdf-375e-4851-b98c-3d04cb6edd21 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:12:03.430597 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-005d0bdf-375e-4851-b98c-3d04cb6edd21 service neutron] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:12:03.438881 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 1209/2409] 10.222.0.59 () {60 vars in 1365 bytes} [Thu Jun 2 16:12:03 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 33 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 16:12:03.528089 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b138f66-43de-475a-98c9-b9e0c69963b6 None None] REQUEST_METHOD: `GET` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:12:03.528376 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b138f66-43de-475a-98c9-b9e0c69963b6 None None] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:12:03.528652 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b138f66-43de-475a-98c9-b9e0c69963b6 None None] PATH_INFO: `/` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:12:03.530103 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 1201/2410] 10.222.0.59 () {54 vars in 921 bytes} [Thu Jun 2 16:12:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 16:12:03.535478 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d6319b-d2cc-4df4-b243-fdb7993cba4e None None] REQUEST_METHOD: `POST` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:12:03.535791 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d6319b-d2cc-4df4-b243-fdb7993cba4e None None] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:12:03.536056 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d6319b-d2cc-4df4-b243-fdb7993cba4e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:12:03.554964 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.auth.core [None req-43d6319b-d2cc-4df4-b243-fdb7993cba4e None None] MFA Rules not processed for user `52f9fe4b13574516bb0a8e2aa11a61e8`. Rule list: `[]` (Enabled: `True`). {{(pid=80395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 16:12:03.556139 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.fernet_utils [None req-43d6319b-d2cc-4df4-b243-fdb7993cba4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:12:03.565749 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 1210/2411] 10.222.0.59 () {58 vars in 1018 bytes} [Thu Jun 2 16:12:03 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 16:12:03.576424 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b138f66-43de-475a-98c9-b9e0c69963b6 None None] Authenticating user token {{(pid=80396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:12:03.587532 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b138f66-43de-475a-98c9-b9e0c69963b6 None None] Validating token access rules against request {{(pid=80396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:12:03.591110 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfed9dba-cfe8-46b9-bdac-b66288367d92 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9af40ddfe9ff4be3887b068f13a28dc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c87c981909d4b8db02783421818c79b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:12:03.591758 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfed9dba-cfe8-46b9-bdac-b66288367d92 service neutron] REQUEST_METHOD: `GET` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:12:03.592040 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfed9dba-cfe8-46b9-bdac-b66288367d92 service neutron] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:12:03.592573 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfed9dba-cfe8-46b9-bdac-b66288367d92 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:12:03.602558 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfed9dba-cfe8-46b9-bdac-b66288367d92 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:12:03.603971 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfed9dba-cfe8-46b9-bdac-b66288367d92 service neutron] RBAC: Authorization granted {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:12:03.615009 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 1202/2412] 10.222.0.59 () {60 vars in 1365 bytes} [Thu Jun 2 16:12:03 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 16:12:03.678994 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43d6319b-d2cc-4df4-b243-fdb7993cba4e None None] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:12:03.680357 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.fernet_utils [None req-43d6319b-d2cc-4df4-b243-fdb7993cba4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:12:03.749264 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43d6319b-d2cc-4df4-b243-fdb7993cba4e None None] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:12:03.754326 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c3a45ec-4cc8-4ee7-942b-18edd1c62372 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b700f6d94374ba4b362a8f0d5b35796', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c87c981909d4b8db02783421818c79b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:12:03.754965 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3a45ec-4cc8-4ee7-942b-18edd1c62372 service placement] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:12:03.755273 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3a45ec-4cc8-4ee7-942b-18edd1c62372 service placement] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:12:03.755548 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3a45ec-4cc8-4ee7-942b-18edd1c62372 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:12:03.757314 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.fernet_utils [None req-4c3a45ec-4cc8-4ee7-942b-18edd1c62372 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:12:03.768831 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c3a45ec-4cc8-4ee7-942b-18edd1c62372 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:12:03.770447 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c3a45ec-4cc8-4ee7-942b-18edd1c62372 service placement] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:12:03.780723 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 1211/2413] 10.222.0.59 () {60 vars in 1365 bytes} [Thu Jun 2 16:12:03 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 16:12:07.825078 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6cf3b39-23f9-4aab-945d-0d8c08be1e14 None None] REQUEST_METHOD: `POST` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:12:07.825605 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6cf3b39-23f9-4aab-945d-0d8c08be1e14 None None] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:12:07.825605 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6cf3b39-23f9-4aab-945d-0d8c08be1e14 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:12:07.844792 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.auth.core [None req-f6cf3b39-23f9-4aab-945d-0d8c08be1e14 None None] MFA Rules not processed for user `11b714eb2dda4460a8ff52215e671bfa`. Rule list: `[]` (Enabled: `True`). {{(pid=80396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 16:12:07.845980 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.fernet_utils [None req-f6cf3b39-23f9-4aab-945d-0d8c08be1e14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:12:07.853231 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 1203/2414] 10.222.0.59 () {58 vars in 1009 bytes} [Thu Jun 2 16:12:07 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 16:12:07.865041 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c3a45ec-4cc8-4ee7-942b-18edd1c62372 service placement] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:12:07.876521 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c3a45ec-4cc8-4ee7-942b-18edd1c62372 service placement] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:12:07.881328 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3169c53-70d3-4f75-bb0f-8ecb4e90546f service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31bd858bf7674f43a99b77d11bc3c1a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c87c981909d4b8db02783421818c79b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:12:07.881947 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3169c53-70d3-4f75-bb0f-8ecb4e90546f service swift] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:12:07.882286 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3169c53-70d3-4f75-bb0f-8ecb4e90546f service swift] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:12:07.882562 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3169c53-70d3-4f75-bb0f-8ecb4e90546f service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:12:07.891145 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3169c53-70d3-4f75-bb0f-8ecb4e90546f service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:12:07.892713 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3169c53-70d3-4f75-bb0f-8ecb4e90546f service swift] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:12:07.900599 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 1212/2415] 10.222.0.59 () {60 vars in 1384 bytes} [Thu Jun 2 16:12:07 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 02 16:12:09.477826 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6cf3b39-23f9-4aab-945d-0d8c08be1e14 None None] Authenticating user token {{(pid=80396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:12:09.479346 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.fernet_utils [None req-f6cf3b39-23f9-4aab-945d-0d8c08be1e14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:12:09.496104 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6cf3b39-23f9-4aab-945d-0d8c08be1e14 None None] Validating token access rules against request {{(pid=80396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:12:09.501958 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a00030c-68a3-440e-a1c2-93d5ed65db0d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52f9fe4b13574516bb0a8e2aa11a61e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c87c981909d4b8db02783421818c79b', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:12:09.502647 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a00030c-68a3-440e-a1c2-93d5ed65db0d service nova] REQUEST_METHOD: `GET` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:12:09.502948 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a00030c-68a3-440e-a1c2-93d5ed65db0d service nova] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:12:09.503241 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a00030c-68a3-440e-a1c2-93d5ed65db0d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:12:09.505046 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.fernet_utils [None req-6a00030c-68a3-440e-a1c2-93d5ed65db0d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:12:09.565943 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a00030c-68a3-440e-a1c2-93d5ed65db0d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:12:09.567591 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a00030c-68a3-440e-a1c2-93d5ed65db0d service nova] RBAC: Authorization granted {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:12:09.572866 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG dbcounter [-] [80396] Writing DB stats keystone:SELECT=100 {{(pid=80396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 16:12:09.577814 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 1204/2416] 10.222.0.59 () {60 vars in 1365 bytes} [Thu Jun 2 16:12:09 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 16:12:17.897583 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writing DB stats keystone:SELECT=84 {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 16:12:19.615581 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG dbcounter [-] [80396] Writing DB stats keystone:SELECT=1 {{(pid=80396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 16:12:31.898457 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3169c53-70d3-4f75-bb0f-8ecb4e90546f service swift] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:12:31.899867 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.fernet_utils [None req-a3169c53-70d3-4f75-bb0f-8ecb4e90546f service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:12:31.915784 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3169c53-70d3-4f75-bb0f-8ecb4e90546f service swift] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:12:31.922053 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82d1dce6-1222-494b-a6a5-54715be48fef service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52f9fe4b13574516bb0a8e2aa11a61e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c87c981909d4b8db02783421818c79b', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:12:31.922717 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d1dce6-1222-494b-a6a5-54715be48fef service nova] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:12:31.923032 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d1dce6-1222-494b-a6a5-54715be48fef service nova] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:12:31.923309 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d1dce6-1222-494b-a6a5-54715be48fef service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:12:31.925004 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.fernet_utils [None req-82d1dce6-1222-494b-a6a5-54715be48fef service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:12:31.982529 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82d1dce6-1222-494b-a6a5-54715be48fef service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:12:31.984123 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82d1dce6-1222-494b-a6a5-54715be48fef service nova] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:12:31.993341 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 1213/2417] 10.222.0.59 () {60 vars in 1365 bytes} [Thu Jun 2 16:12:31 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 16:12:33.481853 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a00030c-68a3-440e-a1c2-93d5ed65db0d service nova] Authenticating user token {{(pid=80396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:12:33.493184 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a00030c-68a3-440e-a1c2-93d5ed65db0d service nova] Validating token access rules against request {{(pid=80396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:12:33.517271 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3bdf14b-eb12-498a-895c-ba063e47b2a7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52f9fe4b13574516bb0a8e2aa11a61e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c87c981909d4b8db02783421818c79b', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:12:33.520423 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3bdf14b-eb12-498a-895c-ba063e47b2a7 service nova] REQUEST_METHOD: `GET` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:12:33.520423 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3bdf14b-eb12-498a-895c-ba063e47b2a7 service nova] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:12:33.520423 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3bdf14b-eb12-498a-895c-ba063e47b2a7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:12:33.521044 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.fernet_utils [None req-b3bdf14b-eb12-498a-895c-ba063e47b2a7 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:12:33.537793 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3bdf14b-eb12-498a-895c-ba063e47b2a7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:12:33.539780 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3bdf14b-eb12-498a-895c-ba063e47b2a7 service nova] RBAC: Authorization granted {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:12:33.554681 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 1205/2418] 10.222.0.59 () {60 vars in 1365 bytes} [Thu Jun 2 16:12:33 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 73 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 16:12:37.129730 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfcb0f24-1092-4229-81d5-d6dd80fdaea4 None None] REQUEST_METHOD: `POST` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:12:37.130274 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfcb0f24-1092-4229-81d5-d6dd80fdaea4 None None] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:12:37.130513 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfcb0f24-1092-4229-81d5-d6dd80fdaea4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:12:37.149250 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.auth.core [None req-dfcb0f24-1092-4229-81d5-d6dd80fdaea4 None None] MFA Rules not processed for user `11b714eb2dda4460a8ff52215e671bfa`. Rule list: `[]` (Enabled: `True`). {{(pid=80395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 16:12:37.150390 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.fernet_utils [None req-dfcb0f24-1092-4229-81d5-d6dd80fdaea4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:12:37.158744 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 1214/2419] 10.222.0.59 () {58 vars in 967 bytes} [Thu Jun 2 16:12:37 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 16:12:37.172441 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3bdf14b-eb12-498a-895c-ba063e47b2a7 service nova] Authenticating user token {{(pid=80396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:12:37.185872 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3bdf14b-eb12-498a-895c-ba063e47b2a7 service nova] Validating token access rules against request {{(pid=80396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:12:37.191046 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77be87e9-58cf-446f-8602-263d2a8fc2ee service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31bd858bf7674f43a99b77d11bc3c1a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c87c981909d4b8db02783421818c79b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:12:37.191918 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77be87e9-58cf-446f-8602-263d2a8fc2ee service swift] REQUEST_METHOD: `GET` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:12:37.192210 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77be87e9-58cf-446f-8602-263d2a8fc2ee service swift] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:12:37.192494 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77be87e9-58cf-446f-8602-263d2a8fc2ee service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:12:37.202406 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77be87e9-58cf-446f-8602-263d2a8fc2ee service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:12:37.203987 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77be87e9-58cf-446f-8602-263d2a8fc2ee service swift] RBAC: Authorization granted {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:12:37.212450 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 1206/2420] 10.222.0.59 () {60 vars in 1384 bytes} [Thu Jun 2 16:12:37 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 02 16:12:47.143811 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writing DB stats keystone:SELECT=31 {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 16:12:47.209141 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG dbcounter [-] [80396] Writing DB stats keystone:SELECT=12 {{(pid=80396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 16:12:58.870617 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06927461-fd11-4bfa-8e30-017113139dd4 None None] REQUEST_METHOD: `POST` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:12:58.871154 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06927461-fd11-4bfa-8e30-017113139dd4 None None] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:12:58.871270 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06927461-fd11-4bfa-8e30-017113139dd4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:12:58.889072 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.auth.core [None req-06927461-fd11-4bfa-8e30-017113139dd4 None None] MFA Rules not processed for user `a8658730ea2a4a06b7b4070976c6397f`. Rule list: `[]` (Enabled: `True`). {{(pid=80395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 16:12:58.890272 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.fernet_utils [None req-06927461-fd11-4bfa-8e30-017113139dd4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:12:58.896953 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 1215/2421] 10.222.0.59 () {58 vars in 957 bytes} [Thu Jun 2 16:12:58 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 16:12:59.205305 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77be87e9-58cf-446f-8602-263d2a8fc2ee service swift] Authenticating user token {{(pid=80396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:12:59.217920 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77be87e9-58cf-446f-8602-263d2a8fc2ee service swift] Validating token access rules against request {{(pid=80396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:12:59.224529 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df6308bf-57c1-45c7-a441-20438cb31f93 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52f9fe4b13574516bb0a8e2aa11a61e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c87c981909d4b8db02783421818c79b', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:12:59.225103 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df6308bf-57c1-45c7-a441-20438cb31f93 service nova] REQUEST_METHOD: `GET` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:12:59.225382 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df6308bf-57c1-45c7-a441-20438cb31f93 service nova] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:12:59.225657 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df6308bf-57c1-45c7-a441-20438cb31f93 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:12:59.227404 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.fernet_utils [None req-df6308bf-57c1-45c7-a441-20438cb31f93 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:12:59.292768 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df6308bf-57c1-45c7-a441-20438cb31f93 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:12:59.292768 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df6308bf-57c1-45c7-a441-20438cb31f93 service nova] RBAC: Authorization granted {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:12:59.302862 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 1207/2422] 10.222.0.59 () {60 vars in 1365 bytes} [Thu Jun 2 16:12:59 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 16:13:00.293442 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06927461-fd11-4bfa-8e30-017113139dd4 None None] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:13:00.313707 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06927461-fd11-4bfa-8e30-017113139dd4 None None] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:13:00.325062 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58caedb8-6a12-4ce0-b93a-12f630f16f63 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52f9fe4b13574516bb0a8e2aa11a61e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c87c981909d4b8db02783421818c79b', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:13:00.327572 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58caedb8-6a12-4ce0-b93a-12f630f16f63 service nova] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:13:00.328355 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58caedb8-6a12-4ce0-b93a-12f630f16f63 service nova] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:13:00.329012 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58caedb8-6a12-4ce0-b93a-12f630f16f63 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:13:00.332190 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.fernet_utils [None req-58caedb8-6a12-4ce0-b93a-12f630f16f63 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:13:00.348983 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58caedb8-6a12-4ce0-b93a-12f630f16f63 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:13:00.351137 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58caedb8-6a12-4ce0-b93a-12f630f16f63 service nova] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:13:00.366628 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 1216/2423] 10.222.0.59 () {60 vars in 1365 bytes} [Thu Jun 2 16:13:00 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 74 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 16:13:09.297378 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG dbcounter [-] [80396] Writing DB stats keystone:SELECT=28 {{(pid=80396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 16:13:10.360867 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writing DB stats keystone:SELECT=9 {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 16:13:11.793787 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd32cf9-f725-4cc7-b277-5e16fcff35ef None None] REQUEST_METHOD: `POST` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:13:11.794275 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd32cf9-f725-4cc7-b277-5e16fcff35ef None None] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:13:11.794374 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd32cf9-f725-4cc7-b277-5e16fcff35ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:13:11.813883 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.auth.core [None req-9bd32cf9-f725-4cc7-b277-5e16fcff35ef None None] MFA Rules not processed for user `11b714eb2dda4460a8ff52215e671bfa`. Rule list: `[]` (Enabled: `True`). {{(pid=80396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 16:13:11.815116 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.fernet_utils [None req-9bd32cf9-f725-4cc7-b277-5e16fcff35ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:13:11.822243 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 1208/2424] 10.222.0.59 () {58 vars in 967 bytes} [Thu Jun 2 16:13:11 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 16:13:11.844957 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58caedb8-6a12-4ce0-b93a-12f630f16f63 service nova] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:13:11.856300 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58caedb8-6a12-4ce0-b93a-12f630f16f63 service nova] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:13:11.861504 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdc6d335-651e-4754-9007-7da83fd5ba74 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31bd858bf7674f43a99b77d11bc3c1a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c87c981909d4b8db02783421818c79b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:13:11.862179 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc6d335-651e-4754-9007-7da83fd5ba74 service swift] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:13:11.862479 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc6d335-651e-4754-9007-7da83fd5ba74 service swift] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:13:11.862884 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc6d335-651e-4754-9007-7da83fd5ba74 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:13:11.870963 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdc6d335-651e-4754-9007-7da83fd5ba74 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:13:11.872605 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdc6d335-651e-4754-9007-7da83fd5ba74 service swift] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:13:11.881558 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 1217/2425] 10.222.0.59 () {60 vars in 1384 bytes} [Thu Jun 2 16:13:11 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 02 16:13:13.062034 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bd32cf9-f725-4cc7-b277-5e16fcff35ef None None] Authenticating user token {{(pid=80396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:13:13.072650 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bd32cf9-f725-4cc7-b277-5e16fcff35ef None None] Validating token access rules against request {{(pid=80396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:13:13.077176 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab8b6b6c-854c-4337-af3b-13c75516eb5c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9af40ddfe9ff4be3887b068f13a28dc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c87c981909d4b8db02783421818c79b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:13:13.078509 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8b6b6c-854c-4337-af3b-13c75516eb5c service neutron] REQUEST_METHOD: `GET` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:13:13.078852 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8b6b6c-854c-4337-af3b-13c75516eb5c service neutron] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:13:13.079132 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8b6b6c-854c-4337-af3b-13c75516eb5c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:13:13.081169 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.fernet_utils [None req-ab8b6b6c-854c-4337-af3b-13c75516eb5c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:13:13.147516 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab8b6b6c-854c-4337-af3b-13c75516eb5c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:13:13.149050 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab8b6b6c-854c-4337-af3b-13c75516eb5c service neutron] RBAC: Authorization granted {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:13:13.159331 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 1209/2426] 10.222.0.59 () {60 vars in 1365 bytes} [Thu Jun 2 16:13:13 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 16:13:17.040390 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdc6d335-651e-4754-9007-7da83fd5ba74 service swift] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:13:17.052217 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdc6d335-651e-4754-9007-7da83fd5ba74 service swift] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:13:17.057294 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab7b1482-64fc-41ef-8471-e2acd4d3900b service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b700f6d94374ba4b362a8f0d5b35796', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c87c981909d4b8db02783421818c79b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:13:17.057929 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab7b1482-64fc-41ef-8471-e2acd4d3900b service placement] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:13:17.058249 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab7b1482-64fc-41ef-8471-e2acd4d3900b service placement] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:13:17.058530 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab7b1482-64fc-41ef-8471-e2acd4d3900b service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:13:17.060315 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.fernet_utils [None req-ab7b1482-64fc-41ef-8471-e2acd4d3900b service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:13:17.072837 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab7b1482-64fc-41ef-8471-e2acd4d3900b service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:13:17.074596 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab7b1482-64fc-41ef-8471-e2acd4d3900b service placement] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:13:17.085030 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 1218/2427] 10.222.0.59 () {60 vars in 1365 bytes} [Thu Jun 2 16:13:17 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 16:13:20.965452 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab8b6b6c-854c-4337-af3b-13c75516eb5c service neutron] Authenticating user token {{(pid=80396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:13:20.966880 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.fernet_utils [None req-ab8b6b6c-854c-4337-af3b-13c75516eb5c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:13:20.980932 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab8b6b6c-854c-4337-af3b-13c75516eb5c service neutron] Validating token access rules against request {{(pid=80396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:13:20.986378 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48ad4803-a10f-42b7-995e-e43cde77e58e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f73d5a98be74242b45222df39fb6213', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:13:20.987271 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ad4803-a10f-42b7-995e-e43cde77e58e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:13:20.987556 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ad4803-a10f-42b7-995e-e43cde77e58e admin admin] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:13:20.987834 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ad4803-a10f-42b7-995e-e43cde77e58e admin admin] PATH_INFO: `/v3/users/88d362d24ff54106b00d945599f2a61d` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:13:20.989029 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48ad4803-a10f-42b7-995e-e43cde77e58e admin admin] RBAC: Authorizing `identity:delete_user(user_id=88d362d24ff54106b00d945599f2a61d)` {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:13:20.991140 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48ad4803-a10f-42b7-995e-e43cde77e58e admin admin] RBAC: Authorization granted {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:13:21.183005 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.notifications [None req-48ad4803-a10f-42b7-995e-e43cde77e58e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '88d362d24ff54106b00d945599f2a61d'} {{(pid=80396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:13:21.183655 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.notifications [None req-48ad4803-a10f-42b7-995e-e43cde77e58e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '88d362d24ff54106b00d945599f2a61d'} {{(pid=80396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:13:21.275827 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.notifications [None req-48ad4803-a10f-42b7-995e-e43cde77e58e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '88d362d24ff54106b00d945599f2a61d'} {{(pid=80396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:13:21.289096 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.notifications [None req-48ad4803-a10f-42b7-995e-e43cde77e58e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '88d362d24ff54106b00d945599f2a61d'} {{(pid=80396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:13:21.296042 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.notifications [None req-48ad4803-a10f-42b7-995e-e43cde77e58e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '88d362d24ff54106b00d945599f2a61d'} {{(pid=80396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:13:21.302775 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 1210/2428] 10.222.0.59 () {58 vars in 1223 bytes} [Thu Jun 2 16:13:20 2022] DELETE /identity/v3/users/88d362d24ff54106b00d945599f2a61d => generated 0 bytes in 338 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 16:13:21.559346 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab7b1482-64fc-41ef-8471-e2acd4d3900b service placement] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:13:21.574000 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab7b1482-64fc-41ef-8471-e2acd4d3900b service placement] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:13:21.630968 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ad37ad9-1af8-4a55-9c11-3781227883a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f73d5a98be74242b45222df39fb6213', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:13:21.631820 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad37ad9-1af8-4a55-9c11-3781227883a4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:13:21.632106 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad37ad9-1af8-4a55-9c11-3781227883a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:13:21.632381 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad37ad9-1af8-4a55-9c11-3781227883a4 admin admin] PATH_INFO: `/v3/projects/b9ae3e4e2fa943d497623a549e23f906` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:13:21.633560 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ad37ad9-1af8-4a55-9c11-3781227883a4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b9ae3e4e2fa943d497623a549e23f906)` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:13:21.635499 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ad37ad9-1af8-4a55-9c11-3781227883a4 admin admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:13:21.803870 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.notifications [None req-9ad37ad9-1af8-4a55-9c11-3781227883a4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b9ae3e4e2fa943d497623a549e23f906', 'request_id': 'req-9ad37ad9-1af8-4a55-9c11-3781227883a4'} {{(pid=80395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:13:21.810187 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.notifications [None req-9ad37ad9-1af8-4a55-9c11-3781227883a4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b9ae3e4e2fa943d497623a549e23f906', 'request_id': 'req-9ad37ad9-1af8-4a55-9c11-3781227883a4'} {{(pid=80395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:13:21.906144 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.notifications [None req-9ad37ad9-1af8-4a55-9c11-3781227883a4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b9ae3e4e2fa943d497623a549e23f906', 'request_id': 'req-9ad37ad9-1af8-4a55-9c11-3781227883a4'} {{(pid=80395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:13:21.917415 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.notifications [None req-9ad37ad9-1af8-4a55-9c11-3781227883a4 admin admin] The token cache is being invalidate because project b9ae3e4e2fa943d497623a549e23f906 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80395) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 02 16:13:21.917708 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.notifications [None req-9ad37ad9-1af8-4a55-9c11-3781227883a4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:13:21.918366 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.notifications [None req-9ad37ad9-1af8-4a55-9c11-3781227883a4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:13:21.920249 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 1219/2429] 10.222.0.59 () {58 vars in 1232 bytes} [Thu Jun 2 16:13:21 2022] DELETE /identity/v3/projects/b9ae3e4e2fa943d497623a549e23f906 => generated 0 bytes in 361 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 16:13:21.925105 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48ad4803-a10f-42b7-995e-e43cde77e58e admin admin] Authenticating user token {{(pid=80396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:13:21.926545 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.fernet_utils [None req-48ad4803-a10f-42b7-995e-e43cde77e58e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:13:21.939701 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48ad4803-a10f-42b7-995e-e43cde77e58e admin admin] Validating token access rules against request {{(pid=80396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:13:21.998249 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d856a59e-ffb2-431e-8a5c-1296c153ab69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f73d5a98be74242b45222df39fb6213', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:13:21.999119 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d856a59e-ffb2-431e-8a5c-1296c153ab69 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:13:21.999403 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d856a59e-ffb2-431e-8a5c-1296c153ab69 admin admin] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:13:21.999681 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d856a59e-ffb2-431e-8a5c-1296c153ab69 admin admin] PATH_INFO: `/v3/users/76c62c880c2a43a1b68b0ed41af39835` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:13:22.001017 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d856a59e-ffb2-431e-8a5c-1296c153ab69 admin admin] RBAC: Authorizing `identity:delete_user(user_id=76c62c880c2a43a1b68b0ed41af39835)` {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:13:22.004194 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d856a59e-ffb2-431e-8a5c-1296c153ab69 admin admin] RBAC: Authorization granted {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:13:22.005746 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG dbcounter [-] [80396] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 16:13:22.242656 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.notifications [None req-d856a59e-ffb2-431e-8a5c-1296c153ab69 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '76c62c880c2a43a1b68b0ed41af39835'} {{(pid=80396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:13:22.243470 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.notifications [None req-d856a59e-ffb2-431e-8a5c-1296c153ab69 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '76c62c880c2a43a1b68b0ed41af39835'} {{(pid=80396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:13:22.312255 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.notifications [None req-d856a59e-ffb2-431e-8a5c-1296c153ab69 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '76c62c880c2a43a1b68b0ed41af39835'} {{(pid=80396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:13:22.324364 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.notifications [None req-d856a59e-ffb2-431e-8a5c-1296c153ab69 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '76c62c880c2a43a1b68b0ed41af39835'} {{(pid=80396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:13:22.331026 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.notifications [None req-d856a59e-ffb2-431e-8a5c-1296c153ab69 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '76c62c880c2a43a1b68b0ed41af39835'} {{(pid=80396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:13:22.336874 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 1211/2430] 10.222.0.59 () {58 vars in 1223 bytes} [Thu Jun 2 16:13:21 2022] DELETE /identity/v3/users/76c62c880c2a43a1b68b0ed41af39835 => generated 0 bytes in 413 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 02 16:13:22.598066 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ad37ad9-1af8-4a55-9c11-3781227883a4 admin admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:13:22.599776 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.fernet_utils [None req-9ad37ad9-1af8-4a55-9c11-3781227883a4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:13:22.616080 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ad37ad9-1af8-4a55-9c11-3781227883a4 admin admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:13:22.675561 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39c7501a-1a5b-4a47-8e03-c85cbd60e388 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f73d5a98be74242b45222df39fb6213', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:13:22.676417 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c7501a-1a5b-4a47-8e03-c85cbd60e388 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:13:22.676696 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c7501a-1a5b-4a47-8e03-c85cbd60e388 admin admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:13:22.676968 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c7501a-1a5b-4a47-8e03-c85cbd60e388 admin admin] PATH_INFO: `/v3/projects/0206b1e1d2f34c44bba5570f30d4c677` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:13:22.678168 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39c7501a-1a5b-4a47-8e03-c85cbd60e388 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0206b1e1d2f34c44bba5570f30d4c677)` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:13:22.680080 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39c7501a-1a5b-4a47-8e03-c85cbd60e388 admin admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:13:22.686535 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 16:13:22.887758 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.notifications [None req-39c7501a-1a5b-4a47-8e03-c85cbd60e388 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0206b1e1d2f34c44bba5570f30d4c677', 'request_id': 'req-39c7501a-1a5b-4a47-8e03-c85cbd60e388'} {{(pid=80395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:13:22.894656 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.notifications [None req-39c7501a-1a5b-4a47-8e03-c85cbd60e388 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0206b1e1d2f34c44bba5570f30d4c677', 'request_id': 'req-39c7501a-1a5b-4a47-8e03-c85cbd60e388'} {{(pid=80395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:13:23.041360 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.notifications [None req-39c7501a-1a5b-4a47-8e03-c85cbd60e388 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0206b1e1d2f34c44bba5570f30d4c677', 'request_id': 'req-39c7501a-1a5b-4a47-8e03-c85cbd60e388'} {{(pid=80395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:13:23.052942 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.notifications [None req-39c7501a-1a5b-4a47-8e03-c85cbd60e388 admin admin] The token cache is being invalidate because project 0206b1e1d2f34c44bba5570f30d4c677 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80395) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 02 16:13:23.056823 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.notifications [None req-39c7501a-1a5b-4a47-8e03-c85cbd60e388 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:13:23.056823 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.notifications [None req-39c7501a-1a5b-4a47-8e03-c85cbd60e388 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:13:23.056823 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 1220/2431] 10.222.0.59 () {58 vars in 1232 bytes} [Thu Jun 2 16:13:22 2022] DELETE /identity/v3/projects/0206b1e1d2f34c44bba5570f30d4c677 => generated 0 bytes in 458 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 02 16:13:23.060400 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a983be0-2561-4dd3-bc9f-5928877b333f None None] REQUEST_METHOD: `POST` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:13:23.060852 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a983be0-2561-4dd3-bc9f-5928877b333f None None] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:13:23.060960 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a983be0-2561-4dd3-bc9f-5928877b333f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:13:23.079919 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.auth.core [None req-0a983be0-2561-4dd3-bc9f-5928877b333f None None] MFA Rules not processed for user `400d1f4db9de49638549e5db29a041e1`. Rule list: `[]` (Enabled: `True`). {{(pid=80396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 16:13:23.081751 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.fernet_utils [None req-0a983be0-2561-4dd3-bc9f-5928877b333f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:13:23.139553 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 1212/2432] 10.222.0.59 () {58 vars in 957 bytes} [Thu Jun 2 16:13:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 02 16:13:23.148786 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1209d545-beb9-45f8-926f-b884997c4b3d None None] REQUEST_METHOD: `POST` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:13:23.149078 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1209d545-beb9-45f8-926f-b884997c4b3d None None] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:13:23.149361 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1209d545-beb9-45f8-926f-b884997c4b3d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:13:23.170923 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.auth.core [None req-1209d545-beb9-45f8-926f-b884997c4b3d None None] MFA Rules not processed for user `400d1f4db9de49638549e5db29a041e1`. Rule list: `[]` (Enabled: `True`). {{(pid=80395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 16:13:23.170923 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.fernet_utils [None req-1209d545-beb9-45f8-926f-b884997c4b3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:13:23.177981 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 1221/2433] 10.222.0.59 () {58 vars in 957 bytes} [Thu Jun 2 16:13:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 16:13:23.182341 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a983be0-2561-4dd3-bc9f-5928877b333f None None] Authenticating user token {{(pid=80396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:13:23.192887 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a983be0-2561-4dd3-bc9f-5928877b333f None None] Validating token access rules against request {{(pid=80396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:13:23.197443 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-875ed73e-3aa2-4994-8d8e-fb053b4adcf1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f73d5a98be74242b45222df39fb6213', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:13:23.198149 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875ed73e-3aa2-4994-8d8e-fb053b4adcf1 admin admin] REQUEST_METHOD: `GET` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:13:23.198427 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875ed73e-3aa2-4994-8d8e-fb053b4adcf1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:13:23.198700 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875ed73e-3aa2-4994-8d8e-fb053b4adcf1 admin admin] PATH_INFO: `/v3/domains` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:13:23.199412 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-875ed73e-3aa2-4994-8d8e-fb053b4adcf1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80396) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 16:13:23.199717 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-875ed73e-3aa2-4994-8d8e-fb053b4adcf1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:13:23.201291 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-875ed73e-3aa2-4994-8d8e-fb053b4adcf1 admin admin] RBAC: Authorization granted {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:13:23.213644 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 1213/2434] 10.222.0.59 () {58 vars in 1152 bytes} [Thu Jun 2 16:13:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 16:13:23.223341 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1209d545-beb9-45f8-926f-b884997c4b3d None None] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:13:23.227290 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1209d545-beb9-45f8-926f-b884997c4b3d None None] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:13:23.231892 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2091697-483d-41c6-9cd0-fb9ae8771b2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f73d5a98be74242b45222df39fb6213', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:13:23.232527 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2091697-483d-41c6-9cd0-fb9ae8771b2f admin admin] REQUEST_METHOD: `POST` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:13:23.232806 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2091697-483d-41c6-9cd0-fb9ae8771b2f admin admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:13:23.233085 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2091697-483d-41c6-9cd0-fb9ae8771b2f admin admin] PATH_INFO: `/v3/projects` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:13:23.233777 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2091697-483d-41c6-9cd0-fb9ae8771b2f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:13:23.235713 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2091697-483d-41c6-9cd0-fb9ae8771b2f admin admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:13:23.330052 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 1222/2435] 10.222.0.59 () {60 vars in 1152 bytes} [Thu Jun 2 16:13:23 2022] POST /identity/v3/projects => generated 377 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 16:13:23.334727 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-875ed73e-3aa2-4994-8d8e-fb053b4adcf1 admin admin] Authenticating user token {{(pid=80396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:13:23.344688 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-875ed73e-3aa2-4994-8d8e-fb053b4adcf1 admin admin] Validating token access rules against request {{(pid=80396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:13:23.399423 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a2bd26e-50ac-45ec-937f-c4c981ac9d3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f73d5a98be74242b45222df39fb6213', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:13:23.400074 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2bd26e-50ac-45ec-937f-c4c981ac9d3e admin admin] REQUEST_METHOD: `POST` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:13:23.400351 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2bd26e-50ac-45ec-937f-c4c981ac9d3e admin admin] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:13:23.400618 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2bd26e-50ac-45ec-937f-c4c981ac9d3e admin admin] PATH_INFO: `/v3/users` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:13:23.401330 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a2bd26e-50ac-45ec-937f-c4c981ac9d3e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:13:23.403236 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a2bd26e-50ac-45ec-937f-c4c981ac9d3e admin admin] RBAC: Authorization granted {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:13:23.412795 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG dbcounter [-] [80396] Writing DB stats keystone:SELECT=86,keystone:DELETE=10,keystone:INSERT=4 {{(pid=80396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 16:13:23.490152 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 1214/2436] 10.222.0.59 () {60 vars in 1143 bytes} [Thu Jun 2 16:13:23 2022] POST /identity/v3/users => generated 289 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 16:13:23.494386 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2091697-483d-41c6-9cd0-fb9ae8771b2f admin admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:13:23.505841 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2091697-483d-41c6-9cd0-fb9ae8771b2f admin admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:13:23.510451 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f03005a-2c60-424f-bda0-cf4494b24080 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f73d5a98be74242b45222df39fb6213', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:13:23.511123 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f03005a-2c60-424f-bda0-cf4494b24080 admin admin] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:13:23.511410 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f03005a-2c60-424f-bda0-cf4494b24080 admin admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:13:23.515455 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f03005a-2c60-424f-bda0-cf4494b24080 admin admin] PATH_INFO: `/v3/roles` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:13:23.515455 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f03005a-2c60-424f-bda0-cf4494b24080 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:13:23.515455 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f03005a-2c60-424f-bda0-cf4494b24080 admin admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:13:23.524423 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 1223/2437] 10.222.0.59 () {58 vars in 1121 bytes} [Thu Jun 2 16:13:23 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 16:13:23.528344 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a2bd26e-50ac-45ec-937f-c4c981ac9d3e admin admin] Authenticating user token {{(pid=80396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:13:23.538516 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a2bd26e-50ac-45ec-937f-c4c981ac9d3e admin admin] Validating token access rules against request {{(pid=80396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:13:23.543159 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc4b5a4f-1271-4dfe-b8a5-7c51d3c3a516 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f73d5a98be74242b45222df39fb6213', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:13:23.543813 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4b5a4f-1271-4dfe-b8a5-7c51d3c3a516 admin admin] REQUEST_METHOD: `GET` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:13:23.544203 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4b5a4f-1271-4dfe-b8a5-7c51d3c3a516 admin admin] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:13:23.544484 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4b5a4f-1271-4dfe-b8a5-7c51d3c3a516 admin admin] PATH_INFO: `/v3/roles` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:13:23.545212 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc4b5a4f-1271-4dfe-b8a5-7c51d3c3a516 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:13:23.546836 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc4b5a4f-1271-4dfe-b8a5-7c51d3c3a516 admin admin] RBAC: Authorization granted {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:13:23.557794 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 1215/2438] 10.222.0.59 () {58 vars in 1121 bytes} [Thu Jun 2 16:13:23 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 16:13:23.562010 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f03005a-2c60-424f-bda0-cf4494b24080 admin admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:13:23.572886 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f03005a-2c60-424f-bda0-cf4494b24080 admin admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:13:23.577661 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7056efab-12e7-417a-b99b-5193f8012057 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f73d5a98be74242b45222df39fb6213', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:13:23.578560 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7056efab-12e7-417a-b99b-5193f8012057 admin admin] REQUEST_METHOD: `PUT` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:13:23.578847 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7056efab-12e7-417a-b99b-5193f8012057 admin admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:13:23.579125 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7056efab-12e7-417a-b99b-5193f8012057 admin admin] PATH_INFO: `/v3/projects/460ea33e74e8480c8b70c8123e81e4c4/users/5d2ef2aa9b8c46cfb198bd18a5944a85/roles/649e0f2b5a264c419ea6a1441f123a03` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:13:23.594525 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7056efab-12e7-417a-b99b-5193f8012057 admin admin] RBAC: Authorizing `identity:create_grant(project_id=460ea33e74e8480c8b70c8123e81e4c4, user_id=5d2ef2aa9b8c46cfb198bd18a5944a85, role_id=649e0f2b5a264c419ea6a1441f123a03)` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:13:23.597331 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7056efab-12e7-417a-b99b-5193f8012057 admin admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:13:23.666342 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 1224/2439] 10.222.0.59 () {60 vars in 1482 bytes} [Thu Jun 2 16:13:23 2022] PUT /identity/v3/projects/460ea33e74e8480c8b70c8123e81e4c4/users/5d2ef2aa9b8c46cfb198bd18a5944a85/roles/649e0f2b5a264c419ea6a1441f123a03 => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 16:13:23.671315 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f9b6bb-4c1d-480c-a952-f411352a3644 None None] REQUEST_METHOD: `POST` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:13:23.671836 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f9b6bb-4c1d-480c-a952-f411352a3644 None None] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:13:23.672318 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f9b6bb-4c1d-480c-a952-f411352a3644 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:13:23.691748 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.auth.core [None req-a8f9b6bb-4c1d-480c-a952-f411352a3644 None None] MFA Rules not processed for user `400d1f4db9de49638549e5db29a041e1`. Rule list: `[]` (Enabled: `True`). {{(pid=80396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 16:13:23.692950 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.fernet_utils [None req-a8f9b6bb-4c1d-480c-a952-f411352a3644 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:13:23.750961 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 1216/2440] 10.222.0.59 () {58 vars in 957 bytes} [Thu Jun 2 16:13:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 16:13:23.761277 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7056efab-12e7-417a-b99b-5193f8012057 admin admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:13:23.763102 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.fernet_utils [None req-7056efab-12e7-417a-b99b-5193f8012057 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:13:23.818182 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7056efab-12e7-417a-b99b-5193f8012057 admin admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:13:23.821763 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98fc1bac-c50c-4c86-9077-d1efa787ee6b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9af40ddfe9ff4be3887b068f13a28dc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c87c981909d4b8db02783421818c79b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:13:23.822416 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98fc1bac-c50c-4c86-9077-d1efa787ee6b service neutron] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:13:23.822696 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98fc1bac-c50c-4c86-9077-d1efa787ee6b service neutron] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:13:23.822968 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98fc1bac-c50c-4c86-9077-d1efa787ee6b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:13:23.831707 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98fc1bac-c50c-4c86-9077-d1efa787ee6b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:13:23.833125 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98fc1bac-c50c-4c86-9077-d1efa787ee6b service neutron] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:13:23.842206 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 1225/2441] 10.222.0.59 () {60 vars in 1365 bytes} [Thu Jun 2 16:13:23 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 16:13:29.696465 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a558d6-05ed-416a-88b4-f9cf4ab20ea8 None None] REQUEST_METHOD: `POST` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:13:29.697049 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a558d6-05ed-416a-88b4-f9cf4ab20ea8 None None] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:13:29.698316 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a558d6-05ed-416a-88b4-f9cf4ab20ea8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:13:29.728348 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.auth.core [None req-96a558d6-05ed-416a-88b4-f9cf4ab20ea8 None None] MFA Rules not processed for user `5d2ef2aa9b8c46cfb198bd18a5944a85`. Rule list: `[]` (Enabled: `True`). {{(pid=80396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 16:13:29.729853 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.fernet_utils [None req-96a558d6-05ed-416a-88b4-f9cf4ab20ea8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:13:29.802022 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 1217/2442] 10.222.0.59 () {58 vars in 957 bytes} [Thu Jun 2 16:13:29 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 16:13:29.806687 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98fc1bac-c50c-4c86-9077-d1efa787ee6b service neutron] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:13:29.816947 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98fc1bac-c50c-4c86-9077-d1efa787ee6b service neutron] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:13:29.822806 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8d0a850-4277-42f2-a1ff-50a420a7f728 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f73d5a98be74242b45222df39fb6213', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:13:29.823461 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d0a850-4277-42f2-a1ff-50a420a7f728 admin admin] REQUEST_METHOD: `POST` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:13:29.823743 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d0a850-4277-42f2-a1ff-50a420a7f728 admin admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:13:29.824020 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d0a850-4277-42f2-a1ff-50a420a7f728 admin admin] PATH_INFO: `/v3/projects` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:13:29.824727 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8d0a850-4277-42f2-a1ff-50a420a7f728 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:13:29.826684 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8d0a850-4277-42f2-a1ff-50a420a7f728 admin admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:13:29.947378 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 1226/2443] 10.222.0.59 () {60 vars in 1152 bytes} [Thu Jun 2 16:13:29 2022] POST /identity/v3/projects => generated 379 bytes in 141 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 16:13:29.951607 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96a558d6-05ed-416a-88b4-f9cf4ab20ea8 None None] Authenticating user token {{(pid=80396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:13:29.963795 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96a558d6-05ed-416a-88b4-f9cf4ab20ea8 None None] Validating token access rules against request {{(pid=80396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:13:30.044985 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a27cbd6b-b30e-4b4e-8398-b06a0ebe7d7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f73d5a98be74242b45222df39fb6213', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:13:30.045800 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27cbd6b-b30e-4b4e-8398-b06a0ebe7d7a admin admin] REQUEST_METHOD: `POST` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:13:30.046195 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27cbd6b-b30e-4b4e-8398-b06a0ebe7d7a admin admin] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:13:30.046534 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27cbd6b-b30e-4b4e-8398-b06a0ebe7d7a admin admin] PATH_INFO: `/v3/users` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:13:30.047299 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a27cbd6b-b30e-4b4e-8398-b06a0ebe7d7a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:13:30.049317 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a27cbd6b-b30e-4b4e-8398-b06a0ebe7d7a admin admin] RBAC: Authorization granted {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:13:30.167186 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 1218/2444] 10.222.0.59 () {60 vars in 1143 bytes} [Thu Jun 2 16:13:29 2022] POST /identity/v3/users => generated 296 bytes in 214 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 16:13:30.172762 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8d0a850-4277-42f2-a1ff-50a420a7f728 admin admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:13:30.181329 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 16:13:30.192789 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8d0a850-4277-42f2-a1ff-50a420a7f728 admin admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:13:30.203424 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50d6e947-b375-4867-a474-5538ff508862 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f73d5a98be74242b45222df39fb6213', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:13:30.204495 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d6e947-b375-4867-a474-5538ff508862 admin admin] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:13:30.204875 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d6e947-b375-4867-a474-5538ff508862 admin admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:13:30.205246 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d6e947-b375-4867-a474-5538ff508862 admin admin] PATH_INFO: `/v3/roles` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:13:30.206616 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50d6e947-b375-4867-a474-5538ff508862 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:13:30.208322 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50d6e947-b375-4867-a474-5538ff508862 admin admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:13:30.222118 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 1227/2445] 10.222.0.59 () {58 vars in 1121 bytes} [Thu Jun 2 16:13:30 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 16:13:30.225984 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a27cbd6b-b30e-4b4e-8398-b06a0ebe7d7a admin admin] Authenticating user token {{(pid=80396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:13:30.234016 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG dbcounter [-] [80396] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 16:13:30.238679 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a27cbd6b-b30e-4b4e-8398-b06a0ebe7d7a admin admin] Validating token access rules against request {{(pid=80396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:13:30.244979 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f302100-f518-4977-bcbc-82521feb2393 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f73d5a98be74242b45222df39fb6213', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:13:30.246141 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f302100-f518-4977-bcbc-82521feb2393 admin admin] REQUEST_METHOD: `PUT` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:13:30.246295 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f302100-f518-4977-bcbc-82521feb2393 admin admin] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:13:30.246634 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f302100-f518-4977-bcbc-82521feb2393 admin admin] PATH_INFO: `/v3/projects/463ac172b94146af9f4b04e18d871924/users/17435809270e4ec899c65bc4bec9c028/roles/f1e0c25f6e9049e897cb7350c7e54ab3` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:13:30.265038 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f302100-f518-4977-bcbc-82521feb2393 admin admin] RBAC: Authorizing `identity:create_grant(project_id=463ac172b94146af9f4b04e18d871924, user_id=17435809270e4ec899c65bc4bec9c028, role_id=f1e0c25f6e9049e897cb7350c7e54ab3)` {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:13:30.267787 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f302100-f518-4977-bcbc-82521feb2393 admin admin] RBAC: Authorization granted {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:13:30.376618 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 1219/2446] 10.222.0.59 () {60 vars in 1482 bytes} [Thu Jun 2 16:13:30 2022] PUT /identity/v3/projects/463ac172b94146af9f4b04e18d871924/users/17435809270e4ec899c65bc4bec9c028/roles/f1e0c25f6e9049e897cb7350c7e54ab3 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 16:13:30.379340 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50d6e947-b375-4867-a474-5538ff508862 admin admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:13:30.392489 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50d6e947-b375-4867-a474-5538ff508862 admin admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:13:30.456727 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b98985f4-f7bc-4125-b9a6-1619ec11dc51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f73d5a98be74242b45222df39fb6213', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:13:30.457450 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b98985f4-f7bc-4125-b9a6-1619ec11dc51 admin admin] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:13:30.457735 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b98985f4-f7bc-4125-b9a6-1619ec11dc51 admin admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:13:30.458009 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b98985f4-f7bc-4125-b9a6-1619ec11dc51 admin admin] PATH_INFO: `/v3/roles` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:13:30.458923 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b98985f4-f7bc-4125-b9a6-1619ec11dc51 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:13:30.460523 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b98985f4-f7bc-4125-b9a6-1619ec11dc51 admin admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:13:30.473691 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 1228/2447] 10.222.0.59 () {58 vars in 1121 bytes} [Thu Jun 2 16:13:30 2022] GET /identity/v3/roles => generated 1420 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 02 16:13:30.475894 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f302100-f518-4977-bcbc-82521feb2393 admin admin] Authenticating user token {{(pid=80396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:13:30.487066 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f302100-f518-4977-bcbc-82521feb2393 admin admin] Validating token access rules against request {{(pid=80396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:13:30.492772 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-696cdc8d-3740-464d-a349-9790bc9b7b73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f73d5a98be74242b45222df39fb6213', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:13:30.493799 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-696cdc8d-3740-464d-a349-9790bc9b7b73 admin admin] REQUEST_METHOD: `PUT` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:13:30.494039 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-696cdc8d-3740-464d-a349-9790bc9b7b73 admin admin] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:13:30.494784 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-696cdc8d-3740-464d-a349-9790bc9b7b73 admin admin] PATH_INFO: `/v3/projects/463ac172b94146af9f4b04e18d871924/users/17435809270e4ec899c65bc4bec9c028/roles/f1e0c25f6e9049e897cb7350c7e54ab3` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:13:30.496452 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-696cdc8d-3740-464d-a349-9790bc9b7b73 admin admin] RBAC: Authorizing `identity:create_grant(project_id=463ac172b94146af9f4b04e18d871924, user_id=17435809270e4ec899c65bc4bec9c028, role_id=f1e0c25f6e9049e897cb7350c7e54ab3)` {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:13:30.499253 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-696cdc8d-3740-464d-a349-9790bc9b7b73 admin admin] RBAC: Authorization granted {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:13:30.511475 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 1220/2448] 10.222.0.59 () {60 vars in 1482 bytes} [Thu Jun 2 16:13:30 2022] PUT /identity/v3/projects/463ac172b94146af9f4b04e18d871924/users/17435809270e4ec899c65bc4bec9c028/roles/f1e0c25f6e9049e897cb7350c7e54ab3 => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 16:13:36.106759 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7c0621-2dc8-444f-b79c-a6b7ef128b87 None None] REQUEST_METHOD: `POST` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:13:36.107568 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7c0621-2dc8-444f-b79c-a6b7ef128b87 None None] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:13:36.107852 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7c0621-2dc8-444f-b79c-a6b7ef128b87 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:13:36.150494 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.auth.core [None req-2b7c0621-2dc8-444f-b79c-a6b7ef128b87 None None] MFA Rules not processed for user `17435809270e4ec899c65bc4bec9c028`. Rule list: `[]` (Enabled: `True`). {{(pid=80395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 16:13:36.152039 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.fernet_utils [None req-2b7c0621-2dc8-444f-b79c-a6b7ef128b87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:13:36.251666 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 1229/2449] 10.222.0.59 () {58 vars in 957 bytes} [Thu Jun 2 16:13:36 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 16:13:36.268610 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-696cdc8d-3740-464d-a349-9790bc9b7b73 admin admin] Authenticating user token {{(pid=80396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:13:36.270596 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.fernet_utils [None req-696cdc8d-3740-464d-a349-9790bc9b7b73 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:13:36.360015 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-696cdc8d-3740-464d-a349-9790bc9b7b73 admin admin] Validating token access rules against request {{(pid=80396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:13:36.366574 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c439087e-fd6e-44cb-bd86-e3da80285107 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52f9fe4b13574516bb0a8e2aa11a61e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c87c981909d4b8db02783421818c79b', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:13:36.367236 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c439087e-fd6e-44cb-bd86-e3da80285107 service nova] REQUEST_METHOD: `GET` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:13:36.367514 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c439087e-fd6e-44cb-bd86-e3da80285107 service nova] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:13:36.367785 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c439087e-fd6e-44cb-bd86-e3da80285107 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:13:36.436868 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c439087e-fd6e-44cb-bd86-e3da80285107 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:13:36.438495 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c439087e-fd6e-44cb-bd86-e3da80285107 service nova] RBAC: Authorization granted {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:13:36.448577 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 1221/2450] 10.222.0.59 () {60 vars in 1365 bytes} [Thu Jun 2 16:13:36 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 181 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 16:13:38.613710 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b7c0621-2dc8-444f-b79c-a6b7ef128b87 None None] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:13:38.615300 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.fernet_utils [None req-2b7c0621-2dc8-444f-b79c-a6b7ef128b87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:13:38.632751 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b7c0621-2dc8-444f-b79c-a6b7ef128b87 None None] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:13:38.638192 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab0c15d8-5365-4c52-9b35-d54791814e1b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52f9fe4b13574516bb0a8e2aa11a61e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c87c981909d4b8db02783421818c79b', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:13:38.639034 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0c15d8-5365-4c52-9b35-d54791814e1b service nova] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:13:38.639133 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0c15d8-5365-4c52-9b35-d54791814e1b service nova] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:13:38.639394 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0c15d8-5365-4c52-9b35-d54791814e1b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:13:38.641115 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.fernet_utils [None req-ab0c15d8-5365-4c52-9b35-d54791814e1b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:13:38.712038 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab0c15d8-5365-4c52-9b35-d54791814e1b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:13:38.714067 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab0c15d8-5365-4c52-9b35-d54791814e1b service nova] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:13:38.728172 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 1230/2451] 10.222.0.59 () {60 vars in 1365 bytes} [Thu Jun 2 16:13:38 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 16:13:46.444465 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG dbcounter [-] [80396] Writing DB stats keystone:SELECT=69,keystone:INSERT=2 {{(pid=80396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 16:13:48.720886 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writing DB stats keystone:SELECT=95 {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 16:13:49.760206 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ebd99e-4812-4d6e-b304-ff0786d49586 None None] REQUEST_METHOD: `POST` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:13:49.760714 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ebd99e-4812-4d6e-b304-ff0786d49586 None None] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:13:49.760813 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ebd99e-4812-4d6e-b304-ff0786d49586 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:13:49.778493 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.auth.core [None req-f7ebd99e-4812-4d6e-b304-ff0786d49586 None None] MFA Rules not processed for user `95108cdd8e134be3823d5024f7037b3e`. Rule list: `[]` (Enabled: `True`). {{(pid=80396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 16:13:49.779776 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.fernet_utils [None req-f7ebd99e-4812-4d6e-b304-ff0786d49586 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:13:49.786859 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 1222/2452] 10.222.0.59 () {58 vars in 957 bytes} [Thu Jun 2 16:13:49 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 16:13:59.773225 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG dbcounter [-] [80396] Writing DB stats keystone:SELECT=3 {{(pid=80396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 16:14:04.652336 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2875a946-6180-42cd-ba05-27ebd38e403b None None] REQUEST_METHOD: `POST` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:14:04.653331 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2875a946-6180-42cd-ba05-27ebd38e403b None None] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:14:04.653950 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2875a946-6180-42cd-ba05-27ebd38e403b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:14:04.672865 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.auth.core [None req-2875a946-6180-42cd-ba05-27ebd38e403b None None] MFA Rules not processed for user `5d2ef2aa9b8c46cfb198bd18a5944a85`. Rule list: `[]` (Enabled: `True`). {{(pid=80395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 16:14:04.674487 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.fernet_utils [None req-2875a946-6180-42cd-ba05-27ebd38e403b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:14:04.705305 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 1231/2453] 10.222.0.59 () {58 vars in 957 bytes} [Thu Jun 2 16:14:04 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 54 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 16:14:05.021223 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7ebd99e-4812-4d6e-b304-ff0786d49586 None None] Authenticating user token {{(pid=80396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:14:05.075483 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7ebd99e-4812-4d6e-b304-ff0786d49586 None None] Validating token access rules against request {{(pid=80396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:14:05.079061 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f771de-b17b-4e6c-9e19-f233054022de service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9af40ddfe9ff4be3887b068f13a28dc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c87c981909d4b8db02783421818c79b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:14:05.079704 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f771de-b17b-4e6c-9e19-f233054022de service neutron] REQUEST_METHOD: `GET` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:14:05.079989 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f771de-b17b-4e6c-9e19-f233054022de service neutron] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:14:05.080266 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f771de-b17b-4e6c-9e19-f233054022de service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:14:05.082469 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.fernet_utils [None req-98f771de-b17b-4e6c-9e19-f233054022de service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:14:05.092156 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98f771de-b17b-4e6c-9e19-f233054022de service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:14:05.093625 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98f771de-b17b-4e6c-9e19-f233054022de service neutron] RBAC: Authorization granted {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:14:05.102794 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 1223/2454] 10.222.0.59 () {60 vars in 1365 bytes} [Thu Jun 2 16:14:05 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 16:14:11.453158 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2d6a87-4789-4e46-9ecd-3e9584d8bd09 None None] REQUEST_METHOD: `POST` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:14:11.453682 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2d6a87-4789-4e46-9ecd-3e9584d8bd09 None None] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:14:11.453779 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2d6a87-4789-4e46-9ecd-3e9584d8bd09 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:14:11.471874 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.auth.core [None req-5a2d6a87-4789-4e46-9ecd-3e9584d8bd09 None None] MFA Rules not processed for user `88bb3d2dbcdb45bb8baba424e5239e21`. Rule list: `[]` (Enabled: `True`). {{(pid=80395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 16:14:11.473820 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.fernet_utils [None req-5a2d6a87-4789-4e46-9ecd-3e9584d8bd09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:14:11.526360 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 1232/2455] 10.222.0.59 () {58 vars in 957 bytes} [Thu Jun 2 16:14:11 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 74 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 16:14:15.099325 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG dbcounter [-] [80396] Writing DB stats keystone:SELECT=26 {{(pid=80396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 16:14:20.995114 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f771de-b17b-4e6c-9e19-f233054022de service neutron] Authenticating user token {{(pid=80396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:14:21.025269 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f771de-b17b-4e6c-9e19-f233054022de service neutron] Validating token access rules against request {{(pid=80396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:14:21.032553 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9acb98c5-80d3-46f3-8a2f-95fe2f9142d5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52f9fe4b13574516bb0a8e2aa11a61e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c87c981909d4b8db02783421818c79b', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:14:21.034477 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9acb98c5-80d3-46f3-8a2f-95fe2f9142d5 service nova] REQUEST_METHOD: `GET` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:14:21.035220 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9acb98c5-80d3-46f3-8a2f-95fe2f9142d5 service nova] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:14:21.035975 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9acb98c5-80d3-46f3-8a2f-95fe2f9142d5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:14:21.039177 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.fernet_utils [None req-9acb98c5-80d3-46f3-8a2f-95fe2f9142d5 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:14:21.058792 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9acb98c5-80d3-46f3-8a2f-95fe2f9142d5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:14:21.061063 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9acb98c5-80d3-46f3-8a2f-95fe2f9142d5 service nova] RBAC: Authorization granted {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:14:21.075022 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 1224/2456] 10.222.0.59 () {60 vars in 1365 bytes} [Thu Jun 2 16:14:20 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 80 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 16:14:21.529630 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writing DB stats keystone:SELECT=28 {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 16:14:22.975629 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a2d6a87-4789-4e46-9ecd-3e9584d8bd09 None None] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:14:22.977055 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.fernet_utils [None req-5a2d6a87-4789-4e46-9ecd-3e9584d8bd09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:14:22.989818 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a2d6a87-4789-4e46-9ecd-3e9584d8bd09 None None] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:14:22.993457 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a092b2c0-d21a-4219-8b93-3de3044db798 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9af40ddfe9ff4be3887b068f13a28dc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c87c981909d4b8db02783421818c79b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:14:22.994132 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a092b2c0-d21a-4219-8b93-3de3044db798 service neutron] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:14:22.994410 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a092b2c0-d21a-4219-8b93-3de3044db798 service neutron] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:14:22.994689 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a092b2c0-d21a-4219-8b93-3de3044db798 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:14:23.004250 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a092b2c0-d21a-4219-8b93-3de3044db798 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:14:23.005785 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a092b2c0-d21a-4219-8b93-3de3044db798 service neutron] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:14:23.015688 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 1233/2457] 10.222.0.59 () {60 vars in 1365 bytes} [Thu Jun 2 16:14:22 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 16:14:31.068883 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG dbcounter [-] [80396] Writing DB stats keystone:SELECT=6 {{(pid=80396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 16:14:33.018803 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writing DB stats keystone:SELECT=6 {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 16:14:36.088499 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9acb98c5-80d3-46f3-8a2f-95fe2f9142d5 service nova] Authenticating user token {{(pid=80396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:14:36.090666 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.fernet_utils [None req-9acb98c5-80d3-46f3-8a2f-95fe2f9142d5 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:14:36.241684 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9acb98c5-80d3-46f3-8a2f-95fe2f9142d5 service nova] Validating token access rules against request {{(pid=80396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:14:36.247304 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cd507fb-2d6a-49a9-b2f1-fd88699268fe service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b700f6d94374ba4b362a8f0d5b35796', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c87c981909d4b8db02783421818c79b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:14:36.247975 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd507fb-2d6a-49a9-b2f1-fd88699268fe service placement] REQUEST_METHOD: `GET` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:14:36.248257 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd507fb-2d6a-49a9-b2f1-fd88699268fe service placement] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:14:36.248532 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd507fb-2d6a-49a9-b2f1-fd88699268fe service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:14:36.250365 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.fernet_utils [None req-7cd507fb-2d6a-49a9-b2f1-fd88699268fe service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:14:36.268732 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cd507fb-2d6a-49a9-b2f1-fd88699268fe service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:14:36.268732 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cd507fb-2d6a-49a9-b2f1-fd88699268fe service placement] RBAC: Authorization granted {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:14:36.284788 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 1225/2458] 10.222.0.59 () {60 vars in 1365 bytes} [Thu Jun 2 16:14:36 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 197 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 16:14:38.315312 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a092b2c0-d21a-4219-8b93-3de3044db798 service neutron] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:14:38.324481 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a092b2c0-d21a-4219-8b93-3de3044db798 service neutron] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:14:38.328047 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b5d083-3abb-4b9a-ab83-cc1c001db1a5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9af40ddfe9ff4be3887b068f13a28dc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c87c981909d4b8db02783421818c79b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:14:38.328672 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b5d083-3abb-4b9a-ab83-cc1c001db1a5 service neutron] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:14:38.328953 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b5d083-3abb-4b9a-ab83-cc1c001db1a5 service neutron] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:14:38.329226 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b5d083-3abb-4b9a-ab83-cc1c001db1a5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:14:38.330986 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.fernet_utils [None req-73b5d083-3abb-4b9a-ab83-cc1c001db1a5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:14:38.403784 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73b5d083-3abb-4b9a-ab83-cc1c001db1a5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:14:38.405241 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73b5d083-3abb-4b9a-ab83-cc1c001db1a5 service neutron] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:14:38.421146 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 1234/2459] 10.222.0.59 () {60 vars in 1365 bytes} [Thu Jun 2 16:14:38 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 16:14:42.130330 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cd507fb-2d6a-49a9-b2f1-fd88699268fe service placement] Authenticating user token {{(pid=80396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:14:42.131791 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.fernet_utils [None req-7cd507fb-2d6a-49a9-b2f1-fd88699268fe service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:14:42.146381 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cd507fb-2d6a-49a9-b2f1-fd88699268fe service placement] Validating token access rules against request {{(pid=80396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:14:42.150917 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e69f9547-c05f-49f7-bbf8-1e88adc202a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f73d5a98be74242b45222df39fb6213', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:14:42.151781 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69f9547-c05f-49f7-bbf8-1e88adc202a5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:14:42.152069 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69f9547-c05f-49f7-bbf8-1e88adc202a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:14:42.152351 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69f9547-c05f-49f7-bbf8-1e88adc202a5 admin admin] PATH_INFO: `/v3/users/a8658730ea2a4a06b7b4070976c6397f` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:14:42.153528 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e69f9547-c05f-49f7-bbf8-1e88adc202a5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a8658730ea2a4a06b7b4070976c6397f)` {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:14:42.155465 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e69f9547-c05f-49f7-bbf8-1e88adc202a5 admin admin] RBAC: Authorization granted {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:14:42.334991 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.notifications [None req-e69f9547-c05f-49f7-bbf8-1e88adc202a5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a8658730ea2a4a06b7b4070976c6397f'} {{(pid=80396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:14:42.335793 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.notifications [None req-e69f9547-c05f-49f7-bbf8-1e88adc202a5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a8658730ea2a4a06b7b4070976c6397f'} {{(pid=80396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:14:42.400398 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.notifications [None req-e69f9547-c05f-49f7-bbf8-1e88adc202a5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a8658730ea2a4a06b7b4070976c6397f'} {{(pid=80396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:14:42.414281 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.notifications [None req-e69f9547-c05f-49f7-bbf8-1e88adc202a5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a8658730ea2a4a06b7b4070976c6397f'} {{(pid=80396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:14:42.421926 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.notifications [None req-e69f9547-c05f-49f7-bbf8-1e88adc202a5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a8658730ea2a4a06b7b4070976c6397f'} {{(pid=80396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:14:42.428242 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 1226/2460] 10.222.0.59 () {58 vars in 1223 bytes} [Thu Jun 2 16:14:42 2022] DELETE /identity/v3/users/a8658730ea2a4a06b7b4070976c6397f => generated 0 bytes in 299 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 16:14:42.687413 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b5d083-3abb-4b9a-ab83-cc1c001db1a5 service neutron] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:14:42.699175 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b5d083-3abb-4b9a-ab83-cc1c001db1a5 service neutron] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:14:42.758586 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e8de0d9-a268-4e8f-8c6a-ba7453a7f865 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f73d5a98be74242b45222df39fb6213', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:14:42.759449 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8de0d9-a268-4e8f-8c6a-ba7453a7f865 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:14:42.759738 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8de0d9-a268-4e8f-8c6a-ba7453a7f865 admin admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:14:42.760016 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8de0d9-a268-4e8f-8c6a-ba7453a7f865 admin admin] PATH_INFO: `/v3/projects/629a7b91ffc64154a55a45415f739949` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:14:42.761228 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e8de0d9-a268-4e8f-8c6a-ba7453a7f865 admin admin] RBAC: Authorizing `identity:delete_project(project_id=629a7b91ffc64154a55a45415f739949)` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:14:42.763373 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e8de0d9-a268-4e8f-8c6a-ba7453a7f865 admin admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:14:42.887389 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.notifications [None req-4e8de0d9-a268-4e8f-8c6a-ba7453a7f865 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '629a7b91ffc64154a55a45415f739949', 'request_id': 'req-4e8de0d9-a268-4e8f-8c6a-ba7453a7f865'} {{(pid=80395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:14:42.893444 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.notifications [None req-4e8de0d9-a268-4e8f-8c6a-ba7453a7f865 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '629a7b91ffc64154a55a45415f739949', 'request_id': 'req-4e8de0d9-a268-4e8f-8c6a-ba7453a7f865'} {{(pid=80395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:14:42.989409 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.notifications [None req-4e8de0d9-a268-4e8f-8c6a-ba7453a7f865 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '629a7b91ffc64154a55a45415f739949', 'request_id': 'req-4e8de0d9-a268-4e8f-8c6a-ba7453a7f865'} {{(pid=80395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:14:43.000203 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.notifications [None req-4e8de0d9-a268-4e8f-8c6a-ba7453a7f865 admin admin] The token cache is being invalidate because project 629a7b91ffc64154a55a45415f739949 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80395) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 02 16:14:43.000491 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.notifications [None req-4e8de0d9-a268-4e8f-8c6a-ba7453a7f865 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:14:43.001115 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.notifications [None req-4e8de0d9-a268-4e8f-8c6a-ba7453a7f865 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:14:43.002766 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 1235/2461] 10.222.0.59 () {58 vars in 1232 bytes} [Thu Jun 2 16:14:42 2022] DELETE /identity/v3/projects/629a7b91ffc64154a55a45415f739949 => generated 0 bytes in 316 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 16:14:43.008282 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287225a4-6144-4fd0-bb06-195ba3a4d55e None None] REQUEST_METHOD: `POST` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:14:43.008566 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287225a4-6144-4fd0-bb06-195ba3a4d55e None None] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:14:43.008841 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287225a4-6144-4fd0-bb06-195ba3a4d55e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:14:43.027426 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.auth.core [None req-287225a4-6144-4fd0-bb06-195ba3a4d55e None None] MFA Rules not processed for user `400d1f4db9de49638549e5db29a041e1`. Rule list: `[]` (Enabled: `True`). {{(pid=80396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 16:14:43.028660 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.fernet_utils [None req-287225a4-6144-4fd0-bb06-195ba3a4d55e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:14:43.091321 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 1227/2462] 10.222.0.59 () {58 vars in 957 bytes} [Thu Jun 2 16:14:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 16:14:43.099743 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f03657fd-0677-40b5-9ac0-adbb9ce95d37 None None] REQUEST_METHOD: `POST` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:14:43.100112 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f03657fd-0677-40b5-9ac0-adbb9ce95d37 None None] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:14:43.100399 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f03657fd-0677-40b5-9ac0-adbb9ce95d37 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:14:43.119120 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.auth.core [None req-f03657fd-0677-40b5-9ac0-adbb9ce95d37 None None] MFA Rules not processed for user `400d1f4db9de49638549e5db29a041e1`. Rule list: `[]` (Enabled: `True`). {{(pid=80395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 16:14:43.120326 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.fernet_utils [None req-f03657fd-0677-40b5-9ac0-adbb9ce95d37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:14:43.128148 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 1236/2463] 10.222.0.59 () {58 vars in 957 bytes} [Thu Jun 2 16:14:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 16:14:43.133232 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-287225a4-6144-4fd0-bb06-195ba3a4d55e None None] Authenticating user token {{(pid=80396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:14:43.138111 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG dbcounter [-] [80396] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 16:14:43.143383 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-287225a4-6144-4fd0-bb06-195ba3a4d55e None None] Validating token access rules against request {{(pid=80396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:14:43.148027 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e10c535c-1ad3-465c-8ff3-b00442afeebd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f73d5a98be74242b45222df39fb6213', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:14:43.150279 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10c535c-1ad3-465c-8ff3-b00442afeebd admin admin] REQUEST_METHOD: `GET` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:14:43.150279 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10c535c-1ad3-465c-8ff3-b00442afeebd admin admin] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:14:43.150279 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10c535c-1ad3-465c-8ff3-b00442afeebd admin admin] PATH_INFO: `/v3/domains` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:14:43.150279 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e10c535c-1ad3-465c-8ff3-b00442afeebd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80396) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 16:14:43.150279 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e10c535c-1ad3-465c-8ff3-b00442afeebd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:14:43.151865 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e10c535c-1ad3-465c-8ff3-b00442afeebd admin admin] RBAC: Authorization granted {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:14:43.163992 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 1228/2464] 10.222.0.59 () {58 vars in 1152 bytes} [Thu Jun 2 16:14:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 16:14:43.168377 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f03657fd-0677-40b5-9ac0-adbb9ce95d37 None None] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:14:43.179061 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f03657fd-0677-40b5-9ac0-adbb9ce95d37 None None] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:14:43.183746 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb949b48-d56d-4b84-95c0-3fd783e7e218 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f73d5a98be74242b45222df39fb6213', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:14:43.184392 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb949b48-d56d-4b84-95c0-3fd783e7e218 admin admin] REQUEST_METHOD: `POST` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:14:43.184673 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb949b48-d56d-4b84-95c0-3fd783e7e218 admin admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:14:43.185244 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb949b48-d56d-4b84-95c0-3fd783e7e218 admin admin] PATH_INFO: `/v3/projects` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:14:43.185636 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb949b48-d56d-4b84-95c0-3fd783e7e218 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:14:43.187599 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb949b48-d56d-4b84-95c0-3fd783e7e218 admin admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:14:43.201689 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 16:14:43.284070 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 1237/2465] 10.222.0.59 () {60 vars in 1152 bytes} [Thu Jun 2 16:14:43 2022] POST /identity/v3/projects => generated 383 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 16:14:43.289014 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e10c535c-1ad3-465c-8ff3-b00442afeebd admin admin] Authenticating user token {{(pid=80396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:14:43.298993 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e10c535c-1ad3-465c-8ff3-b00442afeebd admin admin] Validating token access rules against request {{(pid=80396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:14:43.357898 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53905862-670b-40ab-a14a-69c168383b78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f73d5a98be74242b45222df39fb6213', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:14:43.358598 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53905862-670b-40ab-a14a-69c168383b78 admin admin] REQUEST_METHOD: `POST` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:14:43.358912 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53905862-670b-40ab-a14a-69c168383b78 admin admin] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:14:43.359189 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53905862-670b-40ab-a14a-69c168383b78 admin admin] PATH_INFO: `/v3/users` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:14:43.359918 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53905862-670b-40ab-a14a-69c168383b78 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:14:43.361941 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53905862-670b-40ab-a14a-69c168383b78 admin admin] RBAC: Authorization granted {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:14:43.459857 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 1229/2466] 10.222.0.59 () {60 vars in 1143 bytes} [Thu Jun 2 16:14:43 2022] POST /identity/v3/users => generated 292 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 16:14:43.464004 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb949b48-d56d-4b84-95c0-3fd783e7e218 admin admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:14:43.475588 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb949b48-d56d-4b84-95c0-3fd783e7e218 admin admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:14:43.480173 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0129a0a5-5a2d-41ef-947c-65489e602407 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f73d5a98be74242b45222df39fb6213', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:14:43.480825 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0129a0a5-5a2d-41ef-947c-65489e602407 admin admin] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:14:43.481111 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0129a0a5-5a2d-41ef-947c-65489e602407 admin admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:14:43.481384 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0129a0a5-5a2d-41ef-947c-65489e602407 admin admin] PATH_INFO: `/v3/roles` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:14:43.482136 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0129a0a5-5a2d-41ef-947c-65489e602407 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:14:43.483731 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0129a0a5-5a2d-41ef-947c-65489e602407 admin admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:14:43.495060 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 1238/2467] 10.222.0.59 () {58 vars in 1121 bytes} [Thu Jun 2 16:14:43 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 16:14:43.499202 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53905862-670b-40ab-a14a-69c168383b78 admin admin] Authenticating user token {{(pid=80396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:14:43.509248 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53905862-670b-40ab-a14a-69c168383b78 admin admin] Validating token access rules against request {{(pid=80396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:14:43.513998 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-688cb1f6-b7bb-4be7-b1c1-95e1026701d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f73d5a98be74242b45222df39fb6213', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:14:43.514686 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688cb1f6-b7bb-4be7-b1c1-95e1026701d1 admin admin] REQUEST_METHOD: `GET` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:14:43.514972 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688cb1f6-b7bb-4be7-b1c1-95e1026701d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:14:43.515253 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688cb1f6-b7bb-4be7-b1c1-95e1026701d1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:14:43.515979 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-688cb1f6-b7bb-4be7-b1c1-95e1026701d1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:14:43.517591 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-688cb1f6-b7bb-4be7-b1c1-95e1026701d1 admin admin] RBAC: Authorization granted {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:14:43.528273 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 1230/2468] 10.222.0.59 () {58 vars in 1121 bytes} [Thu Jun 2 16:14:43 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 16:14:43.532315 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0129a0a5-5a2d-41ef-947c-65489e602407 admin admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:14:43.543163 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0129a0a5-5a2d-41ef-947c-65489e602407 admin admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:14:43.547683 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22674531-b2c2-4fa3-909c-6739f51e09da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f73d5a98be74242b45222df39fb6213', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:14:43.548543 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22674531-b2c2-4fa3-909c-6739f51e09da admin admin] REQUEST_METHOD: `PUT` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:14:43.548830 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22674531-b2c2-4fa3-909c-6739f51e09da admin admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:14:43.549104 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22674531-b2c2-4fa3-909c-6739f51e09da admin admin] PATH_INFO: `/v3/projects/7777a6f5b0fe475cb40df7a197e4ebb1/users/70015a7d1e504bff9030fc81445d0c19/roles/649e0f2b5a264c419ea6a1441f123a03` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:14:43.563770 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22674531-b2c2-4fa3-909c-6739f51e09da admin admin] RBAC: Authorizing `identity:create_grant(project_id=7777a6f5b0fe475cb40df7a197e4ebb1, user_id=70015a7d1e504bff9030fc81445d0c19, role_id=649e0f2b5a264c419ea6a1441f123a03)` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:14:43.566771 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22674531-b2c2-4fa3-909c-6739f51e09da admin admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:14:43.653677 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 1239/2469] 10.222.0.59 () {60 vars in 1482 bytes} [Thu Jun 2 16:14:43 2022] PUT /identity/v3/projects/7777a6f5b0fe475cb40df7a197e4ebb1/users/70015a7d1e504bff9030fc81445d0c19/roles/649e0f2b5a264c419ea6a1441f123a03 => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 16:14:43.664965 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2251f1-85d9-4489-a1a3-51ab2deed0de None None] REQUEST_METHOD: `POST` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:14:43.665258 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2251f1-85d9-4489-a1a3-51ab2deed0de None None] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:14:43.665542 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2251f1-85d9-4489-a1a3-51ab2deed0de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:14:43.691876 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.auth.core [None req-ec2251f1-85d9-4489-a1a3-51ab2deed0de None None] MFA Rules not processed for user `70015a7d1e504bff9030fc81445d0c19`. Rule list: `[]` (Enabled: `True`). {{(pid=80396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 16:14:43.693080 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.fernet_utils [None req-ec2251f1-85d9-4489-a1a3-51ab2deed0de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:14:43.757356 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 1231/2470] 10.222.0.59 () {58 vars in 957 bytes} [Thu Jun 2 16:14:43 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 16:14:43.769984 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22674531-b2c2-4fa3-909c-6739f51e09da admin admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:14:43.771722 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.fernet_utils [None req-22674531-b2c2-4fa3-909c-6739f51e09da admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:14:43.846116 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22674531-b2c2-4fa3-909c-6739f51e09da admin admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:14:43.852552 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30a509e3-e8db-4567-934f-6f77fc064783 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52f9fe4b13574516bb0a8e2aa11a61e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c87c981909d4b8db02783421818c79b', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:14:43.853191 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a509e3-e8db-4567-934f-6f77fc064783 service nova] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:14:43.853475 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a509e3-e8db-4567-934f-6f77fc064783 service nova] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:14:43.853806 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a509e3-e8db-4567-934f-6f77fc064783 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:14:43.861772 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30a509e3-e8db-4567-934f-6f77fc064783 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:14:43.863574 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30a509e3-e8db-4567-934f-6f77fc064783 service nova] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:14:43.872387 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 1240/2471] 10.222.0.59 () {60 vars in 1365 bytes} [Thu Jun 2 16:14:43 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 16:14:53.754375 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG dbcounter [-] [80396] Writing DB stats keystone:SELECT=71,keystone:INSERT=3 {{(pid=80396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 16:14:53.868399 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writing DB stats keystone:SELECT=51,keystone:INSERT=1 {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 16:14:55.186317 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec2251f1-85d9-4489-a1a3-51ab2deed0de None None] Authenticating user token {{(pid=80396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:14:55.247623 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec2251f1-85d9-4489-a1a3-51ab2deed0de None None] Validating token access rules against request {{(pid=80396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:14:55.252146 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe1e15ec-9a94-4a1b-bf59-2d6a7d1ff3ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f73d5a98be74242b45222df39fb6213', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:14:55.253006 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1e15ec-9a94-4a1b-bf59-2d6a7d1ff3ed admin admin] REQUEST_METHOD: `DELETE` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:14:55.253290 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1e15ec-9a94-4a1b-bf59-2d6a7d1ff3ed admin admin] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:14:55.253567 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1e15ec-9a94-4a1b-bf59-2d6a7d1ff3ed admin admin] PATH_INFO: `/v3/users/70015a7d1e504bff9030fc81445d0c19` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:14:55.254761 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe1e15ec-9a94-4a1b-bf59-2d6a7d1ff3ed admin admin] RBAC: Authorizing `identity:delete_user(user_id=70015a7d1e504bff9030fc81445d0c19)` {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:14:55.256921 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe1e15ec-9a94-4a1b-bf59-2d6a7d1ff3ed admin admin] RBAC: Authorization granted {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:14:55.490514 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.notifications [None req-fe1e15ec-9a94-4a1b-bf59-2d6a7d1ff3ed admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '70015a7d1e504bff9030fc81445d0c19'} {{(pid=80396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:14:55.491241 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.notifications [None req-fe1e15ec-9a94-4a1b-bf59-2d6a7d1ff3ed admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '70015a7d1e504bff9030fc81445d0c19'} {{(pid=80396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:14:55.567593 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.notifications [None req-fe1e15ec-9a94-4a1b-bf59-2d6a7d1ff3ed admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '70015a7d1e504bff9030fc81445d0c19'} {{(pid=80396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:14:55.579834 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.notifications [None req-fe1e15ec-9a94-4a1b-bf59-2d6a7d1ff3ed admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '70015a7d1e504bff9030fc81445d0c19'} {{(pid=80396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:14:55.587079 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.notifications [None req-fe1e15ec-9a94-4a1b-bf59-2d6a7d1ff3ed admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '70015a7d1e504bff9030fc81445d0c19'} {{(pid=80396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:14:55.592921 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 1232/2472] 10.222.0.59 () {58 vars in 1223 bytes} [Thu Jun 2 16:14:55 2022] DELETE /identity/v3/users/70015a7d1e504bff9030fc81445d0c19 => generated 0 bytes in 409 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 16:14:55.597847 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f92891-eb89-47ab-ad26-bd5cb2a95f93 None None] REQUEST_METHOD: `POST` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:14:55.598341 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f92891-eb89-47ab-ad26-bd5cb2a95f93 None None] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:14:55.598437 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f92891-eb89-47ab-ad26-bd5cb2a95f93 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:14:55.616077 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.auth.core [None req-b6f92891-eb89-47ab-ad26-bd5cb2a95f93 None None] MFA Rules not processed for user `400d1f4db9de49638549e5db29a041e1`. Rule list: `[]` (Enabled: `True`). {{(pid=80395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 16:14:55.617252 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.fernet_utils [None req-b6f92891-eb89-47ab-ad26-bd5cb2a95f93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:14:55.675228 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 1241/2473] 10.222.0.59 () {58 vars in 957 bytes} [Thu Jun 2 16:14:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 16:14:55.685297 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe1e15ec-9a94-4a1b-bf59-2d6a7d1ff3ed admin admin] Authenticating user token {{(pid=80396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:14:55.686710 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.fernet_utils [None req-fe1e15ec-9a94-4a1b-bf59-2d6a7d1ff3ed admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:14:55.743912 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe1e15ec-9a94-4a1b-bf59-2d6a7d1ff3ed admin admin] Validating token access rules against request {{(pid=80396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:14:55.747380 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4f07c23-c867-4119-9471-63a0db1c33f5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9af40ddfe9ff4be3887b068f13a28dc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c87c981909d4b8db02783421818c79b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:14:55.748019 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f07c23-c867-4119-9471-63a0db1c33f5 service neutron] REQUEST_METHOD: `GET` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:14:55.748296 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f07c23-c867-4119-9471-63a0db1c33f5 service neutron] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:14:55.748568 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f07c23-c867-4119-9471-63a0db1c33f5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:14:55.757881 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4f07c23-c867-4119-9471-63a0db1c33f5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:14:55.759361 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4f07c23-c867-4119-9471-63a0db1c33f5 service neutron] RBAC: Authorization granted {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:14:55.769586 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 1233/2474] 10.222.0.59 () {60 vars in 1365 bytes} [Thu Jun 2 16:14:55 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 16:14:56.184978 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6f92891-eb89-47ab-ad26-bd5cb2a95f93 None None] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:14:56.193792 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.fernet_utils [None req-b6f92891-eb89-47ab-ad26-bd5cb2a95f93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:14:56.199353 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6f92891-eb89-47ab-ad26-bd5cb2a95f93 None None] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:14:56.204757 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46c69381-4623-4270-843f-ec929c99d860 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f73d5a98be74242b45222df39fb6213', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:14:56.205679 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c69381-4623-4270-843f-ec929c99d860 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:14:56.205967 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c69381-4623-4270-843f-ec929c99d860 admin admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:14:56.206296 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c69381-4623-4270-843f-ec929c99d860 admin admin] PATH_INFO: `/v3/projects/7777a6f5b0fe475cb40df7a197e4ebb1` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:14:56.207500 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46c69381-4623-4270-843f-ec929c99d860 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7777a6f5b0fe475cb40df7a197e4ebb1)` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:14:56.210062 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46c69381-4623-4270-843f-ec929c99d860 admin admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:14:56.335087 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.notifications [None req-46c69381-4623-4270-843f-ec929c99d860 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7777a6f5b0fe475cb40df7a197e4ebb1', 'request_id': 'req-46c69381-4623-4270-843f-ec929c99d860'} {{(pid=80395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:14:56.341200 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.notifications [None req-46c69381-4623-4270-843f-ec929c99d860 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7777a6f5b0fe475cb40df7a197e4ebb1', 'request_id': 'req-46c69381-4623-4270-843f-ec929c99d860'} {{(pid=80395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:14:56.431518 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.notifications [None req-46c69381-4623-4270-843f-ec929c99d860 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7777a6f5b0fe475cb40df7a197e4ebb1', 'request_id': 'req-46c69381-4623-4270-843f-ec929c99d860'} {{(pid=80395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:14:56.443504 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.notifications [None req-46c69381-4623-4270-843f-ec929c99d860 admin admin] The token cache is being invalidate because project 7777a6f5b0fe475cb40df7a197e4ebb1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80395) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 02 16:14:56.443798 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.notifications [None req-46c69381-4623-4270-843f-ec929c99d860 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:14:56.450025 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.notifications [None req-46c69381-4623-4270-843f-ec929c99d860 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:14:56.450025 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 1242/2475] 10.222.0.59 () {58 vars in 1232 bytes} [Thu Jun 2 16:14:56 2022] DELETE /identity/v3/projects/7777a6f5b0fe475cb40df7a197e4ebb1 => generated 0 bytes in 262 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 16:14:56.451049 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07c57a9-7e68-4cff-a66c-9b3dfaa45c11 None None] REQUEST_METHOD: `POST` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:14:56.451488 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07c57a9-7e68-4cff-a66c-9b3dfaa45c11 None None] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:14:56.451610 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07c57a9-7e68-4cff-a66c-9b3dfaa45c11 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:14:56.471735 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.auth.core [None req-c07c57a9-7e68-4cff-a66c-9b3dfaa45c11 None None] MFA Rules not processed for user `400d1f4db9de49638549e5db29a041e1`. Rule list: `[]` (Enabled: `True`). {{(pid=80396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 16:14:56.472941 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.fernet_utils [None req-c07c57a9-7e68-4cff-a66c-9b3dfaa45c11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:14:56.494511 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG dbcounter [-] [80396] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 16:14:56.537847 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 1234/2476] 10.222.0.59 () {58 vars in 957 bytes} [Thu Jun 2 16:14:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 16:14:56.545510 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f1d813-536f-4f03-a0bb-407cfa0ffe41 None None] REQUEST_METHOD: `POST` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:14:56.545806 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f1d813-536f-4f03-a0bb-407cfa0ffe41 None None] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:14:56.546108 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f1d813-536f-4f03-a0bb-407cfa0ffe41 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:14:56.566721 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.auth.core [None req-d4f1d813-536f-4f03-a0bb-407cfa0ffe41 None None] MFA Rules not processed for user `400d1f4db9de49638549e5db29a041e1`. Rule list: `[]` (Enabled: `True`). {{(pid=80395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 16:14:56.568590 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.fernet_utils [None req-d4f1d813-536f-4f03-a0bb-407cfa0ffe41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:14:56.578939 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 1243/2477] 10.222.0.59 () {58 vars in 957 bytes} [Thu Jun 2 16:14:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 16:14:56.583867 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c07c57a9-7e68-4cff-a66c-9b3dfaa45c11 None None] Authenticating user token {{(pid=80396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:14:56.595543 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c07c57a9-7e68-4cff-a66c-9b3dfaa45c11 None None] Validating token access rules against request {{(pid=80396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:14:56.601587 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-752e6a55-834e-462d-8c13-74f05daef905 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f73d5a98be74242b45222df39fb6213', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:14:56.602276 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-752e6a55-834e-462d-8c13-74f05daef905 admin admin] REQUEST_METHOD: `GET` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:14:56.604931 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-752e6a55-834e-462d-8c13-74f05daef905 admin admin] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:14:56.604931 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-752e6a55-834e-462d-8c13-74f05daef905 admin admin] PATH_INFO: `/v3/domains` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:14:56.604931 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-752e6a55-834e-462d-8c13-74f05daef905 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80396) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 16:14:56.604931 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-752e6a55-834e-462d-8c13-74f05daef905 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:14:56.605596 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-752e6a55-834e-462d-8c13-74f05daef905 admin admin] RBAC: Authorization granted {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:14:56.618509 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 1235/2478] 10.222.0.59 () {58 vars in 1152 bytes} [Thu Jun 2 16:14:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 16:14:56.622649 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f1d813-536f-4f03-a0bb-407cfa0ffe41 None None] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:14:56.632342 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f1d813-536f-4f03-a0bb-407cfa0ffe41 None None] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:14:56.637072 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7e4a944-dbf0-4ac1-bb27-549266fbf9f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f73d5a98be74242b45222df39fb6213', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:14:56.637744 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e4a944-dbf0-4ac1-bb27-549266fbf9f2 admin admin] REQUEST_METHOD: `POST` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:14:56.638027 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e4a944-dbf0-4ac1-bb27-549266fbf9f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:14:56.638325 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e4a944-dbf0-4ac1-bb27-549266fbf9f2 admin admin] PATH_INFO: `/v3/projects` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:14:56.639021 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7e4a944-dbf0-4ac1-bb27-549266fbf9f2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:14:56.640951 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7e4a944-dbf0-4ac1-bb27-549266fbf9f2 admin admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:14:56.779721 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 1244/2479] 10.222.0.59 () {60 vars in 1152 bytes} [Thu Jun 2 16:14:56 2022] POST /identity/v3/projects => generated 401 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 02 16:14:56.784619 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-752e6a55-834e-462d-8c13-74f05daef905 admin admin] Authenticating user token {{(pid=80396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:14:56.795756 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-752e6a55-834e-462d-8c13-74f05daef905 admin admin] Validating token access rules against request {{(pid=80396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:14:56.858485 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e61e905a-bf4f-4183-8a8e-f8a2827acbf8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f73d5a98be74242b45222df39fb6213', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:14:56.859054 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e61e905a-bf4f-4183-8a8e-f8a2827acbf8 admin admin] REQUEST_METHOD: `POST` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:14:56.859511 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e61e905a-bf4f-4183-8a8e-f8a2827acbf8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:14:56.860020 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e61e905a-bf4f-4183-8a8e-f8a2827acbf8 admin admin] PATH_INFO: `/v3/users` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:14:56.860891 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e61e905a-bf4f-4183-8a8e-f8a2827acbf8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:14:56.862877 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e61e905a-bf4f-4183-8a8e-f8a2827acbf8 admin admin] RBAC: Authorization granted {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:14:56.968895 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 1236/2480] 10.222.0.59 () {60 vars in 1143 bytes} [Thu Jun 2 16:14:56 2022] POST /identity/v3/users => generated 301 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 16:14:56.974696 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7e4a944-dbf0-4ac1-bb27-549266fbf9f2 admin admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:14:56.986033 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7e4a944-dbf0-4ac1-bb27-549266fbf9f2 admin admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:14:56.991701 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ae9728b-cddc-442a-acdb-ee2bbcf7c70b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f73d5a98be74242b45222df39fb6213', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:14:56.992369 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae9728b-cddc-442a-acdb-ee2bbcf7c70b admin admin] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:14:56.992656 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae9728b-cddc-442a-acdb-ee2bbcf7c70b admin admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:14:56.992933 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae9728b-cddc-442a-acdb-ee2bbcf7c70b admin admin] PATH_INFO: `/v3/roles` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:14:56.993694 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ae9728b-cddc-442a-acdb-ee2bbcf7c70b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:14:56.995771 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ae9728b-cddc-442a-acdb-ee2bbcf7c70b admin admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:14:57.007277 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 1245/2481] 10.222.0.59 () {58 vars in 1121 bytes} [Thu Jun 2 16:14:56 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 02 16:14:57.011684 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e61e905a-bf4f-4183-8a8e-f8a2827acbf8 admin admin] Authenticating user token {{(pid=80396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:14:57.022368 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e61e905a-bf4f-4183-8a8e-f8a2827acbf8 admin admin] Validating token access rules against request {{(pid=80396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:14:57.027830 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-958da769-4d95-4900-9165-8b858e528dcd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f73d5a98be74242b45222df39fb6213', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:14:57.028489 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958da769-4d95-4900-9165-8b858e528dcd admin admin] REQUEST_METHOD: `GET` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:14:57.028773 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958da769-4d95-4900-9165-8b858e528dcd admin admin] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:14:57.029049 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958da769-4d95-4900-9165-8b858e528dcd admin admin] PATH_INFO: `/v3/roles` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:14:57.029782 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-958da769-4d95-4900-9165-8b858e528dcd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:14:57.031414 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-958da769-4d95-4900-9165-8b858e528dcd admin admin] RBAC: Authorization granted {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:14:57.045029 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 1237/2482] 10.222.0.59 () {58 vars in 1121 bytes} [Thu Jun 2 16:14:57 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 16:14:57.049307 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ae9728b-cddc-442a-acdb-ee2bbcf7c70b admin admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:14:57.062496 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ae9728b-cddc-442a-acdb-ee2bbcf7c70b admin admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:14:57.069420 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4645599-f8af-4a84-bc7e-2c62aa3e76a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f73d5a98be74242b45222df39fb6213', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:14:57.070367 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4645599-f8af-4a84-bc7e-2c62aa3e76a0 admin admin] REQUEST_METHOD: `PUT` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:14:57.070658 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4645599-f8af-4a84-bc7e-2c62aa3e76a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:14:57.070937 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4645599-f8af-4a84-bc7e-2c62aa3e76a0 admin admin] PATH_INFO: `/v3/projects/08fd583907e94f18bde814a2bb75f694/users/dcd309dec683492eb06cb8ac636e121f/roles/649e0f2b5a264c419ea6a1441f123a03` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:14:57.086193 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4645599-f8af-4a84-bc7e-2c62aa3e76a0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=08fd583907e94f18bde814a2bb75f694, user_id=dcd309dec683492eb06cb8ac636e121f, role_id=649e0f2b5a264c419ea6a1441f123a03)` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:14:57.088883 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4645599-f8af-4a84-bc7e-2c62aa3e76a0 admin admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:14:57.196808 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 1246/2483] 10.222.0.59 () {60 vars in 1482 bytes} [Thu Jun 2 16:14:57 2022] PUT /identity/v3/projects/08fd583907e94f18bde814a2bb75f694/users/dcd309dec683492eb06cb8ac636e121f/roles/649e0f2b5a264c419ea6a1441f123a03 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 16:14:57.213183 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd27020-3585-49a6-967a-9a4df624481f None None] REQUEST_METHOD: `POST` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:14:57.213183 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd27020-3585-49a6-967a-9a4df624481f None None] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:14:57.213183 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd27020-3585-49a6-967a-9a4df624481f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:14:57.236344 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.auth.core [None req-efd27020-3585-49a6-967a-9a4df624481f None None] MFA Rules not processed for user `dcd309dec683492eb06cb8ac636e121f`. Rule list: `[]` (Enabled: `True`). {{(pid=80396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 16:14:57.237543 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.fernet_utils [None req-efd27020-3585-49a6-967a-9a4df624481f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:14:57.302543 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 1238/2484] 10.222.0.59 () {58 vars in 957 bytes} [Thu Jun 2 16:14:57 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 16:14:57.307135 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4645599-f8af-4a84-bc7e-2c62aa3e76a0 admin admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:14:57.328407 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 16:14:57.375657 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4645599-f8af-4a84-bc7e-2c62aa3e76a0 admin admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:14:57.382188 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1598cda9-197c-428c-874c-4d0a8a3f420d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f73d5a98be74242b45222df39fb6213', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:14:57.383704 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1598cda9-197c-428c-874c-4d0a8a3f420d admin admin] REQUEST_METHOD: `POST` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:14:57.384174 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1598cda9-197c-428c-874c-4d0a8a3f420d admin admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:14:57.384679 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1598cda9-197c-428c-874c-4d0a8a3f420d admin admin] PATH_INFO: `/v3/projects` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:14:57.385547 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1598cda9-197c-428c-874c-4d0a8a3f420d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:14:57.387864 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1598cda9-197c-428c-874c-4d0a8a3f420d admin admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:14:57.545450 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 1247/2485] 10.222.0.59 () {60 vars in 1152 bytes} [Thu Jun 2 16:14:57 2022] POST /identity/v3/projects => generated 401 bytes in 239 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 16:14:57.549431 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efd27020-3585-49a6-967a-9a4df624481f None None] Authenticating user token {{(pid=80396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:14:57.560124 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efd27020-3585-49a6-967a-9a4df624481f None None] Validating token access rules against request {{(pid=80396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:14:57.572752 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG dbcounter [-] [80396] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 16:14:57.615917 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21ebc914-ae35-43a1-8453-ca9e2934e153 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f73d5a98be74242b45222df39fb6213', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:14:57.616585 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ebc914-ae35-43a1-8453-ca9e2934e153 admin admin] REQUEST_METHOD: `POST` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:14:57.616870 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ebc914-ae35-43a1-8453-ca9e2934e153 admin admin] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:14:57.617166 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ebc914-ae35-43a1-8453-ca9e2934e153 admin admin] PATH_INFO: `/v3/users` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:14:57.618301 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21ebc914-ae35-43a1-8453-ca9e2934e153 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:14:57.620323 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21ebc914-ae35-43a1-8453-ca9e2934e153 admin admin] RBAC: Authorization granted {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:14:57.714940 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 1239/2486] 10.222.0.59 () {60 vars in 1143 bytes} [Thu Jun 2 16:14:57 2022] POST /identity/v3/users => generated 307 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 16:14:57.718968 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1598cda9-197c-428c-874c-4d0a8a3f420d admin admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:14:57.730653 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1598cda9-197c-428c-874c-4d0a8a3f420d admin admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:14:57.735272 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec3b0e39-8389-414c-b09f-186146d0ea74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f73d5a98be74242b45222df39fb6213', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:14:57.735989 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3b0e39-8389-414c-b09f-186146d0ea74 admin admin] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:14:57.736275 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3b0e39-8389-414c-b09f-186146d0ea74 admin admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:14:57.736548 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3b0e39-8389-414c-b09f-186146d0ea74 admin admin] PATH_INFO: `/v3/roles` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:14:57.737264 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec3b0e39-8389-414c-b09f-186146d0ea74 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:14:57.738888 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec3b0e39-8389-414c-b09f-186146d0ea74 admin admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:14:57.749867 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 1248/2487] 10.222.0.59 () {58 vars in 1121 bytes} [Thu Jun 2 16:14:57 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 16:14:57.754113 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21ebc914-ae35-43a1-8453-ca9e2934e153 admin admin] Authenticating user token {{(pid=80396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:14:57.764934 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21ebc914-ae35-43a1-8453-ca9e2934e153 admin admin] Validating token access rules against request {{(pid=80396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:14:57.769717 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdfa1e23-7ed8-451e-af69-5c6f15aa6b89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f73d5a98be74242b45222df39fb6213', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:14:57.770679 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdfa1e23-7ed8-451e-af69-5c6f15aa6b89 admin admin] REQUEST_METHOD: `PUT` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:14:57.771002 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdfa1e23-7ed8-451e-af69-5c6f15aa6b89 admin admin] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:14:57.771309 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdfa1e23-7ed8-451e-af69-5c6f15aa6b89 admin admin] PATH_INFO: `/v3/projects/230005d3d30c4176bd06f3e154063ca6/users/9bd2af80ce404e78b5277fcb20f85628/roles/f1e0c25f6e9049e897cb7350c7e54ab3` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:14:57.787991 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdfa1e23-7ed8-451e-af69-5c6f15aa6b89 admin admin] RBAC: Authorizing `identity:create_grant(project_id=230005d3d30c4176bd06f3e154063ca6, user_id=9bd2af80ce404e78b5277fcb20f85628, role_id=f1e0c25f6e9049e897cb7350c7e54ab3)` {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:14:57.791141 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdfa1e23-7ed8-451e-af69-5c6f15aa6b89 admin admin] RBAC: Authorization granted {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:14:57.917591 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 1240/2488] 10.222.0.59 () {60 vars in 1482 bytes} [Thu Jun 2 16:14:57 2022] PUT /identity/v3/projects/230005d3d30c4176bd06f3e154063ca6/users/9bd2af80ce404e78b5277fcb20f85628/roles/f1e0c25f6e9049e897cb7350c7e54ab3 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 02 16:14:57.921414 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec3b0e39-8389-414c-b09f-186146d0ea74 admin admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:14:57.932135 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec3b0e39-8389-414c-b09f-186146d0ea74 admin admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:14:57.989455 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71566d30-5fc8-4c56-bda8-916c967f383c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f73d5a98be74242b45222df39fb6213', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:14:57.990152 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71566d30-5fc8-4c56-bda8-916c967f383c admin admin] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:14:57.990437 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71566d30-5fc8-4c56-bda8-916c967f383c admin admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:14:57.990711 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71566d30-5fc8-4c56-bda8-916c967f383c admin admin] PATH_INFO: `/v3/roles` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:14:57.991427 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71566d30-5fc8-4c56-bda8-916c967f383c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:14:57.993555 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71566d30-5fc8-4c56-bda8-916c967f383c admin admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:14:58.003332 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 1249/2489] 10.222.0.59 () {58 vars in 1121 bytes} [Thu Jun 2 16:14:57 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 16:14:58.007727 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdfa1e23-7ed8-451e-af69-5c6f15aa6b89 admin admin] Authenticating user token {{(pid=80396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:14:58.018529 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdfa1e23-7ed8-451e-af69-5c6f15aa6b89 admin admin] Validating token access rules against request {{(pid=80396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:14:58.023199 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37366203-ad5f-4d0d-94f0-f7f72ee2baac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f73d5a98be74242b45222df39fb6213', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:14:58.024113 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37366203-ad5f-4d0d-94f0-f7f72ee2baac admin admin] REQUEST_METHOD: `PUT` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:14:58.024501 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37366203-ad5f-4d0d-94f0-f7f72ee2baac admin admin] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:14:58.024753 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37366203-ad5f-4d0d-94f0-f7f72ee2baac admin admin] PATH_INFO: `/v3/projects/230005d3d30c4176bd06f3e154063ca6/users/9bd2af80ce404e78b5277fcb20f85628/roles/f1e0c25f6e9049e897cb7350c7e54ab3` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:14:58.026712 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37366203-ad5f-4d0d-94f0-f7f72ee2baac admin admin] RBAC: Authorizing `identity:create_grant(project_id=230005d3d30c4176bd06f3e154063ca6, user_id=9bd2af80ce404e78b5277fcb20f85628, role_id=f1e0c25f6e9049e897cb7350c7e54ab3)` {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:14:58.031497 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37366203-ad5f-4d0d-94f0-f7f72ee2baac admin admin] RBAC: Authorization granted {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:14:58.040312 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 1241/2490] 10.222.0.59 () {60 vars in 1482 bytes} [Thu Jun 2 16:14:58 2022] PUT /identity/v3/projects/230005d3d30c4176bd06f3e154063ca6/users/9bd2af80ce404e78b5277fcb20f85628/roles/f1e0c25f6e9049e897cb7350c7e54ab3 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 16:14:58.050409 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6391fa8-cdad-46fe-a622-2e8c3046a89a None None] REQUEST_METHOD: `POST` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:14:58.050703 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6391fa8-cdad-46fe-a622-2e8c3046a89a None None] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:14:58.050983 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6391fa8-cdad-46fe-a622-2e8c3046a89a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:14:58.077322 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.auth.core [None req-f6391fa8-cdad-46fe-a622-2e8c3046a89a None None] MFA Rules not processed for user `9bd2af80ce404e78b5277fcb20f85628`. Rule list: `[]` (Enabled: `True`). {{(pid=80395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 16:14:58.078537 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.fernet_utils [None req-f6391fa8-cdad-46fe-a622-2e8c3046a89a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:14:58.145072 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 1250/2491] 10.222.0.59 () {58 vars in 957 bytes} [Thu Jun 2 16:14:58 2022] POST /identity/v3/auth/tokens => generated 3335 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 16:14:58.155797 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37366203-ad5f-4d0d-94f0-f7f72ee2baac admin admin] Authenticating user token {{(pid=80396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:14:58.157459 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.fernet_utils [None req-37366203-ad5f-4d0d-94f0-f7f72ee2baac admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:14:58.214337 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37366203-ad5f-4d0d-94f0-f7f72ee2baac admin admin] Validating token access rules against request {{(pid=80396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:14:58.218257 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-051b675c-0ca3-4b2b-96f9-2526c5937ead service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6534961c369940a5b88f310c6450250b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c87c981909d4b8db02783421818c79b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:14:58.218548 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051b675c-0ca3-4b2b-96f9-2526c5937ead service cinder] REQUEST_METHOD: `GET` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:14:58.218835 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051b675c-0ca3-4b2b-96f9-2526c5937ead service cinder] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:14:58.219106 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051b675c-0ca3-4b2b-96f9-2526c5937ead service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:14:58.228902 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-051b675c-0ca3-4b2b-96f9-2526c5937ead service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:14:58.230356 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-051b675c-0ca3-4b2b-96f9-2526c5937ead service cinder] RBAC: Authorization granted {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:14:58.239451 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 1242/2492] 10.222.0.59 () {60 vars in 1365 bytes} [Thu Jun 2 16:14:58 2022] GET /identity/v3/auth/tokens => generated 3335 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 16:14:58.482415 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6391fa8-cdad-46fe-a622-2e8c3046a89a None None] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:14:58.491862 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6391fa8-cdad-46fe-a622-2e8c3046a89a None None] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:14:58.495998 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1f84303-e363-4470-9588-dfc7f9b54e18 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6534961c369940a5b88f310c6450250b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c87c981909d4b8db02783421818c79b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:14:58.496626 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f84303-e363-4470-9588-dfc7f9b54e18 service cinder] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:14:58.496909 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f84303-e363-4470-9588-dfc7f9b54e18 service cinder] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:14:58.497188 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f84303-e363-4470-9588-dfc7f9b54e18 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:14:58.509827 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 16:14:58.553222 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1f84303-e363-4470-9588-dfc7f9b54e18 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:14:58.555416 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1f84303-e363-4470-9588-dfc7f9b54e18 service cinder] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:14:58.564011 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 1251/2493] 10.222.0.59 () {60 vars in 1365 bytes} [Thu Jun 2 16:14:58 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 16:15:04.679728 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-051b675c-0ca3-4b2b-96f9-2526c5937ead service cinder] Authenticating user token {{(pid=80396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:15:04.743646 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-051b675c-0ca3-4b2b-96f9-2526c5937ead service cinder] Validating token access rules against request {{(pid=80396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:15:04.748053 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4452f409-3c76-4fa5-a117-ef3030afdab1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f73d5a98be74242b45222df39fb6213', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:15:04.748897 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4452f409-3c76-4fa5-a117-ef3030afdab1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:15:04.749178 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4452f409-3c76-4fa5-a117-ef3030afdab1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:15:04.749451 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4452f409-3c76-4fa5-a117-ef3030afdab1 admin admin] PATH_INFO: `/v3/users/dcd309dec683492eb06cb8ac636e121f` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:15:04.750643 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4452f409-3c76-4fa5-a117-ef3030afdab1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=dcd309dec683492eb06cb8ac636e121f)` {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:15:04.752538 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4452f409-3c76-4fa5-a117-ef3030afdab1 admin admin] RBAC: Authorization granted {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:15:04.766468 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG dbcounter [-] [80396] Writing DB stats keystone:SELECT=94,keystone:INSERT=5,keystone:DELETE=1 {{(pid=80396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 16:15:04.980047 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.notifications [None req-4452f409-3c76-4fa5-a117-ef3030afdab1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dcd309dec683492eb06cb8ac636e121f'} {{(pid=80396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:15:04.980705 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.notifications [None req-4452f409-3c76-4fa5-a117-ef3030afdab1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dcd309dec683492eb06cb8ac636e121f'} {{(pid=80396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:15:05.105130 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.notifications [None req-4452f409-3c76-4fa5-a117-ef3030afdab1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dcd309dec683492eb06cb8ac636e121f'} {{(pid=80396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:15:05.117432 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.notifications [None req-4452f409-3c76-4fa5-a117-ef3030afdab1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dcd309dec683492eb06cb8ac636e121f'} {{(pid=80396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:15:05.125115 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.notifications [None req-4452f409-3c76-4fa5-a117-ef3030afdab1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dcd309dec683492eb06cb8ac636e121f'} {{(pid=80396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:15:05.131205 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 1243/2494] 10.222.0.59 () {58 vars in 1223 bytes} [Thu Jun 2 16:15:04 2022] DELETE /identity/v3/users/dcd309dec683492eb06cb8ac636e121f => generated 0 bytes in 452 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 16:15:05.135811 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84aa118e-269f-40f7-8872-d96b018224e1 None None] REQUEST_METHOD: `POST` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:15:05.136316 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84aa118e-269f-40f7-8872-d96b018224e1 None None] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:15:05.136417 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84aa118e-269f-40f7-8872-d96b018224e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:15:05.153453 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.auth.core [None req-84aa118e-269f-40f7-8872-d96b018224e1 None None] MFA Rules not processed for user `400d1f4db9de49638549e5db29a041e1`. Rule list: `[]` (Enabled: `True`). {{(pid=80395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 16:15:05.154716 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.fernet_utils [None req-84aa118e-269f-40f7-8872-d96b018224e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:15:05.213095 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 1252/2495] 10.222.0.59 () {58 vars in 957 bytes} [Thu Jun 2 16:15:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 16:15:05.223308 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4452f409-3c76-4fa5-a117-ef3030afdab1 admin admin] Authenticating user token {{(pid=80396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:15:05.224787 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.fernet_utils [None req-4452f409-3c76-4fa5-a117-ef3030afdab1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:15:05.282590 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4452f409-3c76-4fa5-a117-ef3030afdab1 admin admin] Validating token access rules against request {{(pid=80396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:15:05.286042 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7360ef8-44b4-42d9-baaa-ed57b7f8a9e1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9af40ddfe9ff4be3887b068f13a28dc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c87c981909d4b8db02783421818c79b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:15:05.286713 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7360ef8-44b4-42d9-baaa-ed57b7f8a9e1 service neutron] REQUEST_METHOD: `GET` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:15:05.286994 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7360ef8-44b4-42d9-baaa-ed57b7f8a9e1 service neutron] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:15:05.287266 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7360ef8-44b4-42d9-baaa-ed57b7f8a9e1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:15:05.296734 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7360ef8-44b4-42d9-baaa-ed57b7f8a9e1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:15:05.298181 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7360ef8-44b4-42d9-baaa-ed57b7f8a9e1 service neutron] RBAC: Authorization granted {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:15:05.307405 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 1244/2496] 10.222.0.59 () {60 vars in 1365 bytes} [Thu Jun 2 16:15:05 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 16:15:05.724054 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84aa118e-269f-40f7-8872-d96b018224e1 None None] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:15:05.727676 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.fernet_utils [None req-84aa118e-269f-40f7-8872-d96b018224e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:15:05.741318 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84aa118e-269f-40f7-8872-d96b018224e1 None None] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:15:05.762110 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2719e27e-ca1f-4685-8f51-fdd5fccfdbd7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f73d5a98be74242b45222df39fb6213', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:15:05.762110 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2719e27e-ca1f-4685-8f51-fdd5fccfdbd7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:15:05.762110 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2719e27e-ca1f-4685-8f51-fdd5fccfdbd7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:15:05.762110 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2719e27e-ca1f-4685-8f51-fdd5fccfdbd7 admin admin] PATH_INFO: `/v3/projects/08fd583907e94f18bde814a2bb75f694` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:15:05.762930 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2719e27e-ca1f-4685-8f51-fdd5fccfdbd7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=08fd583907e94f18bde814a2bb75f694)` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:15:05.762930 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2719e27e-ca1f-4685-8f51-fdd5fccfdbd7 admin admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:15:05.888317 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.notifications [None req-2719e27e-ca1f-4685-8f51-fdd5fccfdbd7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '08fd583907e94f18bde814a2bb75f694', 'request_id': 'req-2719e27e-ca1f-4685-8f51-fdd5fccfdbd7'} {{(pid=80395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:15:05.895457 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.notifications [None req-2719e27e-ca1f-4685-8f51-fdd5fccfdbd7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '08fd583907e94f18bde814a2bb75f694', 'request_id': 'req-2719e27e-ca1f-4685-8f51-fdd5fccfdbd7'} {{(pid=80395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:15:05.961843 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.notifications [None req-2719e27e-ca1f-4685-8f51-fdd5fccfdbd7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '08fd583907e94f18bde814a2bb75f694', 'request_id': 'req-2719e27e-ca1f-4685-8f51-fdd5fccfdbd7'} {{(pid=80395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:15:05.975334 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.notifications [None req-2719e27e-ca1f-4685-8f51-fdd5fccfdbd7 admin admin] The token cache is being invalidate because project 08fd583907e94f18bde814a2bb75f694 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80395) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 02 16:15:05.975627 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.notifications [None req-2719e27e-ca1f-4685-8f51-fdd5fccfdbd7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:15:05.976280 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.notifications [None req-2719e27e-ca1f-4685-8f51-fdd5fccfdbd7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:15:05.977852 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 1253/2497] 10.222.0.59 () {58 vars in 1232 bytes} [Thu Jun 2 16:15:05 2022] DELETE /identity/v3/projects/08fd583907e94f18bde814a2bb75f694 => generated 0 bytes in 254 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 16:15:05.981886 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7360ef8-44b4-42d9-baaa-ed57b7f8a9e1 service neutron] Authenticating user token {{(pid=80396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:15:05.991827 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7360ef8-44b4-42d9-baaa-ed57b7f8a9e1 service neutron] Validating token access rules against request {{(pid=80396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:15:06.050699 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a39710ba-66d0-49f4-a71b-a5380fa5497d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f73d5a98be74242b45222df39fb6213', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:15:06.051556 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39710ba-66d0-49f4-a71b-a5380fa5497d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:15:06.051837 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39710ba-66d0-49f4-a71b-a5380fa5497d admin admin] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:15:06.052113 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39710ba-66d0-49f4-a71b-a5380fa5497d admin admin] PATH_INFO: `/v3/users/9bd2af80ce404e78b5277fcb20f85628` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:15:06.053295 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a39710ba-66d0-49f4-a71b-a5380fa5497d admin admin] RBAC: Authorizing `identity:delete_user(user_id=9bd2af80ce404e78b5277fcb20f85628)` {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:15:06.055360 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a39710ba-66d0-49f4-a71b-a5380fa5497d admin admin] RBAC: Authorization granted {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:15:06.264347 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG dbcounter [-] [80396] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=80396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 16:15:06.272515 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.notifications [None req-a39710ba-66d0-49f4-a71b-a5380fa5497d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9bd2af80ce404e78b5277fcb20f85628'} {{(pid=80396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:15:06.281883 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.notifications [None req-a39710ba-66d0-49f4-a71b-a5380fa5497d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9bd2af80ce404e78b5277fcb20f85628'} {{(pid=80396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:15:06.361898 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.notifications [None req-a39710ba-66d0-49f4-a71b-a5380fa5497d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9bd2af80ce404e78b5277fcb20f85628'} {{(pid=80396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:15:06.375655 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.notifications [None req-a39710ba-66d0-49f4-a71b-a5380fa5497d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9bd2af80ce404e78b5277fcb20f85628'} {{(pid=80396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:15:06.385037 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.notifications [None req-a39710ba-66d0-49f4-a71b-a5380fa5497d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9bd2af80ce404e78b5277fcb20f85628'} {{(pid=80396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:15:06.388737 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 1245/2498] 10.222.0.59 () {58 vars in 1223 bytes} [Thu Jun 2 16:15:05 2022] DELETE /identity/v3/users/9bd2af80ce404e78b5277fcb20f85628 => generated 0 bytes in 407 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 16:15:06.813055 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2719e27e-ca1f-4685-8f51-fdd5fccfdbd7 admin admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:15:06.814543 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.fernet_utils [None req-2719e27e-ca1f-4685-8f51-fdd5fccfdbd7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:15:06.829408 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2719e27e-ca1f-4685-8f51-fdd5fccfdbd7 admin admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:15:06.866005 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 16:15:06.888248 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3060f6b9-eb39-4058-8413-0130e5bef3db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f73d5a98be74242b45222df39fb6213', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:15:06.889130 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3060f6b9-eb39-4058-8413-0130e5bef3db admin admin] REQUEST_METHOD: `DELETE` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:15:06.889411 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3060f6b9-eb39-4058-8413-0130e5bef3db admin admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:15:06.889686 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3060f6b9-eb39-4058-8413-0130e5bef3db admin admin] PATH_INFO: `/v3/projects/230005d3d30c4176bd06f3e154063ca6` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:15:06.890958 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3060f6b9-eb39-4058-8413-0130e5bef3db admin admin] RBAC: Authorizing `identity:delete_project(project_id=230005d3d30c4176bd06f3e154063ca6)` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:15:06.892858 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3060f6b9-eb39-4058-8413-0130e5bef3db admin admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:15:07.033407 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.notifications [None req-3060f6b9-eb39-4058-8413-0130e5bef3db admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '230005d3d30c4176bd06f3e154063ca6', 'request_id': 'req-3060f6b9-eb39-4058-8413-0130e5bef3db'} {{(pid=80395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:15:07.039611 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.notifications [None req-3060f6b9-eb39-4058-8413-0130e5bef3db admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '230005d3d30c4176bd06f3e154063ca6', 'request_id': 'req-3060f6b9-eb39-4058-8413-0130e5bef3db'} {{(pid=80395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:15:07.125820 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.notifications [None req-3060f6b9-eb39-4058-8413-0130e5bef3db admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '230005d3d30c4176bd06f3e154063ca6', 'request_id': 'req-3060f6b9-eb39-4058-8413-0130e5bef3db'} {{(pid=80395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:15:07.137106 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.notifications [None req-3060f6b9-eb39-4058-8413-0130e5bef3db admin admin] The token cache is being invalidate because project 230005d3d30c4176bd06f3e154063ca6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80395) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 02 16:15:07.147001 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.notifications [None req-3060f6b9-eb39-4058-8413-0130e5bef3db admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:15:07.147001 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.notifications [None req-3060f6b9-eb39-4058-8413-0130e5bef3db admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:15:07.147001 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 1254/2499] 10.222.0.59 () {58 vars in 1232 bytes} [Thu Jun 2 16:15:06 2022] DELETE /identity/v3/projects/230005d3d30c4176bd06f3e154063ca6 => generated 0 bytes in 327 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 16:15:07.147278 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cac7fd7-42c7-40e3-b66f-50e1924ce657 None None] REQUEST_METHOD: `POST` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:15:07.147278 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cac7fd7-42c7-40e3-b66f-50e1924ce657 None None] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:15:07.147278 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cac7fd7-42c7-40e3-b66f-50e1924ce657 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:15:07.163129 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.auth.core [None req-6cac7fd7-42c7-40e3-b66f-50e1924ce657 None None] MFA Rules not processed for user `400d1f4db9de49638549e5db29a041e1`. Rule list: `[]` (Enabled: `True`). {{(pid=80396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 16:15:07.164347 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.fernet_utils [None req-6cac7fd7-42c7-40e3-b66f-50e1924ce657 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:15:07.224198 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 1246/2500] 10.222.0.59 () {58 vars in 957 bytes} [Thu Jun 2 16:15:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 16:15:07.233893 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab37f4b9-9419-4c3c-9f5b-e7231ae26789 None None] REQUEST_METHOD: `POST` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:15:07.234233 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab37f4b9-9419-4c3c-9f5b-e7231ae26789 None None] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:15:07.234515 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab37f4b9-9419-4c3c-9f5b-e7231ae26789 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:15:07.253076 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.auth.core [None req-ab37f4b9-9419-4c3c-9f5b-e7231ae26789 None None] MFA Rules not processed for user `400d1f4db9de49638549e5db29a041e1`. Rule list: `[]` (Enabled: `True`). {{(pid=80395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 16:15:07.255819 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.fernet_utils [None req-ab37f4b9-9419-4c3c-9f5b-e7231ae26789 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:15:07.262269 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 1255/2501] 10.222.0.59 () {58 vars in 957 bytes} [Thu Jun 2 16:15:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 16:15:07.266437 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cac7fd7-42c7-40e3-b66f-50e1924ce657 None None] Authenticating user token {{(pid=80396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:15:07.276369 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cac7fd7-42c7-40e3-b66f-50e1924ce657 None None] Validating token access rules against request {{(pid=80396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:15:07.280918 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ab91b4a-b99e-41a9-81cc-6f192bd13827 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f73d5a98be74242b45222df39fb6213', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:15:07.285467 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab91b4a-b99e-41a9-81cc-6f192bd13827 admin admin] REQUEST_METHOD: `GET` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:15:07.285467 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab91b4a-b99e-41a9-81cc-6f192bd13827 admin admin] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:15:07.285467 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab91b4a-b99e-41a9-81cc-6f192bd13827 admin admin] PATH_INFO: `/v3/domains` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:15:07.285467 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ab91b4a-b99e-41a9-81cc-6f192bd13827 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80396) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 16:15:07.285467 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ab91b4a-b99e-41a9-81cc-6f192bd13827 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:15:07.285467 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ab91b4a-b99e-41a9-81cc-6f192bd13827 admin admin] RBAC: Authorization granted {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:15:07.297116 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 1247/2502] 10.222.0.59 () {58 vars in 1152 bytes} [Thu Jun 2 16:15:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 16:15:07.301307 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab37f4b9-9419-4c3c-9f5b-e7231ae26789 None None] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:15:07.311074 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab37f4b9-9419-4c3c-9f5b-e7231ae26789 None None] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:15:07.315686 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fec9ed2-87b5-4ced-9059-6ff5d688c1c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f73d5a98be74242b45222df39fb6213', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:15:07.316327 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fec9ed2-87b5-4ced-9059-6ff5d688c1c2 admin admin] REQUEST_METHOD: `POST` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:15:07.316608 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fec9ed2-87b5-4ced-9059-6ff5d688c1c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:15:07.316884 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fec9ed2-87b5-4ced-9059-6ff5d688c1c2 admin admin] PATH_INFO: `/v3/projects` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:15:07.317578 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fec9ed2-87b5-4ced-9059-6ff5d688c1c2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:15:07.319507 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fec9ed2-87b5-4ced-9059-6ff5d688c1c2 admin admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:15:07.444270 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 1256/2503] 10.222.0.59 () {60 vars in 1152 bytes} [Thu Jun 2 16:15:07 2022] POST /identity/v3/projects => generated 387 bytes in 143 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 02 16:15:07.447910 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ab91b4a-b99e-41a9-81cc-6f192bd13827 admin admin] Authenticating user token {{(pid=80396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:15:07.457758 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ab91b4a-b99e-41a9-81cc-6f192bd13827 admin admin] Validating token access rules against request {{(pid=80396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:15:07.515429 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b86800-be31-4316-b1ea-8c200de7612f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f73d5a98be74242b45222df39fb6213', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:15:07.516093 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b86800-be31-4316-b1ea-8c200de7612f admin admin] REQUEST_METHOD: `POST` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:15:07.516412 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b86800-be31-4316-b1ea-8c200de7612f admin admin] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:15:07.516690 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b86800-be31-4316-b1ea-8c200de7612f admin admin] PATH_INFO: `/v3/users` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:15:07.517378 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4b86800-be31-4316-b1ea-8c200de7612f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:15:07.519327 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4b86800-be31-4316-b1ea-8c200de7612f admin admin] RBAC: Authorization granted {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:15:07.625192 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 1248/2504] 10.222.0.59 () {60 vars in 1143 bytes} [Thu Jun 2 16:15:07 2022] POST /identity/v3/users => generated 294 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 16:15:07.629529 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fec9ed2-87b5-4ced-9059-6ff5d688c1c2 admin admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:15:07.639981 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fec9ed2-87b5-4ced-9059-6ff5d688c1c2 admin admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:15:07.644752 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab89434e-90d4-41a7-abab-17ba888c472b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f73d5a98be74242b45222df39fb6213', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:15:07.645402 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab89434e-90d4-41a7-abab-17ba888c472b admin admin] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:15:07.645685 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab89434e-90d4-41a7-abab-17ba888c472b admin admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:15:07.646017 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab89434e-90d4-41a7-abab-17ba888c472b admin admin] PATH_INFO: `/v3/roles` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:15:07.646764 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab89434e-90d4-41a7-abab-17ba888c472b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:15:07.648354 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab89434e-90d4-41a7-abab-17ba888c472b admin admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:15:07.659302 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 1257/2505] 10.222.0.59 () {58 vars in 1121 bytes} [Thu Jun 2 16:15:07 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 02 16:15:07.663194 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b86800-be31-4316-b1ea-8c200de7612f admin admin] Authenticating user token {{(pid=80396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:15:07.674061 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b86800-be31-4316-b1ea-8c200de7612f admin admin] Validating token access rules against request {{(pid=80396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:15:07.678728 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea82a6ac-0f8c-4a93-8ead-ecbf586bdb03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f73d5a98be74242b45222df39fb6213', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:15:07.679379 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea82a6ac-0f8c-4a93-8ead-ecbf586bdb03 admin admin] REQUEST_METHOD: `GET` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:15:07.679664 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea82a6ac-0f8c-4a93-8ead-ecbf586bdb03 admin admin] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:15:07.679943 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea82a6ac-0f8c-4a93-8ead-ecbf586bdb03 admin admin] PATH_INFO: `/v3/roles` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:15:07.680701 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea82a6ac-0f8c-4a93-8ead-ecbf586bdb03 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:15:07.682744 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea82a6ac-0f8c-4a93-8ead-ecbf586bdb03 admin admin] RBAC: Authorization granted {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:15:07.692618 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 1249/2506] 10.222.0.59 () {58 vars in 1121 bytes} [Thu Jun 2 16:15:07 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 16:15:07.696600 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab89434e-90d4-41a7-abab-17ba888c472b admin admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:15:07.706842 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab89434e-90d4-41a7-abab-17ba888c472b admin admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:15:07.711643 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-565c4ccb-95f6-428f-8210-626d7f9b1ded admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f73d5a98be74242b45222df39fb6213', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:15:07.713503 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-565c4ccb-95f6-428f-8210-626d7f9b1ded admin admin] REQUEST_METHOD: `PUT` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:15:07.713793 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-565c4ccb-95f6-428f-8210-626d7f9b1ded admin admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:15:07.714096 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-565c4ccb-95f6-428f-8210-626d7f9b1ded admin admin] PATH_INFO: `/v3/projects/d09ed720680f4b6cb1055cefc5dc9111/users/9969d14a80b245aea1eb08a8ababb1c9/roles/649e0f2b5a264c419ea6a1441f123a03` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:15:07.729562 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-565c4ccb-95f6-428f-8210-626d7f9b1ded admin admin] RBAC: Authorizing `identity:create_grant(project_id=d09ed720680f4b6cb1055cefc5dc9111, user_id=9969d14a80b245aea1eb08a8ababb1c9, role_id=649e0f2b5a264c419ea6a1441f123a03)` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:15:07.732222 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-565c4ccb-95f6-428f-8210-626d7f9b1ded admin admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:15:07.830393 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 1258/2507] 10.222.0.59 () {60 vars in 1482 bytes} [Thu Jun 2 16:15:07 2022] PUT /identity/v3/projects/d09ed720680f4b6cb1055cefc5dc9111/users/9969d14a80b245aea1eb08a8ababb1c9/roles/649e0f2b5a264c419ea6a1441f123a03 => generated 0 bytes in 134 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 16:15:07.841312 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95132029-6d51-4d59-b6a1-a7bcf97ce842 None None] REQUEST_METHOD: `POST` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:15:07.841609 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95132029-6d51-4d59-b6a1-a7bcf97ce842 None None] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:15:07.841898 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95132029-6d51-4d59-b6a1-a7bcf97ce842 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:15:07.869448 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.auth.core [None req-95132029-6d51-4d59-b6a1-a7bcf97ce842 None None] MFA Rules not processed for user `9969d14a80b245aea1eb08a8ababb1c9`. Rule list: `[]` (Enabled: `True`). {{(pid=80396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 16:15:07.870702 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.fernet_utils [None req-95132029-6d51-4d59-b6a1-a7bcf97ce842 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:15:07.879013 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG dbcounter [-] [80396] Writing DB stats keystone:SELECT=91,keystone:DELETE=5,keystone:INSERT=4 {{(pid=80396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 16:15:07.937543 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 1250/2508] 10.222.0.59 () {58 vars in 957 bytes} [Thu Jun 2 16:15:07 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 02 16:15:07.941879 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-565c4ccb-95f6-428f-8210-626d7f9b1ded admin admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:15:08.005446 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-565c4ccb-95f6-428f-8210-626d7f9b1ded admin admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:15:08.010769 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9ef5daa-d4ab-445d-a741-399023534bbc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f73d5a98be74242b45222df39fb6213', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:15:08.011424 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ef5daa-d4ab-445d-a741-399023534bbc admin admin] REQUEST_METHOD: `POST` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:15:08.012906 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ef5daa-d4ab-445d-a741-399023534bbc admin admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:15:08.012906 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ef5daa-d4ab-445d-a741-399023534bbc admin admin] PATH_INFO: `/v3/projects` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:15:08.012906 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9ef5daa-d4ab-445d-a741-399023534bbc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:15:08.014664 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9ef5daa-d4ab-445d-a741-399023534bbc admin admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:15:08.023071 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 16:15:08.100080 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 1259/2509] 10.222.0.59 () {60 vars in 1152 bytes} [Thu Jun 2 16:15:07 2022] POST /identity/v3/projects => generated 387 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 16:15:08.104320 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95132029-6d51-4d59-b6a1-a7bcf97ce842 None None] Authenticating user token {{(pid=80396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:15:08.115486 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95132029-6d51-4d59-b6a1-a7bcf97ce842 None None] Validating token access rules against request {{(pid=80396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:15:08.171344 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f895d39e-528a-4796-9b44-3cadd3f45a23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f73d5a98be74242b45222df39fb6213', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:15:08.172016 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f895d39e-528a-4796-9b44-3cadd3f45a23 admin admin] REQUEST_METHOD: `POST` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:15:08.172284 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f895d39e-528a-4796-9b44-3cadd3f45a23 admin admin] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:15:08.172561 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f895d39e-528a-4796-9b44-3cadd3f45a23 admin admin] PATH_INFO: `/v3/users` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:15:08.173254 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f895d39e-528a-4796-9b44-3cadd3f45a23 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:15:08.175222 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f895d39e-528a-4796-9b44-3cadd3f45a23 admin admin] RBAC: Authorization granted {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:15:08.259544 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 1251/2510] 10.222.0.59 () {60 vars in 1143 bytes} [Thu Jun 2 16:15:08 2022] POST /identity/v3/users => generated 300 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 16:15:08.264424 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9ef5daa-d4ab-445d-a741-399023534bbc admin admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:15:08.274937 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9ef5daa-d4ab-445d-a741-399023534bbc admin admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:15:08.280131 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-151c3f7a-94ec-4799-989b-609be815481a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f73d5a98be74242b45222df39fb6213', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:15:08.280782 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151c3f7a-94ec-4799-989b-609be815481a admin admin] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:15:08.281086 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151c3f7a-94ec-4799-989b-609be815481a admin admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:15:08.281344 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151c3f7a-94ec-4799-989b-609be815481a admin admin] PATH_INFO: `/v3/roles` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:15:08.282064 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-151c3f7a-94ec-4799-989b-609be815481a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:15:08.283693 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-151c3f7a-94ec-4799-989b-609be815481a admin admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:15:08.296143 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 1260/2511] 10.222.0.59 () {58 vars in 1121 bytes} [Thu Jun 2 16:15:08 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 16:15:08.300286 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f895d39e-528a-4796-9b44-3cadd3f45a23 admin admin] Authenticating user token {{(pid=80396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:15:08.311245 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f895d39e-528a-4796-9b44-3cadd3f45a23 admin admin] Validating token access rules against request {{(pid=80396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:15:08.315979 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e75832b-ac57-46bc-9043-90eb2019e192 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f73d5a98be74242b45222df39fb6213', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:15:08.316876 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e75832b-ac57-46bc-9043-90eb2019e192 admin admin] REQUEST_METHOD: `PUT` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:15:08.317163 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e75832b-ac57-46bc-9043-90eb2019e192 admin admin] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:15:08.317440 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e75832b-ac57-46bc-9043-90eb2019e192 admin admin] PATH_INFO: `/v3/projects/6aa4e3058ff5491eb9ce3595df6a1027/users/3ba3cc2768664a74bb9a3635ad322f1e/roles/f1e0c25f6e9049e897cb7350c7e54ab3` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:15:08.333011 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e75832b-ac57-46bc-9043-90eb2019e192 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6aa4e3058ff5491eb9ce3595df6a1027, user_id=3ba3cc2768664a74bb9a3635ad322f1e, role_id=f1e0c25f6e9049e897cb7350c7e54ab3)` {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:15:08.335708 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e75832b-ac57-46bc-9043-90eb2019e192 admin admin] RBAC: Authorization granted {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:15:08.396130 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 1252/2512] 10.222.0.59 () {60 vars in 1482 bytes} [Thu Jun 2 16:15:08 2022] PUT /identity/v3/projects/6aa4e3058ff5491eb9ce3595df6a1027/users/3ba3cc2768664a74bb9a3635ad322f1e/roles/f1e0c25f6e9049e897cb7350c7e54ab3 => generated 0 bytes in 96 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 16:15:08.400052 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-151c3f7a-94ec-4799-989b-609be815481a admin admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:15:08.410524 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-151c3f7a-94ec-4799-989b-609be815481a admin admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:15:08.466742 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0180ca3e-0f48-4bf4-8aa1-f8dda77d9c02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f73d5a98be74242b45222df39fb6213', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:15:08.467397 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0180ca3e-0f48-4bf4-8aa1-f8dda77d9c02 admin admin] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:15:08.467683 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0180ca3e-0f48-4bf4-8aa1-f8dda77d9c02 admin admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:15:08.467952 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0180ca3e-0f48-4bf4-8aa1-f8dda77d9c02 admin admin] PATH_INFO: `/v3/roles` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:15:08.468662 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0180ca3e-0f48-4bf4-8aa1-f8dda77d9c02 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:15:08.470539 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0180ca3e-0f48-4bf4-8aa1-f8dda77d9c02 admin admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:15:08.480081 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 1261/2513] 10.222.0.59 () {58 vars in 1121 bytes} [Thu Jun 2 16:15:08 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 16:15:08.484747 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e75832b-ac57-46bc-9043-90eb2019e192 admin admin] Authenticating user token {{(pid=80396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:15:08.494921 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e75832b-ac57-46bc-9043-90eb2019e192 admin admin] Validating token access rules against request {{(pid=80396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:15:08.499801 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1682e235-83f8-4314-88e2-cdcf24058c53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f73d5a98be74242b45222df39fb6213', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:15:08.500702 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1682e235-83f8-4314-88e2-cdcf24058c53 admin admin] REQUEST_METHOD: `PUT` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:15:08.500988 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1682e235-83f8-4314-88e2-cdcf24058c53 admin admin] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:15:08.501263 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1682e235-83f8-4314-88e2-cdcf24058c53 admin admin] PATH_INFO: `/v3/projects/6aa4e3058ff5491eb9ce3595df6a1027/users/3ba3cc2768664a74bb9a3635ad322f1e/roles/f1e0c25f6e9049e897cb7350c7e54ab3` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:15:08.503269 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1682e235-83f8-4314-88e2-cdcf24058c53 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6aa4e3058ff5491eb9ce3595df6a1027, user_id=3ba3cc2768664a74bb9a3635ad322f1e, role_id=f1e0c25f6e9049e897cb7350c7e54ab3)` {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:15:08.505879 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1682e235-83f8-4314-88e2-cdcf24058c53 admin admin] RBAC: Authorization granted {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:15:08.516699 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 1253/2514] 10.222.0.59 () {60 vars in 1482 bytes} [Thu Jun 2 16:15:08 2022] PUT /identity/v3/projects/6aa4e3058ff5491eb9ce3595df6a1027/users/3ba3cc2768664a74bb9a3635ad322f1e/roles/f1e0c25f6e9049e897cb7350c7e54ab3 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 16:15:08.526526 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b25434-20e2-414a-adbe-69dcf8751250 None None] REQUEST_METHOD: `POST` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:15:08.526821 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b25434-20e2-414a-adbe-69dcf8751250 None None] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:15:08.527105 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b25434-20e2-414a-adbe-69dcf8751250 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:15:08.553109 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.auth.core [None req-23b25434-20e2-414a-adbe-69dcf8751250 None None] MFA Rules not processed for user `3ba3cc2768664a74bb9a3635ad322f1e`. Rule list: `[]` (Enabled: `True`). {{(pid=80395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 16:15:08.554352 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.fernet_utils [None req-23b25434-20e2-414a-adbe-69dcf8751250 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:15:08.621695 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 1262/2515] 10.222.0.59 () {58 vars in 957 bytes} [Thu Jun 2 16:15:08 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 16:15:08.634431 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1682e235-83f8-4314-88e2-cdcf24058c53 admin admin] Authenticating user token {{(pid=80396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:15:08.636100 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.fernet_utils [None req-1682e235-83f8-4314-88e2-cdcf24058c53 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:15:08.696631 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1682e235-83f8-4314-88e2-cdcf24058c53 admin admin] Validating token access rules against request {{(pid=80396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:15:08.700724 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e604232d-265d-4fc4-b483-eb1732594c06 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6534961c369940a5b88f310c6450250b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c87c981909d4b8db02783421818c79b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:15:08.701355 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e604232d-265d-4fc4-b483-eb1732594c06 service cinder] REQUEST_METHOD: `GET` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:15:08.701634 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e604232d-265d-4fc4-b483-eb1732594c06 service cinder] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:15:08.701904 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e604232d-265d-4fc4-b483-eb1732594c06 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:15:08.710783 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e604232d-265d-4fc4-b483-eb1732594c06 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:15:08.712189 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e604232d-265d-4fc4-b483-eb1732594c06 service cinder] RBAC: Authorization granted {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:15:08.722333 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 1254/2516] 10.222.0.59 () {60 vars in 1365 bytes} [Thu Jun 2 16:15:08 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 16:15:08.855142 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23b25434-20e2-414a-adbe-69dcf8751250 None None] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:15:08.916112 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23b25434-20e2-414a-adbe-69dcf8751250 None None] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:15:08.920613 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59898f55-595d-4ca1-8673-2e52bd4d3243 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f73d5a98be74242b45222df39fb6213', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:15:08.921471 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59898f55-595d-4ca1-8673-2e52bd4d3243 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:15:08.921751 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59898f55-595d-4ca1-8673-2e52bd4d3243 admin admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:15:08.922043 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59898f55-595d-4ca1-8673-2e52bd4d3243 admin admin] PATH_INFO: `/v3/users/9969d14a80b245aea1eb08a8ababb1c9` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:15:08.923228 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59898f55-595d-4ca1-8673-2e52bd4d3243 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9969d14a80b245aea1eb08a8ababb1c9)` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:15:08.925179 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59898f55-595d-4ca1-8673-2e52bd4d3243 admin admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:15:08.926699 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 16:15:09.124492 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.notifications [None req-59898f55-595d-4ca1-8673-2e52bd4d3243 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9969d14a80b245aea1eb08a8ababb1c9'} {{(pid=80395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:15:09.179210 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.notifications [None req-59898f55-595d-4ca1-8673-2e52bd4d3243 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9969d14a80b245aea1eb08a8ababb1c9'} {{(pid=80395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:15:09.193012 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.notifications [None req-59898f55-595d-4ca1-8673-2e52bd4d3243 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9969d14a80b245aea1eb08a8ababb1c9'} {{(pid=80395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:15:09.193749 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.notifications [None req-59898f55-595d-4ca1-8673-2e52bd4d3243 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9969d14a80b245aea1eb08a8ababb1c9'} {{(pid=80395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:15:09.201067 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.notifications [None req-59898f55-595d-4ca1-8673-2e52bd4d3243 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9969d14a80b245aea1eb08a8ababb1c9'} {{(pid=80395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:15:09.207133 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 1263/2517] 10.222.0.59 () {58 vars in 1223 bytes} [Thu Jun 2 16:15:08 2022] DELETE /identity/v3/users/9969d14a80b245aea1eb08a8ababb1c9 => generated 0 bytes in 353 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 16:15:09.211564 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66e08bc-ad11-40ec-b009-67fae87a3178 None None] REQUEST_METHOD: `POST` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:15:09.212058 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66e08bc-ad11-40ec-b009-67fae87a3178 None None] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:15:09.212179 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66e08bc-ad11-40ec-b009-67fae87a3178 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:15:09.219022 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG dbcounter [-] [80396] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 16:15:09.229886 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.auth.core [None req-c66e08bc-ad11-40ec-b009-67fae87a3178 None None] MFA Rules not processed for user `400d1f4db9de49638549e5db29a041e1`. Rule list: `[]` (Enabled: `True`). {{(pid=80396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 16:15:09.231668 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.fernet_utils [None req-c66e08bc-ad11-40ec-b009-67fae87a3178 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:15:09.290304 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 1255/2518] 10.222.0.59 () {58 vars in 957 bytes} [Thu Jun 2 16:15:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 02 16:15:09.300662 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59898f55-595d-4ca1-8673-2e52bd4d3243 admin admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:15:09.302110 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.fernet_utils [None req-59898f55-595d-4ca1-8673-2e52bd4d3243 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:15:09.360399 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59898f55-595d-4ca1-8673-2e52bd4d3243 admin admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:15:09.364032 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b9d55d0-de8d-45d9-a82a-722efa637e32 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9af40ddfe9ff4be3887b068f13a28dc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c87c981909d4b8db02783421818c79b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:15:09.364671 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b9d55d0-de8d-45d9-a82a-722efa637e32 service neutron] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:15:09.364957 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b9d55d0-de8d-45d9-a82a-722efa637e32 service neutron] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:15:09.365237 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b9d55d0-de8d-45d9-a82a-722efa637e32 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:15:09.374848 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b9d55d0-de8d-45d9-a82a-722efa637e32 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:15:09.376223 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b9d55d0-de8d-45d9-a82a-722efa637e32 service neutron] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:15:09.387725 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 1264/2519] 10.222.0.59 () {60 vars in 1365 bytes} [Thu Jun 2 16:15:09 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 16:15:09.767856 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c66e08bc-ad11-40ec-b009-67fae87a3178 None None] Authenticating user token {{(pid=80396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:15:09.772386 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.fernet_utils [None req-c66e08bc-ad11-40ec-b009-67fae87a3178 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:15:09.782358 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c66e08bc-ad11-40ec-b009-67fae87a3178 None None] Validating token access rules against request {{(pid=80396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:15:09.787190 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6f85fcd-6b49-4c2d-b39e-e9eec08c18e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f73d5a98be74242b45222df39fb6213', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:15:09.788081 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f85fcd-6b49-4c2d-b39e-e9eec08c18e9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:15:09.788368 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f85fcd-6b49-4c2d-b39e-e9eec08c18e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:15:09.788647 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f85fcd-6b49-4c2d-b39e-e9eec08c18e9 admin admin] PATH_INFO: `/v3/projects/d09ed720680f4b6cb1055cefc5dc9111` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:15:09.790614 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6f85fcd-6b49-4c2d-b39e-e9eec08c18e9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d09ed720680f4b6cb1055cefc5dc9111)` {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:15:09.792570 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6f85fcd-6b49-4c2d-b39e-e9eec08c18e9 admin admin] RBAC: Authorization granted {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:15:09.925928 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.notifications [None req-d6f85fcd-6b49-4c2d-b39e-e9eec08c18e9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd09ed720680f4b6cb1055cefc5dc9111', 'request_id': 'req-d6f85fcd-6b49-4c2d-b39e-e9eec08c18e9'} {{(pid=80396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:15:09.932072 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.notifications [None req-d6f85fcd-6b49-4c2d-b39e-e9eec08c18e9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd09ed720680f4b6cb1055cefc5dc9111', 'request_id': 'req-d6f85fcd-6b49-4c2d-b39e-e9eec08c18e9'} {{(pid=80396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:15:10.001307 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.notifications [None req-d6f85fcd-6b49-4c2d-b39e-e9eec08c18e9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd09ed720680f4b6cb1055cefc5dc9111', 'request_id': 'req-d6f85fcd-6b49-4c2d-b39e-e9eec08c18e9'} {{(pid=80396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:15:10.015009 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.notifications [None req-d6f85fcd-6b49-4c2d-b39e-e9eec08c18e9 admin admin] The token cache is being invalidate because project d09ed720680f4b6cb1055cefc5dc9111 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80396) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 02 16:15:10.015302 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.notifications [None req-d6f85fcd-6b49-4c2d-b39e-e9eec08c18e9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:15:10.015938 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.notifications [None req-d6f85fcd-6b49-4c2d-b39e-e9eec08c18e9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:15:10.017663 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 1256/2520] 10.222.0.59 () {58 vars in 1232 bytes} [Thu Jun 2 16:15:09 2022] DELETE /identity/v3/projects/d09ed720680f4b6cb1055cefc5dc9111 => generated 0 bytes in 250 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 16:15:10.021670 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b9d55d0-de8d-45d9-a82a-722efa637e32 service neutron] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:15:10.031821 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b9d55d0-de8d-45d9-a82a-722efa637e32 service neutron] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:15:10.086928 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f6ad6d7-b5f8-4dd4-aeba-a46d29c60124 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f73d5a98be74242b45222df39fb6213', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:15:10.087793 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f6ad6d7-b5f8-4dd4-aeba-a46d29c60124 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:15:10.088072 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f6ad6d7-b5f8-4dd4-aeba-a46d29c60124 admin admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:15:10.088347 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f6ad6d7-b5f8-4dd4-aeba-a46d29c60124 admin admin] PATH_INFO: `/v3/users/3ba3cc2768664a74bb9a3635ad322f1e` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:15:10.089513 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f6ad6d7-b5f8-4dd4-aeba-a46d29c60124 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3ba3cc2768664a74bb9a3635ad322f1e)` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:15:10.092250 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f6ad6d7-b5f8-4dd4-aeba-a46d29c60124 admin admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:15:10.114170 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 16:15:10.306034 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.notifications [None req-8f6ad6d7-b5f8-4dd4-aeba-a46d29c60124 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3ba3cc2768664a74bb9a3635ad322f1e'} {{(pid=80395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:15:10.389192 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.notifications [None req-8f6ad6d7-b5f8-4dd4-aeba-a46d29c60124 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3ba3cc2768664a74bb9a3635ad322f1e'} {{(pid=80395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:15:10.401516 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.notifications [None req-8f6ad6d7-b5f8-4dd4-aeba-a46d29c60124 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3ba3cc2768664a74bb9a3635ad322f1e'} {{(pid=80395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:15:10.405399 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.notifications [None req-8f6ad6d7-b5f8-4dd4-aeba-a46d29c60124 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3ba3cc2768664a74bb9a3635ad322f1e'} {{(pid=80395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:15:10.409199 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.notifications [None req-8f6ad6d7-b5f8-4dd4-aeba-a46d29c60124 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3ba3cc2768664a74bb9a3635ad322f1e'} {{(pid=80395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:15:10.415040 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 1265/2521] 10.222.0.59 () {58 vars in 1223 bytes} [Thu Jun 2 16:15:10 2022] DELETE /identity/v3/users/3ba3cc2768664a74bb9a3635ad322f1e => generated 0 bytes in 394 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 02 16:15:10.813639 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6f85fcd-6b49-4c2d-b39e-e9eec08c18e9 admin admin] Authenticating user token {{(pid=80396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:15:10.815141 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.fernet_utils [None req-d6f85fcd-6b49-4c2d-b39e-e9eec08c18e9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:15:10.830792 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6f85fcd-6b49-4c2d-b39e-e9eec08c18e9 admin admin] Validating token access rules against request {{(pid=80396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:15:10.890486 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc385d0-1b9d-4fc6-b7a5-2b21f8e88654 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f73d5a98be74242b45222df39fb6213', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:15:10.891353 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc385d0-1b9d-4fc6-b7a5-2b21f8e88654 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:15:10.891636 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc385d0-1b9d-4fc6-b7a5-2b21f8e88654 admin admin] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:15:10.891911 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc385d0-1b9d-4fc6-b7a5-2b21f8e88654 admin admin] PATH_INFO: `/v3/projects/6aa4e3058ff5491eb9ce3595df6a1027` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:15:10.893227 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fc385d0-1b9d-4fc6-b7a5-2b21f8e88654 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6aa4e3058ff5491eb9ce3595df6a1027)` {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:15:10.895171 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fc385d0-1b9d-4fc6-b7a5-2b21f8e88654 admin admin] RBAC: Authorization granted {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:15:11.046315 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG dbcounter [-] [80396] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=80396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 16:15:11.058726 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.notifications [None req-9fc385d0-1b9d-4fc6-b7a5-2b21f8e88654 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6aa4e3058ff5491eb9ce3595df6a1027', 'request_id': 'req-9fc385d0-1b9d-4fc6-b7a5-2b21f8e88654'} {{(pid=80396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:15:11.065750 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.notifications [None req-9fc385d0-1b9d-4fc6-b7a5-2b21f8e88654 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6aa4e3058ff5491eb9ce3595df6a1027', 'request_id': 'req-9fc385d0-1b9d-4fc6-b7a5-2b21f8e88654'} {{(pid=80396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:15:11.161638 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.notifications [None req-9fc385d0-1b9d-4fc6-b7a5-2b21f8e88654 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6aa4e3058ff5491eb9ce3595df6a1027', 'request_id': 'req-9fc385d0-1b9d-4fc6-b7a5-2b21f8e88654'} {{(pid=80396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:15:11.173392 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.notifications [None req-9fc385d0-1b9d-4fc6-b7a5-2b21f8e88654 admin admin] The token cache is being invalidate because project 6aa4e3058ff5491eb9ce3595df6a1027 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80396) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 02 16:15:11.173768 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.notifications [None req-9fc385d0-1b9d-4fc6-b7a5-2b21f8e88654 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:15:11.175020 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.notifications [None req-9fc385d0-1b9d-4fc6-b7a5-2b21f8e88654 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:15:11.176621 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 1257/2522] 10.222.0.59 () {58 vars in 1232 bytes} [Thu Jun 2 16:15:10 2022] DELETE /identity/v3/projects/6aa4e3058ff5491eb9ce3595df6a1027 => generated 0 bytes in 364 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 16:15:11.181671 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda7aebc-b3c3-4bb4-aab4-ef6b258d27e0 None None] REQUEST_METHOD: `POST` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:15:11.182149 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda7aebc-b3c3-4bb4-aab4-ef6b258d27e0 None None] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:15:11.182250 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda7aebc-b3c3-4bb4-aab4-ef6b258d27e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:15:11.200886 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.auth.core [None req-bda7aebc-b3c3-4bb4-aab4-ef6b258d27e0 None None] MFA Rules not processed for user `400d1f4db9de49638549e5db29a041e1`. Rule list: `[]` (Enabled: `True`). {{(pid=80395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 16:15:11.202064 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.fernet_utils [None req-bda7aebc-b3c3-4bb4-aab4-ef6b258d27e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:15:11.265901 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 1266/2523] 10.222.0.59 () {58 vars in 957 bytes} [Thu Jun 2 16:15:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 16:15:11.274695 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f755407-556a-48c1-8560-90295b0feb44 None None] REQUEST_METHOD: `POST` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:15:11.274973 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f755407-556a-48c1-8560-90295b0feb44 None None] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:15:11.275272 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f755407-556a-48c1-8560-90295b0feb44 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:15:11.294401 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.auth.core [None req-5f755407-556a-48c1-8560-90295b0feb44 None None] MFA Rules not processed for user `400d1f4db9de49638549e5db29a041e1`. Rule list: `[]` (Enabled: `True`). {{(pid=80396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 16:15:11.295590 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.fernet_utils [None req-5f755407-556a-48c1-8560-90295b0feb44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:15:11.303282 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 1258/2524] 10.222.0.59 () {58 vars in 957 bytes} [Thu Jun 2 16:15:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 02 16:15:11.311055 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bda7aebc-b3c3-4bb4-aab4-ef6b258d27e0 None None] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:15:11.320863 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bda7aebc-b3c3-4bb4-aab4-ef6b258d27e0 None None] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:15:11.325606 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09d34b34-56f4-4a97-b212-d3afd933f191 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f73d5a98be74242b45222df39fb6213', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:15:11.326351 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d34b34-56f4-4a97-b212-d3afd933f191 admin admin] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:15:11.326633 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d34b34-56f4-4a97-b212-d3afd933f191 admin admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:15:11.326910 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d34b34-56f4-4a97-b212-d3afd933f191 admin admin] PATH_INFO: `/v3/domains` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:15:11.327634 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09d34b34-56f4-4a97-b212-d3afd933f191 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80395) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 16:15:11.327933 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09d34b34-56f4-4a97-b212-d3afd933f191 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:15:11.329527 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09d34b34-56f4-4a97-b212-d3afd933f191 admin admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:15:11.342122 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 1267/2525] 10.222.0.59 () {58 vars in 1152 bytes} [Thu Jun 2 16:15:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 16:15:11.346398 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f755407-556a-48c1-8560-90295b0feb44 None None] Authenticating user token {{(pid=80396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:15:11.355480 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f755407-556a-48c1-8560-90295b0feb44 None None] Validating token access rules against request {{(pid=80396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:15:11.360686 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3775431-9dee-4b83-864f-24733ff89f64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f73d5a98be74242b45222df39fb6213', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:15:11.361319 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3775431-9dee-4b83-864f-24733ff89f64 admin admin] REQUEST_METHOD: `POST` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:15:11.361598 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3775431-9dee-4b83-864f-24733ff89f64 admin admin] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:15:11.361871 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3775431-9dee-4b83-864f-24733ff89f64 admin admin] PATH_INFO: `/v3/projects` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:15:11.362615 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3775431-9dee-4b83-864f-24733ff89f64 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:15:11.364489 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3775431-9dee-4b83-864f-24733ff89f64 admin admin] RBAC: Authorization granted {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:15:11.448705 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 1259/2526] 10.222.0.59 () {60 vars in 1152 bytes} [Thu Jun 2 16:15:11 2022] POST /identity/v3/projects => generated 381 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 02 16:15:11.453353 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09d34b34-56f4-4a97-b212-d3afd933f191 admin admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:15:11.463102 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09d34b34-56f4-4a97-b212-d3afd933f191 admin admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:15:11.518379 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44d68956-3a7e-4233-9057-3750e4765c81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f73d5a98be74242b45222df39fb6213', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:15:11.519034 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d68956-3a7e-4233-9057-3750e4765c81 admin admin] REQUEST_METHOD: `POST` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:15:11.519316 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d68956-3a7e-4233-9057-3750e4765c81 admin admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:15:11.519590 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d68956-3a7e-4233-9057-3750e4765c81 admin admin] PATH_INFO: `/v3/users` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:15:11.520280 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44d68956-3a7e-4233-9057-3750e4765c81 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:15:11.522434 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44d68956-3a7e-4233-9057-3750e4765c81 admin admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:15:11.625417 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 1268/2527] 10.222.0.59 () {60 vars in 1143 bytes} [Thu Jun 2 16:15:11 2022] POST /identity/v3/users => generated 291 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 16:15:11.629646 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3775431-9dee-4b83-864f-24733ff89f64 admin admin] Authenticating user token {{(pid=80396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:15:11.641122 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3775431-9dee-4b83-864f-24733ff89f64 admin admin] Validating token access rules against request {{(pid=80396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:15:11.645749 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c079ec6-f56e-41cd-b125-6ae6bae8e96a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f73d5a98be74242b45222df39fb6213', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:15:11.646448 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c079ec6-f56e-41cd-b125-6ae6bae8e96a admin admin] REQUEST_METHOD: `GET` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:15:11.646736 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c079ec6-f56e-41cd-b125-6ae6bae8e96a admin admin] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:15:11.647015 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c079ec6-f56e-41cd-b125-6ae6bae8e96a admin admin] PATH_INFO: `/v3/roles` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:15:11.647824 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c079ec6-f56e-41cd-b125-6ae6bae8e96a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:15:11.649422 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c079ec6-f56e-41cd-b125-6ae6bae8e96a admin admin] RBAC: Authorization granted {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:15:11.660317 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 1260/2528] 10.222.0.59 () {58 vars in 1121 bytes} [Thu Jun 2 16:15:11 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 16:15:11.664352 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44d68956-3a7e-4233-9057-3750e4765c81 admin admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:15:11.674777 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44d68956-3a7e-4233-9057-3750e4765c81 admin admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:15:11.679506 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b45f5c31-5ec2-435a-bdf0-9db9d104012e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f73d5a98be74242b45222df39fb6213', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:15:11.680571 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b45f5c31-5ec2-435a-bdf0-9db9d104012e admin admin] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:15:11.680571 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b45f5c31-5ec2-435a-bdf0-9db9d104012e admin admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:15:11.680781 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b45f5c31-5ec2-435a-bdf0-9db9d104012e admin admin] PATH_INFO: `/v3/roles` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:15:11.681497 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b45f5c31-5ec2-435a-bdf0-9db9d104012e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:15:11.683157 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b45f5c31-5ec2-435a-bdf0-9db9d104012e admin admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:15:11.695208 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 1269/2529] 10.222.0.59 () {58 vars in 1121 bytes} [Thu Jun 2 16:15:11 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 02 16:15:11.699379 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c079ec6-f56e-41cd-b125-6ae6bae8e96a admin admin] Authenticating user token {{(pid=80396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:15:11.709953 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c079ec6-f56e-41cd-b125-6ae6bae8e96a admin admin] Validating token access rules against request {{(pid=80396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:15:11.714561 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b7a688f-35e5-448b-96f5-d0811f297109 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f73d5a98be74242b45222df39fb6213', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:15:11.715422 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b7a688f-35e5-448b-96f5-d0811f297109 admin admin] REQUEST_METHOD: `PUT` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:15:11.715706 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b7a688f-35e5-448b-96f5-d0811f297109 admin admin] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:15:11.715983 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b7a688f-35e5-448b-96f5-d0811f297109 admin admin] PATH_INFO: `/v3/projects/3e212086aed64da7b2e1a4106b195114/users/dd65d49305f44a6fa50ec68c103d225c/roles/649e0f2b5a264c419ea6a1441f123a03` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:15:11.732377 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b7a688f-35e5-448b-96f5-d0811f297109 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3e212086aed64da7b2e1a4106b195114, user_id=dd65d49305f44a6fa50ec68c103d225c, role_id=649e0f2b5a264c419ea6a1441f123a03)` {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:15:11.735100 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b7a688f-35e5-448b-96f5-d0811f297109 admin admin] RBAC: Authorization granted {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:15:11.824507 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 1261/2530] 10.222.0.59 () {60 vars in 1482 bytes} [Thu Jun 2 16:15:11 2022] PUT /identity/v3/projects/3e212086aed64da7b2e1a4106b195114/users/dd65d49305f44a6fa50ec68c103d225c/roles/649e0f2b5a264c419ea6a1441f123a03 => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 16:15:11.835649 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0db1b2-d9e1-4487-9f4a-9600d4da472e None None] REQUEST_METHOD: `POST` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:15:11.835858 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0db1b2-d9e1-4487-9f4a-9600d4da472e None None] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:15:11.836133 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0db1b2-d9e1-4487-9f4a-9600d4da472e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:15:11.848711 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writing DB stats keystone:SELECT=90,keystone:DELETE=6,keystone:INSERT=4 {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 16:15:11.863412 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.auth.core [None req-2c0db1b2-d9e1-4487-9f4a-9600d4da472e None None] MFA Rules not processed for user `dd65d49305f44a6fa50ec68c103d225c`. Rule list: `[]` (Enabled: `True`). {{(pid=80395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 16:15:11.864617 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.fernet_utils [None req-2c0db1b2-d9e1-4487-9f4a-9600d4da472e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:15:11.928640 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 1270/2531] 10.222.0.59 () {58 vars in 957 bytes} [Thu Jun 2 16:15:11 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 16:15:11.933400 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b7a688f-35e5-448b-96f5-d0811f297109 admin admin] Authenticating user token {{(pid=80396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:15:11.994187 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b7a688f-35e5-448b-96f5-d0811f297109 admin admin] Validating token access rules against request {{(pid=80396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:15:11.999377 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3caeeab9-1859-477c-9295-6c56d7d1d8fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f73d5a98be74242b45222df39fb6213', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:15:12.000019 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3caeeab9-1859-477c-9295-6c56d7d1d8fc admin admin] REQUEST_METHOD: `POST` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:15:12.000307 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3caeeab9-1859-477c-9295-6c56d7d1d8fc admin admin] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:15:12.000584 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3caeeab9-1859-477c-9295-6c56d7d1d8fc admin admin] PATH_INFO: `/v3/projects` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:15:12.001278 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3caeeab9-1859-477c-9295-6c56d7d1d8fc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:15:12.003204 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3caeeab9-1859-477c-9295-6c56d7d1d8fc admin admin] RBAC: Authorization granted {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:15:12.100616 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 1262/2532] 10.222.0.59 () {60 vars in 1152 bytes} [Thu Jun 2 16:15:11 2022] POST /identity/v3/projects => generated 383 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 02 16:15:12.104568 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c0db1b2-d9e1-4487-9f4a-9600d4da472e None None] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:15:12.115409 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c0db1b2-d9e1-4487-9f4a-9600d4da472e None None] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:15:12.171285 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58f93fd4-113e-4771-85dd-3d31a90b4de5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f73d5a98be74242b45222df39fb6213', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:15:12.171953 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f93fd4-113e-4771-85dd-3d31a90b4de5 admin admin] REQUEST_METHOD: `POST` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:15:12.172245 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f93fd4-113e-4771-85dd-3d31a90b4de5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:15:12.172518 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f93fd4-113e-4771-85dd-3d31a90b4de5 admin admin] PATH_INFO: `/v3/users` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:15:12.173209 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58f93fd4-113e-4771-85dd-3d31a90b4de5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:15:12.175190 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58f93fd4-113e-4771-85dd-3d31a90b4de5 admin admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:15:12.287844 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 1271/2533] 10.222.0.59 () {60 vars in 1143 bytes} [Thu Jun 2 16:15:12 2022] POST /identity/v3/users => generated 298 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 16:15:12.291762 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3caeeab9-1859-477c-9295-6c56d7d1d8fc admin admin] Authenticating user token {{(pid=80396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:15:12.302868 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3caeeab9-1859-477c-9295-6c56d7d1d8fc admin admin] Validating token access rules against request {{(pid=80396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:15:12.307916 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-653ed9b6-97a2-4f2c-8a95-9214eca98ba5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f73d5a98be74242b45222df39fb6213', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:15:12.308225 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653ed9b6-97a2-4f2c-8a95-9214eca98ba5 admin admin] REQUEST_METHOD: `GET` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:15:12.308507 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653ed9b6-97a2-4f2c-8a95-9214eca98ba5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:15:12.308780 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653ed9b6-97a2-4f2c-8a95-9214eca98ba5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:15:12.309494 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-653ed9b6-97a2-4f2c-8a95-9214eca98ba5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:15:12.311709 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-653ed9b6-97a2-4f2c-8a95-9214eca98ba5 admin admin] RBAC: Authorization granted {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:15:12.322442 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 1263/2534] 10.222.0.59 () {58 vars in 1121 bytes} [Thu Jun 2 16:15:12 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 16:15:12.326617 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58f93fd4-113e-4771-85dd-3d31a90b4de5 admin admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:15:12.336828 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58f93fd4-113e-4771-85dd-3d31a90b4de5 admin admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:15:12.341378 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c42fbc0b-bbf1-4dd2-ba80-538c4c82b9c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f73d5a98be74242b45222df39fb6213', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:15:12.342374 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42fbc0b-bbf1-4dd2-ba80-538c4c82b9c7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:15:12.342800 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42fbc0b-bbf1-4dd2-ba80-538c4c82b9c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:15:12.343077 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42fbc0b-bbf1-4dd2-ba80-538c4c82b9c7 admin admin] PATH_INFO: `/v3/projects/c5bdf982a6a04a47a0d650a3c12f5432/users/1a2492dda2a34c4a8f0cbef226cc77fb/roles/f1e0c25f6e9049e897cb7350c7e54ab3` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:15:12.358236 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c42fbc0b-bbf1-4dd2-ba80-538c4c82b9c7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c5bdf982a6a04a47a0d650a3c12f5432, user_id=1a2492dda2a34c4a8f0cbef226cc77fb, role_id=f1e0c25f6e9049e897cb7350c7e54ab3)` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:15:12.360885 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c42fbc0b-bbf1-4dd2-ba80-538c4c82b9c7 admin admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:15:12.476539 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 1272/2535] 10.222.0.59 () {60 vars in 1482 bytes} [Thu Jun 2 16:15:12 2022] PUT /identity/v3/projects/c5bdf982a6a04a47a0d650a3c12f5432/users/1a2492dda2a34c4a8f0cbef226cc77fb/roles/f1e0c25f6e9049e897cb7350c7e54ab3 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 16:15:12.480537 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-653ed9b6-97a2-4f2c-8a95-9214eca98ba5 admin admin] Authenticating user token {{(pid=80396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:15:12.491180 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-653ed9b6-97a2-4f2c-8a95-9214eca98ba5 admin admin] Validating token access rules against request {{(pid=80396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:15:12.517268 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG dbcounter [-] [80396] Writing DB stats keystone:SELECT=91,keystone:DELETE=5,keystone:INSERT=4 {{(pid=80396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 16:15:12.547687 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a291843b-12c3-4cd1-a9ca-02fb33619a63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f73d5a98be74242b45222df39fb6213', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:15:12.548346 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a291843b-12c3-4cd1-a9ca-02fb33619a63 admin admin] REQUEST_METHOD: `GET` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:15:12.548730 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a291843b-12c3-4cd1-a9ca-02fb33619a63 admin admin] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:15:12.548950 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a291843b-12c3-4cd1-a9ca-02fb33619a63 admin admin] PATH_INFO: `/v3/roles` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:15:12.549668 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a291843b-12c3-4cd1-a9ca-02fb33619a63 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:15:12.551328 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a291843b-12c3-4cd1-a9ca-02fb33619a63 admin admin] RBAC: Authorization granted {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:15:12.561472 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 1264/2536] 10.222.0.59 () {58 vars in 1121 bytes} [Thu Jun 2 16:15:12 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 16:15:12.565680 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c42fbc0b-bbf1-4dd2-ba80-538c4c82b9c7 admin admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:15:12.575918 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c42fbc0b-bbf1-4dd2-ba80-538c4c82b9c7 admin admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:15:12.580886 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3743edb5-3efa-4e6f-95e7-8759ac736fee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f73d5a98be74242b45222df39fb6213', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:15:12.581785 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3743edb5-3efa-4e6f-95e7-8759ac736fee admin admin] REQUEST_METHOD: `PUT` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:15:12.582089 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3743edb5-3efa-4e6f-95e7-8759ac736fee admin admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:15:12.582397 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3743edb5-3efa-4e6f-95e7-8759ac736fee admin admin] PATH_INFO: `/v3/projects/c5bdf982a6a04a47a0d650a3c12f5432/users/1a2492dda2a34c4a8f0cbef226cc77fb/roles/f1e0c25f6e9049e897cb7350c7e54ab3` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:15:12.584424 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3743edb5-3efa-4e6f-95e7-8759ac736fee admin admin] RBAC: Authorizing `identity:create_grant(project_id=c5bdf982a6a04a47a0d650a3c12f5432, user_id=1a2492dda2a34c4a8f0cbef226cc77fb, role_id=f1e0c25f6e9049e897cb7350c7e54ab3)` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:15:12.587154 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3743edb5-3efa-4e6f-95e7-8759ac736fee admin admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:15:12.598019 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 1273/2537] 10.222.0.59 () {60 vars in 1482 bytes} [Thu Jun 2 16:15:12 2022] PUT /identity/v3/projects/c5bdf982a6a04a47a0d650a3c12f5432/users/1a2492dda2a34c4a8f0cbef226cc77fb/roles/f1e0c25f6e9049e897cb7350c7e54ab3 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 16:15:12.612428 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b7a733-b65c-452e-9e95-8b141b93b260 None None] REQUEST_METHOD: `POST` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:15:12.612671 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b7a733-b65c-452e-9e95-8b141b93b260 None None] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:15:12.612933 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b7a733-b65c-452e-9e95-8b141b93b260 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:15:12.640583 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.auth.core [None req-b2b7a733-b65c-452e-9e95-8b141b93b260 None None] MFA Rules not processed for user `1a2492dda2a34c4a8f0cbef226cc77fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 16:15:12.641781 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.fernet_utils [None req-b2b7a733-b65c-452e-9e95-8b141b93b260 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:15:12.709713 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 1265/2538] 10.222.0.59 () {58 vars in 957 bytes} [Thu Jun 2 16:15:12 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 16:15:12.721996 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3743edb5-3efa-4e6f-95e7-8759ac736fee admin admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:15:12.723703 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.fernet_utils [None req-3743edb5-3efa-4e6f-95e7-8759ac736fee admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:15:12.777933 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 16:15:12.781833 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3743edb5-3efa-4e6f-95e7-8759ac736fee admin admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:15:12.785516 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17572983-a825-417c-b952-aee7fda4048b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6534961c369940a5b88f310c6450250b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c87c981909d4b8db02783421818c79b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:15:12.786301 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17572983-a825-417c-b952-aee7fda4048b service cinder] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:15:12.786585 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17572983-a825-417c-b952-aee7fda4048b service cinder] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:15:12.786859 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17572983-a825-417c-b952-aee7fda4048b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:15:12.795762 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17572983-a825-417c-b952-aee7fda4048b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:15:12.797634 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17572983-a825-417c-b952-aee7fda4048b service cinder] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:15:12.806778 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 1274/2539] 10.222.0.59 () {60 vars in 1365 bytes} [Thu Jun 2 16:15:12 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 16:15:12.975236 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2b7a733-b65c-452e-9e95-8b141b93b260 None None] Authenticating user token {{(pid=80396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:15:12.985312 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2b7a733-b65c-452e-9e95-8b141b93b260 None None] Validating token access rules against request {{(pid=80396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:15:12.988851 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee7513e5-bb49-42cb-802d-2316e7b351b9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6534961c369940a5b88f310c6450250b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c87c981909d4b8db02783421818c79b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:15:12.989473 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7513e5-bb49-42cb-802d-2316e7b351b9 service cinder] REQUEST_METHOD: `GET` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:15:12.989751 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7513e5-bb49-42cb-802d-2316e7b351b9 service cinder] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:15:12.990022 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7513e5-bb49-42cb-802d-2316e7b351b9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:15:13.046062 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee7513e5-bb49-42cb-802d-2316e7b351b9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:15:13.047518 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee7513e5-bb49-42cb-802d-2316e7b351b9 service cinder] RBAC: Authorization granted {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:15:13.056358 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 1266/2540] 10.222.0.59 () {60 vars in 1365 bytes} [Thu Jun 2 16:15:12 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 16:15:13.536750 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17572983-a825-417c-b952-aee7fda4048b service cinder] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:15:13.599840 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17572983-a825-417c-b952-aee7fda4048b service cinder] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:15:13.604363 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adeeebb1-d27d-4fab-881e-fa574fdaa276 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f73d5a98be74242b45222df39fb6213', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:15:13.609486 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adeeebb1-d27d-4fab-881e-fa574fdaa276 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:15:13.609486 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adeeebb1-d27d-4fab-881e-fa574fdaa276 admin admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:15:13.609486 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adeeebb1-d27d-4fab-881e-fa574fdaa276 admin admin] PATH_INFO: `/v3/users/dd65d49305f44a6fa50ec68c103d225c` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:15:13.609486 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adeeebb1-d27d-4fab-881e-fa574fdaa276 admin admin] RBAC: Authorizing `identity:delete_user(user_id=dd65d49305f44a6fa50ec68c103d225c)` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:15:13.609486 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adeeebb1-d27d-4fab-881e-fa574fdaa276 admin admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:15:13.826130 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.notifications [None req-adeeebb1-d27d-4fab-881e-fa574fdaa276 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dd65d49305f44a6fa50ec68c103d225c'} {{(pid=80395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:15:13.897059 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.notifications [None req-adeeebb1-d27d-4fab-881e-fa574fdaa276 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dd65d49305f44a6fa50ec68c103d225c'} {{(pid=80395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:15:13.909457 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.notifications [None req-adeeebb1-d27d-4fab-881e-fa574fdaa276 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dd65d49305f44a6fa50ec68c103d225c'} {{(pid=80395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:15:13.910104 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.notifications [None req-adeeebb1-d27d-4fab-881e-fa574fdaa276 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dd65d49305f44a6fa50ec68c103d225c'} {{(pid=80395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:15:13.916889 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.notifications [None req-adeeebb1-d27d-4fab-881e-fa574fdaa276 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dd65d49305f44a6fa50ec68c103d225c'} {{(pid=80395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:15:13.923342 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 1275/2541] 10.222.0.59 () {58 vars in 1223 bytes} [Thu Jun 2 16:15:13 2022] DELETE /identity/v3/users/dd65d49305f44a6fa50ec68c103d225c => generated 0 bytes in 387 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 16:15:13.927866 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9719e241-1c49-43a3-b575-9b082345e05a None None] REQUEST_METHOD: `POST` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:15:13.928154 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9719e241-1c49-43a3-b575-9b082345e05a None None] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:15:13.928434 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9719e241-1c49-43a3-b575-9b082345e05a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:15:13.946709 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.auth.core [None req-9719e241-1c49-43a3-b575-9b082345e05a None None] MFA Rules not processed for user `400d1f4db9de49638549e5db29a041e1`. Rule list: `[]` (Enabled: `True`). {{(pid=80396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 16:15:13.947903 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.fernet_utils [None req-9719e241-1c49-43a3-b575-9b082345e05a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:15:13.990593 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG dbcounter [-] [80396] Writing DB stats keystone:SELECT=100 {{(pid=80396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 16:15:14.006421 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 1267/2542] 10.222.0.59 () {58 vars in 957 bytes} [Thu Jun 2 16:15:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 02 16:15:14.016106 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adeeebb1-d27d-4fab-881e-fa574fdaa276 admin admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:15:14.017578 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.fernet_utils [None req-adeeebb1-d27d-4fab-881e-fa574fdaa276 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:15:14.074613 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adeeebb1-d27d-4fab-881e-fa574fdaa276 admin admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:15:14.078693 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f59b268d-9ced-49ec-8401-bea07661c169 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9af40ddfe9ff4be3887b068f13a28dc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c87c981909d4b8db02783421818c79b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:15:14.079332 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f59b268d-9ced-49ec-8401-bea07661c169 service neutron] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:15:14.079613 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f59b268d-9ced-49ec-8401-bea07661c169 service neutron] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:15:14.079887 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f59b268d-9ced-49ec-8401-bea07661c169 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:15:14.088849 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f59b268d-9ced-49ec-8401-bea07661c169 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:15:14.090316 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f59b268d-9ced-49ec-8401-bea07661c169 service neutron] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:15:14.100489 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 1276/2543] 10.222.0.59 () {60 vars in 1365 bytes} [Thu Jun 2 16:15:14 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 16:15:14.517941 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9719e241-1c49-43a3-b575-9b082345e05a None None] Authenticating user token {{(pid=80396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:15:14.519477 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.fernet_utils [None req-9719e241-1c49-43a3-b575-9b082345e05a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:15:14.532152 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9719e241-1c49-43a3-b575-9b082345e05a None None] Validating token access rules against request {{(pid=80396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:15:14.536936 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2664dcf-7fac-4f95-b88b-1677fab3b23b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f73d5a98be74242b45222df39fb6213', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:15:14.537801 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2664dcf-7fac-4f95-b88b-1677fab3b23b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:15:14.538095 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2664dcf-7fac-4f95-b88b-1677fab3b23b admin admin] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:15:14.538445 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2664dcf-7fac-4f95-b88b-1677fab3b23b admin admin] PATH_INFO: `/v3/projects/3e212086aed64da7b2e1a4106b195114` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:15:14.539748 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2664dcf-7fac-4f95-b88b-1677fab3b23b admin admin] RBAC: Authorizing `identity:delete_project(project_id=3e212086aed64da7b2e1a4106b195114)` {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:15:14.541925 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2664dcf-7fac-4f95-b88b-1677fab3b23b admin admin] RBAC: Authorization granted {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:15:14.669373 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.notifications [None req-d2664dcf-7fac-4f95-b88b-1677fab3b23b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3e212086aed64da7b2e1a4106b195114', 'request_id': 'req-d2664dcf-7fac-4f95-b88b-1677fab3b23b'} {{(pid=80396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:15:14.675822 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.notifications [None req-d2664dcf-7fac-4f95-b88b-1677fab3b23b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3e212086aed64da7b2e1a4106b195114', 'request_id': 'req-d2664dcf-7fac-4f95-b88b-1677fab3b23b'} {{(pid=80396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:15:14.742735 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.notifications [None req-d2664dcf-7fac-4f95-b88b-1677fab3b23b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3e212086aed64da7b2e1a4106b195114', 'request_id': 'req-d2664dcf-7fac-4f95-b88b-1677fab3b23b'} {{(pid=80396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:15:14.753897 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.notifications [None req-d2664dcf-7fac-4f95-b88b-1677fab3b23b admin admin] The token cache is being invalidate because project 3e212086aed64da7b2e1a4106b195114 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80396) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 02 16:15:14.754209 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.notifications [None req-d2664dcf-7fac-4f95-b88b-1677fab3b23b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:15:14.754826 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.notifications [None req-d2664dcf-7fac-4f95-b88b-1677fab3b23b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:15:14.756361 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 1268/2544] 10.222.0.59 () {58 vars in 1232 bytes} [Thu Jun 2 16:15:14 2022] DELETE /identity/v3/projects/3e212086aed64da7b2e1a4106b195114 => generated 0 bytes in 239 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 16:15:14.760309 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f59b268d-9ced-49ec-8401-bea07661c169 service neutron] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:15:14.770981 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f59b268d-9ced-49ec-8401-bea07661c169 service neutron] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:15:14.780563 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 16:15:14.827617 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bc0d696-24cf-4628-865a-8e9ec6d9e004 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f73d5a98be74242b45222df39fb6213', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:15:14.828476 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc0d696-24cf-4628-865a-8e9ec6d9e004 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:15:14.828757 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc0d696-24cf-4628-865a-8e9ec6d9e004 admin admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:15:14.829032 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc0d696-24cf-4628-865a-8e9ec6d9e004 admin admin] PATH_INFO: `/v3/users/1a2492dda2a34c4a8f0cbef226cc77fb` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:15:14.830254 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bc0d696-24cf-4628-865a-8e9ec6d9e004 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1a2492dda2a34c4a8f0cbef226cc77fb)` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:15:14.832175 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bc0d696-24cf-4628-865a-8e9ec6d9e004 admin admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:15:15.025257 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.notifications [None req-0bc0d696-24cf-4628-865a-8e9ec6d9e004 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1a2492dda2a34c4a8f0cbef226cc77fb'} {{(pid=80395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:15:15.119573 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.notifications [None req-0bc0d696-24cf-4628-865a-8e9ec6d9e004 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1a2492dda2a34c4a8f0cbef226cc77fb'} {{(pid=80395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:15:15.133020 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.notifications [None req-0bc0d696-24cf-4628-865a-8e9ec6d9e004 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1a2492dda2a34c4a8f0cbef226cc77fb'} {{(pid=80395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:15:15.133653 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.notifications [None req-0bc0d696-24cf-4628-865a-8e9ec6d9e004 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1a2492dda2a34c4a8f0cbef226cc77fb'} {{(pid=80395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:15:15.141415 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.notifications [None req-0bc0d696-24cf-4628-865a-8e9ec6d9e004 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1a2492dda2a34c4a8f0cbef226cc77fb'} {{(pid=80395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:15:15.147360 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 1277/2545] 10.222.0.59 () {58 vars in 1223 bytes} [Thu Jun 2 16:15:14 2022] DELETE /identity/v3/users/1a2492dda2a34c4a8f0cbef226cc77fb => generated 0 bytes in 388 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 16:15:15.521859 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2664dcf-7fac-4f95-b88b-1677fab3b23b admin admin] Authenticating user token {{(pid=80396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:15:15.523345 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.fernet_utils [None req-d2664dcf-7fac-4f95-b88b-1677fab3b23b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:15:15.536570 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2664dcf-7fac-4f95-b88b-1677fab3b23b admin admin] Validating token access rules against request {{(pid=80396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:15:15.593278 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69d6c95b-ccd2-413c-85a9-12327ed4369c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f73d5a98be74242b45222df39fb6213', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:15:15.594150 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d6c95b-ccd2-413c-85a9-12327ed4369c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:15:15.594430 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d6c95b-ccd2-413c-85a9-12327ed4369c admin admin] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:15:15.594706 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d6c95b-ccd2-413c-85a9-12327ed4369c admin admin] PATH_INFO: `/v3/projects/c5bdf982a6a04a47a0d650a3c12f5432` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:15:15.596197 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69d6c95b-ccd2-413c-85a9-12327ed4369c admin admin] RBAC: Authorizing `identity:delete_project(project_id=c5bdf982a6a04a47a0d650a3c12f5432)` {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:15:15.598096 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69d6c95b-ccd2-413c-85a9-12327ed4369c admin admin] RBAC: Authorization granted {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:15:15.700857 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.notifications [None req-69d6c95b-ccd2-413c-85a9-12327ed4369c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c5bdf982a6a04a47a0d650a3c12f5432', 'request_id': 'req-69d6c95b-ccd2-413c-85a9-12327ed4369c'} {{(pid=80396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:15:15.708605 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.notifications [None req-69d6c95b-ccd2-413c-85a9-12327ed4369c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c5bdf982a6a04a47a0d650a3c12f5432', 'request_id': 'req-69d6c95b-ccd2-413c-85a9-12327ed4369c'} {{(pid=80396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:15:15.817358 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.notifications [None req-69d6c95b-ccd2-413c-85a9-12327ed4369c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c5bdf982a6a04a47a0d650a3c12f5432', 'request_id': 'req-69d6c95b-ccd2-413c-85a9-12327ed4369c'} {{(pid=80396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:15:15.829254 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.notifications [None req-69d6c95b-ccd2-413c-85a9-12327ed4369c admin admin] The token cache is being invalidate because project c5bdf982a6a04a47a0d650a3c12f5432 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80396) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 02 16:15:15.829540 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.notifications [None req-69d6c95b-ccd2-413c-85a9-12327ed4369c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:15:15.830219 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.notifications [None req-69d6c95b-ccd2-413c-85a9-12327ed4369c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:15:15.831750 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 1269/2546] 10.222.0.59 () {58 vars in 1232 bytes} [Thu Jun 2 16:15:15 2022] DELETE /identity/v3/projects/c5bdf982a6a04a47a0d650a3c12f5432 => generated 0 bytes in 310 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 16:15:15.836769 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-465b7a54-2f26-4bd3-9414-70e63c867cc8 None None] REQUEST_METHOD: `POST` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:15:15.837287 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-465b7a54-2f26-4bd3-9414-70e63c867cc8 None None] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:15:15.837383 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-465b7a54-2f26-4bd3-9414-70e63c867cc8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:15:15.855422 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.auth.core [None req-465b7a54-2f26-4bd3-9414-70e63c867cc8 None None] MFA Rules not processed for user `400d1f4db9de49638549e5db29a041e1`. Rule list: `[]` (Enabled: `True`). {{(pid=80395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 16:15:15.856593 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.fernet_utils [None req-465b7a54-2f26-4bd3-9414-70e63c867cc8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:15:15.915954 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 1278/2547] 10.222.0.59 () {58 vars in 957 bytes} [Thu Jun 2 16:15:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 16:15:15.923835 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38bab884-d1ce-42c4-a464-929bc71a0a95 None None] REQUEST_METHOD: `POST` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:15:15.924121 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38bab884-d1ce-42c4-a464-929bc71a0a95 None None] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:15:15.924396 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38bab884-d1ce-42c4-a464-929bc71a0a95 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:15:15.930594 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG dbcounter [-] [80396] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 16:15:15.944532 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.auth.core [None req-38bab884-d1ce-42c4-a464-929bc71a0a95 None None] MFA Rules not processed for user `400d1f4db9de49638549e5db29a041e1`. Rule list: `[]` (Enabled: `True`). {{(pid=80396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 16:15:15.945774 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.fernet_utils [None req-38bab884-d1ce-42c4-a464-929bc71a0a95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:15:15.954805 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 1270/2548] 10.222.0.59 () {58 vars in 957 bytes} [Thu Jun 2 16:15:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 16:15:15.958979 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-465b7a54-2f26-4bd3-9414-70e63c867cc8 None None] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:15:15.969633 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-465b7a54-2f26-4bd3-9414-70e63c867cc8 None None] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:15:15.974522 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcd87bba-22ea-4cde-a8dd-7515ed90d348 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f73d5a98be74242b45222df39fb6213', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:15:15.976131 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd87bba-22ea-4cde-a8dd-7515ed90d348 admin admin] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:15:15.976131 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd87bba-22ea-4cde-a8dd-7515ed90d348 admin admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:15:15.976131 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd87bba-22ea-4cde-a8dd-7515ed90d348 admin admin] PATH_INFO: `/v3/domains` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:15:15.976413 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcd87bba-22ea-4cde-a8dd-7515ed90d348 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80395) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 16:15:15.976707 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcd87bba-22ea-4cde-a8dd-7515ed90d348 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:15:15.978328 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcd87bba-22ea-4cde-a8dd-7515ed90d348 admin admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:15:15.990031 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 1279/2549] 10.222.0.59 () {58 vars in 1152 bytes} [Thu Jun 2 16:15:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 16:15:15.994396 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38bab884-d1ce-42c4-a464-929bc71a0a95 None None] Authenticating user token {{(pid=80396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:15:16.003979 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38bab884-d1ce-42c4-a464-929bc71a0a95 None None] Validating token access rules against request {{(pid=80396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:15:16.008606 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d375d00-4ddf-4097-9bfc-b20e592fad81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f73d5a98be74242b45222df39fb6213', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:15:16.009244 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d375d00-4ddf-4097-9bfc-b20e592fad81 admin admin] REQUEST_METHOD: `POST` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:15:16.009527 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d375d00-4ddf-4097-9bfc-b20e592fad81 admin admin] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:15:16.009804 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d375d00-4ddf-4097-9bfc-b20e592fad81 admin admin] PATH_INFO: `/v3/projects` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:15:16.010568 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d375d00-4ddf-4097-9bfc-b20e592fad81 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:15:16.012482 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d375d00-4ddf-4097-9bfc-b20e592fad81 admin admin] RBAC: Authorization granted {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:15:16.095621 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 1271/2550] 10.222.0.59 () {60 vars in 1152 bytes} [Thu Jun 2 16:15:15 2022] POST /identity/v3/projects => generated 373 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 16:15:16.099879 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcd87bba-22ea-4cde-a8dd-7515ed90d348 admin admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:15:16.110276 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcd87bba-22ea-4cde-a8dd-7515ed90d348 admin admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:15:16.128310 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 16:15:16.165989 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-280e7dde-177b-44f3-8207-e6b7780bc7fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f73d5a98be74242b45222df39fb6213', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:15:16.170986 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-280e7dde-177b-44f3-8207-e6b7780bc7fd admin admin] REQUEST_METHOD: `POST` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:15:16.170986 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-280e7dde-177b-44f3-8207-e6b7780bc7fd admin admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:15:16.170986 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-280e7dde-177b-44f3-8207-e6b7780bc7fd admin admin] PATH_INFO: `/v3/users` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:15:16.170986 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-280e7dde-177b-44f3-8207-e6b7780bc7fd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:15:16.170986 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-280e7dde-177b-44f3-8207-e6b7780bc7fd admin admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:15:16.288245 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 1280/2551] 10.222.0.59 () {60 vars in 1143 bytes} [Thu Jun 2 16:15:16 2022] POST /identity/v3/users => generated 287 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 02 16:15:16.292308 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d375d00-4ddf-4097-9bfc-b20e592fad81 admin admin] Authenticating user token {{(pid=80396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:15:16.302774 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d375d00-4ddf-4097-9bfc-b20e592fad81 admin admin] Validating token access rules against request {{(pid=80396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:15:16.307299 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ab625c1-1465-4c35-a5fe-4bd47bcee258 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f73d5a98be74242b45222df39fb6213', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:15:16.307942 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab625c1-1465-4c35-a5fe-4bd47bcee258 admin admin] REQUEST_METHOD: `GET` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:15:16.308223 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab625c1-1465-4c35-a5fe-4bd47bcee258 admin admin] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:15:16.308498 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab625c1-1465-4c35-a5fe-4bd47bcee258 admin admin] PATH_INFO: `/v3/roles` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:15:16.309213 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ab625c1-1465-4c35-a5fe-4bd47bcee258 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:15:16.310994 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ab625c1-1465-4c35-a5fe-4bd47bcee258 admin admin] RBAC: Authorization granted {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:15:16.321754 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 1272/2552] 10.222.0.59 () {58 vars in 1121 bytes} [Thu Jun 2 16:15:16 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 16:15:16.325703 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-280e7dde-177b-44f3-8207-e6b7780bc7fd admin admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:15:16.336538 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-280e7dde-177b-44f3-8207-e6b7780bc7fd admin admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:15:16.341181 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec69b5a8-f3da-465b-a3c7-c8d82eb5cbe6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f73d5a98be74242b45222df39fb6213', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:15:16.341837 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec69b5a8-f3da-465b-a3c7-c8d82eb5cbe6 admin admin] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:15:16.342155 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec69b5a8-f3da-465b-a3c7-c8d82eb5cbe6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:15:16.342432 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec69b5a8-f3da-465b-a3c7-c8d82eb5cbe6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:15:16.343162 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec69b5a8-f3da-465b-a3c7-c8d82eb5cbe6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:15:16.344752 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec69b5a8-f3da-465b-a3c7-c8d82eb5cbe6 admin admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:15:16.354903 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 1281/2553] 10.222.0.59 () {58 vars in 1121 bytes} [Thu Jun 2 16:15:16 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 16:15:16.359328 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ab625c1-1465-4c35-a5fe-4bd47bcee258 admin admin] Authenticating user token {{(pid=80396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:15:16.369158 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ab625c1-1465-4c35-a5fe-4bd47bcee258 admin admin] Validating token access rules against request {{(pid=80396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:15:16.373645 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b734fcae-0fd5-451b-b09a-05b7e6f4cbab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f73d5a98be74242b45222df39fb6213', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:15:16.375448 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b734fcae-0fd5-451b-b09a-05b7e6f4cbab admin admin] REQUEST_METHOD: `PUT` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:15:16.375743 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b734fcae-0fd5-451b-b09a-05b7e6f4cbab admin admin] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:15:16.376024 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b734fcae-0fd5-451b-b09a-05b7e6f4cbab admin admin] PATH_INFO: `/v3/projects/4b55791589a44e97a0101982cf7817d9/users/62841aae207f4261ab2d03c77e4cda5b/roles/649e0f2b5a264c419ea6a1441f123a03` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:15:16.391572 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b734fcae-0fd5-451b-b09a-05b7e6f4cbab admin admin] RBAC: Authorizing `identity:create_grant(project_id=4b55791589a44e97a0101982cf7817d9, user_id=62841aae207f4261ab2d03c77e4cda5b, role_id=649e0f2b5a264c419ea6a1441f123a03)` {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:15:16.394279 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b734fcae-0fd5-451b-b09a-05b7e6f4cbab admin admin] RBAC: Authorization granted {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:15:16.471553 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 1273/2554] 10.222.0.59 () {60 vars in 1482 bytes} [Thu Jun 2 16:15:16 2022] PUT /identity/v3/projects/4b55791589a44e97a0101982cf7817d9/users/62841aae207f4261ab2d03c77e4cda5b/roles/649e0f2b5a264c419ea6a1441f123a03 => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 16:15:16.476984 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0bceb49-7150-4404-b067-e8f5d6212f98 None None] REQUEST_METHOD: `POST` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:15:16.477361 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0bceb49-7150-4404-b067-e8f5d6212f98 None None] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:15:16.477731 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0bceb49-7150-4404-b067-e8f5d6212f98 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:15:16.495681 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.auth.core [None req-d0bceb49-7150-4404-b067-e8f5d6212f98 None None] MFA Rules not processed for user `400d1f4db9de49638549e5db29a041e1`. Rule list: `[]` (Enabled: `True`). {{(pid=80395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 16:15:16.496916 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.fernet_utils [None req-d0bceb49-7150-4404-b067-e8f5d6212f98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:15:16.554671 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 1282/2555] 10.222.0.59 () {58 vars in 957 bytes} [Thu Jun 2 16:15:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 16:15:16.565186 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b734fcae-0fd5-451b-b09a-05b7e6f4cbab admin admin] Authenticating user token {{(pid=80396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:15:16.566943 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.fernet_utils [None req-b734fcae-0fd5-451b-b09a-05b7e6f4cbab admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:15:16.624848 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b734fcae-0fd5-451b-b09a-05b7e6f4cbab admin admin] Validating token access rules against request {{(pid=80396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:15:16.628638 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23de06a9-3da9-4bb1-9320-56256e74d1bb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9af40ddfe9ff4be3887b068f13a28dc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c87c981909d4b8db02783421818c79b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:15:16.629274 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23de06a9-3da9-4bb1-9320-56256e74d1bb service neutron] REQUEST_METHOD: `GET` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:15:16.629559 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23de06a9-3da9-4bb1-9320-56256e74d1bb service neutron] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:15:16.629838 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23de06a9-3da9-4bb1-9320-56256e74d1bb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:15:16.638714 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23de06a9-3da9-4bb1-9320-56256e74d1bb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:15:16.640422 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23de06a9-3da9-4bb1-9320-56256e74d1bb service neutron] RBAC: Authorization granted {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:15:16.649732 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 1274/2556] 10.222.0.59 () {60 vars in 1365 bytes} [Thu Jun 2 16:15:16 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 16:15:17.887869 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e8bb988-c6d7-4384-bcba-c6c7b45d433e None None] REQUEST_METHOD: `POST` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:15:17.888409 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e8bb988-c6d7-4384-bcba-c6c7b45d433e None None] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:15:17.888568 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e8bb988-c6d7-4384-bcba-c6c7b45d433e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:15:17.918051 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.auth.core [None req-2e8bb988-c6d7-4384-bcba-c6c7b45d433e None None] MFA Rules not processed for user `62841aae207f4261ab2d03c77e4cda5b`. Rule list: `[]` (Enabled: `True`). {{(pid=80395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 16:15:17.919423 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.fernet_utils [None req-2e8bb988-c6d7-4384-bcba-c6c7b45d433e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:15:17.993121 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 1283/2557] 10.222.0.59 () {58 vars in 957 bytes} [Thu Jun 2 16:15:17 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 16:15:17.997797 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23de06a9-3da9-4bb1-9320-56256e74d1bb service neutron] Authenticating user token {{(pid=80396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:15:18.007797 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23de06a9-3da9-4bb1-9320-56256e74d1bb service neutron] Validating token access rules against request {{(pid=80396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:15:18.012325 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47dac968-b1a5-42d4-9f05-d987f38c1175 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f73d5a98be74242b45222df39fb6213', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:15:18.013030 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47dac968-b1a5-42d4-9f05-d987f38c1175 admin admin] REQUEST_METHOD: `POST` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:15:18.013294 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47dac968-b1a5-42d4-9f05-d987f38c1175 admin admin] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:15:18.013571 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47dac968-b1a5-42d4-9f05-d987f38c1175 admin admin] PATH_INFO: `/v3/projects` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:15:18.014288 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47dac968-b1a5-42d4-9f05-d987f38c1175 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:15:18.021104 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47dac968-b1a5-42d4-9f05-d987f38c1175 admin admin] RBAC: Authorization granted {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:15:18.133691 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 1275/2558] 10.222.0.59 () {60 vars in 1152 bytes} [Thu Jun 2 16:15:17 2022] POST /identity/v3/projects => generated 371 bytes in 136 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 16:15:18.137880 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e8bb988-c6d7-4384-bcba-c6c7b45d433e None None] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:15:18.149779 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e8bb988-c6d7-4384-bcba-c6c7b45d433e None None] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:15:18.177234 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 16:15:18.207199 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f57a12cf-f84e-45e8-b05e-e3926a92ed7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f73d5a98be74242b45222df39fb6213', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:15:18.207858 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f57a12cf-f84e-45e8-b05e-e3926a92ed7f admin admin] REQUEST_METHOD: `POST` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:15:18.210123 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f57a12cf-f84e-45e8-b05e-e3926a92ed7f admin admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:15:18.210123 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f57a12cf-f84e-45e8-b05e-e3926a92ed7f admin admin] PATH_INFO: `/v3/users` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:15:18.210123 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f57a12cf-f84e-45e8-b05e-e3926a92ed7f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:15:18.211148 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f57a12cf-f84e-45e8-b05e-e3926a92ed7f admin admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:15:18.304831 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 1284/2559] 10.222.0.59 () {60 vars in 1143 bytes} [Thu Jun 2 16:15:18 2022] POST /identity/v3/users => generated 292 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 16:15:18.308768 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47dac968-b1a5-42d4-9f05-d987f38c1175 admin admin] Authenticating user token {{(pid=80396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:15:18.319302 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47dac968-b1a5-42d4-9f05-d987f38c1175 admin admin] Validating token access rules against request {{(pid=80396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:15:18.324045 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-998347ab-9be5-460a-abfd-b9a9ec8cb00d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f73d5a98be74242b45222df39fb6213', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:15:18.324690 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998347ab-9be5-460a-abfd-b9a9ec8cb00d admin admin] REQUEST_METHOD: `GET` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:15:18.324975 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998347ab-9be5-460a-abfd-b9a9ec8cb00d admin admin] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:15:18.325255 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998347ab-9be5-460a-abfd-b9a9ec8cb00d admin admin] PATH_INFO: `/v3/roles` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:15:18.325980 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-998347ab-9be5-460a-abfd-b9a9ec8cb00d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:15:18.328264 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-998347ab-9be5-460a-abfd-b9a9ec8cb00d admin admin] RBAC: Authorization granted {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:15:18.339191 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 1276/2560] 10.222.0.59 () {58 vars in 1121 bytes} [Thu Jun 2 16:15:18 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 16:15:18.343733 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f57a12cf-f84e-45e8-b05e-e3926a92ed7f admin admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:15:18.353841 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f57a12cf-f84e-45e8-b05e-e3926a92ed7f admin admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:15:18.358393 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bfcad92-4b63-4e24-9895-388619f96049 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f73d5a98be74242b45222df39fb6213', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:15:18.359372 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bfcad92-4b63-4e24-9895-388619f96049 admin admin] REQUEST_METHOD: `PUT` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:15:18.359655 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bfcad92-4b63-4e24-9895-388619f96049 admin admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:15:18.359957 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bfcad92-4b63-4e24-9895-388619f96049 admin admin] PATH_INFO: `/v3/projects/16008b28eeac40baa21bd03debbc4d34/users/36b30e0beb0a43a6aa5e896ae4f16356/roles/f1e0c25f6e9049e897cb7350c7e54ab3` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:15:18.375126 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bfcad92-4b63-4e24-9895-388619f96049 admin admin] RBAC: Authorizing `identity:create_grant(project_id=16008b28eeac40baa21bd03debbc4d34, user_id=36b30e0beb0a43a6aa5e896ae4f16356, role_id=f1e0c25f6e9049e897cb7350c7e54ab3)` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:15:18.377782 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bfcad92-4b63-4e24-9895-388619f96049 admin admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:15:18.491413 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 1285/2561] 10.222.0.59 () {60 vars in 1482 bytes} [Thu Jun 2 16:15:18 2022] PUT /identity/v3/projects/16008b28eeac40baa21bd03debbc4d34/users/36b30e0beb0a43a6aa5e896ae4f16356/roles/f1e0c25f6e9049e897cb7350c7e54ab3 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 16:15:18.495340 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-998347ab-9be5-460a-abfd-b9a9ec8cb00d admin admin] Authenticating user token {{(pid=80396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:15:18.506560 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-998347ab-9be5-460a-abfd-b9a9ec8cb00d admin admin] Validating token access rules against request {{(pid=80396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:15:18.565716 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-948ef0f2-acd2-4ea8-b723-f8edba140607 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f73d5a98be74242b45222df39fb6213', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:15:18.566398 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-948ef0f2-acd2-4ea8-b723-f8edba140607 admin admin] REQUEST_METHOD: `GET` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:15:18.566685 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-948ef0f2-acd2-4ea8-b723-f8edba140607 admin admin] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:15:18.566964 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-948ef0f2-acd2-4ea8-b723-f8edba140607 admin admin] PATH_INFO: `/v3/roles` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:15:18.567687 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-948ef0f2-acd2-4ea8-b723-f8edba140607 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:15:18.569277 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-948ef0f2-acd2-4ea8-b723-f8edba140607 admin admin] RBAC: Authorization granted {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:15:18.580915 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 1277/2562] 10.222.0.59 () {58 vars in 1121 bytes} [Thu Jun 2 16:15:18 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 16:15:18.585019 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bfcad92-4b63-4e24-9895-388619f96049 admin admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:15:18.595804 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bfcad92-4b63-4e24-9895-388619f96049 admin admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:15:18.600351 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54e9bbd8-be2f-4b08-a061-4645ed8955f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f73d5a98be74242b45222df39fb6213', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:15:18.601220 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e9bbd8-be2f-4b08-a061-4645ed8955f5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:15:18.601506 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e9bbd8-be2f-4b08-a061-4645ed8955f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:15:18.601783 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e9bbd8-be2f-4b08-a061-4645ed8955f5 admin admin] PATH_INFO: `/v3/projects/16008b28eeac40baa21bd03debbc4d34/users/36b30e0beb0a43a6aa5e896ae4f16356/roles/f1e0c25f6e9049e897cb7350c7e54ab3` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:15:18.603782 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54e9bbd8-be2f-4b08-a061-4645ed8955f5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=16008b28eeac40baa21bd03debbc4d34, user_id=36b30e0beb0a43a6aa5e896ae4f16356, role_id=f1e0c25f6e9049e897cb7350c7e54ab3)` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:15:18.606449 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54e9bbd8-be2f-4b08-a061-4645ed8955f5 admin admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:15:18.616973 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 1286/2563] 10.222.0.59 () {60 vars in 1482 bytes} [Thu Jun 2 16:15:18 2022] PUT /identity/v3/projects/16008b28eeac40baa21bd03debbc4d34/users/36b30e0beb0a43a6aa5e896ae4f16356/roles/f1e0c25f6e9049e897cb7350c7e54ab3 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 16:15:19.932367 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b01cce4-e863-4379-9e47-e8b48f2a561f None None] REQUEST_METHOD: `POST` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:15:19.932984 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b01cce4-e863-4379-9e47-e8b48f2a561f None None] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:15:19.932984 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b01cce4-e863-4379-9e47-e8b48f2a561f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:15:19.939881 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG dbcounter [-] [80396] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 16:15:19.960596 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.auth.core [None req-4b01cce4-e863-4379-9e47-e8b48f2a561f None None] MFA Rules not processed for user `36b30e0beb0a43a6aa5e896ae4f16356`. Rule list: `[]` (Enabled: `True`). {{(pid=80396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 16:15:19.961875 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.fernet_utils [None req-4b01cce4-e863-4379-9e47-e8b48f2a561f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:15:20.034442 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 1278/2564] 10.222.0.59 () {58 vars in 957 bytes} [Thu Jun 2 16:15:19 2022] POST /identity/v3/auth/tokens => generated 3305 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 16:15:20.045406 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54e9bbd8-be2f-4b08-a061-4645ed8955f5 admin admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:15:20.047210 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.fernet_utils [None req-54e9bbd8-be2f-4b08-a061-4645ed8955f5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:15:20.105065 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54e9bbd8-be2f-4b08-a061-4645ed8955f5 admin admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:15:20.108665 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6f1a428-d5ad-484f-a91b-4d5114187e23 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6534961c369940a5b88f310c6450250b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c87c981909d4b8db02783421818c79b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:15:20.109296 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f1a428-d5ad-484f-a91b-4d5114187e23 service cinder] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:15:20.109579 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f1a428-d5ad-484f-a91b-4d5114187e23 service cinder] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:15:20.109860 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f1a428-d5ad-484f-a91b-4d5114187e23 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:15:20.165812 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6f1a428-d5ad-484f-a91b-4d5114187e23 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:15:20.167218 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6f1a428-d5ad-484f-a91b-4d5114187e23 service cinder] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:15:20.176570 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 1287/2565] 10.222.0.59 () {60 vars in 1365 bytes} [Thu Jun 2 16:15:20 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 132 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 16:15:22.944203 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b01cce4-e863-4379-9e47-e8b48f2a561f None None] Authenticating user token {{(pid=80396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:15:22.955037 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b01cce4-e863-4379-9e47-e8b48f2a561f None None] Validating token access rules against request {{(pid=80396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:15:22.958640 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-315d19c4-23dd-4d10-b711-28f29373c708 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6534961c369940a5b88f310c6450250b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c87c981909d4b8db02783421818c79b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:15:22.959377 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-315d19c4-23dd-4d10-b711-28f29373c708 service cinder] REQUEST_METHOD: `GET` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:15:22.959662 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-315d19c4-23dd-4d10-b711-28f29373c708 service cinder] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:15:22.959979 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-315d19c4-23dd-4d10-b711-28f29373c708 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:15:22.969494 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-315d19c4-23dd-4d10-b711-28f29373c708 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:15:22.971299 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-315d19c4-23dd-4d10-b711-28f29373c708 service cinder] RBAC: Authorization granted {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:15:22.981113 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 1279/2566] 10.222.0.59 () {60 vars in 1365 bytes} [Thu Jun 2 16:15:22 2022] GET /identity/v3/auth/tokens => generated 3305 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 02 16:15:30.172322 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writing DB stats keystone:SELECT=79,keystone:INSERT=5 {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 16:15:32.976756 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG dbcounter [-] [80396] Writing DB stats keystone:SELECT=38 {{(pid=80396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 16:15:43.513244 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6f1a428-d5ad-484f-a91b-4d5114187e23 service cinder] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:15:43.578369 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6f1a428-d5ad-484f-a91b-4d5114187e23 service cinder] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:15:43.583021 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81def2f1-1956-4cc4-862a-d8212125b72b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f73d5a98be74242b45222df39fb6213', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:15:43.583883 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81def2f1-1956-4cc4-862a-d8212125b72b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:15:43.584168 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81def2f1-1956-4cc4-862a-d8212125b72b admin admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:15:43.584446 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81def2f1-1956-4cc4-862a-d8212125b72b admin admin] PATH_INFO: `/v3/users/62841aae207f4261ab2d03c77e4cda5b` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:15:43.585637 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81def2f1-1956-4cc4-862a-d8212125b72b admin admin] RBAC: Authorizing `identity:delete_user(user_id=62841aae207f4261ab2d03c77e4cda5b)` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:15:43.587584 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81def2f1-1956-4cc4-862a-d8212125b72b admin admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:15:43.832047 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.notifications [None req-81def2f1-1956-4cc4-862a-d8212125b72b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '62841aae207f4261ab2d03c77e4cda5b'} {{(pid=80395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:15:43.949667 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.notifications [None req-81def2f1-1956-4cc4-862a-d8212125b72b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '62841aae207f4261ab2d03c77e4cda5b'} {{(pid=80395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:15:43.962361 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.notifications [None req-81def2f1-1956-4cc4-862a-d8212125b72b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '62841aae207f4261ab2d03c77e4cda5b'} {{(pid=80395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:15:43.962996 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.notifications [None req-81def2f1-1956-4cc4-862a-d8212125b72b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '62841aae207f4261ab2d03c77e4cda5b'} {{(pid=80395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:15:43.969946 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.notifications [None req-81def2f1-1956-4cc4-862a-d8212125b72b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '62841aae207f4261ab2d03c77e4cda5b'} {{(pid=80395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:15:43.977308 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 1288/2567] 10.222.0.59 () {58 vars in 1223 bytes} [Thu Jun 2 16:15:43 2022] DELETE /identity/v3/users/62841aae207f4261ab2d03c77e4cda5b => generated 0 bytes in 465 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 16:15:44.227099 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-315d19c4-23dd-4d10-b711-28f29373c708 service cinder] Authenticating user token {{(pid=80396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:15:44.242412 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-315d19c4-23dd-4d10-b711-28f29373c708 service cinder] Validating token access rules against request {{(pid=80396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:15:44.297839 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b036c06-94d1-4661-b811-a0bfa1bb3003 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f73d5a98be74242b45222df39fb6213', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:15:44.298830 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b036c06-94d1-4661-b811-a0bfa1bb3003 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:15:44.299106 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b036c06-94d1-4661-b811-a0bfa1bb3003 admin admin] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:15:44.299377 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b036c06-94d1-4661-b811-a0bfa1bb3003 admin admin] PATH_INFO: `/v3/projects/4b55791589a44e97a0101982cf7817d9` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:15:44.300542 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b036c06-94d1-4661-b811-a0bfa1bb3003 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4b55791589a44e97a0101982cf7817d9)` {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:15:44.302456 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b036c06-94d1-4661-b811-a0bfa1bb3003 admin admin] RBAC: Authorization granted {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:15:44.465980 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.notifications [None req-9b036c06-94d1-4661-b811-a0bfa1bb3003 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4b55791589a44e97a0101982cf7817d9', 'request_id': 'req-9b036c06-94d1-4661-b811-a0bfa1bb3003'} {{(pid=80396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:15:44.473459 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.notifications [None req-9b036c06-94d1-4661-b811-a0bfa1bb3003 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4b55791589a44e97a0101982cf7817d9', 'request_id': 'req-9b036c06-94d1-4661-b811-a0bfa1bb3003'} {{(pid=80396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:15:44.589854 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.notifications [None req-9b036c06-94d1-4661-b811-a0bfa1bb3003 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4b55791589a44e97a0101982cf7817d9', 'request_id': 'req-9b036c06-94d1-4661-b811-a0bfa1bb3003'} {{(pid=80396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:15:44.601570 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.notifications [None req-9b036c06-94d1-4661-b811-a0bfa1bb3003 admin admin] The token cache is being invalidate because project 4b55791589a44e97a0101982cf7817d9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80396) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 02 16:15:44.601864 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.notifications [None req-9b036c06-94d1-4661-b811-a0bfa1bb3003 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:15:44.602538 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.notifications [None req-9b036c06-94d1-4661-b811-a0bfa1bb3003 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:15:44.604942 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 1280/2568] 10.222.0.59 () {58 vars in 1232 bytes} [Thu Jun 2 16:15:44 2022] DELETE /identity/v3/projects/4b55791589a44e97a0101982cf7817d9 => generated 0 bytes in 378 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 16:15:44.608096 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81def2f1-1956-4cc4-862a-d8212125b72b admin admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:15:44.609505 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.fernet_utils [None req-81def2f1-1956-4cc4-862a-d8212125b72b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:15:44.622682 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81def2f1-1956-4cc4-862a-d8212125b72b admin admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:15:44.678647 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d8c500a-f349-4952-b52f-f12d38e5ccc8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f73d5a98be74242b45222df39fb6213', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:15:44.679530 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8c500a-f349-4952-b52f-f12d38e5ccc8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:15:44.679813 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8c500a-f349-4952-b52f-f12d38e5ccc8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:15:44.680089 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8c500a-f349-4952-b52f-f12d38e5ccc8 admin admin] PATH_INFO: `/v3/users/36b30e0beb0a43a6aa5e896ae4f16356` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:15:44.681256 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d8c500a-f349-4952-b52f-f12d38e5ccc8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=36b30e0beb0a43a6aa5e896ae4f16356)` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:15:44.683197 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d8c500a-f349-4952-b52f-f12d38e5ccc8 admin admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:15:44.706813 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 16:15:44.935490 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.notifications [None req-9d8c500a-f349-4952-b52f-f12d38e5ccc8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '36b30e0beb0a43a6aa5e896ae4f16356'} {{(pid=80395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:15:45.006538 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.notifications [None req-9d8c500a-f349-4952-b52f-f12d38e5ccc8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '36b30e0beb0a43a6aa5e896ae4f16356'} {{(pid=80395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:15:45.018477 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.notifications [None req-9d8c500a-f349-4952-b52f-f12d38e5ccc8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '36b30e0beb0a43a6aa5e896ae4f16356'} {{(pid=80395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:15:45.019169 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.notifications [None req-9d8c500a-f349-4952-b52f-f12d38e5ccc8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '36b30e0beb0a43a6aa5e896ae4f16356'} {{(pid=80395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:15:45.026098 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.notifications [None req-9d8c500a-f349-4952-b52f-f12d38e5ccc8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '36b30e0beb0a43a6aa5e896ae4f16356'} {{(pid=80395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:15:45.032119 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 1289/2569] 10.222.0.59 () {58 vars in 1223 bytes} [Thu Jun 2 16:15:44 2022] DELETE /identity/v3/users/36b30e0beb0a43a6aa5e896ae4f16356 => generated 0 bytes in 425 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 16:15:45.351518 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b036c06-94d1-4661-b811-a0bfa1bb3003 admin admin] Authenticating user token {{(pid=80396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:15:45.353011 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.fernet_utils [None req-9b036c06-94d1-4661-b811-a0bfa1bb3003 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:15:45.371890 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b036c06-94d1-4661-b811-a0bfa1bb3003 admin admin] Validating token access rules against request {{(pid=80396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:15:45.427231 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80839b67-5782-4757-9431-6a0bf22e3af0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f73d5a98be74242b45222df39fb6213', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:15:45.428086 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80839b67-5782-4757-9431-6a0bf22e3af0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:15:45.428368 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80839b67-5782-4757-9431-6a0bf22e3af0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:15:45.428645 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80839b67-5782-4757-9431-6a0bf22e3af0 admin admin] PATH_INFO: `/v3/projects/16008b28eeac40baa21bd03debbc4d34` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:15:45.429917 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80839b67-5782-4757-9431-6a0bf22e3af0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=16008b28eeac40baa21bd03debbc4d34)` {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:15:45.431864 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80839b67-5782-4757-9431-6a0bf22e3af0 admin admin] RBAC: Authorization granted {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:15:45.585188 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG dbcounter [-] [80396] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=80396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 16:15:45.598123 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.notifications [None req-80839b67-5782-4757-9431-6a0bf22e3af0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '16008b28eeac40baa21bd03debbc4d34', 'request_id': 'req-80839b67-5782-4757-9431-6a0bf22e3af0'} {{(pid=80396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:15:45.604329 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.notifications [None req-80839b67-5782-4757-9431-6a0bf22e3af0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '16008b28eeac40baa21bd03debbc4d34', 'request_id': 'req-80839b67-5782-4757-9431-6a0bf22e3af0'} {{(pid=80396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:15:45.664164 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.notifications [None req-80839b67-5782-4757-9431-6a0bf22e3af0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '16008b28eeac40baa21bd03debbc4d34', 'request_id': 'req-80839b67-5782-4757-9431-6a0bf22e3af0'} {{(pid=80396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:15:45.675569 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.notifications [None req-80839b67-5782-4757-9431-6a0bf22e3af0 admin admin] The token cache is being invalidate because project 16008b28eeac40baa21bd03debbc4d34 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80396) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 02 16:15:45.675857 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.notifications [None req-80839b67-5782-4757-9431-6a0bf22e3af0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:15:45.676489 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.notifications [None req-80839b67-5782-4757-9431-6a0bf22e3af0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:15:45.678036 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 1281/2570] 10.222.0.59 () {58 vars in 1232 bytes} [Thu Jun 2 16:15:45 2022] DELETE /identity/v3/projects/16008b28eeac40baa21bd03debbc4d34 => generated 0 bytes in 327 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 16:15:45.682947 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e8dda9-9e4a-493a-bb63-4a68418c21f5 None None] REQUEST_METHOD: `POST` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:15:45.683400 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e8dda9-9e4a-493a-bb63-4a68418c21f5 None None] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:15:45.683677 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e8dda9-9e4a-493a-bb63-4a68418c21f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:15:45.701560 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.auth.core [None req-25e8dda9-9e4a-493a-bb63-4a68418c21f5 None None] MFA Rules not processed for user `400d1f4db9de49638549e5db29a041e1`. Rule list: `[]` (Enabled: `True`). {{(pid=80395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 16:15:45.702838 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.fernet_utils [None req-25e8dda9-9e4a-493a-bb63-4a68418c21f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:15:45.762198 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 1290/2571] 10.222.0.59 () {58 vars in 957 bytes} [Thu Jun 2 16:15:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 16:15:45.770422 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55fbfdb-3d4b-4b29-9d82-cf52bcff959c None None] REQUEST_METHOD: `POST` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:15:45.770718 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55fbfdb-3d4b-4b29-9d82-cf52bcff959c None None] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:15:45.771041 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55fbfdb-3d4b-4b29-9d82-cf52bcff959c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:15:45.791295 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.auth.core [None req-e55fbfdb-3d4b-4b29-9d82-cf52bcff959c None None] MFA Rules not processed for user `400d1f4db9de49638549e5db29a041e1`. Rule list: `[]` (Enabled: `True`). {{(pid=80396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 16:15:45.792492 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.fernet_utils [None req-e55fbfdb-3d4b-4b29-9d82-cf52bcff959c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:15:45.800752 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 1282/2572] 10.222.0.59 () {58 vars in 957 bytes} [Thu Jun 2 16:15:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 16:15:45.804878 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25e8dda9-9e4a-493a-bb63-4a68418c21f5 None None] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:15:45.814578 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25e8dda9-9e4a-493a-bb63-4a68418c21f5 None None] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:15:45.819123 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d020bcb-38af-47e8-a170-6995e0711467 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f73d5a98be74242b45222df39fb6213', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:15:45.819761 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d020bcb-38af-47e8-a170-6995e0711467 admin admin] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:15:45.820039 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d020bcb-38af-47e8-a170-6995e0711467 admin admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:15:45.820308 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d020bcb-38af-47e8-a170-6995e0711467 admin admin] PATH_INFO: `/v3/domains` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:15:45.821082 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d020bcb-38af-47e8-a170-6995e0711467 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80395) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 16:15:45.821383 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d020bcb-38af-47e8-a170-6995e0711467 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:15:45.822990 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d020bcb-38af-47e8-a170-6995e0711467 admin admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:15:45.835081 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 1291/2573] 10.222.0.59 () {58 vars in 1152 bytes} [Thu Jun 2 16:15:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 16:15:45.839313 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e55fbfdb-3d4b-4b29-9d82-cf52bcff959c None None] Authenticating user token {{(pid=80396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:15:45.849544 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e55fbfdb-3d4b-4b29-9d82-cf52bcff959c None None] Validating token access rules against request {{(pid=80396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:15:45.854090 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59c52efe-ba3f-44dc-a0eb-8e4d2e5b615c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f73d5a98be74242b45222df39fb6213', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:15:45.854729 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c52efe-ba3f-44dc-a0eb-8e4d2e5b615c admin admin] REQUEST_METHOD: `POST` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:15:45.855042 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c52efe-ba3f-44dc-a0eb-8e4d2e5b615c admin admin] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:15:45.855347 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c52efe-ba3f-44dc-a0eb-8e4d2e5b615c admin admin] PATH_INFO: `/v3/projects` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:15:45.856031 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59c52efe-ba3f-44dc-a0eb-8e4d2e5b615c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:15:45.857901 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59c52efe-ba3f-44dc-a0eb-8e4d2e5b615c admin admin] RBAC: Authorization granted {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:15:45.938404 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 1283/2574] 10.222.0.59 () {60 vars in 1152 bytes} [Thu Jun 2 16:15:45 2022] POST /identity/v3/projects => generated 381 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 16:15:45.943000 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d020bcb-38af-47e8-a170-6995e0711467 admin admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:15:45.953083 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d020bcb-38af-47e8-a170-6995e0711467 admin admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:15:46.009269 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4be4aff-7eeb-4c79-82ca-db154f9fbe92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f73d5a98be74242b45222df39fb6213', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:15:46.009935 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4be4aff-7eeb-4c79-82ca-db154f9fbe92 admin admin] REQUEST_METHOD: `POST` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:15:46.010244 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4be4aff-7eeb-4c79-82ca-db154f9fbe92 admin admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:15:46.010523 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4be4aff-7eeb-4c79-82ca-db154f9fbe92 admin admin] PATH_INFO: `/v3/users` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:15:46.011205 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4be4aff-7eeb-4c79-82ca-db154f9fbe92 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:15:46.013109 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4be4aff-7eeb-4c79-82ca-db154f9fbe92 admin admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:15:46.137626 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 1292/2575] 10.222.0.59 () {60 vars in 1143 bytes} [Thu Jun 2 16:15:45 2022] POST /identity/v3/users => generated 291 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 16:15:46.141526 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59c52efe-ba3f-44dc-a0eb-8e4d2e5b615c admin admin] Authenticating user token {{(pid=80396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:15:46.152668 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59c52efe-ba3f-44dc-a0eb-8e4d2e5b615c admin admin] Validating token access rules against request {{(pid=80396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:15:46.157160 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45dba333-b668-4792-89b5-8cda05e06420 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f73d5a98be74242b45222df39fb6213', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:15:46.157933 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45dba333-b668-4792-89b5-8cda05e06420 admin admin] REQUEST_METHOD: `GET` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:15:46.158274 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45dba333-b668-4792-89b5-8cda05e06420 admin admin] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:15:46.158548 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45dba333-b668-4792-89b5-8cda05e06420 admin admin] PATH_INFO: `/v3/roles` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:15:46.159295 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45dba333-b668-4792-89b5-8cda05e06420 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:15:46.160872 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45dba333-b668-4792-89b5-8cda05e06420 admin admin] RBAC: Authorization granted {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:15:46.171117 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 1284/2576] 10.222.0.59 () {58 vars in 1121 bytes} [Thu Jun 2 16:15:46 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 16:15:46.175717 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4be4aff-7eeb-4c79-82ca-db154f9fbe92 admin admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:15:46.185733 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4be4aff-7eeb-4c79-82ca-db154f9fbe92 admin admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:15:46.190949 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d53233ff-2802-4290-ab41-6ef8636b0f2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f73d5a98be74242b45222df39fb6213', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:15:46.191602 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d53233ff-2802-4290-ab41-6ef8636b0f2c admin admin] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:15:46.191887 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d53233ff-2802-4290-ab41-6ef8636b0f2c admin admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:15:46.192167 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d53233ff-2802-4290-ab41-6ef8636b0f2c admin admin] PATH_INFO: `/v3/roles` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:15:46.192891 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d53233ff-2802-4290-ab41-6ef8636b0f2c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:15:46.194526 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d53233ff-2802-4290-ab41-6ef8636b0f2c admin admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:15:46.205418 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 1293/2577] 10.222.0.59 () {58 vars in 1121 bytes} [Thu Jun 2 16:15:46 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 02 16:15:46.209541 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45dba333-b668-4792-89b5-8cda05e06420 admin admin] Authenticating user token {{(pid=80396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:15:46.219532 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45dba333-b668-4792-89b5-8cda05e06420 admin admin] Validating token access rules against request {{(pid=80396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:15:46.224549 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad903e76-cce4-4a2d-835f-ec36dcee2808 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f73d5a98be74242b45222df39fb6213', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:15:46.225507 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad903e76-cce4-4a2d-835f-ec36dcee2808 admin admin] REQUEST_METHOD: `PUT` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:15:46.225714 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad903e76-cce4-4a2d-835f-ec36dcee2808 admin admin] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:15:46.225977 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad903e76-cce4-4a2d-835f-ec36dcee2808 admin admin] PATH_INFO: `/v3/projects/f556a2c3bb1c45f0a3607912effac5c8/users/2910f2833ce24b17b248ad9106f19786/roles/649e0f2b5a264c419ea6a1441f123a03` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:15:46.240950 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad903e76-cce4-4a2d-835f-ec36dcee2808 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f556a2c3bb1c45f0a3607912effac5c8, user_id=2910f2833ce24b17b248ad9106f19786, role_id=649e0f2b5a264c419ea6a1441f123a03)` {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:15:46.243529 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad903e76-cce4-4a2d-835f-ec36dcee2808 admin admin] RBAC: Authorization granted {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:15:46.320466 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 1285/2578] 10.222.0.59 () {60 vars in 1482 bytes} [Thu Jun 2 16:15:46 2022] PUT /identity/v3/projects/f556a2c3bb1c45f0a3607912effac5c8/users/2910f2833ce24b17b248ad9106f19786/roles/649e0f2b5a264c419ea6a1441f123a03 => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 16:15:46.325738 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7028320-ccc7-487e-96a8-9b774d5615fc None None] REQUEST_METHOD: `POST` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:15:46.326030 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7028320-ccc7-487e-96a8-9b774d5615fc None None] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:15:46.326349 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7028320-ccc7-487e-96a8-9b774d5615fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:15:46.333023 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writing DB stats keystone:DELETE=7,keystone:SELECT=89,keystone:INSERT=4 {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 16:15:46.344136 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.auth.core [None req-c7028320-ccc7-487e-96a8-9b774d5615fc None None] MFA Rules not processed for user `400d1f4db9de49638549e5db29a041e1`. Rule list: `[]` (Enabled: `True`). {{(pid=80395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 16:15:46.345869 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.fernet_utils [None req-c7028320-ccc7-487e-96a8-9b774d5615fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:15:46.405045 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 1294/2579] 10.222.0.59 () {58 vars in 957 bytes} [Thu Jun 2 16:15:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 16:15:46.414641 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad903e76-cce4-4a2d-835f-ec36dcee2808 admin admin] Authenticating user token {{(pid=80396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:15:46.416473 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.fernet_utils [None req-ad903e76-cce4-4a2d-835f-ec36dcee2808 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:15:46.474850 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad903e76-cce4-4a2d-835f-ec36dcee2808 admin admin] Validating token access rules against request {{(pid=80396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:15:46.478514 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51564c7f-4137-4c19-a7ba-41fef1857cd3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9af40ddfe9ff4be3887b068f13a28dc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c87c981909d4b8db02783421818c79b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:15:46.479155 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51564c7f-4137-4c19-a7ba-41fef1857cd3 service neutron] REQUEST_METHOD: `GET` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:15:46.479443 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51564c7f-4137-4c19-a7ba-41fef1857cd3 service neutron] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:15:46.479724 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51564c7f-4137-4c19-a7ba-41fef1857cd3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:15:46.489377 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51564c7f-4137-4c19-a7ba-41fef1857cd3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:15:46.490827 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51564c7f-4137-4c19-a7ba-41fef1857cd3 service neutron] RBAC: Authorization granted {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:15:46.500146 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 1286/2580] 10.222.0.59 () {60 vars in 1365 bytes} [Thu Jun 2 16:15:46 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 16:15:47.751776 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bcfcc38-b33e-49cb-a9a7-24f6fc00d610 None None] REQUEST_METHOD: `POST` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:15:47.761721 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bcfcc38-b33e-49cb-a9a7-24f6fc00d610 None None] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:15:47.761721 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bcfcc38-b33e-49cb-a9a7-24f6fc00d610 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:15:47.781985 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.auth.core [None req-3bcfcc38-b33e-49cb-a9a7-24f6fc00d610 None None] MFA Rules not processed for user `2910f2833ce24b17b248ad9106f19786`. Rule list: `[]` (Enabled: `True`). {{(pid=80395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 16:15:47.783309 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.fernet_utils [None req-3bcfcc38-b33e-49cb-a9a7-24f6fc00d610 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:15:47.853515 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 1295/2581] 10.222.0.59 () {58 vars in 957 bytes} [Thu Jun 2 16:15:47 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 16:15:47.864893 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51564c7f-4137-4c19-a7ba-41fef1857cd3 service neutron] Authenticating user token {{(pid=80396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:15:47.866586 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.fernet_utils [None req-51564c7f-4137-4c19-a7ba-41fef1857cd3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:15:47.939961 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51564c7f-4137-4c19-a7ba-41fef1857cd3 service neutron] Validating token access rules against request {{(pid=80396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:15:47.944404 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d4eba0-8528-42e8-af93-fed55868890d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6534961c369940a5b88f310c6450250b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c87c981909d4b8db02783421818c79b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:15:47.944404 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d4eba0-8528-42e8-af93-fed55868890d service cinder] REQUEST_METHOD: `GET` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:15:47.944767 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d4eba0-8528-42e8-af93-fed55868890d service cinder] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:15:47.944950 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d4eba0-8528-42e8-af93-fed55868890d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:15:47.954626 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06d4eba0-8528-42e8-af93-fed55868890d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:15:47.956209 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06d4eba0-8528-42e8-af93-fed55868890d service cinder] RBAC: Authorization granted {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:15:47.966840 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 1287/2582] 10.222.0.59 () {60 vars in 1365 bytes} [Thu Jun 2 16:15:47 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 16:15:49.777718 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee4c3b1-01ac-45d4-a738-da863a6d5440 None None] REQUEST_METHOD: `POST` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:15:49.782364 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee4c3b1-01ac-45d4-a738-da863a6d5440 None None] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:15:49.782364 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee4c3b1-01ac-45d4-a738-da863a6d5440 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:15:49.795648 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.auth.core [None req-9ee4c3b1-01ac-45d4-a738-da863a6d5440 None None] MFA Rules not processed for user `2910f2833ce24b17b248ad9106f19786`. Rule list: `[]` (Enabled: `True`). {{(pid=80395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 16:15:49.796834 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.fernet_utils [None req-9ee4c3b1-01ac-45d4-a738-da863a6d5440 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:15:49.804413 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 1296/2583] 10.222.0.59 () {58 vars in 957 bytes} [Thu Jun 2 16:15:49 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 02 16:15:57.962049 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG dbcounter [-] [80396] Writing DB stats keystone:SELECT=91,keystone:DELETE=5,keystone:INSERT=3 {{(pid=80396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 16:15:58.467128 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e1de4f-6cda-4c51-9ff5-f4e12d16879d None None] REQUEST_METHOD: `POST` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:15:58.467417 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e1de4f-6cda-4c51-9ff5-f4e12d16879d None None] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:15:58.467743 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e1de4f-6cda-4c51-9ff5-f4e12d16879d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:15:58.490065 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.auth.core [None req-00e1de4f-6cda-4c51-9ff5-f4e12d16879d None None] MFA Rules not processed for user `11b714eb2dda4460a8ff52215e671bfa`. Rule list: `[]` (Enabled: `True`). {{(pid=80396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 16:15:58.491339 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.fernet_utils [None req-00e1de4f-6cda-4c51-9ff5-f4e12d16879d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:15:58.558523 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 1288/2584] 10.222.0.59 () {58 vars in 1009 bytes} [Thu Jun 2 16:15:58 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 02 16:15:58.710379 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ee4c3b1-01ac-45d4-a738-da863a6d5440 None None] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:15:58.711796 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.fernet_utils [None req-9ee4c3b1-01ac-45d4-a738-da863a6d5440 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:15:58.790848 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ee4c3b1-01ac-45d4-a738-da863a6d5440 None None] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:15:58.797351 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f51e83bd-95ce-43c5-a6c7-f3fd26ee0cd1 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31bd858bf7674f43a99b77d11bc3c1a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c87c981909d4b8db02783421818c79b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:15:58.798347 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f51e83bd-95ce-43c5-a6c7-f3fd26ee0cd1 service swift] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:15:58.798698 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f51e83bd-95ce-43c5-a6c7-f3fd26ee0cd1 service swift] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:15:58.799070 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f51e83bd-95ce-43c5-a6c7-f3fd26ee0cd1 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:15:58.811957 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f51e83bd-95ce-43c5-a6c7-f3fd26ee0cd1 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:15:58.814256 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f51e83bd-95ce-43c5-a6c7-f3fd26ee0cd1 service swift] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:15:58.825187 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 1297/2585] 10.222.0.59 () {60 vars in 1384 bytes} [Thu Jun 2 16:15:58 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 02 16:16:08.552001 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG dbcounter [-] [80396] Writing DB stats keystone:SELECT=25 {{(pid=80396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 16:16:08.820642 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writing DB stats keystone:SELECT=92 {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 16:16:16.913137 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00e1de4f-6cda-4c51-9ff5-f4e12d16879d None None] Authenticating user token {{(pid=80396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:16:16.914781 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.fernet_utils [None req-00e1de4f-6cda-4c51-9ff5-f4e12d16879d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:16:16.927432 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00e1de4f-6cda-4c51-9ff5-f4e12d16879d None None] Validating token access rules against request {{(pid=80396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:16:16.931118 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaaf0afa-6bc5-48da-94bb-03a1a3d8b360 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9af40ddfe9ff4be3887b068f13a28dc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c87c981909d4b8db02783421818c79b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:16:16.931760 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaaf0afa-6bc5-48da-94bb-03a1a3d8b360 service neutron] REQUEST_METHOD: `GET` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:16:16.932042 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaaf0afa-6bc5-48da-94bb-03a1a3d8b360 service neutron] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:16:16.932312 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaaf0afa-6bc5-48da-94bb-03a1a3d8b360 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:16:16.934100 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.fernet_utils [None req-aaaf0afa-6bc5-48da-94bb-03a1a3d8b360 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:16:16.999171 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaaf0afa-6bc5-48da-94bb-03a1a3d8b360 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:16:17.000614 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaaf0afa-6bc5-48da-94bb-03a1a3d8b360 service neutron] RBAC: Authorization granted {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:16:17.010861 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 1289/2586] 10.222.0.59 () {60 vars in 1365 bytes} [Thu Jun 2 16:16:16 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 02 16:16:22.627309 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93533b8a-2f2d-4250-8a1b-b81bcf0fd127 None None] REQUEST_METHOD: `POST` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:16:22.627309 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93533b8a-2f2d-4250-8a1b-b81bcf0fd127 None None] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:16:22.627309 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93533b8a-2f2d-4250-8a1b-b81bcf0fd127 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:16:22.644231 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.auth.core [None req-93533b8a-2f2d-4250-8a1b-b81bcf0fd127 None None] MFA Rules not processed for user `11b714eb2dda4460a8ff52215e671bfa`. Rule list: `[]` (Enabled: `True`). {{(pid=80395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 16:16:22.645415 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.fernet_utils [None req-93533b8a-2f2d-4250-8a1b-b81bcf0fd127 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:16:22.652740 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 1298/2587] 10.222.0.59 () {58 vars in 1009 bytes} [Thu Jun 2 16:16:22 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 16:16:22.667402 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaaf0afa-6bc5-48da-94bb-03a1a3d8b360 service neutron] Authenticating user token {{(pid=80396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:16:22.678610 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaaf0afa-6bc5-48da-94bb-03a1a3d8b360 service neutron] Validating token access rules against request {{(pid=80396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:16:22.684014 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81f49cab-6e6d-4f54-8a5a-6c14e9011c9f service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31bd858bf7674f43a99b77d11bc3c1a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c87c981909d4b8db02783421818c79b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:16:22.684703 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f49cab-6e6d-4f54-8a5a-6c14e9011c9f service swift] REQUEST_METHOD: `GET` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:16:22.684984 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f49cab-6e6d-4f54-8a5a-6c14e9011c9f service swift] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:16:22.685357 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f49cab-6e6d-4f54-8a5a-6c14e9011c9f service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:16:22.701776 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81f49cab-6e6d-4f54-8a5a-6c14e9011c9f service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:16:22.701776 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81f49cab-6e6d-4f54-8a5a-6c14e9011c9f service swift] RBAC: Authorization granted {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:16:22.715051 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 1290/2588] 10.222.0.59 () {60 vars in 1384 bytes} [Thu Jun 2 16:16:22 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 02 16:16:28.113119 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93533b8a-2f2d-4250-8a1b-b81bcf0fd127 None None] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:16:28.126232 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93533b8a-2f2d-4250-8a1b-b81bcf0fd127 None None] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:16:28.131455 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c7219d9-2197-4815-859c-6bf2c4871f39 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9af40ddfe9ff4be3887b068f13a28dc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c87c981909d4b8db02783421818c79b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:16:28.132541 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c7219d9-2197-4815-859c-6bf2c4871f39 service neutron] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:16:28.133076 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c7219d9-2197-4815-859c-6bf2c4871f39 service neutron] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:16:28.133576 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c7219d9-2197-4815-859c-6bf2c4871f39 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:16:28.136316 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.fernet_utils [None req-3c7219d9-2197-4815-859c-6bf2c4871f39 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:16:28.215851 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c7219d9-2197-4815-859c-6bf2c4871f39 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:16:28.217448 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c7219d9-2197-4815-859c-6bf2c4871f39 service neutron] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:16:28.230285 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 1299/2589] 10.222.0.59 () {60 vars in 1365 bytes} [Thu Jun 2 16:16:28 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 16:16:28.724304 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81f49cab-6e6d-4f54-8a5a-6c14e9011c9f service swift] Authenticating user token {{(pid=80396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:16:28.735152 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81f49cab-6e6d-4f54-8a5a-6c14e9011c9f service swift] Validating token access rules against request {{(pid=80396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:16:28.739517 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5abe1114-d3c7-4d6d-9a2d-9b1eac0d10bd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9af40ddfe9ff4be3887b068f13a28dc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c87c981909d4b8db02783421818c79b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:16:28.740541 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5abe1114-d3c7-4d6d-9a2d-9b1eac0d10bd service neutron] REQUEST_METHOD: `GET` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:16:28.740831 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5abe1114-d3c7-4d6d-9a2d-9b1eac0d10bd service neutron] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:16:28.741114 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5abe1114-d3c7-4d6d-9a2d-9b1eac0d10bd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:16:28.743216 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.fernet_utils [None req-5abe1114-d3c7-4d6d-9a2d-9b1eac0d10bd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:16:28.759279 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5abe1114-d3c7-4d6d-9a2d-9b1eac0d10bd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:16:28.761673 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5abe1114-d3c7-4d6d-9a2d-9b1eac0d10bd service neutron] RBAC: Authorization granted {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:16:28.774199 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 1291/2590] 10.222.0.59 () {60 vars in 1365 bytes} [Thu Jun 2 16:16:28 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 02 16:16:38.225933 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writing DB stats keystone:SELECT=37 {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 16:16:38.767935 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG dbcounter [-] [80396] Writing DB stats keystone:SELECT=40 {{(pid=80396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 16:16:40.942803 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c7219d9-2197-4815-859c-6bf2c4871f39 service neutron] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:16:40.951776 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c7219d9-2197-4815-859c-6bf2c4871f39 service neutron] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:16:40.963097 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abe94d5e-2409-4c0a-8c14-4638c7c49c11 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9af40ddfe9ff4be3887b068f13a28dc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c87c981909d4b8db02783421818c79b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:16:40.963835 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe94d5e-2409-4c0a-8c14-4638c7c49c11 service neutron] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:16:40.967024 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe94d5e-2409-4c0a-8c14-4638c7c49c11 service neutron] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:16:40.967024 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe94d5e-2409-4c0a-8c14-4638c7c49c11 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:16:40.967024 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.fernet_utils [None req-abe94d5e-2409-4c0a-8c14-4638c7c49c11 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:16:40.980051 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abe94d5e-2409-4c0a-8c14-4638c7c49c11 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:16:40.982090 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abe94d5e-2409-4c0a-8c14-4638c7c49c11 service neutron] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:16:40.993338 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 1300/2591] 10.222.0.59 () {60 vars in 1365 bytes} [Thu Jun 2 16:16:40 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 02 16:16:46.132745 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de07afb6-df70-40e8-b264-6f98d11869f7 None None] REQUEST_METHOD: `POST` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:16:46.133265 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de07afb6-df70-40e8-b264-6f98d11869f7 None None] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:16:46.133356 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de07afb6-df70-40e8-b264-6f98d11869f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:16:46.153731 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.auth.core [None req-de07afb6-df70-40e8-b264-6f98d11869f7 None None] MFA Rules not processed for user `11b714eb2dda4460a8ff52215e671bfa`. Rule list: `[]` (Enabled: `True`). {{(pid=80396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 16:16:46.154976 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.fernet_utils [None req-de07afb6-df70-40e8-b264-6f98d11869f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:16:46.173957 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 1292/2592] 10.222.0.59 () {58 vars in 967 bytes} [Thu Jun 2 16:16:46 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 16:16:46.182544 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abe94d5e-2409-4c0a-8c14-4638c7c49c11 service neutron] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:16:46.197560 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abe94d5e-2409-4c0a-8c14-4638c7c49c11 service neutron] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:16:46.204498 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-146e4d8e-4c39-4eeb-b177-cfe0cc63411b service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31bd858bf7674f43a99b77d11bc3c1a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c87c981909d4b8db02783421818c79b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:16:46.205446 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-146e4d8e-4c39-4eeb-b177-cfe0cc63411b service swift] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:16:46.206547 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-146e4d8e-4c39-4eeb-b177-cfe0cc63411b service swift] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:16:46.206993 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-146e4d8e-4c39-4eeb-b177-cfe0cc63411b service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:16:46.216100 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-146e4d8e-4c39-4eeb-b177-cfe0cc63411b service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:16:46.217762 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-146e4d8e-4c39-4eeb-b177-cfe0cc63411b service swift] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:16:46.227786 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 1301/2593] 10.222.0.59 () {60 vars in 1384 bytes} [Thu Jun 2 16:16:46 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 02 16:16:48.749176 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de07afb6-df70-40e8-b264-6f98d11869f7 None None] Authenticating user token {{(pid=80396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:16:48.754104 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.fernet_utils [None req-de07afb6-df70-40e8-b264-6f98d11869f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:16:48.825436 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de07afb6-df70-40e8-b264-6f98d11869f7 None None] Validating token access rules against request {{(pid=80396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:16:48.831679 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39fd2d29-5b98-48d3-8c39-12e488a89f88 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b700f6d94374ba4b362a8f0d5b35796', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c87c981909d4b8db02783421818c79b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:16:48.837326 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39fd2d29-5b98-48d3-8c39-12e488a89f88 service placement] REQUEST_METHOD: `GET` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:16:48.837326 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39fd2d29-5b98-48d3-8c39-12e488a89f88 service placement] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:16:48.837326 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39fd2d29-5b98-48d3-8c39-12e488a89f88 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:16:48.837326 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.fernet_utils [None req-39fd2d29-5b98-48d3-8c39-12e488a89f88 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:16:48.847075 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39fd2d29-5b98-48d3-8c39-12e488a89f88 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:16:48.848793 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39fd2d29-5b98-48d3-8c39-12e488a89f88 service placement] RBAC: Authorization granted {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:16:48.859151 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 1293/2594] 10.222.0.59 () {60 vars in 1365 bytes} [Thu Jun 2 16:16:48 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 16:16:48.870517 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-146e4d8e-4c39-4eeb-b177-cfe0cc63411b service swift] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:16:48.872192 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.fernet_utils [None req-146e4d8e-4c39-4eeb-b177-cfe0cc63411b service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:16:48.887123 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-146e4d8e-4c39-4eeb-b177-cfe0cc63411b service swift] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:16:48.900761 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b76384fb-2e04-4ce3-9310-d69bf2800220 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f73d5a98be74242b45222df39fb6213', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:16:48.900761 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b76384fb-2e04-4ce3-9310-d69bf2800220 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:16:48.900761 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b76384fb-2e04-4ce3-9310-d69bf2800220 admin admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:16:48.900761 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b76384fb-2e04-4ce3-9310-d69bf2800220 admin admin] PATH_INFO: `/v3/users/2f09d7a733fa43a7a45f56176c752447` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:16:48.901338 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b76384fb-2e04-4ce3-9310-d69bf2800220 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2f09d7a733fa43a7a45f56176c752447)` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:16:48.901338 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b76384fb-2e04-4ce3-9310-d69bf2800220 admin admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:16:49.104891 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.notifications [None req-b76384fb-2e04-4ce3-9310-d69bf2800220 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2f09d7a733fa43a7a45f56176c752447'} {{(pid=80395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:16:49.182587 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.notifications [None req-b76384fb-2e04-4ce3-9310-d69bf2800220 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2f09d7a733fa43a7a45f56176c752447'} {{(pid=80395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:16:49.196192 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.notifications [None req-b76384fb-2e04-4ce3-9310-d69bf2800220 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2f09d7a733fa43a7a45f56176c752447'} {{(pid=80395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:16:49.196862 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.notifications [None req-b76384fb-2e04-4ce3-9310-d69bf2800220 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2f09d7a733fa43a7a45f56176c752447'} {{(pid=80395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:16:49.203799 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.notifications [None req-b76384fb-2e04-4ce3-9310-d69bf2800220 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2f09d7a733fa43a7a45f56176c752447'} {{(pid=80395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:16:49.210032 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 1302/2595] 10.222.0.59 () {58 vars in 1223 bytes} [Thu Jun 2 16:16:48 2022] DELETE /identity/v3/users/2f09d7a733fa43a7a45f56176c752447 => generated 0 bytes in 340 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 16:16:49.481401 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39fd2d29-5b98-48d3-8c39-12e488a89f88 service placement] Authenticating user token {{(pid=80396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:16:49.492381 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39fd2d29-5b98-48d3-8c39-12e488a89f88 service placement] Validating token access rules against request {{(pid=80396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:16:49.553466 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74137dc2-11b7-4456-acff-2e45bb721d36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f73d5a98be74242b45222df39fb6213', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:16:49.554352 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74137dc2-11b7-4456-acff-2e45bb721d36 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:16:49.554637 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74137dc2-11b7-4456-acff-2e45bb721d36 admin admin] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:16:49.554914 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74137dc2-11b7-4456-acff-2e45bb721d36 admin admin] PATH_INFO: `/v3/projects/aa7bcb5f489f4a2db902c2035d9879a5` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:16:49.556085 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74137dc2-11b7-4456-acff-2e45bb721d36 admin admin] RBAC: Authorizing `identity:delete_project(project_id=aa7bcb5f489f4a2db902c2035d9879a5)` {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:16:49.557975 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74137dc2-11b7-4456-acff-2e45bb721d36 admin admin] RBAC: Authorization granted {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:16:49.673909 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.notifications [None req-74137dc2-11b7-4456-acff-2e45bb721d36 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'aa7bcb5f489f4a2db902c2035d9879a5', 'request_id': 'req-74137dc2-11b7-4456-acff-2e45bb721d36'} {{(pid=80396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:16:49.680839 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.notifications [None req-74137dc2-11b7-4456-acff-2e45bb721d36 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'aa7bcb5f489f4a2db902c2035d9879a5', 'request_id': 'req-74137dc2-11b7-4456-acff-2e45bb721d36'} {{(pid=80396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:16:49.779159 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.notifications [None req-74137dc2-11b7-4456-acff-2e45bb721d36 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'aa7bcb5f489f4a2db902c2035d9879a5', 'request_id': 'req-74137dc2-11b7-4456-acff-2e45bb721d36'} {{(pid=80396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:16:49.792298 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.notifications [None req-74137dc2-11b7-4456-acff-2e45bb721d36 admin admin] The token cache is being invalidate because project aa7bcb5f489f4a2db902c2035d9879a5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80396) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 02 16:16:49.792698 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.notifications [None req-74137dc2-11b7-4456-acff-2e45bb721d36 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:16:49.793309 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.notifications [None req-74137dc2-11b7-4456-acff-2e45bb721d36 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:16:49.795050 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 1294/2596] 10.222.0.59 () {58 vars in 1232 bytes} [Thu Jun 2 16:16:49 2022] DELETE /identity/v3/projects/aa7bcb5f489f4a2db902c2035d9879a5 => generated 0 bytes in 314 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 16:16:49.799229 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b76384fb-2e04-4ce3-9310-d69bf2800220 admin admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:16:49.800946 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.fernet_utils [None req-b76384fb-2e04-4ce3-9310-d69bf2800220 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:16:49.814798 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b76384fb-2e04-4ce3-9310-d69bf2800220 admin admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:16:49.876227 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-375be59f-1e75-439b-a32a-6698d87cf92f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f73d5a98be74242b45222df39fb6213', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:16:49.877133 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375be59f-1e75-439b-a32a-6698d87cf92f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:16:49.877383 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375be59f-1e75-439b-a32a-6698d87cf92f admin admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:16:49.878244 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375be59f-1e75-439b-a32a-6698d87cf92f admin admin] PATH_INFO: `/v3/users/5c74b6deafc74a7ca85b145628e0731b` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:16:49.879478 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-375be59f-1e75-439b-a32a-6698d87cf92f admin admin] RBAC: Authorizing `identity:delete_user(user_id=5c74b6deafc74a7ca85b145628e0731b)` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:16:49.881410 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-375be59f-1e75-439b-a32a-6698d87cf92f admin admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:16:50.108374 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.notifications [None req-375be59f-1e75-439b-a32a-6698d87cf92f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5c74b6deafc74a7ca85b145628e0731b'} {{(pid=80395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:16:50.110039 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writing DB stats keystone:SELECT=82,keystone:DELETE=17,keystone:INSERT=1 {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 16:16:50.184233 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.notifications [None req-375be59f-1e75-439b-a32a-6698d87cf92f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5c74b6deafc74a7ca85b145628e0731b'} {{(pid=80395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:16:50.212834 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.notifications [None req-375be59f-1e75-439b-a32a-6698d87cf92f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5c74b6deafc74a7ca85b145628e0731b'} {{(pid=80395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:16:50.213756 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.notifications [None req-375be59f-1e75-439b-a32a-6698d87cf92f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5c74b6deafc74a7ca85b145628e0731b'} {{(pid=80395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:16:50.222417 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.notifications [None req-375be59f-1e75-439b-a32a-6698d87cf92f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5c74b6deafc74a7ca85b145628e0731b'} {{(pid=80395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:16:50.229288 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 1303/2597] 10.222.0.59 () {58 vars in 1223 bytes} [Thu Jun 2 16:16:49 2022] DELETE /identity/v3/users/5c74b6deafc74a7ca85b145628e0731b => generated 0 bytes in 431 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 02 16:16:50.492288 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74137dc2-11b7-4456-acff-2e45bb721d36 admin admin] Authenticating user token {{(pid=80396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:16:50.493799 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.fernet_utils [None req-74137dc2-11b7-4456-acff-2e45bb721d36 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:16:50.514302 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74137dc2-11b7-4456-acff-2e45bb721d36 admin admin] Validating token access rules against request {{(pid=80396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:16:50.532974 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG dbcounter [-] [80396] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 16:16:50.584232 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eabe733d-eee5-4e5e-8c10-27b06989f8be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f73d5a98be74242b45222df39fb6213', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:16:50.585088 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eabe733d-eee5-4e5e-8c10-27b06989f8be admin admin] REQUEST_METHOD: `DELETE` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:16:50.585372 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eabe733d-eee5-4e5e-8c10-27b06989f8be admin admin] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:16:50.585654 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eabe733d-eee5-4e5e-8c10-27b06989f8be admin admin] PATH_INFO: `/v3/projects/347c963f7ce64b1395a727389b88afe0` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:16:50.586875 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eabe733d-eee5-4e5e-8c10-27b06989f8be admin admin] RBAC: Authorizing `identity:delete_project(project_id=347c963f7ce64b1395a727389b88afe0)` {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:16:50.588809 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eabe733d-eee5-4e5e-8c10-27b06989f8be admin admin] RBAC: Authorization granted {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:16:50.714899 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.notifications [None req-eabe733d-eee5-4e5e-8c10-27b06989f8be admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '347c963f7ce64b1395a727389b88afe0', 'request_id': 'req-eabe733d-eee5-4e5e-8c10-27b06989f8be'} {{(pid=80396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:16:50.721988 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.notifications [None req-eabe733d-eee5-4e5e-8c10-27b06989f8be admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '347c963f7ce64b1395a727389b88afe0', 'request_id': 'req-eabe733d-eee5-4e5e-8c10-27b06989f8be'} {{(pid=80396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:16:50.817198 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.notifications [None req-eabe733d-eee5-4e5e-8c10-27b06989f8be admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '347c963f7ce64b1395a727389b88afe0', 'request_id': 'req-eabe733d-eee5-4e5e-8c10-27b06989f8be'} {{(pid=80396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:16:50.828377 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.notifications [None req-eabe733d-eee5-4e5e-8c10-27b06989f8be admin admin] The token cache is being invalidate because project 347c963f7ce64b1395a727389b88afe0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80396) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 02 16:16:50.828664 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.notifications [None req-eabe733d-eee5-4e5e-8c10-27b06989f8be admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:16:50.829280 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.notifications [None req-eabe733d-eee5-4e5e-8c10-27b06989f8be admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:16:50.831491 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 1295/2598] 10.222.0.59 () {58 vars in 1232 bytes} [Thu Jun 2 16:16:50 2022] DELETE /identity/v3/projects/347c963f7ce64b1395a727389b88afe0 => generated 0 bytes in 340 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 02 16:17:00.388041 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writing DB stats keystone:INSERT=1,keystone:DELETE=3,keystone:SELECT=12 {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 16:17:00.825185 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG dbcounter [-] [80396] Writing DB stats keystone:SELECT=45,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 16:17:31.579911 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-375be59f-1e75-439b-a32a-6698d87cf92f admin admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:17:31.581395 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.fernet_utils [None req-375be59f-1e75-439b-a32a-6698d87cf92f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:17:31.639285 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-375be59f-1e75-439b-a32a-6698d87cf92f admin admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:17:31.687856 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0141cc0-2252-4381-b14a-3e3a04d6c3e6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6534961c369940a5b88f310c6450250b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c87c981909d4b8db02783421818c79b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:17:31.688636 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0141cc0-2252-4381-b14a-3e3a04d6c3e6 service cinder] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:17:31.688926 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0141cc0-2252-4381-b14a-3e3a04d6c3e6 service cinder] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:17:31.689197 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0141cc0-2252-4381-b14a-3e3a04d6c3e6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:17:31.690982 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.fernet_utils [None req-a0141cc0-2252-4381-b14a-3e3a04d6c3e6 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:17:31.770451 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0141cc0-2252-4381-b14a-3e3a04d6c3e6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:17:31.771815 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0141cc0-2252-4381-b14a-3e3a04d6c3e6 service cinder] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:17:31.791424 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 1304/2599] 10.222.0.59 () {60 vars in 1365 bytes} [Thu Jun 2 16:17:31 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 212 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 16:17:40.396065 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eabe733d-eee5-4e5e-8c10-27b06989f8be admin admin] Authenticating user token {{(pid=80396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:17:40.397578 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.fernet_utils [None req-eabe733d-eee5-4e5e-8c10-27b06989f8be admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:17:40.456954 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eabe733d-eee5-4e5e-8c10-27b06989f8be admin admin] Validating token access rules against request {{(pid=80396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:17:40.460432 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dbc94ca-7da8-4e6e-ad9c-9885fc09d93e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9af40ddfe9ff4be3887b068f13a28dc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c87c981909d4b8db02783421818c79b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:17:40.461069 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dbc94ca-7da8-4e6e-ad9c-9885fc09d93e service neutron] REQUEST_METHOD: `GET` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:17:40.461351 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dbc94ca-7da8-4e6e-ad9c-9885fc09d93e service neutron] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:17:40.461626 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dbc94ca-7da8-4e6e-ad9c-9885fc09d93e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:17:40.463410 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.fernet_utils [None req-3dbc94ca-7da8-4e6e-ad9c-9885fc09d93e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:17:40.473803 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dbc94ca-7da8-4e6e-ad9c-9885fc09d93e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:17:40.475250 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dbc94ca-7da8-4e6e-ad9c-9885fc09d93e service neutron] RBAC: Authorization granted {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:17:40.483225 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 1296/2600] 10.222.0.59 () {60 vars in 1365 bytes} [Thu Jun 2 16:17:40 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 16:17:41.788347 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writing DB stats keystone:SELECT=81 {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 16:17:50.479548 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG dbcounter [-] [80396] Writing DB stats keystone:SELECT=26 {{(pid=80396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 16:18:36.922729 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0141cc0-2252-4381-b14a-3e3a04d6c3e6 service cinder] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:18:36.924810 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.fernet_utils [None req-a0141cc0-2252-4381-b14a-3e3a04d6c3e6 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:18:37.043872 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0141cc0-2252-4381-b14a-3e3a04d6c3e6 service cinder] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:18:37.049837 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8ba9bf3-ebc1-4095-9fb0-c7d8e5dd3c24 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52f9fe4b13574516bb0a8e2aa11a61e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c87c981909d4b8db02783421818c79b', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:18:37.050504 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ba9bf3-ebc1-4095-9fb0-c7d8e5dd3c24 service nova] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:18:37.050788 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ba9bf3-ebc1-4095-9fb0-c7d8e5dd3c24 service nova] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:18:37.051064 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ba9bf3-ebc1-4095-9fb0-c7d8e5dd3c24 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:18:37.052816 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.fernet_utils [None req-e8ba9bf3-ebc1-4095-9fb0-c7d8e5dd3c24 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:18:37.109003 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8ba9bf3-ebc1-4095-9fb0-c7d8e5dd3c24 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:18:37.110619 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8ba9bf3-ebc1-4095-9fb0-c7d8e5dd3c24 service nova] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:18:37.119960 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 1305/2601] 10.222.0.59 () {60 vars in 1365 bytes} [Thu Jun 2 16:18:36 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 198 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 16:18:47.115877 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writing DB stats keystone:SELECT=78 {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 16:19:39.900261 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dbc94ca-7da8-4e6e-ad9c-9885fc09d93e service neutron] Authenticating user token {{(pid=80396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:19:39.901677 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.fernet_utils [None req-3dbc94ca-7da8-4e6e-ad9c-9885fc09d93e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:19:40.021194 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dbc94ca-7da8-4e6e-ad9c-9885fc09d93e service neutron] Validating token access rules against request {{(pid=80396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:19:40.026336 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efa9d50e-f0f6-4ef0-8c14-9b1a604036d8 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b700f6d94374ba4b362a8f0d5b35796', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c87c981909d4b8db02783421818c79b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:19:40.026975 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa9d50e-f0f6-4ef0-8c14-9b1a604036d8 service placement] REQUEST_METHOD: `GET` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:19:40.027265 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa9d50e-f0f6-4ef0-8c14-9b1a604036d8 service placement] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:19:40.027728 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa9d50e-f0f6-4ef0-8c14-9b1a604036d8 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:19:40.029584 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.fernet_utils [None req-efa9d50e-f0f6-4ef0-8c14-9b1a604036d8 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:19:40.040848 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efa9d50e-f0f6-4ef0-8c14-9b1a604036d8 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:19:40.042458 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efa9d50e-f0f6-4ef0-8c14-9b1a604036d8 service placement] RBAC: Authorization granted {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:19:40.052821 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 1297/2602] 10.222.0.59 () {60 vars in 1365 bytes} [Thu Jun 2 16:19:39 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 153 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 16:19:40.749913 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8ba9bf3-ebc1-4095-9fb0-c7d8e5dd3c24 service nova] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:19:40.751335 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.fernet_utils [None req-e8ba9bf3-ebc1-4095-9fb0-c7d8e5dd3c24 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:19:40.785200 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8ba9bf3-ebc1-4095-9fb0-c7d8e5dd3c24 service nova] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:19:40.788888 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc65b5f4-d71f-48e2-b3b8-3709a8b3f783 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6534961c369940a5b88f310c6450250b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c87c981909d4b8db02783421818c79b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:19:40.789532 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc65b5f4-d71f-48e2-b3b8-3709a8b3f783 service cinder] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:19:40.789819 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc65b5f4-d71f-48e2-b3b8-3709a8b3f783 service cinder] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:19:40.790121 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc65b5f4-d71f-48e2-b3b8-3709a8b3f783 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:19:40.791907 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.fernet_utils [None req-cc65b5f4-d71f-48e2-b3b8-3709a8b3f783 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:19:40.874108 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc65b5f4-d71f-48e2-b3b8-3709a8b3f783 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:19:40.875555 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc65b5f4-d71f-48e2-b3b8-3709a8b3f783 service cinder] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:19:40.894389 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 1306/2603] 10.222.0.59 () {60 vars in 1365 bytes} [Thu Jun 2 16:19:40 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 145 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 16:19:45.891619 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efa9d50e-f0f6-4ef0-8c14-9b1a604036d8 service placement] Authenticating user token {{(pid=80396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:19:45.893114 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.fernet_utils [None req-efa9d50e-f0f6-4ef0-8c14-9b1a604036d8 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:19:45.943037 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efa9d50e-f0f6-4ef0-8c14-9b1a604036d8 service placement] Validating token access rules against request {{(pid=80396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:19:45.949130 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e35bdb2a-e79c-40c1-a2dc-9e2e2d77628c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52f9fe4b13574516bb0a8e2aa11a61e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c87c981909d4b8db02783421818c79b', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:19:45.951890 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e35bdb2a-e79c-40c1-a2dc-9e2e2d77628c service nova] REQUEST_METHOD: `GET` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:19:45.951890 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e35bdb2a-e79c-40c1-a2dc-9e2e2d77628c service nova] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:19:45.951890 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e35bdb2a-e79c-40c1-a2dc-9e2e2d77628c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:19:45.952777 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.fernet_utils [None req-e35bdb2a-e79c-40c1-a2dc-9e2e2d77628c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:19:45.967272 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e35bdb2a-e79c-40c1-a2dc-9e2e2d77628c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:19:45.969001 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e35bdb2a-e79c-40c1-a2dc-9e2e2d77628c service nova] RBAC: Authorization granted {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:19:45.985272 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 1298/2604] 10.222.0.59 () {60 vars in 1365 bytes} [Thu Jun 2 16:19:45 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 16:19:50.891739 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writing DB stats keystone:SELECT=50 {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 16:19:55.977699 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG dbcounter [-] [80396] Writing DB stats keystone:SELECT=72 {{(pid=80396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 16:21:29.901833 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc65b5f4-d71f-48e2-b3b8-3709a8b3f783 service cinder] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:21:29.903271 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.fernet_utils [None req-cc65b5f4-d71f-48e2-b3b8-3709a8b3f783 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:21:29.936171 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc65b5f4-d71f-48e2-b3b8-3709a8b3f783 service cinder] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:21:29.939902 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c0dec2e-cf14-4c2e-94b0-520f51ced2e0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9af40ddfe9ff4be3887b068f13a28dc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c87c981909d4b8db02783421818c79b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:21:29.940531 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0dec2e-cf14-4c2e-94b0-520f51ced2e0 service neutron] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:21:29.940810 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0dec2e-cf14-4c2e-94b0-520f51ced2e0 service neutron] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:21:29.941083 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0dec2e-cf14-4c2e-94b0-520f51ced2e0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:21:29.942845 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.fernet_utils [None req-9c0dec2e-cf14-4c2e-94b0-520f51ced2e0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:21:29.956257 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c0dec2e-cf14-4c2e-94b0-520f51ced2e0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:21:29.957675 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c0dec2e-cf14-4c2e-94b0-520f51ced2e0 service neutron] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:21:29.968914 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 1307/2605] 10.222.0.59 () {60 vars in 1365 bytes} [Thu Jun 2 16:21:29 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 68 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 16:21:31.070794 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e35bdb2a-e79c-40c1-a2dc-9e2e2d77628c service nova] Authenticating user token {{(pid=80396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:21:31.080745 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e35bdb2a-e79c-40c1-a2dc-9e2e2d77628c service nova] Validating token access rules against request {{(pid=80396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:21:31.084299 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dea89611-cb77-4b0d-9edc-6e72c9d277fd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9af40ddfe9ff4be3887b068f13a28dc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c87c981909d4b8db02783421818c79b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:21:31.084953 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea89611-cb77-4b0d-9edc-6e72c9d277fd service neutron] REQUEST_METHOD: `GET` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:21:31.085233 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea89611-cb77-4b0d-9edc-6e72c9d277fd service neutron] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:21:31.085508 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea89611-cb77-4b0d-9edc-6e72c9d277fd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:21:31.087296 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.fernet_utils [None req-dea89611-cb77-4b0d-9edc-6e72c9d277fd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:21:31.100883 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dea89611-cb77-4b0d-9edc-6e72c9d277fd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:21:31.102332 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dea89611-cb77-4b0d-9edc-6e72c9d277fd service neutron] RBAC: Authorization granted {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:21:31.113773 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 1299/2606] 10.222.0.59 () {60 vars in 1365 bytes} [Thu Jun 2 16:21:31 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 16:21:39.963550 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writing DB stats keystone:SELECT=15 {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 16:21:41.104640 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c0dec2e-cf14-4c2e-94b0-520f51ced2e0 service neutron] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:21:41.109055 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG dbcounter [-] [80396] Writing DB stats keystone:SELECT=6 {{(pid=80396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 16:21:41.114949 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c0dec2e-cf14-4c2e-94b0-520f51ced2e0 service neutron] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:21:41.118677 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2129ea0e-2839-4fe5-94ac-6267f7cfd537 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6534961c369940a5b88f310c6450250b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c87c981909d4b8db02783421818c79b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:21:41.119254 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2129ea0e-2839-4fe5-94ac-6267f7cfd537 service cinder] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:21:41.119538 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2129ea0e-2839-4fe5-94ac-6267f7cfd537 service cinder] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:21:41.119816 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2129ea0e-2839-4fe5-94ac-6267f7cfd537 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:21:41.121882 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.fernet_utils [None req-2129ea0e-2839-4fe5-94ac-6267f7cfd537 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:21:41.192383 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2129ea0e-2839-4fe5-94ac-6267f7cfd537 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:21:41.193844 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2129ea0e-2839-4fe5-94ac-6267f7cfd537 service cinder] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:21:41.203322 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 1308/2607] 10.222.0.59 () {60 vars in 1365 bytes} [Thu Jun 2 16:21:41 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 16:21:51.198977 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writing DB stats keystone:SELECT=28 {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 16:23:31.655557 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dea89611-cb77-4b0d-9edc-6e72c9d277fd service neutron] Authenticating user token {{(pid=80396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:23:31.665372 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dea89611-cb77-4b0d-9edc-6e72c9d277fd service neutron] Validating token access rules against request {{(pid=80396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:23:31.669098 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cad5398-e56b-4250-83ca-fa2765636b65 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9af40ddfe9ff4be3887b068f13a28dc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c87c981909d4b8db02783421818c79b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:23:31.669738 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cad5398-e56b-4250-83ca-fa2765636b65 service neutron] REQUEST_METHOD: `GET` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:23:31.670022 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cad5398-e56b-4250-83ca-fa2765636b65 service neutron] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:23:31.670358 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cad5398-e56b-4250-83ca-fa2765636b65 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:23:31.678050 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cad5398-e56b-4250-83ca-fa2765636b65 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:23:31.679537 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cad5398-e56b-4250-83ca-fa2765636b65 service neutron] RBAC: Authorization granted {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:23:31.687421 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 1300/2608] 10.222.0.59 () {60 vars in 1365 bytes} [Thu Jun 2 16:23:31 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 32 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 02 16:23:37.077568 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2129ea0e-2839-4fe5-94ac-6267f7cfd537 service cinder] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:23:37.089903 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2129ea0e-2839-4fe5-94ac-6267f7cfd537 service cinder] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:23:37.095501 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8482e769-8ad7-4438-9553-11247a72c89e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52f9fe4b13574516bb0a8e2aa11a61e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c87c981909d4b8db02783421818c79b', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:23:37.096185 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8482e769-8ad7-4438-9553-11247a72c89e service nova] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:23:37.096462 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8482e769-8ad7-4438-9553-11247a72c89e service nova] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:23:37.096735 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8482e769-8ad7-4438-9553-11247a72c89e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:23:37.104306 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8482e769-8ad7-4438-9553-11247a72c89e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:23:37.105890 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8482e769-8ad7-4438-9553-11247a72c89e service nova] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:23:37.133484 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 1309/2609] 10.222.0.59 () {60 vars in 1365 bytes} [Thu Jun 2 16:23:37 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 16:23:41.637166 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cad5398-e56b-4250-83ca-fa2765636b65 service neutron] Authenticating user token {{(pid=80396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:23:41.646644 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cad5398-e56b-4250-83ca-fa2765636b65 service neutron] Validating token access rules against request {{(pid=80396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:23:41.650391 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fb25625-ba58-4990-8482-6351e23668ee service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6534961c369940a5b88f310c6450250b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c87c981909d4b8db02783421818c79b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:23:41.651084 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb25625-ba58-4990-8482-6351e23668ee service cinder] REQUEST_METHOD: `GET` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:23:41.651357 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb25625-ba58-4990-8482-6351e23668ee service cinder] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:23:41.651598 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb25625-ba58-4990-8482-6351e23668ee service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:23:41.660328 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fb25625-ba58-4990-8482-6351e23668ee service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:23:41.661746 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fb25625-ba58-4990-8482-6351e23668ee service cinder] RBAC: Authorization granted {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:23:41.670796 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 1301/2610] 10.222.0.59 () {60 vars in 1365 bytes} [Thu Jun 2 16:23:41 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 34 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 16:23:47.130929 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writing DB stats keystone:SELECT=13 {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 16:23:51.666561 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG dbcounter [-] [80396] Writing DB stats keystone:SELECT=12 {{(pid=80396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 16:24:46.932394 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8482e769-8ad7-4438-9553-11247a72c89e service nova] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:24:46.945308 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8482e769-8ad7-4438-9553-11247a72c89e service nova] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:24:46.950538 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b2aad6a-6869-463f-8ae9-923b329db182 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b700f6d94374ba4b362a8f0d5b35796', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c87c981909d4b8db02783421818c79b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:24:46.951234 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b2aad6a-6869-463f-8ae9-923b329db182 service placement] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:24:46.951516 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b2aad6a-6869-463f-8ae9-923b329db182 service placement] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:24:46.951793 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b2aad6a-6869-463f-8ae9-923b329db182 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:24:46.961214 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b2aad6a-6869-463f-8ae9-923b329db182 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:24:46.962851 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b2aad6a-6869-463f-8ae9-923b329db182 service placement] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:24:46.973529 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 1310/2611] 10.222.0.59 () {60 vars in 1365 bytes} [Thu Jun 2 16:24:46 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 02 16:24:56.968362 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writing DB stats keystone:SELECT=6 {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 16:25:41.912612 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fb25625-ba58-4990-8482-6351e23668ee service cinder] Authenticating user token {{(pid=80396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:25:41.921809 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fb25625-ba58-4990-8482-6351e23668ee service cinder] Validating token access rules against request {{(pid=80396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:25:41.925404 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ee17b1a-81a0-4bc6-be02-4d504f25249b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6534961c369940a5b88f310c6450250b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c87c981909d4b8db02783421818c79b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:25:41.926034 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee17b1a-81a0-4bc6-be02-4d504f25249b service cinder] REQUEST_METHOD: `GET` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:25:41.926346 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee17b1a-81a0-4bc6-be02-4d504f25249b service cinder] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:25:41.926624 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee17b1a-81a0-4bc6-be02-4d504f25249b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:25:41.935436 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ee17b1a-81a0-4bc6-be02-4d504f25249b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:25:41.936863 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ee17b1a-81a0-4bc6-be02-4d504f25249b service cinder] RBAC: Authorization granted {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:25:41.945920 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 1302/2612] 10.222.0.59 () {60 vars in 1365 bytes} [Thu Jun 2 16:25:41 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 34 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 16:25:51.941621 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG dbcounter [-] [80396] Writing DB stats keystone:SELECT=6 {{(pid=80396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 16:26:30.551616 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b2aad6a-6869-463f-8ae9-923b329db182 service placement] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:26:30.561051 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b2aad6a-6869-463f-8ae9-923b329db182 service placement] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:26:30.564652 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c813a42-bc0d-4225-b441-c76c6c3737d6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9af40ddfe9ff4be3887b068f13a28dc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c87c981909d4b8db02783421818c79b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:26:30.565278 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c813a42-bc0d-4225-b441-c76c6c3737d6 service neutron] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:26:30.565564 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c813a42-bc0d-4225-b441-c76c6c3737d6 service neutron] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:26:30.565841 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c813a42-bc0d-4225-b441-c76c6c3737d6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:26:30.576068 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c813a42-bc0d-4225-b441-c76c6c3737d6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:26:30.577505 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c813a42-bc0d-4225-b441-c76c6c3737d6 service neutron] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:26:30.588820 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 1311/2613] 10.222.0.59 () {60 vars in 1365 bytes} [Thu Jun 2 16:26:30 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 16:26:40.583401 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writing DB stats keystone:SELECT=6 {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 16:26:41.992934 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ee17b1a-81a0-4bc6-be02-4d504f25249b service cinder] Authenticating user token {{(pid=80396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:26:42.005476 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ee17b1a-81a0-4bc6-be02-4d504f25249b service cinder] Validating token access rules against request {{(pid=80396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:26:42.010766 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a92756-bb10-4ecf-a3cd-a9fa9e93e10c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52f9fe4b13574516bb0a8e2aa11a61e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c87c981909d4b8db02783421818c79b', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:26:42.011385 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a92756-bb10-4ecf-a3cd-a9fa9e93e10c service nova] REQUEST_METHOD: `GET` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:26:42.011662 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a92756-bb10-4ecf-a3cd-a9fa9e93e10c service nova] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:26:42.011934 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a92756-bb10-4ecf-a3cd-a9fa9e93e10c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:26:42.019541 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45a92756-bb10-4ecf-a3cd-a9fa9e93e10c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:26:42.021097 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45a92756-bb10-4ecf-a3cd-a9fa9e93e10c service nova] RBAC: Authorization granted {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:26:42.048497 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 1303/2614] 10.222.0.59 () {60 vars in 1365 bytes} [Thu Jun 2 16:26:41 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 16:26:52.045906 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG dbcounter [-] [80396] Writing DB stats keystone:SELECT=13 {{(pid=80396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 16:27:42.190365 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c813a42-bc0d-4225-b441-c76c6c3737d6 service neutron] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:27:42.246200 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c813a42-bc0d-4225-b441-c76c6c3737d6 service neutron] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:27:42.249758 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a399444-5517-4c38-a250-ea0dc6d565ef service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6534961c369940a5b88f310c6450250b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c87c981909d4b8db02783421818c79b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:27:42.250438 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a399444-5517-4c38-a250-ea0dc6d565ef service cinder] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:27:42.250718 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a399444-5517-4c38-a250-ea0dc6d565ef service cinder] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:27:42.250993 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a399444-5517-4c38-a250-ea0dc6d565ef service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:27:42.261128 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a399444-5517-4c38-a250-ea0dc6d565ef service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:27:42.262600 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a399444-5517-4c38-a250-ea0dc6d565ef service cinder] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:27:42.273282 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 1312/2615] 10.222.0.59 () {60 vars in 1365 bytes} [Thu Jun 2 16:27:42 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 16:27:52.268493 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writing DB stats keystone:SELECT=26 {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 16:28:34.631323 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a92756-bb10-4ecf-a3cd-a9fa9e93e10c service nova] Authenticating user token {{(pid=80396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:28:34.685423 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a92756-bb10-4ecf-a3cd-a9fa9e93e10c service nova] Validating token access rules against request {{(pid=80396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:28:34.689006 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75f9d3d8-eee1-41c7-8657-68dbeca5623c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9af40ddfe9ff4be3887b068f13a28dc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c87c981909d4b8db02783421818c79b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:28:34.689645 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f9d3d8-eee1-41c7-8657-68dbeca5623c service neutron] REQUEST_METHOD: `GET` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:28:34.689930 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f9d3d8-eee1-41c7-8657-68dbeca5623c service neutron] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:28:34.690239 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f9d3d8-eee1-41c7-8657-68dbeca5623c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:28:34.692134 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.fernet_utils [None req-75f9d3d8-eee1-41c7-8657-68dbeca5623c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:28:34.701454 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75f9d3d8-eee1-41c7-8657-68dbeca5623c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:28:34.702901 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75f9d3d8-eee1-41c7-8657-68dbeca5623c service neutron] RBAC: Authorization granted {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:28:34.710827 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 1304/2616] 10.222.0.59 () {60 vars in 1365 bytes} [Thu Jun 2 16:28:34 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 80 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 16:28:37.353366 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a399444-5517-4c38-a250-ea0dc6d565ef service cinder] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:28:37.354818 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.fernet_utils [None req-1a399444-5517-4c38-a250-ea0dc6d565ef service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:28:37.366063 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a399444-5517-4c38-a250-ea0dc6d565ef service cinder] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:28:37.370035 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1dd472a-6c85-47d6-8f63-52f632214664 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6534961c369940a5b88f310c6450250b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c87c981909d4b8db02783421818c79b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:28:37.370691 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1dd472a-6c85-47d6-8f63-52f632214664 service cinder] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:28:37.371002 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1dd472a-6c85-47d6-8f63-52f632214664 service cinder] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:28:37.371279 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1dd472a-6c85-47d6-8f63-52f632214664 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:28:37.373127 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.fernet_utils [None req-f1dd472a-6c85-47d6-8f63-52f632214664 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:28:37.459244 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1dd472a-6c85-47d6-8f63-52f632214664 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:28:37.460687 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1dd472a-6c85-47d6-8f63-52f632214664 service cinder] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:28:37.470779 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 1313/2617] 10.222.0.59 () {60 vars in 1365 bytes} [Thu Jun 2 16:28:37 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 16:28:42.326884 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75f9d3d8-eee1-41c7-8657-68dbeca5623c service neutron] Authenticating user token {{(pid=80396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:28:42.403650 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75f9d3d8-eee1-41c7-8657-68dbeca5623c service neutron] Validating token access rules against request {{(pid=80396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:28:42.409082 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72911b6d-b25c-4133-911e-bed46033b622 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52f9fe4b13574516bb0a8e2aa11a61e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c87c981909d4b8db02783421818c79b', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:28:42.409719 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72911b6d-b25c-4133-911e-bed46033b622 service nova] REQUEST_METHOD: `GET` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:28:42.410003 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72911b6d-b25c-4133-911e-bed46033b622 service nova] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:28:42.410314 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72911b6d-b25c-4133-911e-bed46033b622 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:28:42.412181 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.fernet_utils [None req-72911b6d-b25c-4133-911e-bed46033b622 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:28:42.493218 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72911b6d-b25c-4133-911e-bed46033b622 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:28:42.494836 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72911b6d-b25c-4133-911e-bed46033b622 service nova] RBAC: Authorization granted {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:28:42.513531 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 1305/2618] 10.222.0.59 () {60 vars in 1365 bytes} [Thu Jun 2 16:28:42 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 187 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 16:28:47.466334 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writing DB stats keystone:SELECT=39 {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 16:28:52.510972 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG dbcounter [-] [80396] Writing DB stats keystone:SELECT=98 {{(pid=80396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 16:29:51.065191 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1dd472a-6c85-47d6-8f63-52f632214664 service cinder] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:29:51.066828 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.fernet_utils [None req-f1dd472a-6c85-47d6-8f63-52f632214664 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:29:51.185123 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1dd472a-6c85-47d6-8f63-52f632214664 service cinder] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:29:51.190279 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44b93a87-3c9b-4a56-a10f-ab3d711c9b2c service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b700f6d94374ba4b362a8f0d5b35796', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c87c981909d4b8db02783421818c79b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:29:51.190924 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b93a87-3c9b-4a56-a10f-ab3d711c9b2c service placement] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:29:51.191204 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b93a87-3c9b-4a56-a10f-ab3d711c9b2c service placement] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:29:51.191478 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b93a87-3c9b-4a56-a10f-ab3d711c9b2c service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:29:51.193380 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.fernet_utils [None req-44b93a87-3c9b-4a56-a10f-ab3d711c9b2c service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:29:51.204907 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44b93a87-3c9b-4a56-a10f-ab3d711c9b2c service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:29:51.206516 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44b93a87-3c9b-4a56-a10f-ab3d711c9b2c service placement] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:29:51.216310 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 1314/2619] 10.222.0.59 () {60 vars in 1365 bytes} [Thu Jun 2 16:29:51 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 152 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 16:30:01.212178 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writing DB stats keystone:SELECT=54 {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 16:30:41.950315 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72911b6d-b25c-4133-911e-bed46033b622 service nova] Authenticating user token {{(pid=80396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:30:41.979806 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72911b6d-b25c-4133-911e-bed46033b622 service nova] Validating token access rules against request {{(pid=80396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:30:41.983389 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e76f88d8-1d01-4cb5-9650-0fc44abf367a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6534961c369940a5b88f310c6450250b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c87c981909d4b8db02783421818c79b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:30:41.984026 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76f88d8-1d01-4cb5-9650-0fc44abf367a service cinder] REQUEST_METHOD: `GET` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:30:41.984307 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76f88d8-1d01-4cb5-9650-0fc44abf367a service cinder] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:30:41.984582 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76f88d8-1d01-4cb5-9650-0fc44abf367a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:30:41.986522 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.fernet_utils [None req-e76f88d8-1d01-4cb5-9650-0fc44abf367a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:30:42.066713 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e76f88d8-1d01-4cb5-9650-0fc44abf367a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:30:42.068180 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e76f88d8-1d01-4cb5-9650-0fc44abf367a service cinder] RBAC: Authorization granted {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:30:42.086214 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 1306/2620] 10.222.0.59 () {60 vars in 1365 bytes} [Thu Jun 2 16:30:41 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 136 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 02 16:30:52.083597 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG dbcounter [-] [80396] Writing DB stats keystone:SELECT=50 {{(pid=80396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 16:31:42.241367 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44b93a87-3c9b-4a56-a10f-ab3d711c9b2c service placement] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:31:42.250697 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44b93a87-3c9b-4a56-a10f-ab3d711c9b2c service placement] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:31:42.254314 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4020092d-5675-42f6-b4a3-8df927e0a530 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6534961c369940a5b88f310c6450250b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c87c981909d4b8db02783421818c79b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:31:42.254942 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4020092d-5675-42f6-b4a3-8df927e0a530 service cinder] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:31:42.255226 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4020092d-5675-42f6-b4a3-8df927e0a530 service cinder] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:31:42.255507 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4020092d-5675-42f6-b4a3-8df927e0a530 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:31:42.257331 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.fernet_utils [None req-4020092d-5675-42f6-b4a3-8df927e0a530 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:31:42.327090 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4020092d-5675-42f6-b4a3-8df927e0a530 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:31:42.328533 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4020092d-5675-42f6-b4a3-8df927e0a530 service cinder] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:31:42.338095 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 1315/2621] 10.222.0.59 () {60 vars in 1365 bytes} [Thu Jun 2 16:31:42 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 16:31:52.334029 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writing DB stats keystone:SELECT=33 {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 16:33:37.109206 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e76f88d8-1d01-4cb5-9650-0fc44abf367a service cinder] Authenticating user token {{(pid=80396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:33:37.110883 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.fernet_utils [None req-e76f88d8-1d01-4cb5-9650-0fc44abf367a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:33:37.136200 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e76f88d8-1d01-4cb5-9650-0fc44abf367a service cinder] Validating token access rules against request {{(pid=80396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:33:37.139827 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2feb82a-2e32-481a-bddb-a4cd57b739b2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6534961c369940a5b88f310c6450250b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c87c981909d4b8db02783421818c79b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:33:37.140467 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2feb82a-2e32-481a-bddb-a4cd57b739b2 service cinder] REQUEST_METHOD: `GET` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:33:37.140747 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2feb82a-2e32-481a-bddb-a4cd57b739b2 service cinder] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:33:37.141020 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2feb82a-2e32-481a-bddb-a4cd57b739b2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:33:37.149630 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2feb82a-2e32-481a-bddb-a4cd57b739b2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:33:37.151072 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2feb82a-2e32-481a-bddb-a4cd57b739b2 service cinder] RBAC: Authorization granted {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:33:37.179239 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 1307/2622] 10.222.0.59 () {60 vars in 1365 bytes} [Thu Jun 2 16:33:37 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 71 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 16:33:38.611575 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4020092d-5675-42f6-b4a3-8df927e0a530 service cinder] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:33:38.613662 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.fernet_utils [None req-4020092d-5675-42f6-b4a3-8df927e0a530 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:33:38.647344 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4020092d-5675-42f6-b4a3-8df927e0a530 service cinder] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:33:38.650935 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3be6c59-df65-4fac-a1c3-e07bfec063ce service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9af40ddfe9ff4be3887b068f13a28dc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c87c981909d4b8db02783421818c79b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:33:38.651572 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3be6c59-df65-4fac-a1c3-e07bfec063ce service neutron] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:33:38.651857 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3be6c59-df65-4fac-a1c3-e07bfec063ce service neutron] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:33:38.652134 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3be6c59-df65-4fac-a1c3-e07bfec063ce service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:33:38.659945 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3be6c59-df65-4fac-a1c3-e07bfec063ce service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:33:38.661406 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3be6c59-df65-4fac-a1c3-e07bfec063ce service neutron] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:33:38.669293 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 1316/2623] 10.222.0.59 () {60 vars in 1365 bytes} [Thu Jun 2 16:33:38 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 58 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 16:33:42.589579 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2feb82a-2e32-481a-bddb-a4cd57b739b2 service cinder] Authenticating user token {{(pid=80396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:33:42.601855 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2feb82a-2e32-481a-bddb-a4cd57b739b2 service cinder] Validating token access rules against request {{(pid=80396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:33:42.607714 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d38774bd-2915-40bc-98d8-5635f179856b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6534961c369940a5b88f310c6450250b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c87c981909d4b8db02783421818c79b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:33:42.608653 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d38774bd-2915-40bc-98d8-5635f179856b service cinder] REQUEST_METHOD: `GET` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:33:42.609174 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d38774bd-2915-40bc-98d8-5635f179856b service cinder] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:33:42.609772 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d38774bd-2915-40bc-98d8-5635f179856b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:33:42.625082 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d38774bd-2915-40bc-98d8-5635f179856b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:33:42.625420 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d38774bd-2915-40bc-98d8-5635f179856b service cinder] RBAC: Authorization granted {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:33:42.636544 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 1308/2624] 10.222.0.59 () {60 vars in 1365 bytes} [Thu Jun 2 16:33:42 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 16:33:42.639451 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3be6c59-df65-4fac-a1c3-e07bfec063ce service neutron] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:33:42.649642 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3be6c59-df65-4fac-a1c3-e07bfec063ce service neutron] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:33:42.654681 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a40da381-26d6-4ce6-a21f-e0e5ffe4bf9d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9af40ddfe9ff4be3887b068f13a28dc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c87c981909d4b8db02783421818c79b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:33:42.655325 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a40da381-26d6-4ce6-a21f-e0e5ffe4bf9d service neutron] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:33:42.655608 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a40da381-26d6-4ce6-a21f-e0e5ffe4bf9d service neutron] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:33:42.655885 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a40da381-26d6-4ce6-a21f-e0e5ffe4bf9d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:33:42.657678 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.fernet_utils [None req-a40da381-26d6-4ce6-a21f-e0e5ffe4bf9d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:33:42.746685 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a40da381-26d6-4ce6-a21f-e0e5ffe4bf9d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:33:42.748075 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a40da381-26d6-4ce6-a21f-e0e5ffe4bf9d service neutron] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:33:42.767540 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 1317/2625] 10.222.0.59 () {60 vars in 1365 bytes} [Thu Jun 2 16:33:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 129 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 02 16:33:42.992412 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d38774bd-2915-40bc-98d8-5635f179856b service cinder] Authenticating user token {{(pid=80396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:33:43.002065 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d38774bd-2915-40bc-98d8-5635f179856b service cinder] Validating token access rules against request {{(pid=80396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:33:43.006311 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ad4886e-9058-484c-980d-9dfd54a7842b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9af40ddfe9ff4be3887b068f13a28dc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c87c981909d4b8db02783421818c79b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:33:43.006976 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad4886e-9058-484c-980d-9dfd54a7842b service neutron] REQUEST_METHOD: `GET` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:33:43.007294 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad4886e-9058-484c-980d-9dfd54a7842b service neutron] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:33:43.007524 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad4886e-9058-484c-980d-9dfd54a7842b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:33:43.009418 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.fernet_utils [None req-7ad4886e-9058-484c-980d-9dfd54a7842b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:33:43.043513 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ad4886e-9058-484c-980d-9dfd54a7842b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:33:43.044942 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ad4886e-9058-484c-980d-9dfd54a7842b service neutron] RBAC: Authorization granted {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:33:43.067391 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 1309/2626] 10.222.0.59 () {60 vars in 1365 bytes} [Thu Jun 2 16:33:42 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 75 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 16:33:44.351425 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a40da381-26d6-4ce6-a21f-e0e5ffe4bf9d service neutron] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:33:44.353686 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.fernet_utils [None req-a40da381-26d6-4ce6-a21f-e0e5ffe4bf9d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:33:44.367397 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a40da381-26d6-4ce6-a21f-e0e5ffe4bf9d service neutron] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:33:44.371190 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26c0c16e-d0da-4eb5-80f0-60b605a7a431 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9af40ddfe9ff4be3887b068f13a28dc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c87c981909d4b8db02783421818c79b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:33:44.371839 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c0c16e-d0da-4eb5-80f0-60b605a7a431 service neutron] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:33:44.372123 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c0c16e-d0da-4eb5-80f0-60b605a7a431 service neutron] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:33:44.372403 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c0c16e-d0da-4eb5-80f0-60b605a7a431 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:33:44.374480 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.fernet_utils [None req-26c0c16e-d0da-4eb5-80f0-60b605a7a431 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:33:44.391056 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26c0c16e-d0da-4eb5-80f0-60b605a7a431 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:33:44.392534 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26c0c16e-d0da-4eb5-80f0-60b605a7a431 service neutron] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:33:44.405680 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 1318/2627] 10.222.0.59 () {60 vars in 1365 bytes} [Thu Jun 2 16:33:44 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 16:33:45.203373 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ad4886e-9058-484c-980d-9dfd54a7842b service neutron] Authenticating user token {{(pid=80396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:33:45.228081 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ad4886e-9058-484c-980d-9dfd54a7842b service neutron] Validating token access rules against request {{(pid=80396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:33:45.242582 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d17e005a-3c01-41e2-899e-bc2f3a226bec service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9af40ddfe9ff4be3887b068f13a28dc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c87c981909d4b8db02783421818c79b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:33:45.242582 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d17e005a-3c01-41e2-899e-bc2f3a226bec service neutron] REQUEST_METHOD: `GET` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:33:45.242582 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d17e005a-3c01-41e2-899e-bc2f3a226bec service neutron] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:33:45.242582 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d17e005a-3c01-41e2-899e-bc2f3a226bec service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:33:45.243186 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.fernet_utils [None req-d17e005a-3c01-41e2-899e-bc2f3a226bec service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:33:45.256673 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d17e005a-3c01-41e2-899e-bc2f3a226bec service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:33:45.258269 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d17e005a-3c01-41e2-899e-bc2f3a226bec service neutron] RBAC: Authorization granted {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:33:45.268172 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 1310/2628] 10.222.0.59 () {60 vars in 1365 bytes} [Thu Jun 2 16:33:45 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 66 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 02 16:33:46.479781 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26c0c16e-d0da-4eb5-80f0-60b605a7a431 service neutron] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:33:46.493280 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26c0c16e-d0da-4eb5-80f0-60b605a7a431 service neutron] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:33:46.499928 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f83e125e-7208-469c-86a5-e5747812c32c service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b700f6d94374ba4b362a8f0d5b35796', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c87c981909d4b8db02783421818c79b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:33:46.505559 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83e125e-7208-469c-86a5-e5747812c32c service placement] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:33:46.505559 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83e125e-7208-469c-86a5-e5747812c32c service placement] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:33:46.505559 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83e125e-7208-469c-86a5-e5747812c32c service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:33:46.505559 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.fernet_utils [None req-f83e125e-7208-469c-86a5-e5747812c32c service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:33:46.518793 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f83e125e-7208-469c-86a5-e5747812c32c service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:33:46.520609 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f83e125e-7208-469c-86a5-e5747812c32c service placement] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:33:46.537074 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 1319/2629] 10.222.0.59 () {60 vars in 1365 bytes} [Thu Jun 2 16:33:46 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 16:33:46.643635 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d17e005a-3c01-41e2-899e-bc2f3a226bec service neutron] Authenticating user token {{(pid=80396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:33:46.643635 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.fernet_utils [None req-d17e005a-3c01-41e2-899e-bc2f3a226bec service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:33:46.652482 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d17e005a-3c01-41e2-899e-bc2f3a226bec service neutron] Validating token access rules against request {{(pid=80396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:33:46.658783 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aca756f1-e856-4f08-a559-f6b40f7e73d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f73d5a98be74242b45222df39fb6213', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:33:46.660246 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca756f1-e856-4f08-a559-f6b40f7e73d5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:33:46.660518 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca756f1-e856-4f08-a559-f6b40f7e73d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:33:46.660796 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca756f1-e856-4f08-a559-f6b40f7e73d5 admin admin] PATH_INFO: `/v3/users/95108cdd8e134be3823d5024f7037b3e` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:33:46.662053 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aca756f1-e856-4f08-a559-f6b40f7e73d5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=95108cdd8e134be3823d5024f7037b3e)` {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:33:46.664072 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aca756f1-e856-4f08-a559-f6b40f7e73d5 admin admin] RBAC: Authorization granted {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:33:46.854438 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.notifications [None req-aca756f1-e856-4f08-a559-f6b40f7e73d5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '95108cdd8e134be3823d5024f7037b3e'} {{(pid=80396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:33:46.855208 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.notifications [None req-aca756f1-e856-4f08-a559-f6b40f7e73d5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '95108cdd8e134be3823d5024f7037b3e'} {{(pid=80396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:33:46.917808 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.notifications [None req-aca756f1-e856-4f08-a559-f6b40f7e73d5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '95108cdd8e134be3823d5024f7037b3e'} {{(pid=80396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:33:46.933888 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.notifications [None req-aca756f1-e856-4f08-a559-f6b40f7e73d5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '95108cdd8e134be3823d5024f7037b3e'} {{(pid=80396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:33:46.958749 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.notifications [None req-aca756f1-e856-4f08-a559-f6b40f7e73d5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '95108cdd8e134be3823d5024f7037b3e'} {{(pid=80396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:33:46.970496 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 1311/2630] 10.222.0.59 () {58 vars in 1223 bytes} [Thu Jun 2 16:33:46 2022] DELETE /identity/v3/users/95108cdd8e134be3823d5024f7037b3e => generated 0 bytes in 335 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 02 16:33:47.520929 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f83e125e-7208-469c-86a5-e5747812c32c service placement] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:33:47.532247 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f83e125e-7208-469c-86a5-e5747812c32c service placement] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:33:47.603117 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a89f723e-f4ad-41e0-ac03-fb29cf4ba33c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f73d5a98be74242b45222df39fb6213', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:33:47.604205 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a89f723e-f4ad-41e0-ac03-fb29cf4ba33c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:33:47.604744 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a89f723e-f4ad-41e0-ac03-fb29cf4ba33c admin admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:33:47.605123 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a89f723e-f4ad-41e0-ac03-fb29cf4ba33c admin admin] PATH_INFO: `/v3/projects/470abf75f36f4a84b9382efc2aa2fc1c` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:33:47.606828 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a89f723e-f4ad-41e0-ac03-fb29cf4ba33c admin admin] RBAC: Authorizing `identity:delete_project(project_id=470abf75f36f4a84b9382efc2aa2fc1c)` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:33:47.609006 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a89f723e-f4ad-41e0-ac03-fb29cf4ba33c admin admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:33:47.618175 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writing DB stats keystone:SELECT=100 {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 16:33:47.734303 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.notifications [None req-a89f723e-f4ad-41e0-ac03-fb29cf4ba33c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '470abf75f36f4a84b9382efc2aa2fc1c', 'request_id': 'req-a89f723e-f4ad-41e0-ac03-fb29cf4ba33c'} {{(pid=80395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:33:47.745707 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.notifications [None req-a89f723e-f4ad-41e0-ac03-fb29cf4ba33c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '470abf75f36f4a84b9382efc2aa2fc1c', 'request_id': 'req-a89f723e-f4ad-41e0-ac03-fb29cf4ba33c'} {{(pid=80395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:33:47.809822 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.notifications [None req-a89f723e-f4ad-41e0-ac03-fb29cf4ba33c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '470abf75f36f4a84b9382efc2aa2fc1c', 'request_id': 'req-a89f723e-f4ad-41e0-ac03-fb29cf4ba33c'} {{(pid=80395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:33:47.821674 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.notifications [None req-a89f723e-f4ad-41e0-ac03-fb29cf4ba33c admin admin] The token cache is being invalidate because project 470abf75f36f4a84b9382efc2aa2fc1c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80395) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 02 16:33:47.821965 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.notifications [None req-a89f723e-f4ad-41e0-ac03-fb29cf4ba33c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:33:47.822633 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.notifications [None req-a89f723e-f4ad-41e0-ac03-fb29cf4ba33c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:33:47.824182 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 1320/2631] 10.222.0.59 () {58 vars in 1232 bytes} [Thu Jun 2 16:33:47 2022] DELETE /identity/v3/projects/470abf75f36f4a84b9382efc2aa2fc1c => generated 0 bytes in 304 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 16:33:47.831063 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb31701c-2430-40ad-ace8-9e55497d0ed7 None None] REQUEST_METHOD: `POST` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:33:47.831666 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb31701c-2430-40ad-ace8-9e55497d0ed7 None None] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:33:47.831666 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb31701c-2430-40ad-ace8-9e55497d0ed7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:33:47.872313 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG dbcounter [-] [80396] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 16:33:47.895899 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.auth.core [None req-bb31701c-2430-40ad-ace8-9e55497d0ed7 None None] MFA Rules not processed for user `400d1f4db9de49638549e5db29a041e1`. Rule list: `[]` (Enabled: `True`). {{(pid=80396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 16:33:47.897227 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.fernet_utils [None req-bb31701c-2430-40ad-ace8-9e55497d0ed7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:33:47.963242 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 1312/2632] 10.222.0.59 () {58 vars in 957 bytes} [Thu Jun 2 16:33:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 02 16:33:47.965245 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad886ee1-bdee-4fb2-a4cb-d19feb81bee8 None None] REQUEST_METHOD: `POST` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:33:47.965532 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad886ee1-bdee-4fb2-a4cb-d19feb81bee8 None None] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:33:47.965814 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad886ee1-bdee-4fb2-a4cb-d19feb81bee8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:33:47.984844 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.auth.core [None req-ad886ee1-bdee-4fb2-a4cb-d19feb81bee8 None None] MFA Rules not processed for user `400d1f4db9de49638549e5db29a041e1`. Rule list: `[]` (Enabled: `True`). {{(pid=80395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 16:33:47.986010 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.fernet_utils [None req-ad886ee1-bdee-4fb2-a4cb-d19feb81bee8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:33:47.994474 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 1321/2633] 10.222.0.59 () {58 vars in 957 bytes} [Thu Jun 2 16:33:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 16:33:47.998716 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb31701c-2430-40ad-ace8-9e55497d0ed7 None None] Authenticating user token {{(pid=80396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:33:48.009534 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb31701c-2430-40ad-ace8-9e55497d0ed7 None None] Validating token access rules against request {{(pid=80396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:33:48.014234 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29a2cba8-3514-4032-9f69-0522abe42070 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f73d5a98be74242b45222df39fb6213', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:33:48.014894 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a2cba8-3514-4032-9f69-0522abe42070 admin admin] REQUEST_METHOD: `GET` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:33:48.015179 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a2cba8-3514-4032-9f69-0522abe42070 admin admin] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:33:48.015453 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a2cba8-3514-4032-9f69-0522abe42070 admin admin] PATH_INFO: `/v3/domains` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:33:48.016184 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29a2cba8-3514-4032-9f69-0522abe42070 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80396) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 16:33:48.016486 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29a2cba8-3514-4032-9f69-0522abe42070 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:33:48.018148 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29a2cba8-3514-4032-9f69-0522abe42070 admin admin] RBAC: Authorization granted {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:33:48.033610 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 1313/2634] 10.222.0.59 () {58 vars in 1152 bytes} [Thu Jun 2 16:33:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 16:33:48.038864 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad886ee1-bdee-4fb2-a4cb-d19feb81bee8 None None] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:33:48.055439 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad886ee1-bdee-4fb2-a4cb-d19feb81bee8 None None] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:33:48.067932 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-345f2159-74d6-4b74-8ec0-b29b8f7528e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f73d5a98be74242b45222df39fb6213', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:33:48.068717 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345f2159-74d6-4b74-8ec0-b29b8f7528e0 admin admin] REQUEST_METHOD: `POST` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:33:48.069065 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345f2159-74d6-4b74-8ec0-b29b8f7528e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:33:48.069588 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345f2159-74d6-4b74-8ec0-b29b8f7528e0 admin admin] PATH_INFO: `/v3/projects` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:33:48.070470 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-345f2159-74d6-4b74-8ec0-b29b8f7528e0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:33:48.072540 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-345f2159-74d6-4b74-8ec0-b29b8f7528e0 admin admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:33:48.201424 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 1322/2635] 10.222.0.59 () {60 vars in 1152 bytes} [Thu Jun 2 16:33:48 2022] POST /identity/v3/projects => generated 383 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 16:33:48.205378 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29a2cba8-3514-4032-9f69-0522abe42070 admin admin] Authenticating user token {{(pid=80396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:33:48.222036 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29a2cba8-3514-4032-9f69-0522abe42070 admin admin] Validating token access rules against request {{(pid=80396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:33:48.288440 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11d9a452-85a3-478c-b0d8-ea366c9f0f12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f73d5a98be74242b45222df39fb6213', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:33:48.289205 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d9a452-85a3-478c-b0d8-ea366c9f0f12 admin admin] REQUEST_METHOD: `POST` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:33:48.289483 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d9a452-85a3-478c-b0d8-ea366c9f0f12 admin admin] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:33:48.289754 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d9a452-85a3-478c-b0d8-ea366c9f0f12 admin admin] PATH_INFO: `/v3/users` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:33:48.290482 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11d9a452-85a3-478c-b0d8-ea366c9f0f12 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:33:48.292367 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11d9a452-85a3-478c-b0d8-ea366c9f0f12 admin admin] RBAC: Authorization granted {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:33:48.389761 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 1314/2636] 10.222.0.59 () {60 vars in 1143 bytes} [Thu Jun 2 16:33:48 2022] POST /identity/v3/users => generated 292 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 16:33:48.393484 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-345f2159-74d6-4b74-8ec0-b29b8f7528e0 admin admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:33:48.405598 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-345f2159-74d6-4b74-8ec0-b29b8f7528e0 admin admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:33:48.411783 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb42c31e-bedf-4b2b-a3ca-45be4f9e89ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f73d5a98be74242b45222df39fb6213', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:33:48.412575 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb42c31e-bedf-4b2b-a3ca-45be4f9e89ae admin admin] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:33:48.413436 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb42c31e-bedf-4b2b-a3ca-45be4f9e89ae admin admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:33:48.413819 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb42c31e-bedf-4b2b-a3ca-45be4f9e89ae admin admin] PATH_INFO: `/v3/roles` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:33:48.414695 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb42c31e-bedf-4b2b-a3ca-45be4f9e89ae admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:33:48.416711 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb42c31e-bedf-4b2b-a3ca-45be4f9e89ae admin admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:33:48.431603 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 1323/2637] 10.222.0.59 () {58 vars in 1121 bytes} [Thu Jun 2 16:33:48 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 16:33:48.432638 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11d9a452-85a3-478c-b0d8-ea366c9f0f12 admin admin] Authenticating user token {{(pid=80396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:33:48.444177 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11d9a452-85a3-478c-b0d8-ea366c9f0f12 admin admin] Validating token access rules against request {{(pid=80396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:33:48.449351 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bd67b5d-8bb3-4062-8c49-4a8590607d97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f73d5a98be74242b45222df39fb6213', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:33:48.450016 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd67b5d-8bb3-4062-8c49-4a8590607d97 admin admin] REQUEST_METHOD: `GET` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:33:48.450341 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd67b5d-8bb3-4062-8c49-4a8590607d97 admin admin] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:33:48.450615 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd67b5d-8bb3-4062-8c49-4a8590607d97 admin admin] PATH_INFO: `/v3/roles` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:33:48.451384 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bd67b5d-8bb3-4062-8c49-4a8590607d97 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:33:48.453012 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bd67b5d-8bb3-4062-8c49-4a8590607d97 admin admin] RBAC: Authorization granted {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:33:48.465999 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 1315/2638] 10.222.0.59 () {58 vars in 1121 bytes} [Thu Jun 2 16:33:48 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 16:33:48.469845 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb42c31e-bedf-4b2b-a3ca-45be4f9e89ae admin admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:33:48.480309 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb42c31e-bedf-4b2b-a3ca-45be4f9e89ae admin admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:33:48.484827 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-204de267-d962-4d9c-b190-22fd3fa474ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f73d5a98be74242b45222df39fb6213', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:33:48.485703 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-204de267-d962-4d9c-b190-22fd3fa474ba admin admin] REQUEST_METHOD: `PUT` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:33:48.485987 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-204de267-d962-4d9c-b190-22fd3fa474ba admin admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:33:48.486303 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-204de267-d962-4d9c-b190-22fd3fa474ba admin admin] PATH_INFO: `/v3/projects/17568d6be8f640359bd4c6ec666ea168/users/f8503989cb4a4d9c8db260b403e07226/roles/649e0f2b5a264c419ea6a1441f123a03` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:33:48.501043 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-204de267-d962-4d9c-b190-22fd3fa474ba admin admin] RBAC: Authorizing `identity:create_grant(project_id=17568d6be8f640359bd4c6ec666ea168, user_id=f8503989cb4a4d9c8db260b403e07226, role_id=649e0f2b5a264c419ea6a1441f123a03)` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:33:48.504148 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-204de267-d962-4d9c-b190-22fd3fa474ba admin admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:33:48.590163 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 1324/2639] 10.222.0.59 () {60 vars in 1482 bytes} [Thu Jun 2 16:33:48 2022] PUT /identity/v3/projects/17568d6be8f640359bd4c6ec666ea168/users/f8503989cb4a4d9c8db260b403e07226/roles/649e0f2b5a264c419ea6a1441f123a03 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 16:33:48.595435 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdaf4a25-98cc-48c0-950d-bf5c83570cf2 None None] REQUEST_METHOD: `POST` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:33:48.595737 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdaf4a25-98cc-48c0-950d-bf5c83570cf2 None None] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:33:48.596028 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdaf4a25-98cc-48c0-950d-bf5c83570cf2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:33:48.615167 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.auth.core [None req-cdaf4a25-98cc-48c0-950d-bf5c83570cf2 None None] MFA Rules not processed for user `400d1f4db9de49638549e5db29a041e1`. Rule list: `[]` (Enabled: `True`). {{(pid=80396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 16:33:48.616405 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.fernet_utils [None req-cdaf4a25-98cc-48c0-950d-bf5c83570cf2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:33:48.678642 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 1316/2640] 10.222.0.59 () {58 vars in 957 bytes} [Thu Jun 2 16:33:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 16:33:48.688064 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-204de267-d962-4d9c-b190-22fd3fa474ba admin admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:33:48.689873 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.fernet_utils [None req-204de267-d962-4d9c-b190-22fd3fa474ba admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:33:48.758794 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-204de267-d962-4d9c-b190-22fd3fa474ba admin admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:33:48.768797 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0efef827-147d-4878-9f91-83caa62575ce service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9af40ddfe9ff4be3887b068f13a28dc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c87c981909d4b8db02783421818c79b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:33:48.778274 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0efef827-147d-4878-9f91-83caa62575ce service neutron] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:33:48.778274 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0efef827-147d-4878-9f91-83caa62575ce service neutron] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:33:48.778274 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0efef827-147d-4878-9f91-83caa62575ce service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:33:48.781835 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0efef827-147d-4878-9f91-83caa62575ce service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:33:48.783345 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0efef827-147d-4878-9f91-83caa62575ce service neutron] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:33:48.796438 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 1325/2641] 10.222.0.59 () {60 vars in 1365 bytes} [Thu Jun 2 16:33:48 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 02 16:33:55.669588 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdaf4a25-98cc-48c0-950d-bf5c83570cf2 None None] Authenticating user token {{(pid=80396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:33:55.672065 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.fernet_utils [None req-cdaf4a25-98cc-48c0-950d-bf5c83570cf2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:33:55.680157 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG dbcounter [-] [80396] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 16:33:55.685852 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdaf4a25-98cc-48c0-950d-bf5c83570cf2 None None] Validating token access rules against request {{(pid=80396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:33:55.691182 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbd85381-ebb2-4b49-ba95-e384eaecaec0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f73d5a98be74242b45222df39fb6213', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:33:55.692199 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd85381-ebb2-4b49-ba95-e384eaecaec0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:33:55.692553 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd85381-ebb2-4b49-ba95-e384eaecaec0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:33:55.692902 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd85381-ebb2-4b49-ba95-e384eaecaec0 admin admin] PATH_INFO: `/v3/users/5d2ef2aa9b8c46cfb198bd18a5944a85` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:33:55.694472 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbd85381-ebb2-4b49-ba95-e384eaecaec0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5d2ef2aa9b8c46cfb198bd18a5944a85)` {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:33:55.696477 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbd85381-ebb2-4b49-ba95-e384eaecaec0 admin admin] RBAC: Authorization granted {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:33:55.965327 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.notifications [None req-cbd85381-ebb2-4b49-ba95-e384eaecaec0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5d2ef2aa9b8c46cfb198bd18a5944a85'} {{(pid=80396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:33:55.966955 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.notifications [None req-cbd85381-ebb2-4b49-ba95-e384eaecaec0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5d2ef2aa9b8c46cfb198bd18a5944a85'} {{(pid=80396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:33:56.040210 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.notifications [None req-cbd85381-ebb2-4b49-ba95-e384eaecaec0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5d2ef2aa9b8c46cfb198bd18a5944a85'} {{(pid=80396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:33:56.058467 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.notifications [None req-cbd85381-ebb2-4b49-ba95-e384eaecaec0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5d2ef2aa9b8c46cfb198bd18a5944a85'} {{(pid=80396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:33:56.066874 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.notifications [None req-cbd85381-ebb2-4b49-ba95-e384eaecaec0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5d2ef2aa9b8c46cfb198bd18a5944a85'} {{(pid=80396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:33:56.079563 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 1317/2642] 10.222.0.59 () {58 vars in 1223 bytes} [Thu Jun 2 16:33:55 2022] DELETE /identity/v3/users/5d2ef2aa9b8c46cfb198bd18a5944a85 => generated 0 bytes in 404 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 16:33:56.426290 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b195cf45-1d71-4ee0-98ad-c5efad8b2e30 None None] REQUEST_METHOD: `POST` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:33:56.426290 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b195cf45-1d71-4ee0-98ad-c5efad8b2e30 None None] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:33:56.426290 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b195cf45-1d71-4ee0-98ad-c5efad8b2e30 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:33:56.427112 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbd85381-ebb2-4b49-ba95-e384eaecaec0 admin admin] Authenticating user token {{(pid=80396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:33:56.434364 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.fernet_utils [None req-cbd85381-ebb2-4b49-ba95-e384eaecaec0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:33:56.477586 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.auth.core [None req-b195cf45-1d71-4ee0-98ad-c5efad8b2e30 None None] MFA Rules not processed for user `f8503989cb4a4d9c8db260b403e07226`. Rule list: `[]` (Enabled: `True`). {{(pid=80395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 16:33:56.479325 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.fernet_utils [None req-b195cf45-1d71-4ee0-98ad-c5efad8b2e30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:33:56.503977 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 16:33:56.561606 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbd85381-ebb2-4b49-ba95-e384eaecaec0 admin admin] Validating token access rules against request {{(pid=80396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:33:56.567015 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f0e5b30-f107-4a91-9708-3a8f356b4da7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f73d5a98be74242b45222df39fb6213', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:33:56.572587 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0e5b30-f107-4a91-9708-3a8f356b4da7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:33:56.572587 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0e5b30-f107-4a91-9708-3a8f356b4da7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:33:56.572587 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0e5b30-f107-4a91-9708-3a8f356b4da7 admin admin] PATH_INFO: `/v3/projects/460ea33e74e8480c8b70c8123e81e4c4` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:33:56.572587 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f0e5b30-f107-4a91-9708-3a8f356b4da7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=460ea33e74e8480c8b70c8123e81e4c4)` {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:33:56.572587 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f0e5b30-f107-4a91-9708-3a8f356b4da7 admin admin] RBAC: Authorization granted {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:33:56.577375 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 1326/2643] 10.222.0.59 () {58 vars in 957 bytes} [Thu Jun 2 16:33:56 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 16:33:56.592498 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b195cf45-1d71-4ee0-98ad-c5efad8b2e30 None None] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:33:56.593849 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.fernet_utils [None req-b195cf45-1d71-4ee0-98ad-c5efad8b2e30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:33:56.679122 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b195cf45-1d71-4ee0-98ad-c5efad8b2e30 None None] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:33:56.685480 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-242887b8-d9f7-451b-a3da-e14715fd0ad2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52f9fe4b13574516bb0a8e2aa11a61e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c87c981909d4b8db02783421818c79b', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:33:56.686466 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-242887b8-d9f7-451b-a3da-e14715fd0ad2 service nova] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:33:56.686570 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-242887b8-d9f7-451b-a3da-e14715fd0ad2 service nova] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:33:56.686929 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-242887b8-d9f7-451b-a3da-e14715fd0ad2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:33:56.705748 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-242887b8-d9f7-451b-a3da-e14715fd0ad2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:33:56.707330 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-242887b8-d9f7-451b-a3da-e14715fd0ad2 service nova] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:33:56.718020 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 1327/2644] 10.222.0.59 () {60 vars in 1365 bytes} [Thu Jun 2 16:33:56 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 126 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 16:33:56.727761 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.notifications [None req-1f0e5b30-f107-4a91-9708-3a8f356b4da7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '460ea33e74e8480c8b70c8123e81e4c4', 'request_id': 'req-1f0e5b30-f107-4a91-9708-3a8f356b4da7'} {{(pid=80396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:33:56.734796 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.notifications [None req-1f0e5b30-f107-4a91-9708-3a8f356b4da7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '460ea33e74e8480c8b70c8123e81e4c4', 'request_id': 'req-1f0e5b30-f107-4a91-9708-3a8f356b4da7'} {{(pid=80396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:33:56.820248 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.notifications [None req-1f0e5b30-f107-4a91-9708-3a8f356b4da7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '460ea33e74e8480c8b70c8123e81e4c4', 'request_id': 'req-1f0e5b30-f107-4a91-9708-3a8f356b4da7'} {{(pid=80396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:33:56.833808 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.notifications [None req-1f0e5b30-f107-4a91-9708-3a8f356b4da7 admin admin] The token cache is being invalidate because project 460ea33e74e8480c8b70c8123e81e4c4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80396) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 02 16:33:56.834222 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.notifications [None req-1f0e5b30-f107-4a91-9708-3a8f356b4da7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:33:56.834806 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.notifications [None req-1f0e5b30-f107-4a91-9708-3a8f356b4da7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:33:56.839230 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 1318/2645] 10.222.0.59 () {58 vars in 1232 bytes} [Thu Jun 2 16:33:56 2022] DELETE /identity/v3/projects/460ea33e74e8480c8b70c8123e81e4c4 => generated 0 bytes in 414 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 16:33:56.841239 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-242887b8-d9f7-451b-a3da-e14715fd0ad2 service nova] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:33:56.853005 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-242887b8-d9f7-451b-a3da-e14715fd0ad2 service nova] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:33:56.913468 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2071ea4f-3401-478c-a54f-30dbf051f50c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f73d5a98be74242b45222df39fb6213', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:33:56.914387 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2071ea4f-3401-478c-a54f-30dbf051f50c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:33:56.914668 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2071ea4f-3401-478c-a54f-30dbf051f50c admin admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:33:56.917053 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2071ea4f-3401-478c-a54f-30dbf051f50c admin admin] PATH_INFO: `/v3/users/17435809270e4ec899c65bc4bec9c028` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:33:56.929943 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2071ea4f-3401-478c-a54f-30dbf051f50c admin admin] RBAC: Authorizing `identity:delete_user(user_id=17435809270e4ec899c65bc4bec9c028)` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:33:56.932208 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2071ea4f-3401-478c-a54f-30dbf051f50c admin admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:33:57.137093 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 16:33:57.150336 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.notifications [None req-2071ea4f-3401-478c-a54f-30dbf051f50c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '17435809270e4ec899c65bc4bec9c028'} {{(pid=80395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:33:57.216374 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.notifications [None req-2071ea4f-3401-478c-a54f-30dbf051f50c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '17435809270e4ec899c65bc4bec9c028'} {{(pid=80395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:33:57.231501 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.notifications [None req-2071ea4f-3401-478c-a54f-30dbf051f50c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '17435809270e4ec899c65bc4bec9c028'} {{(pid=80395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:33:57.232393 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.notifications [None req-2071ea4f-3401-478c-a54f-30dbf051f50c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '17435809270e4ec899c65bc4bec9c028'} {{(pid=80395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:33:57.239819 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.notifications [None req-2071ea4f-3401-478c-a54f-30dbf051f50c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '17435809270e4ec899c65bc4bec9c028'} {{(pid=80395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:33:57.246201 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 1328/2646] 10.222.0.59 () {58 vars in 1223 bytes} [Thu Jun 2 16:33:56 2022] DELETE /identity/v3/users/17435809270e4ec899c65bc4bec9c028 => generated 0 bytes in 405 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 16:33:57.584803 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f0e5b30-f107-4a91-9708-3a8f356b4da7 admin admin] Authenticating user token {{(pid=80396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:33:57.586321 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.fernet_utils [None req-1f0e5b30-f107-4a91-9708-3a8f356b4da7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:33:57.600748 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG dbcounter [-] [80396] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 16:33:57.603639 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f0e5b30-f107-4a91-9708-3a8f356b4da7 admin admin] Validating token access rules against request {{(pid=80396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:33:57.698832 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-938cf3f8-6d58-4f2c-9b5f-64b09d93a68c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f73d5a98be74242b45222df39fb6213', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:33:57.699741 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-938cf3f8-6d58-4f2c-9b5f-64b09d93a68c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:33:57.700025 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-938cf3f8-6d58-4f2c-9b5f-64b09d93a68c admin admin] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:33:57.700677 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-938cf3f8-6d58-4f2c-9b5f-64b09d93a68c admin admin] PATH_INFO: `/v3/projects/463ac172b94146af9f4b04e18d871924` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:33:57.713283 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-938cf3f8-6d58-4f2c-9b5f-64b09d93a68c admin admin] RBAC: Authorizing `identity:delete_project(project_id=463ac172b94146af9f4b04e18d871924)` {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:33:57.715605 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-938cf3f8-6d58-4f2c-9b5f-64b09d93a68c admin admin] RBAC: Authorization granted {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:33:57.842437 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.notifications [None req-938cf3f8-6d58-4f2c-9b5f-64b09d93a68c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '463ac172b94146af9f4b04e18d871924', 'request_id': 'req-938cf3f8-6d58-4f2c-9b5f-64b09d93a68c'} {{(pid=80396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:33:57.849667 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.notifications [None req-938cf3f8-6d58-4f2c-9b5f-64b09d93a68c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '463ac172b94146af9f4b04e18d871924', 'request_id': 'req-938cf3f8-6d58-4f2c-9b5f-64b09d93a68c'} {{(pid=80396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:33:57.926727 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.notifications [None req-938cf3f8-6d58-4f2c-9b5f-64b09d93a68c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '463ac172b94146af9f4b04e18d871924', 'request_id': 'req-938cf3f8-6d58-4f2c-9b5f-64b09d93a68c'} {{(pid=80396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:33:57.938579 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.notifications [None req-938cf3f8-6d58-4f2c-9b5f-64b09d93a68c admin admin] The token cache is being invalidate because project 463ac172b94146af9f4b04e18d871924 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80396) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 02 16:33:57.938878 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.notifications [None req-938cf3f8-6d58-4f2c-9b5f-64b09d93a68c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:33:57.939531 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.notifications [None req-938cf3f8-6d58-4f2c-9b5f-64b09d93a68c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:33:57.941959 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 1319/2647] 10.222.0.59 () {58 vars in 1232 bytes} [Thu Jun 2 16:33:57 2022] DELETE /identity/v3/projects/463ac172b94146af9f4b04e18d871924 => generated 0 bytes in 358 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 16:33:59.314405 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed2ccc17-913e-45eb-9537-6c8637ee45b7 None None] REQUEST_METHOD: `POST` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:33:59.314979 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed2ccc17-913e-45eb-9537-6c8637ee45b7 None None] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:33:59.314979 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed2ccc17-913e-45eb-9537-6c8637ee45b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:33:59.339418 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.auth.core [None req-ed2ccc17-913e-45eb-9537-6c8637ee45b7 None None] MFA Rules not processed for user `f8503989cb4a4d9c8db260b403e07226`. Rule list: `[]` (Enabled: `True`). {{(pid=80395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 16:33:59.341218 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.fernet_utils [None req-ed2ccc17-913e-45eb-9537-6c8637ee45b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:33:59.414462 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 1329/2648] 10.222.0.59 () {58 vars in 957 bytes} [Thu Jun 2 16:33:59 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 16:33:59.765045 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-938cf3f8-6d58-4f2c-9b5f-64b09d93a68c admin admin] Authenticating user token {{(pid=80396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:33:59.765641 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.fernet_utils [None req-938cf3f8-6d58-4f2c-9b5f-64b09d93a68c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:33:59.835080 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-938cf3f8-6d58-4f2c-9b5f-64b09d93a68c admin admin] Validating token access rules against request {{(pid=80396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:33:59.838969 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae2b5686-32f9-46b4-80ea-1a2fc7ae0394 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9af40ddfe9ff4be3887b068f13a28dc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c87c981909d4b8db02783421818c79b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:33:59.840136 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2b5686-32f9-46b4-80ea-1a2fc7ae0394 service neutron] REQUEST_METHOD: `GET` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:33:59.840741 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2b5686-32f9-46b4-80ea-1a2fc7ae0394 service neutron] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:33:59.841017 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2b5686-32f9-46b4-80ea-1a2fc7ae0394 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:33:59.842875 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.fernet_utils [None req-ae2b5686-32f9-46b4-80ea-1a2fc7ae0394 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:33:59.854250 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae2b5686-32f9-46b4-80ea-1a2fc7ae0394 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:33:59.855708 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae2b5686-32f9-46b4-80ea-1a2fc7ae0394 service neutron] RBAC: Authorization granted {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:33:59.865450 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 1320/2649] 10.222.0.59 () {60 vars in 1365 bytes} [Thu Jun 2 16:33:59 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 16:34:00.589863 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed2ccc17-913e-45eb-9537-6c8637ee45b7 None None] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:34:00.591334 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.fernet_utils [None req-ed2ccc17-913e-45eb-9537-6c8637ee45b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:34:00.673249 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed2ccc17-913e-45eb-9537-6c8637ee45b7 None None] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:34:00.678972 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-505f9206-6d3d-4687-8909-09a477be0bbe service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b700f6d94374ba4b362a8f0d5b35796', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c87c981909d4b8db02783421818c79b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:34:00.679618 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505f9206-6d3d-4687-8909-09a477be0bbe service placement] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:34:00.679904 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505f9206-6d3d-4687-8909-09a477be0bbe service placement] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:34:00.680181 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505f9206-6d3d-4687-8909-09a477be0bbe service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:34:00.681962 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.fernet_utils [None req-505f9206-6d3d-4687-8909-09a477be0bbe service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:34:00.693911 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-505f9206-6d3d-4687-8909-09a477be0bbe service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:34:00.695556 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-505f9206-6d3d-4687-8909-09a477be0bbe service placement] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:34:00.705270 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 1330/2650] 10.222.0.59 () {60 vars in 1365 bytes} [Thu Jun 2 16:34:00 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 16:34:04.655211 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae2b5686-32f9-46b4-80ea-1a2fc7ae0394 service neutron] Authenticating user token {{(pid=80396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:34:04.662179 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.fernet_utils [None req-ae2b5686-32f9-46b4-80ea-1a2fc7ae0394 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:34:04.709842 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG dbcounter [-] [80396] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 16:34:04.756019 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae2b5686-32f9-46b4-80ea-1a2fc7ae0394 service neutron] Validating token access rules against request {{(pid=80396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:34:04.763018 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ddd8319-882e-4bd3-8947-a92989150684 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52f9fe4b13574516bb0a8e2aa11a61e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c87c981909d4b8db02783421818c79b', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:34:04.763731 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ddd8319-882e-4bd3-8947-a92989150684 service nova] REQUEST_METHOD: `GET` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:34:04.764444 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ddd8319-882e-4bd3-8947-a92989150684 service nova] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:34:04.764720 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ddd8319-882e-4bd3-8947-a92989150684 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:34:04.766655 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.fernet_utils [None req-2ddd8319-882e-4bd3-8947-a92989150684 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:34:04.794489 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ddd8319-882e-4bd3-8947-a92989150684 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:34:04.796108 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ddd8319-882e-4bd3-8947-a92989150684 service nova] RBAC: Authorization granted {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:34:04.809231 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 1321/2651] 10.222.0.59 () {60 vars in 1365 bytes} [Thu Jun 2 16:34:04 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 155 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 16:34:10.693646 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-505f9206-6d3d-4687-8909-09a477be0bbe service placement] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:34:10.695279 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.fernet_utils [None req-505f9206-6d3d-4687-8909-09a477be0bbe service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:34:10.710724 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-505f9206-6d3d-4687-8909-09a477be0bbe service placement] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:34:10.716372 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1997ebae-ee02-4e5e-9d8b-7bfffd4663cc service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52f9fe4b13574516bb0a8e2aa11a61e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c87c981909d4b8db02783421818c79b', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:34:10.721111 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1997ebae-ee02-4e5e-9d8b-7bfffd4663cc service nova] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:34:10.721111 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1997ebae-ee02-4e5e-9d8b-7bfffd4663cc service nova] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:34:10.721111 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1997ebae-ee02-4e5e-9d8b-7bfffd4663cc service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:34:10.721111 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.fernet_utils [None req-1997ebae-ee02-4e5e-9d8b-7bfffd4663cc service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:34:10.732616 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1997ebae-ee02-4e5e-9d8b-7bfffd4663cc service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:34:10.734269 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1997ebae-ee02-4e5e-9d8b-7bfffd4663cc service nova] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:34:10.746227 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 1331/2652] 10.222.0.59 () {60 vars in 1365 bytes} [Thu Jun 2 16:34:10 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 16:34:14.900180 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG dbcounter [-] [80396] Writing DB stats keystone:SELECT=21 {{(pid=80396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 16:34:20.741638 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writing DB stats keystone:SELECT=80,keystone:DELETE=5,keystone:INSERT=1 {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 16:34:55.899679 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ddd8319-882e-4bd3-8947-a92989150684 service nova] Authenticating user token {{(pid=80396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:34:55.911312 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ddd8319-882e-4bd3-8947-a92989150684 service nova] Validating token access rules against request {{(pid=80396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:34:55.916301 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86e0b3e0-10d1-471f-b6a7-c2bb924d7cb5 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b700f6d94374ba4b362a8f0d5b35796', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c87c981909d4b8db02783421818c79b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:34:55.916931 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e0b3e0-10d1-471f-b6a7-c2bb924d7cb5 service placement] REQUEST_METHOD: `GET` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:34:55.917215 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e0b3e0-10d1-471f-b6a7-c2bb924d7cb5 service placement] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:34:55.917491 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e0b3e0-10d1-471f-b6a7-c2bb924d7cb5 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:34:55.919319 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.fernet_utils [None req-86e0b3e0-10d1-471f-b6a7-c2bb924d7cb5 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:34:55.931057 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86e0b3e0-10d1-471f-b6a7-c2bb924d7cb5 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:34:55.932725 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86e0b3e0-10d1-471f-b6a7-c2bb924d7cb5 service placement] RBAC: Authorization granted {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:34:55.945496 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 1322/2653] 10.222.0.59 () {60 vars in 1365 bytes} [Thu Jun 2 16:34:55 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 16:35:05.941195 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG dbcounter [-] [80396] Writing DB stats keystone:SELECT=6 {{(pid=80396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 16:36:41.589805 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1997ebae-ee02-4e5e-9d8b-7bfffd4663cc service nova] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:36:41.601111 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1997ebae-ee02-4e5e-9d8b-7bfffd4663cc service nova] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:36:41.606674 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c960ad57-65a2-4073-96a5-1404c5feef74 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52f9fe4b13574516bb0a8e2aa11a61e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c87c981909d4b8db02783421818c79b', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:36:41.607290 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c960ad57-65a2-4073-96a5-1404c5feef74 service nova] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:36:41.607657 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c960ad57-65a2-4073-96a5-1404c5feef74 service nova] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:36:41.607946 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c960ad57-65a2-4073-96a5-1404c5feef74 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:36:41.609834 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.fernet_utils [None req-c960ad57-65a2-4073-96a5-1404c5feef74 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:36:41.677054 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c960ad57-65a2-4073-96a5-1404c5feef74 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:36:41.678744 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c960ad57-65a2-4073-96a5-1404c5feef74 service nova] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:36:41.689054 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 1332/2654] 10.222.0.59 () {60 vars in 1365 bytes} [Thu Jun 2 16:36:41 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 16:36:51.683665 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writing DB stats keystone:SELECT=28 {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 16:38:41.257480 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86e0b3e0-10d1-471f-b6a7-c2bb924d7cb5 service placement] Authenticating user token {{(pid=80396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:38:41.284301 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86e0b3e0-10d1-471f-b6a7-c2bb924d7cb5 service placement] Validating token access rules against request {{(pid=80396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:38:41.289684 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c272d06-801d-46df-a607-cc45cf0f5814 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52f9fe4b13574516bb0a8e2aa11a61e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c87c981909d4b8db02783421818c79b', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:38:41.290347 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c272d06-801d-46df-a607-cc45cf0f5814 service nova] REQUEST_METHOD: `GET` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:38:41.290630 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c272d06-801d-46df-a607-cc45cf0f5814 service nova] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:38:41.290907 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c272d06-801d-46df-a607-cc45cf0f5814 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:38:41.292764 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.fernet_utils [None req-7c272d06-801d-46df-a607-cc45cf0f5814 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:38:41.351874 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c272d06-801d-46df-a607-cc45cf0f5814 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:38:41.353378 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c272d06-801d-46df-a607-cc45cf0f5814 service nova] RBAC: Authorization granted {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:38:41.363082 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 1323/2655] 10.222.0.59 () {60 vars in 1365 bytes} [Thu Jun 2 16:38:41 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 16:38:42.509848 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c960ad57-65a2-4073-96a5-1404c5feef74 service nova] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:38:42.512038 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.fernet_utils [None req-c960ad57-65a2-4073-96a5-1404c5feef74 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:38:42.523903 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c960ad57-65a2-4073-96a5-1404c5feef74 service nova] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:38:42.527789 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af00840f-bfb5-4bcb-a2a8-1f3931b61dc1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9af40ddfe9ff4be3887b068f13a28dc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c87c981909d4b8db02783421818c79b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:38:42.528423 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af00840f-bfb5-4bcb-a2a8-1f3931b61dc1 service neutron] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:38:42.528716 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af00840f-bfb5-4bcb-a2a8-1f3931b61dc1 service neutron] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:38:42.528996 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af00840f-bfb5-4bcb-a2a8-1f3931b61dc1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:38:42.530714 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.fernet_utils [None req-af00840f-bfb5-4bcb-a2a8-1f3931b61dc1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:38:42.551023 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af00840f-bfb5-4bcb-a2a8-1f3931b61dc1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:38:42.552451 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af00840f-bfb5-4bcb-a2a8-1f3931b61dc1 service neutron] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:38:42.563889 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 1333/2656] 10.222.0.59 () {60 vars in 1365 bytes} [Thu Jun 2 16:38:42 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 16:38:43.297834 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c272d06-801d-46df-a607-cc45cf0f5814 service nova] Authenticating user token {{(pid=80396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:38:43.307029 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c272d06-801d-46df-a607-cc45cf0f5814 service nova] Validating token access rules against request {{(pid=80396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:38:43.311069 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d400021-b17c-45ea-a31e-94d4cbee1cb6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9af40ddfe9ff4be3887b068f13a28dc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c87c981909d4b8db02783421818c79b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:38:43.311691 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d400021-b17c-45ea-a31e-94d4cbee1cb6 service neutron] REQUEST_METHOD: `GET` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:38:43.311972 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d400021-b17c-45ea-a31e-94d4cbee1cb6 service neutron] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:38:43.312246 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d400021-b17c-45ea-a31e-94d4cbee1cb6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:38:43.313963 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.fernet_utils [None req-4d400021-b17c-45ea-a31e-94d4cbee1cb6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:38:43.327525 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d400021-b17c-45ea-a31e-94d4cbee1cb6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:38:43.328931 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d400021-b17c-45ea-a31e-94d4cbee1cb6 service neutron] RBAC: Authorization granted {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:38:43.339813 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 1324/2657] 10.222.0.59 () {60 vars in 1365 bytes} [Thu Jun 2 16:38:43 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 16:38:45.618435 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af00840f-bfb5-4bcb-a2a8-1f3931b61dc1 service neutron] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:38:45.627070 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af00840f-bfb5-4bcb-a2a8-1f3931b61dc1 service neutron] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:38:45.630705 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62a2014d-dbb9-4b7d-a954-68b12b5d0b22 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9af40ddfe9ff4be3887b068f13a28dc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c87c981909d4b8db02783421818c79b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:38:45.631336 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a2014d-dbb9-4b7d-a954-68b12b5d0b22 service neutron] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:38:45.631618 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a2014d-dbb9-4b7d-a954-68b12b5d0b22 service neutron] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:38:45.631896 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a2014d-dbb9-4b7d-a954-68b12b5d0b22 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:38:45.633679 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.fernet_utils [None req-62a2014d-dbb9-4b7d-a954-68b12b5d0b22 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:38:45.643174 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62a2014d-dbb9-4b7d-a954-68b12b5d0b22 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:38:45.644641 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62a2014d-dbb9-4b7d-a954-68b12b5d0b22 service neutron] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:38:45.653792 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 1334/2658] 10.222.0.59 () {60 vars in 1365 bytes} [Thu Jun 2 16:38:45 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 16:38:53.334780 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG dbcounter [-] [80396] Writing DB stats keystone:SELECT=40 {{(pid=80396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 16:38:55.649637 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writing DB stats keystone:SELECT=15 {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 16:39:45.235565 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d400021-b17c-45ea-a31e-94d4cbee1cb6 service neutron] Authenticating user token {{(pid=80396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:39:45.236985 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.fernet_utils [None req-4d400021-b17c-45ea-a31e-94d4cbee1cb6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:39:45.294722 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d400021-b17c-45ea-a31e-94d4cbee1cb6 service neutron] Validating token access rules against request {{(pid=80396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:39:45.298398 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e142e8f-ab90-4cb3-9aa2-d1787bfd26b6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6534961c369940a5b88f310c6450250b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c87c981909d4b8db02783421818c79b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:39:45.299046 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e142e8f-ab90-4cb3-9aa2-d1787bfd26b6 service cinder] REQUEST_METHOD: `GET` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:39:45.299330 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e142e8f-ab90-4cb3-9aa2-d1787bfd26b6 service cinder] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:39:45.299610 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e142e8f-ab90-4cb3-9aa2-d1787bfd26b6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:39:45.305977 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.fernet_utils [None req-6e142e8f-ab90-4cb3-9aa2-d1787bfd26b6 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:39:45.315690 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e142e8f-ab90-4cb3-9aa2-d1787bfd26b6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:39:45.317151 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e142e8f-ab90-4cb3-9aa2-d1787bfd26b6 service cinder] RBAC: Authorization granted {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:39:45.331867 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 1325/2659] 10.222.0.59 () {60 vars in 1365 bytes} [Thu Jun 2 16:39:45 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 16:39:45.334379 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62a2014d-dbb9-4b7d-a954-68b12b5d0b22 service neutron] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:39:45.336007 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.fernet_utils [None req-62a2014d-dbb9-4b7d-a954-68b12b5d0b22 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:39:45.348268 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62a2014d-dbb9-4b7d-a954-68b12b5d0b22 service neutron] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:39:45.352423 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f2672f8-b027-46f2-88fa-21e4cf02fd3e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6534961c369940a5b88f310c6450250b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c87c981909d4b8db02783421818c79b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:39:45.353144 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f2672f8-b027-46f2-88fa-21e4cf02fd3e service cinder] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:39:45.353639 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f2672f8-b027-46f2-88fa-21e4cf02fd3e service cinder] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:39:45.353756 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f2672f8-b027-46f2-88fa-21e4cf02fd3e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:39:45.362163 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f2672f8-b027-46f2-88fa-21e4cf02fd3e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:39:45.363698 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f2672f8-b027-46f2-88fa-21e4cf02fd3e service cinder] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:39:45.372954 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 1335/2660] 10.222.0.59 () {60 vars in 1365 bytes} [Thu Jun 2 16:39:45 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 16:39:55.322655 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG dbcounter [-] [80396] Writing DB stats keystone:SELECT=26 {{(pid=80396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 16:39:55.368427 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writing DB stats keystone:SELECT=6 {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 16:40:01.882020 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e142e8f-ab90-4cb3-9aa2-d1787bfd26b6 service cinder] Authenticating user token {{(pid=80396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:40:01.883431 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.fernet_utils [None req-6e142e8f-ab90-4cb3-9aa2-d1787bfd26b6 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:40:01.938763 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e142e8f-ab90-4cb3-9aa2-d1787bfd26b6 service cinder] Validating token access rules against request {{(pid=80396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:40:01.943951 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5067cb9-1e7a-4c40-bb91-12d5c7238510 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b700f6d94374ba4b362a8f0d5b35796', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c87c981909d4b8db02783421818c79b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:40:01.944599 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5067cb9-1e7a-4c40-bb91-12d5c7238510 service placement] REQUEST_METHOD: `GET` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:40:01.944900 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5067cb9-1e7a-4c40-bb91-12d5c7238510 service placement] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:40:01.945179 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5067cb9-1e7a-4c40-bb91-12d5c7238510 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:40:01.954453 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5067cb9-1e7a-4c40-bb91-12d5c7238510 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:40:01.955971 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5067cb9-1e7a-4c40-bb91-12d5c7238510 service placement] RBAC: Authorization granted {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:40:01.965985 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 1326/2661] 10.222.0.59 () {60 vars in 1365 bytes} [Thu Jun 2 16:40:01 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 16:40:11.962031 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG dbcounter [-] [80396] Writing DB stats keystone:SELECT=23 {{(pid=80396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 16:41:45.453763 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f2672f8-b027-46f2-88fa-21e4cf02fd3e service cinder] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:41:45.483374 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f2672f8-b027-46f2-88fa-21e4cf02fd3e service cinder] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:41:45.487231 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8fd30b8-7596-4df8-9298-c68999f1206e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6534961c369940a5b88f310c6450250b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c87c981909d4b8db02783421818c79b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:41:45.487870 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8fd30b8-7596-4df8-9298-c68999f1206e service cinder] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:41:45.488157 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8fd30b8-7596-4df8-9298-c68999f1206e service cinder] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:41:45.488427 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8fd30b8-7596-4df8-9298-c68999f1206e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:41:45.497105 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8fd30b8-7596-4df8-9298-c68999f1206e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:41:45.498559 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8fd30b8-7596-4df8-9298-c68999f1206e service cinder] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:41:45.525565 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 1336/2662] 10.222.0.59 () {60 vars in 1365 bytes} [Thu Jun 2 16:41:45 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 72 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 16:41:47.783455 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5067cb9-1e7a-4c40-bb91-12d5c7238510 service placement] Authenticating user token {{(pid=80396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:41:47.808192 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5067cb9-1e7a-4c40-bb91-12d5c7238510 service placement] Validating token access rules against request {{(pid=80396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:41:47.814257 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d666705-687f-46fa-9d36-7b8aba0d7a2a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52f9fe4b13574516bb0a8e2aa11a61e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c87c981909d4b8db02783421818c79b', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:41:47.814993 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d666705-687f-46fa-9d36-7b8aba0d7a2a service nova] REQUEST_METHOD: `GET` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:41:47.815271 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d666705-687f-46fa-9d36-7b8aba0d7a2a service nova] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:41:47.815543 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d666705-687f-46fa-9d36-7b8aba0d7a2a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:41:47.824814 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d666705-687f-46fa-9d36-7b8aba0d7a2a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:41:47.826476 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d666705-687f-46fa-9d36-7b8aba0d7a2a service nova] RBAC: Authorization granted {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:41:47.837615 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 1327/2663] 10.222.0.59 () {60 vars in 1365 bytes} [Thu Jun 2 16:41:47 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 16:41:52.767121 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e0a84e-3f8e-4110-9acb-65016735e99d None None] REQUEST_METHOD: `POST` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:41:52.767620 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e0a84e-3f8e-4110-9acb-65016735e99d None None] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:41:52.767760 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e0a84e-3f8e-4110-9acb-65016735e99d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:41:52.785302 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.auth.core [None req-15e0a84e-3f8e-4110-9acb-65016735e99d None None] MFA Rules not processed for user `f8503989cb4a4d9c8db260b403e07226`. Rule list: `[]` (Enabled: `True`). {{(pid=80395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 16:41:52.786569 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.fernet_utils [None req-15e0a84e-3f8e-4110-9acb-65016735e99d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:41:52.793345 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 1337/2664] 10.222.0.59 () {58 vars in 957 bytes} [Thu Jun 2 16:41:52 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 16:41:53.098446 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d666705-687f-46fa-9d36-7b8aba0d7a2a service nova] Authenticating user token {{(pid=80396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:41:53.108078 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d666705-687f-46fa-9d36-7b8aba0d7a2a service nova] Validating token access rules against request {{(pid=80396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:41:53.111612 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27c2188a-6724-49eb-ace8-c73fea365a6d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9af40ddfe9ff4be3887b068f13a28dc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c87c981909d4b8db02783421818c79b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:41:53.112303 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c2188a-6724-49eb-ace8-c73fea365a6d service neutron] REQUEST_METHOD: `GET` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:41:53.112772 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c2188a-6724-49eb-ace8-c73fea365a6d service neutron] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:41:53.113114 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c2188a-6724-49eb-ace8-c73fea365a6d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:41:53.114900 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.fernet_utils [None req-27c2188a-6724-49eb-ace8-c73fea365a6d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:41:53.124330 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27c2188a-6724-49eb-ace8-c73fea365a6d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:41:53.125736 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27c2188a-6724-49eb-ace8-c73fea365a6d service neutron] RBAC: Authorization granted {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:41:53.134404 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 1328/2665] 10.222.0.59 () {60 vars in 1365 bytes} [Thu Jun 2 16:41:53 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 16:41:53.532087 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15e0a84e-3f8e-4110-9acb-65016735e99d None None] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:41:53.544262 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15e0a84e-3f8e-4110-9acb-65016735e99d None None] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:41:53.549422 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6a4e155-17dd-4c1b-9a76-bb21a7a5aded service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b700f6d94374ba4b362a8f0d5b35796', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c87c981909d4b8db02783421818c79b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:41:53.550595 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a4e155-17dd-4c1b-9a76-bb21a7a5aded service placement] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:41:53.550887 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a4e155-17dd-4c1b-9a76-bb21a7a5aded service placement] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:41:53.551164 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a4e155-17dd-4c1b-9a76-bb21a7a5aded service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:41:53.560178 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6a4e155-17dd-4c1b-9a76-bb21a7a5aded service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:41:53.561766 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6a4e155-17dd-4c1b-9a76-bb21a7a5aded service placement] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:41:53.572959 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 1338/2666] 10.222.0.59 () {60 vars in 1365 bytes} [Thu Jun 2 16:41:53 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 16:42:03.130874 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG dbcounter [-] [80396] Writing DB stats keystone:SELECT=17 {{(pid=80396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 16:42:03.568274 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writing DB stats keystone:SELECT=31 {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 16:42:04.617878 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27c2188a-6724-49eb-ace8-c73fea365a6d service neutron] Authenticating user token {{(pid=80396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:42:04.631102 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27c2188a-6724-49eb-ace8-c73fea365a6d service neutron] Validating token access rules against request {{(pid=80396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:42:04.636581 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fffff251-84fd-4935-8923-624a2bf21c6a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52f9fe4b13574516bb0a8e2aa11a61e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c87c981909d4b8db02783421818c79b', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:42:04.644146 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fffff251-84fd-4935-8923-624a2bf21c6a service nova] REQUEST_METHOD: `GET` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:42:04.644146 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fffff251-84fd-4935-8923-624a2bf21c6a service nova] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:42:04.644146 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fffff251-84fd-4935-8923-624a2bf21c6a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:42:04.647085 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fffff251-84fd-4935-8923-624a2bf21c6a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:42:04.648687 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fffff251-84fd-4935-8923-624a2bf21c6a service nova] RBAC: Authorization granted {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:42:04.659197 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 1329/2667] 10.222.0.59 () {60 vars in 1365 bytes} [Thu Jun 2 16:42:04 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 16:42:14.654834 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG dbcounter [-] [80396] Writing DB stats keystone:SELECT=6 {{(pid=80396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 16:43:45.692631 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6a4e155-17dd-4c1b-9a76-bb21a7a5aded service placement] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:43:45.703531 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6a4e155-17dd-4c1b-9a76-bb21a7a5aded service placement] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:43:45.707060 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db8709d3-e224-487a-a843-101d2517f6a1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6534961c369940a5b88f310c6450250b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c87c981909d4b8db02783421818c79b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:43:45.707686 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8709d3-e224-487a-a843-101d2517f6a1 service cinder] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:43:45.707966 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8709d3-e224-487a-a843-101d2517f6a1 service cinder] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:43:45.708238 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8709d3-e224-487a-a843-101d2517f6a1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:43:45.718194 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db8709d3-e224-487a-a843-101d2517f6a1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:43:45.719651 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db8709d3-e224-487a-a843-101d2517f6a1 service cinder] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:43:45.739026 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fffff251-84fd-4935-8923-624a2bf21c6a service nova] Authenticating user token {{(pid=80396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:43:45.749447 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fffff251-84fd-4935-8923-624a2bf21c6a service nova] Validating token access rules against request {{(pid=80396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:43:45.750178 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 1339/2668] 10.222.0.59 () {60 vars in 1365 bytes} [Thu Jun 2 16:43:45 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 58 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 16:43:45.753213 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb38d6e-91cb-4103-9a6c-fc40c5370cb8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6534961c369940a5b88f310c6450250b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c87c981909d4b8db02783421818c79b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:43:45.753856 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb38d6e-91cb-4103-9a6c-fc40c5370cb8 service cinder] REQUEST_METHOD: `GET` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:43:45.754172 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb38d6e-91cb-4103-9a6c-fc40c5370cb8 service cinder] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:43:45.760454 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb38d6e-91cb-4103-9a6c-fc40c5370cb8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:43:45.764337 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afb38d6e-91cb-4103-9a6c-fc40c5370cb8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:43:45.765811 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afb38d6e-91cb-4103-9a6c-fc40c5370cb8 service cinder] RBAC: Authorization granted {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:43:45.775418 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 1330/2669] 10.222.0.59 () {60 vars in 1365 bytes} [Thu Jun 2 16:43:45 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 02 16:43:49.660583 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db8709d3-e224-487a-a843-101d2517f6a1 service cinder] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:43:49.679312 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db8709d3-e224-487a-a843-101d2517f6a1 service cinder] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:43:49.682854 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5b7bfa4-8ba3-4b2f-8ad6-ffcfbbaa58b5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9af40ddfe9ff4be3887b068f13a28dc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c87c981909d4b8db02783421818c79b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:43:49.683486 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b7bfa4-8ba3-4b2f-8ad6-ffcfbbaa58b5 service neutron] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:43:49.683769 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b7bfa4-8ba3-4b2f-8ad6-ffcfbbaa58b5 service neutron] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:43:49.684041 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b7bfa4-8ba3-4b2f-8ad6-ffcfbbaa58b5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:43:49.691435 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5b7bfa4-8ba3-4b2f-8ad6-ffcfbbaa58b5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:43:49.692861 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5b7bfa4-8ba3-4b2f-8ad6-ffcfbbaa58b5 service neutron] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:43:49.701529 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 1340/2670] 10.222.0.59 () {60 vars in 1365 bytes} [Thu Jun 2 16:43:49 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 16:43:55.770788 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG dbcounter [-] [80396] Writing DB stats keystone:SELECT=6 {{(pid=80396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 16:43:59.697291 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writing DB stats keystone:SELECT=23 {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 16:45:04.941748 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb38d6e-91cb-4103-9a6c-fc40c5370cb8 service cinder] Authenticating user token {{(pid=80396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:45:05.014431 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb38d6e-91cb-4103-9a6c-fc40c5370cb8 service cinder] Validating token access rules against request {{(pid=80396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:45:05.019339 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7940ea33-9952-4cd6-a46a-a5a1b81249a0 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b700f6d94374ba4b362a8f0d5b35796', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c87c981909d4b8db02783421818c79b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:45:05.019978 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7940ea33-9952-4cd6-a46a-a5a1b81249a0 service placement] REQUEST_METHOD: `GET` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:45:05.020263 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7940ea33-9952-4cd6-a46a-a5a1b81249a0 service placement] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:45:05.021214 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7940ea33-9952-4cd6-a46a-a5a1b81249a0 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:45:05.023403 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.fernet_utils [None req-7940ea33-9952-4cd6-a46a-a5a1b81249a0 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:45:05.034580 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7940ea33-9952-4cd6-a46a-a5a1b81249a0 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:45:05.036175 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7940ea33-9952-4cd6-a46a-a5a1b81249a0 service placement] RBAC: Authorization granted {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:45:05.046665 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 1331/2671] 10.222.0.59 () {60 vars in 1365 bytes} [Thu Jun 2 16:45:04 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 16:45:15.042327 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG dbcounter [-] [80396] Writing DB stats keystone:SELECT=32 {{(pid=80396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 16:45:45.899354 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5b7bfa4-8ba3-4b2f-8ad6-ffcfbbaa58b5 service neutron] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:45:45.910627 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5b7bfa4-8ba3-4b2f-8ad6-ffcfbbaa58b5 service neutron] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:45:45.914697 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-373abf4f-f001-4f56-9572-caa3d6b1f2ae service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6534961c369940a5b88f310c6450250b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c87c981909d4b8db02783421818c79b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:45:45.915367 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-373abf4f-f001-4f56-9572-caa3d6b1f2ae service cinder] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:45:45.915654 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-373abf4f-f001-4f56-9572-caa3d6b1f2ae service cinder] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:45:45.915961 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-373abf4f-f001-4f56-9572-caa3d6b1f2ae service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:45:45.986275 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-373abf4f-f001-4f56-9572-caa3d6b1f2ae service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:45:45.987720 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-373abf4f-f001-4f56-9572-caa3d6b1f2ae service cinder] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:45:46.006709 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 1341/2672] 10.222.0.59 () {60 vars in 1365 bytes} [Thu Jun 2 16:45:45 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 16:45:56.004001 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writing DB stats keystone:SELECT=36 {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 16:46:45.901251 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7940ea33-9952-4cd6-a46a-a5a1b81249a0 service placement] Authenticating user token {{(pid=80396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:46:45.911170 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7940ea33-9952-4cd6-a46a-a5a1b81249a0 service placement] Validating token access rules against request {{(pid=80396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:46:45.914749 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78a412fe-18ff-4a7d-b5bf-063b7ff4bed9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6534961c369940a5b88f310c6450250b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c87c981909d4b8db02783421818c79b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:46:45.915378 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a412fe-18ff-4a7d-b5bf-063b7ff4bed9 service cinder] REQUEST_METHOD: `GET` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:46:45.915661 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a412fe-18ff-4a7d-b5bf-063b7ff4bed9 service cinder] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:46:45.915944 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a412fe-18ff-4a7d-b5bf-063b7ff4bed9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:46:45.917812 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.fernet_utils [None req-78a412fe-18ff-4a7d-b5bf-063b7ff4bed9 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:46:45.991758 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78a412fe-18ff-4a7d-b5bf-063b7ff4bed9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:46:45.993096 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78a412fe-18ff-4a7d-b5bf-063b7ff4bed9 service cinder] RBAC: Authorization granted {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:46:46.002254 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 1332/2673] 10.222.0.59 () {60 vars in 1365 bytes} [Thu Jun 2 16:46:45 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 16:46:55.997826 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG dbcounter [-] [80396] Writing DB stats keystone:SELECT=33 {{(pid=80396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 16:47:47.873966 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-373abf4f-f001-4f56-9572-caa3d6b1f2ae service cinder] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:47:47.882871 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-373abf4f-f001-4f56-9572-caa3d6b1f2ae service cinder] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:47:47.887134 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7478dd57-3d1f-46c7-9e62-ad0c8ddc0051 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6534961c369940a5b88f310c6450250b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c87c981909d4b8db02783421818c79b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:47:47.889203 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7478dd57-3d1f-46c7-9e62-ad0c8ddc0051 service cinder] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:47:47.889203 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7478dd57-3d1f-46c7-9e62-ad0c8ddc0051 service cinder] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:47:47.889203 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7478dd57-3d1f-46c7-9e62-ad0c8ddc0051 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:47:47.965914 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7478dd57-3d1f-46c7-9e62-ad0c8ddc0051 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:47:47.967704 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7478dd57-3d1f-46c7-9e62-ad0c8ddc0051 service cinder] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:47:47.989909 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 1342/2674] 10.222.0.59 () {60 vars in 1365 bytes} [Thu Jun 2 16:47:47 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 16:47:53.337470 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c317774-67be-4220-92f9-98e349971d61 None None] REQUEST_METHOD: `POST` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:47:53.338063 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c317774-67be-4220-92f9-98e349971d61 None None] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:47:53.338063 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c317774-67be-4220-92f9-98e349971d61 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:47:53.375894 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.auth.core [None req-6c317774-67be-4220-92f9-98e349971d61 None None] MFA Rules not processed for user `2910f2833ce24b17b248ad9106f19786`. Rule list: `[]` (Enabled: `True`). {{(pid=80396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 16:47:53.375894 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.fernet_utils [None req-6c317774-67be-4220-92f9-98e349971d61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:47:53.376196 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 1333/2675] 10.222.0.59 () {58 vars in 957 bytes} [Thu Jun 2 16:47:53 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 16:47:53.411162 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7478dd57-3d1f-46c7-9e62-ad0c8ddc0051 service cinder] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:47:53.412544 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.fernet_utils [None req-7478dd57-3d1f-46c7-9e62-ad0c8ddc0051 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:47:53.489817 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7478dd57-3d1f-46c7-9e62-ad0c8ddc0051 service cinder] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:47:53.493653 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d93f2132-1a8a-4603-8ddb-daf4c59f573c service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e673e7e0a4bf4c77bdb3e5325d0d3275', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c87c981909d4b8db02783421818c79b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:47:53.494331 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d93f2132-1a8a-4603-8ddb-daf4c59f573c service glance] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:47:53.494611 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d93f2132-1a8a-4603-8ddb-daf4c59f573c service glance] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:47:53.494880 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d93f2132-1a8a-4603-8ddb-daf4c59f573c service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:47:53.506538 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d93f2132-1a8a-4603-8ddb-daf4c59f573c service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:47:53.507986 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d93f2132-1a8a-4603-8ddb-daf4c59f573c service glance] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:47:53.519672 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 1343/2676] 10.222.0.59 () {60 vars in 1365 bytes} [Thu Jun 2 16:47:53 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 16:47:53.722470 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c317774-67be-4220-92f9-98e349971d61 None None] Authenticating user token {{(pid=80396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:47:53.777983 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c317774-67be-4220-92f9-98e349971d61 None None] Validating token access rules against request {{(pid=80396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:47:53.784104 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2977ba5a-85a3-4edc-9419-de73bd65758f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9af40ddfe9ff4be3887b068f13a28dc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c87c981909d4b8db02783421818c79b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:47:53.784104 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2977ba5a-85a3-4edc-9419-de73bd65758f service neutron] REQUEST_METHOD: `GET` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:47:53.784104 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2977ba5a-85a3-4edc-9419-de73bd65758f service neutron] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:47:53.784104 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2977ba5a-85a3-4edc-9419-de73bd65758f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:47:53.790663 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2977ba5a-85a3-4edc-9419-de73bd65758f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:47:53.792087 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2977ba5a-85a3-4edc-9419-de73bd65758f service neutron] RBAC: Authorization granted {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:47:53.800041 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 1334/2677] 10.222.0.59 () {60 vars in 1365 bytes} [Thu Jun 2 16:47:53 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 78 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 16:47:54.193152 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d93f2132-1a8a-4603-8ddb-daf4c59f573c service glance] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:47:54.194723 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.fernet_utils [None req-d93f2132-1a8a-4603-8ddb-daf4c59f573c service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:47:54.209638 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d93f2132-1a8a-4603-8ddb-daf4c59f573c service glance] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:47:54.214918 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf553873-3e6d-46d3-b844-ec4e09e1e662 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b700f6d94374ba4b362a8f0d5b35796', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c87c981909d4b8db02783421818c79b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:47:54.215560 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf553873-3e6d-46d3-b844-ec4e09e1e662 service placement] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:47:54.215840 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf553873-3e6d-46d3-b844-ec4e09e1e662 service placement] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:47:54.216167 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf553873-3e6d-46d3-b844-ec4e09e1e662 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:47:54.218737 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.fernet_utils [None req-cf553873-3e6d-46d3-b844-ec4e09e1e662 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:47:54.230798 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf553873-3e6d-46d3-b844-ec4e09e1e662 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:47:54.232388 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf553873-3e6d-46d3-b844-ec4e09e1e662 service placement] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:47:54.243913 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 1344/2678] 10.222.0.59 () {60 vars in 1365 bytes} [Thu Jun 2 16:47:54 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 16:47:54.520830 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2977ba5a-85a3-4edc-9419-de73bd65758f service neutron] Authenticating user token {{(pid=80396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:47:54.530005 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2977ba5a-85a3-4edc-9419-de73bd65758f service neutron] Validating token access rules against request {{(pid=80396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:47:54.538817 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e13bc6df-89bf-47bc-8f3e-11da1d5d0111 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9af40ddfe9ff4be3887b068f13a28dc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c87c981909d4b8db02783421818c79b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:47:54.539472 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13bc6df-89bf-47bc-8f3e-11da1d5d0111 service neutron] REQUEST_METHOD: `GET` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:47:54.539764 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13bc6df-89bf-47bc-8f3e-11da1d5d0111 service neutron] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:47:54.540173 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13bc6df-89bf-47bc-8f3e-11da1d5d0111 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:47:54.542055 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.fernet_utils [None req-e13bc6df-89bf-47bc-8f3e-11da1d5d0111 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:47:54.632069 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e13bc6df-89bf-47bc-8f3e-11da1d5d0111 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:47:54.633488 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e13bc6df-89bf-47bc-8f3e-11da1d5d0111 service neutron] RBAC: Authorization granted {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:47:54.652833 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 1335/2679] 10.222.0.59 () {60 vars in 1365 bytes} [Thu Jun 2 16:47:54 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 132 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 16:47:58.560100 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf553873-3e6d-46d3-b844-ec4e09e1e662 service placement] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:47:58.563462 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.fernet_utils [None req-cf553873-3e6d-46d3-b844-ec4e09e1e662 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:47:58.595451 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf553873-3e6d-46d3-b844-ec4e09e1e662 service placement] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:47:58.601543 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cfd67af-08d6-4a35-a7fd-a3e6f307c031 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52f9fe4b13574516bb0a8e2aa11a61e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c87c981909d4b8db02783421818c79b', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:47:58.602251 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cfd67af-08d6-4a35-a7fd-a3e6f307c031 service nova] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:47:58.602537 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cfd67af-08d6-4a35-a7fd-a3e6f307c031 service nova] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:47:58.602813 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cfd67af-08d6-4a35-a7fd-a3e6f307c031 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:47:58.604797 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.fernet_utils [None req-7cfd67af-08d6-4a35-a7fd-a3e6f307c031 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:47:58.618796 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cfd67af-08d6-4a35-a7fd-a3e6f307c031 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:47:58.620366 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cfd67af-08d6-4a35-a7fd-a3e6f307c031 service nova] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:47:58.632034 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 1345/2680] 10.222.0.59 () {60 vars in 1365 bytes} [Thu Jun 2 16:47:58 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 72 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 16:47:58.664994 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e13bc6df-89bf-47bc-8f3e-11da1d5d0111 service neutron] Authenticating user token {{(pid=80396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:47:58.677001 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e13bc6df-89bf-47bc-8f3e-11da1d5d0111 service neutron] Validating token access rules against request {{(pid=80396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:47:58.682097 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acf0ca5e-af40-444c-a289-9dfeda9cc40a service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b700f6d94374ba4b362a8f0d5b35796', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c87c981909d4b8db02783421818c79b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:47:58.682694 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf0ca5e-af40-444c-a289-9dfeda9cc40a service placement] REQUEST_METHOD: `GET` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:47:58.682977 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf0ca5e-af40-444c-a289-9dfeda9cc40a service placement] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:47:58.683253 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf0ca5e-af40-444c-a289-9dfeda9cc40a service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:47:58.685010 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.fernet_utils [None req-acf0ca5e-af40-444c-a289-9dfeda9cc40a service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:47:58.697921 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acf0ca5e-af40-444c-a289-9dfeda9cc40a service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:47:58.699560 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acf0ca5e-af40-444c-a289-9dfeda9cc40a service placement] RBAC: Authorization granted {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:47:58.710025 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 1336/2681] 10.222.0.59 () {60 vars in 1365 bytes} [Thu Jun 2 16:47:58 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 16:47:58.805776 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cfd67af-08d6-4a35-a7fd-a3e6f307c031 service nova] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:47:58.807242 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.fernet_utils [None req-7cfd67af-08d6-4a35-a7fd-a3e6f307c031 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:47:58.823509 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cfd67af-08d6-4a35-a7fd-a3e6f307c031 service nova] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:47:58.829021 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0c4d9fb-e86f-4c19-a4b4-f3650211bd28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f73d5a98be74242b45222df39fb6213', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:47:58.829884 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c4d9fb-e86f-4c19-a4b4-f3650211bd28 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:47:58.830201 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c4d9fb-e86f-4c19-a4b4-f3650211bd28 admin admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:47:58.830516 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c4d9fb-e86f-4c19-a4b4-f3650211bd28 admin admin] PATH_INFO: `/v3/users/88bb3d2dbcdb45bb8baba424e5239e21` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:47:58.843134 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writing DB stats keystone:SELECT=100 {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 16:47:58.845536 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0c4d9fb-e86f-4c19-a4b4-f3650211bd28 admin admin] RBAC: Authorizing `identity:delete_user(user_id=88bb3d2dbcdb45bb8baba424e5239e21)` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:47:58.847550 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0c4d9fb-e86f-4c19-a4b4-f3650211bd28 admin admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:47:59.076717 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.notifications [None req-f0c4d9fb-e86f-4c19-a4b4-f3650211bd28 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '88bb3d2dbcdb45bb8baba424e5239e21'} {{(pid=80395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:47:59.146394 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.notifications [None req-f0c4d9fb-e86f-4c19-a4b4-f3650211bd28 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '88bb3d2dbcdb45bb8baba424e5239e21'} {{(pid=80395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:47:59.160411 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.notifications [None req-f0c4d9fb-e86f-4c19-a4b4-f3650211bd28 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '88bb3d2dbcdb45bb8baba424e5239e21'} {{(pid=80395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:47:59.161236 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.notifications [None req-f0c4d9fb-e86f-4c19-a4b4-f3650211bd28 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '88bb3d2dbcdb45bb8baba424e5239e21'} {{(pid=80395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:47:59.175345 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.notifications [None req-f0c4d9fb-e86f-4c19-a4b4-f3650211bd28 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '88bb3d2dbcdb45bb8baba424e5239e21'} {{(pid=80395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:47:59.182016 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 1346/2682] 10.222.0.59 () {58 vars in 1223 bytes} [Thu Jun 2 16:47:58 2022] DELETE /identity/v3/users/88bb3d2dbcdb45bb8baba424e5239e21 => generated 0 bytes in 377 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 16:47:59.423165 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acf0ca5e-af40-444c-a289-9dfeda9cc40a service placement] Authenticating user token {{(pid=80396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:47:59.437628 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acf0ca5e-af40-444c-a289-9dfeda9cc40a service placement] Validating token access rules against request {{(pid=80396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:47:59.489204 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG dbcounter [-] [80396] Writing DB stats keystone:SELECT=100 {{(pid=80396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 16:47:59.505507 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-247fd56e-044a-43b6-a571-dae6da51ab06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f73d5a98be74242b45222df39fb6213', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:47:59.506465 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247fd56e-044a-43b6-a571-dae6da51ab06 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:47:59.507073 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247fd56e-044a-43b6-a571-dae6da51ab06 admin admin] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:47:59.507073 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247fd56e-044a-43b6-a571-dae6da51ab06 admin admin] PATH_INFO: `/v3/projects/9598d078f4a1477babe0eaf804ef54a8` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:47:59.508295 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-247fd56e-044a-43b6-a571-dae6da51ab06 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9598d078f4a1477babe0eaf804ef54a8)` {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:47:59.510221 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-247fd56e-044a-43b6-a571-dae6da51ab06 admin admin] RBAC: Authorization granted {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:47:59.661548 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.notifications [None req-247fd56e-044a-43b6-a571-dae6da51ab06 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9598d078f4a1477babe0eaf804ef54a8', 'request_id': 'req-247fd56e-044a-43b6-a571-dae6da51ab06'} {{(pid=80396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:47:59.668686 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.notifications [None req-247fd56e-044a-43b6-a571-dae6da51ab06 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9598d078f4a1477babe0eaf804ef54a8', 'request_id': 'req-247fd56e-044a-43b6-a571-dae6da51ab06'} {{(pid=80396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:47:59.757272 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.notifications [None req-247fd56e-044a-43b6-a571-dae6da51ab06 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9598d078f4a1477babe0eaf804ef54a8', 'request_id': 'req-247fd56e-044a-43b6-a571-dae6da51ab06'} {{(pid=80396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:47:59.768136 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.notifications [None req-247fd56e-044a-43b6-a571-dae6da51ab06 admin admin] The token cache is being invalidate because project 9598d078f4a1477babe0eaf804ef54a8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80396) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 02 16:47:59.768423 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.notifications [None req-247fd56e-044a-43b6-a571-dae6da51ab06 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:47:59.769036 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.notifications [None req-247fd56e-044a-43b6-a571-dae6da51ab06 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:47:59.770619 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 1337/2683] 10.222.0.59 () {58 vars in 1232 bytes} [Thu Jun 2 16:47:59 2022] DELETE /identity/v3/projects/9598d078f4a1477babe0eaf804ef54a8 => generated 0 bytes in 348 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 16:47:59.776200 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c88dcd6f-f0c9-42a8-9926-d20c38df9568 None None] REQUEST_METHOD: `POST` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:47:59.776713 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c88dcd6f-f0c9-42a8-9926-d20c38df9568 None None] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:47:59.776913 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c88dcd6f-f0c9-42a8-9926-d20c38df9568 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:47:59.836034 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.auth.core [None req-c88dcd6f-f0c9-42a8-9926-d20c38df9568 None None] MFA Rules not processed for user `400d1f4db9de49638549e5db29a041e1`. Rule list: `[]` (Enabled: `True`). {{(pid=80395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 16:47:59.837177 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.fernet_utils [None req-c88dcd6f-f0c9-42a8-9926-d20c38df9568 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:47:59.896805 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 1347/2684] 10.222.0.59 () {58 vars in 957 bytes} [Thu Jun 2 16:47:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 16:47:59.905251 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ff718d-abab-47b2-9dd5-fc594adb7ce1 None None] REQUEST_METHOD: `POST` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:47:59.905628 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ff718d-abab-47b2-9dd5-fc594adb7ce1 None None] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:47:59.905918 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ff718d-abab-47b2-9dd5-fc594adb7ce1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:47:59.924381 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.auth.core [None req-e4ff718d-abab-47b2-9dd5-fc594adb7ce1 None None] MFA Rules not processed for user `400d1f4db9de49638549e5db29a041e1`. Rule list: `[]` (Enabled: `True`). {{(pid=80396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 16:47:59.925761 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.fernet_utils [None req-e4ff718d-abab-47b2-9dd5-fc594adb7ce1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:47:59.933569 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 1338/2685] 10.222.0.59 () {58 vars in 957 bytes} [Thu Jun 2 16:47:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 16:47:59.937839 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c88dcd6f-f0c9-42a8-9926-d20c38df9568 None None] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:47:59.947735 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c88dcd6f-f0c9-42a8-9926-d20c38df9568 None None] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:47:59.952803 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-989f707d-9f71-453b-ad69-dd9fed300a8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f73d5a98be74242b45222df39fb6213', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:47:59.953464 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989f707d-9f71-453b-ad69-dd9fed300a8b admin admin] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:47:59.953743 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989f707d-9f71-453b-ad69-dd9fed300a8b admin admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:47:59.954015 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989f707d-9f71-453b-ad69-dd9fed300a8b admin admin] PATH_INFO: `/v3/domains` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:47:59.954785 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-989f707d-9f71-453b-ad69-dd9fed300a8b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80395) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 16:47:59.955085 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-989f707d-9f71-453b-ad69-dd9fed300a8b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:47:59.956653 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-989f707d-9f71-453b-ad69-dd9fed300a8b admin admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:47:59.968657 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 1348/2686] 10.222.0.59 () {58 vars in 1152 bytes} [Thu Jun 2 16:47:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 16:47:59.972678 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4ff718d-abab-47b2-9dd5-fc594adb7ce1 None None] Authenticating user token {{(pid=80396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:47:59.981861 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4ff718d-abab-47b2-9dd5-fc594adb7ce1 None None] Validating token access rules against request {{(pid=80396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:47:59.986606 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd22b8f-4391-418f-84dd-c32c093f79a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f73d5a98be74242b45222df39fb6213', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:47:59.987243 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd22b8f-4391-418f-84dd-c32c093f79a8 admin admin] REQUEST_METHOD: `POST` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:47:59.987530 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd22b8f-4391-418f-84dd-c32c093f79a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:47:59.987805 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd22b8f-4391-418f-84dd-c32c093f79a8 admin admin] PATH_INFO: `/v3/projects` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:47:59.988490 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fd22b8f-4391-418f-84dd-c32c093f79a8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:47:59.990405 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fd22b8f-4391-418f-84dd-c32c093f79a8 admin admin] RBAC: Authorization granted {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:48:00.148864 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 1339/2687] 10.222.0.59 () {60 vars in 1152 bytes} [Thu Jun 2 16:47:59 2022] POST /identity/v3/projects => generated 371 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 16:48:00.150101 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-989f707d-9f71-453b-ad69-dd9fed300a8b admin admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:48:00.162430 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-989f707d-9f71-453b-ad69-dd9fed300a8b admin admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:48:00.201635 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 16:48:00.235049 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52cc61ef-5853-4045-8d59-608db9fc9267 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f73d5a98be74242b45222df39fb6213', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:48:00.235625 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52cc61ef-5853-4045-8d59-608db9fc9267 admin admin] REQUEST_METHOD: `POST` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:48:00.236034 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52cc61ef-5853-4045-8d59-608db9fc9267 admin admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:48:00.236324 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52cc61ef-5853-4045-8d59-608db9fc9267 admin admin] PATH_INFO: `/v3/users` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:48:00.237156 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52cc61ef-5853-4045-8d59-608db9fc9267 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:48:00.239999 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52cc61ef-5853-4045-8d59-608db9fc9267 admin admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:48:00.321592 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 1349/2688] 10.222.0.59 () {60 vars in 1143 bytes} [Thu Jun 2 16:48:00 2022] POST /identity/v3/users => generated 286 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 16:48:00.325706 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd22b8f-4391-418f-84dd-c32c093f79a8 admin admin] Authenticating user token {{(pid=80396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:48:00.338339 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd22b8f-4391-418f-84dd-c32c093f79a8 admin admin] Validating token access rules against request {{(pid=80396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:48:00.345187 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06cc4518-0577-45b1-ba3d-0ffe33ac201c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f73d5a98be74242b45222df39fb6213', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:48:00.345952 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06cc4518-0577-45b1-ba3d-0ffe33ac201c admin admin] REQUEST_METHOD: `GET` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:48:00.346394 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06cc4518-0577-45b1-ba3d-0ffe33ac201c admin admin] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:48:00.346763 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06cc4518-0577-45b1-ba3d-0ffe33ac201c admin admin] PATH_INFO: `/v3/roles` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:48:00.347554 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06cc4518-0577-45b1-ba3d-0ffe33ac201c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:48:00.349305 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06cc4518-0577-45b1-ba3d-0ffe33ac201c admin admin] RBAC: Authorization granted {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:48:00.360454 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 1340/2689] 10.222.0.59 () {58 vars in 1121 bytes} [Thu Jun 2 16:48:00 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 16:48:00.364644 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52cc61ef-5853-4045-8d59-608db9fc9267 admin admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:48:00.377934 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52cc61ef-5853-4045-8d59-608db9fc9267 admin admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:48:00.383506 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a9c522e-0676-4a4e-a32d-ba2d64372729 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f73d5a98be74242b45222df39fb6213', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:48:00.384455 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a9c522e-0676-4a4e-a32d-ba2d64372729 admin admin] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:48:00.384868 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a9c522e-0676-4a4e-a32d-ba2d64372729 admin admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:48:00.385208 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a9c522e-0676-4a4e-a32d-ba2d64372729 admin admin] PATH_INFO: `/v3/roles` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:48:00.386101 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a9c522e-0676-4a4e-a32d-ba2d64372729 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:48:00.388131 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a9c522e-0676-4a4e-a32d-ba2d64372729 admin admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:48:00.400776 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 1350/2690] 10.222.0.59 () {58 vars in 1121 bytes} [Thu Jun 2 16:48:00 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 16:48:00.405543 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06cc4518-0577-45b1-ba3d-0ffe33ac201c admin admin] Authenticating user token {{(pid=80396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:48:00.421119 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06cc4518-0577-45b1-ba3d-0ffe33ac201c admin admin] Validating token access rules against request {{(pid=80396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:48:00.427259 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faae8d20-f04f-4ce1-8109-a3b803e5255e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f73d5a98be74242b45222df39fb6213', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:48:00.427625 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faae8d20-f04f-4ce1-8109-a3b803e5255e admin admin] REQUEST_METHOD: `PUT` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:48:00.427933 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faae8d20-f04f-4ce1-8109-a3b803e5255e admin admin] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:48:00.428164 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faae8d20-f04f-4ce1-8109-a3b803e5255e admin admin] PATH_INFO: `/v3/projects/0004cbeb6b434542980502b997dfda08/users/ea260ef0c06243658976af6efbcd0a58/roles/649e0f2b5a264c419ea6a1441f123a03` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:48:00.449121 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faae8d20-f04f-4ce1-8109-a3b803e5255e admin admin] RBAC: Authorizing `identity:create_grant(project_id=0004cbeb6b434542980502b997dfda08, user_id=ea260ef0c06243658976af6efbcd0a58, role_id=649e0f2b5a264c419ea6a1441f123a03)` {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:48:00.454166 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faae8d20-f04f-4ce1-8109-a3b803e5255e admin admin] RBAC: Authorization granted {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:48:00.549474 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 1341/2691] 10.222.0.59 () {60 vars in 1482 bytes} [Thu Jun 2 16:48:00 2022] PUT /identity/v3/projects/0004cbeb6b434542980502b997dfda08/users/ea260ef0c06243658976af6efbcd0a58/roles/649e0f2b5a264c419ea6a1441f123a03 => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 16:48:00.560085 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c655ee0-438d-43d1-a7e9-8521f131e1bb None None] REQUEST_METHOD: `POST` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:48:00.560376 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c655ee0-438d-43d1-a7e9-8521f131e1bb None None] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:48:00.560708 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c655ee0-438d-43d1-a7e9-8521f131e1bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:48:00.588159 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.auth.core [None req-2c655ee0-438d-43d1-a7e9-8521f131e1bb None None] MFA Rules not processed for user `ea260ef0c06243658976af6efbcd0a58`. Rule list: `[]` (Enabled: `True`). {{(pid=80395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 16:48:00.589368 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.fernet_utils [None req-2c655ee0-438d-43d1-a7e9-8521f131e1bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:48:00.659270 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 1351/2692] 10.222.0.59 () {58 vars in 957 bytes} [Thu Jun 2 16:48:00 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 16:48:00.664066 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faae8d20-f04f-4ce1-8109-a3b803e5255e admin admin] Authenticating user token {{(pid=80396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:48:00.728179 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faae8d20-f04f-4ce1-8109-a3b803e5255e admin admin] Validating token access rules against request {{(pid=80396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:48:00.733048 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55efc6ed-3e31-4a80-87a5-b869f2d2f51e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f73d5a98be74242b45222df39fb6213', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:48:00.733679 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55efc6ed-3e31-4a80-87a5-b869f2d2f51e admin admin] REQUEST_METHOD: `POST` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:48:00.733963 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55efc6ed-3e31-4a80-87a5-b869f2d2f51e admin admin] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:48:00.734274 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55efc6ed-3e31-4a80-87a5-b869f2d2f51e admin admin] PATH_INFO: `/v3/projects` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:48:00.735004 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55efc6ed-3e31-4a80-87a5-b869f2d2f51e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:48:00.736949 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55efc6ed-3e31-4a80-87a5-b869f2d2f51e admin admin] RBAC: Authorization granted {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:48:00.740305 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG dbcounter [-] [80396] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 16:48:00.816204 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 1342/2693] 10.222.0.59 () {60 vars in 1152 bytes} [Thu Jun 2 16:48:00 2022] POST /identity/v3/projects => generated 371 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 16:48:00.817626 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c655ee0-438d-43d1-a7e9-8521f131e1bb None None] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:48:00.830702 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c655ee0-438d-43d1-a7e9-8521f131e1bb None None] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:48:00.889569 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-961a8c56-da0a-4b3e-b401-4e6bd0daae90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f73d5a98be74242b45222df39fb6213', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:48:00.890402 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961a8c56-da0a-4b3e-b401-4e6bd0daae90 admin admin] REQUEST_METHOD: `POST` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:48:00.890681 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961a8c56-da0a-4b3e-b401-4e6bd0daae90 admin admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:48:00.890953 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961a8c56-da0a-4b3e-b401-4e6bd0daae90 admin admin] PATH_INFO: `/v3/users` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:48:00.891630 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-961a8c56-da0a-4b3e-b401-4e6bd0daae90 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:48:00.893526 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-961a8c56-da0a-4b3e-b401-4e6bd0daae90 admin admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:48:00.996558 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 1352/2694] 10.222.0.59 () {60 vars in 1143 bytes} [Thu Jun 2 16:48:00 2022] POST /identity/v3/users => generated 292 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 16:48:01.006000 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55efc6ed-3e31-4a80-87a5-b869f2d2f51e admin admin] Authenticating user token {{(pid=80396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:48:01.017087 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55efc6ed-3e31-4a80-87a5-b869f2d2f51e admin admin] Validating token access rules against request {{(pid=80396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:48:01.021928 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cb78289-2cf6-4a4e-a49a-9c25028f908d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f73d5a98be74242b45222df39fb6213', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:48:01.022645 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb78289-2cf6-4a4e-a49a-9c25028f908d admin admin] REQUEST_METHOD: `GET` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:48:01.023342 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb78289-2cf6-4a4e-a49a-9c25028f908d admin admin] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:48:01.023670 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb78289-2cf6-4a4e-a49a-9c25028f908d admin admin] PATH_INFO: `/v3/roles` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:48:01.024421 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cb78289-2cf6-4a4e-a49a-9c25028f908d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:48:01.026015 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cb78289-2cf6-4a4e-a49a-9c25028f908d admin admin] RBAC: Authorization granted {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:48:01.038991 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 1343/2695] 10.222.0.59 () {58 vars in 1121 bytes} [Thu Jun 2 16:48:01 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 16:48:01.044434 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-961a8c56-da0a-4b3e-b401-4e6bd0daae90 admin admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:48:01.054756 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-961a8c56-da0a-4b3e-b401-4e6bd0daae90 admin admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:48:01.059433 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4fff2b7-7093-42d2-aa5b-193adb88d0ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f73d5a98be74242b45222df39fb6213', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:48:01.060304 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4fff2b7-7093-42d2-aa5b-193adb88d0ef admin admin] REQUEST_METHOD: `PUT` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:48:01.060634 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4fff2b7-7093-42d2-aa5b-193adb88d0ef admin admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:48:01.060911 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4fff2b7-7093-42d2-aa5b-193adb88d0ef admin admin] PATH_INFO: `/v3/projects/356e28a7d8fa4034a7b4a00bfd55a273/users/3300255f011d4361b91fcd5e3191e002/roles/f1e0c25f6e9049e897cb7350c7e54ab3` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:48:01.075253 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4fff2b7-7093-42d2-aa5b-193adb88d0ef admin admin] RBAC: Authorizing `identity:create_grant(project_id=356e28a7d8fa4034a7b4a00bfd55a273, user_id=3300255f011d4361b91fcd5e3191e002, role_id=f1e0c25f6e9049e897cb7350c7e54ab3)` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:48:01.078445 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4fff2b7-7093-42d2-aa5b-193adb88d0ef admin admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:48:01.146888 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 1353/2696] 10.222.0.59 () {60 vars in 1482 bytes} [Thu Jun 2 16:48:01 2022] PUT /identity/v3/projects/356e28a7d8fa4034a7b4a00bfd55a273/users/3300255f011d4361b91fcd5e3191e002/roles/f1e0c25f6e9049e897cb7350c7e54ab3 => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 16:48:01.150749 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cb78289-2cf6-4a4e-a49a-9c25028f908d admin admin] Authenticating user token {{(pid=80396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:48:01.161194 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cb78289-2cf6-4a4e-a49a-9c25028f908d admin admin] Validating token access rules against request {{(pid=80396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:48:01.220826 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75270caa-5b03-4d12-99f7-f03f7ef259e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f73d5a98be74242b45222df39fb6213', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:48:01.221477 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75270caa-5b03-4d12-99f7-f03f7ef259e0 admin admin] REQUEST_METHOD: `GET` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:48:01.221756 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75270caa-5b03-4d12-99f7-f03f7ef259e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:48:01.222026 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75270caa-5b03-4d12-99f7-f03f7ef259e0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:48:01.222772 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75270caa-5b03-4d12-99f7-f03f7ef259e0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:48:01.224341 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75270caa-5b03-4d12-99f7-f03f7ef259e0 admin admin] RBAC: Authorization granted {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:48:01.234343 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 1344/2697] 10.222.0.59 () {58 vars in 1121 bytes} [Thu Jun 2 16:48:01 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 16:48:01.238383 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4fff2b7-7093-42d2-aa5b-193adb88d0ef admin admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:48:01.249171 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4fff2b7-7093-42d2-aa5b-193adb88d0ef admin admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:48:01.253831 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59ddd80d-0081-46be-a6ff-f4ccdc0354ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f73d5a98be74242b45222df39fb6213', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:48:01.254742 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ddd80d-0081-46be-a6ff-f4ccdc0354ef admin admin] REQUEST_METHOD: `PUT` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:48:01.255048 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ddd80d-0081-46be-a6ff-f4ccdc0354ef admin admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:48:01.255325 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ddd80d-0081-46be-a6ff-f4ccdc0354ef admin admin] PATH_INFO: `/v3/projects/356e28a7d8fa4034a7b4a00bfd55a273/users/3300255f011d4361b91fcd5e3191e002/roles/f1e0c25f6e9049e897cb7350c7e54ab3` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:48:01.257346 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59ddd80d-0081-46be-a6ff-f4ccdc0354ef admin admin] RBAC: Authorizing `identity:create_grant(project_id=356e28a7d8fa4034a7b4a00bfd55a273, user_id=3300255f011d4361b91fcd5e3191e002, role_id=f1e0c25f6e9049e897cb7350c7e54ab3)` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:48:01.260000 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59ddd80d-0081-46be-a6ff-f4ccdc0354ef admin admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:48:01.262229 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 16:48:01.270959 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 1354/2698] 10.222.0.59 () {60 vars in 1482 bytes} [Thu Jun 2 16:48:01 2022] PUT /identity/v3/projects/356e28a7d8fa4034a7b4a00bfd55a273/users/3300255f011d4361b91fcd5e3191e002/roles/f1e0c25f6e9049e897cb7350c7e54ab3 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 16:48:01.281698 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417d6599-5967-45ee-a65d-008d08285ad3 None None] REQUEST_METHOD: `POST` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:48:01.281987 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417d6599-5967-45ee-a65d-008d08285ad3 None None] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:48:01.282298 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417d6599-5967-45ee-a65d-008d08285ad3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:48:01.308365 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.auth.core [None req-417d6599-5967-45ee-a65d-008d08285ad3 None None] MFA Rules not processed for user `3300255f011d4361b91fcd5e3191e002`. Rule list: `[]` (Enabled: `True`). {{(pid=80396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 16:48:01.309566 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.fernet_utils [None req-417d6599-5967-45ee-a65d-008d08285ad3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:48:01.377642 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 1345/2699] 10.222.0.59 () {58 vars in 957 bytes} [Thu Jun 2 16:48:01 2022] POST /identity/v3/auth/tokens => generated 3305 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 16:48:01.389330 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59ddd80d-0081-46be-a6ff-f4ccdc0354ef admin admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:48:01.390994 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.fernet_utils [None req-59ddd80d-0081-46be-a6ff-f4ccdc0354ef admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:48:01.459865 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59ddd80d-0081-46be-a6ff-f4ccdc0354ef admin admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:48:01.463545 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5c8dbb2-dbf1-4e8d-b6b5-6ccd1ef83d6b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6534961c369940a5b88f310c6450250b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c87c981909d4b8db02783421818c79b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:48:01.464184 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c8dbb2-dbf1-4e8d-b6b5-6ccd1ef83d6b service cinder] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:48:01.464463 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c8dbb2-dbf1-4e8d-b6b5-6ccd1ef83d6b service cinder] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:48:01.464734 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c8dbb2-dbf1-4e8d-b6b5-6ccd1ef83d6b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:48:01.474784 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5c8dbb2-dbf1-4e8d-b6b5-6ccd1ef83d6b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:48:01.476244 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5c8dbb2-dbf1-4e8d-b6b5-6ccd1ef83d6b service cinder] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:48:01.486418 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 1355/2700] 10.222.0.59 () {60 vars in 1365 bytes} [Thu Jun 2 16:48:01 2022] GET /identity/v3/auth/tokens => generated 3305 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 16:48:01.690677 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-417d6599-5967-45ee-a65d-008d08285ad3 None None] Authenticating user token {{(pid=80396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:48:01.700477 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-417d6599-5967-45ee-a65d-008d08285ad3 None None] Validating token access rules against request {{(pid=80396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:48:01.704937 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2ff2311-1641-4abd-b426-2f5ba3a53632 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6534961c369940a5b88f310c6450250b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c87c981909d4b8db02783421818c79b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:48:01.705582 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ff2311-1641-4abd-b426-2f5ba3a53632 service cinder] REQUEST_METHOD: `GET` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:48:01.705865 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ff2311-1641-4abd-b426-2f5ba3a53632 service cinder] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:48:01.706238 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ff2311-1641-4abd-b426-2f5ba3a53632 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:48:01.760145 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG dbcounter [-] [80396] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 16:48:01.764418 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2ff2311-1641-4abd-b426-2f5ba3a53632 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:48:01.765855 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2ff2311-1641-4abd-b426-2f5ba3a53632 service cinder] RBAC: Authorization granted {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:48:01.774663 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 1346/2701] 10.222.0.59 () {60 vars in 1365 bytes} [Thu Jun 2 16:48:01 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 16:48:10.664365 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5c8dbb2-dbf1-4e8d-b6b5-6ccd1ef83d6b service cinder] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:48:10.664365 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.fernet_utils [None req-b5c8dbb2-dbf1-4e8d-b6b5-6ccd1ef83d6b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:48:10.664365 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5c8dbb2-dbf1-4e8d-b6b5-6ccd1ef83d6b service cinder] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:48:10.666955 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d3e4e9f-8e77-4139-ac00-a0f85f34c7f7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52f9fe4b13574516bb0a8e2aa11a61e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c87c981909d4b8db02783421818c79b', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:48:10.666955 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3e4e9f-8e77-4139-ac00-a0f85f34c7f7 service nova] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:48:10.666955 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3e4e9f-8e77-4139-ac00-a0f85f34c7f7 service nova] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:48:10.666955 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3e4e9f-8e77-4139-ac00-a0f85f34c7f7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:48:10.667938 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.fernet_utils [None req-0d3e4e9f-8e77-4139-ac00-a0f85f34c7f7 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:48:10.667938 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d3e4e9f-8e77-4139-ac00-a0f85f34c7f7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:48:10.667938 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d3e4e9f-8e77-4139-ac00-a0f85f34c7f7 service nova] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:48:10.667938 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 1356/2702] 10.222.0.59 () {60 vars in 1365 bytes} [Thu Jun 2 16:48:10 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 133 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 16:48:11.837083 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG dbcounter [-] [80396] Writing DB stats keystone:SELECT=3 {{(pid=80396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 16:48:15.835634 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-988a1036-2286-43f3-b7d6-9429c6eada59 None None] REQUEST_METHOD: `POST` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:48:15.836197 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-988a1036-2286-43f3-b7d6-9429c6eada59 None None] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:48:15.836197 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-988a1036-2286-43f3-b7d6-9429c6eada59 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:48:15.875320 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.auth.core [None req-988a1036-2286-43f3-b7d6-9429c6eada59 None None] MFA Rules not processed for user `f8503989cb4a4d9c8db260b403e07226`. Rule list: `[]` (Enabled: `True`). {{(pid=80396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 16:48:15.876461 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.fernet_utils [None req-988a1036-2286-43f3-b7d6-9429c6eada59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:48:15.931677 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 1347/2703] 10.222.0.59 () {58 vars in 957 bytes} [Thu Jun 2 16:48:15 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 16:48:20.603856 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writing DB stats keystone:INSERT=1,keystone:SELECT=67 {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 16:48:25.925035 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG dbcounter [-] [80396] Writing DB stats keystone:SELECT=33 {{(pid=80396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 16:48:50.431467 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d3e4e9f-8e77-4139-ac00-a0f85f34c7f7 service nova] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:48:50.433008 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.fernet_utils [None req-0d3e4e9f-8e77-4139-ac00-a0f85f34c7f7 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:48:50.471542 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d3e4e9f-8e77-4139-ac00-a0f85f34c7f7 service nova] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:48:50.477612 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e938a497-fcb2-4616-892e-310644d6f9b2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52f9fe4b13574516bb0a8e2aa11a61e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c87c981909d4b8db02783421818c79b', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:48:50.478314 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e938a497-fcb2-4616-892e-310644d6f9b2 service nova] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:48:50.478811 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e938a497-fcb2-4616-892e-310644d6f9b2 service nova] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:48:50.479093 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e938a497-fcb2-4616-892e-310644d6f9b2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:48:50.480956 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.fernet_utils [None req-e938a497-fcb2-4616-892e-310644d6f9b2 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:48:50.495594 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e938a497-fcb2-4616-892e-310644d6f9b2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:48:50.497361 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e938a497-fcb2-4616-892e-310644d6f9b2 service nova] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:48:50.509819 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 1357/2704] 10.222.0.59 () {60 vars in 1365 bytes} [Thu Jun 2 16:48:50 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 79 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 02 16:48:50.598364 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-988a1036-2286-43f3-b7d6-9429c6eada59 None None] Authenticating user token {{(pid=80396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:48:50.600790 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.fernet_utils [None req-988a1036-2286-43f3-b7d6-9429c6eada59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:48:50.676767 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-988a1036-2286-43f3-b7d6-9429c6eada59 None None] Validating token access rules against request {{(pid=80396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:48:50.681459 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e62b274-f5f5-401c-b34f-5436539fb9e8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9af40ddfe9ff4be3887b068f13a28dc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c87c981909d4b8db02783421818c79b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:48:50.682129 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e62b274-f5f5-401c-b34f-5436539fb9e8 service neutron] REQUEST_METHOD: `GET` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:48:50.682434 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e62b274-f5f5-401c-b34f-5436539fb9e8 service neutron] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:48:50.683333 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e62b274-f5f5-401c-b34f-5436539fb9e8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:48:50.684599 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.fernet_utils [None req-9e62b274-f5f5-401c-b34f-5436539fb9e8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:48:50.694340 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e62b274-f5f5-401c-b34f-5436539fb9e8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:48:50.695941 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e62b274-f5f5-401c-b34f-5436539fb9e8 service neutron] RBAC: Authorization granted {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:48:50.706405 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 1348/2705] 10.222.0.59 () {60 vars in 1365 bytes} [Thu Jun 2 16:48:50 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 16:49:00.504031 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writing DB stats keystone:SELECT=15 {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 16:49:00.701595 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG dbcounter [-] [80396] Writing DB stats keystone:SELECT=31 {{(pid=80396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 16:49:09.540994 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e938a497-fcb2-4616-892e-310644d6f9b2 service nova] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:49:09.604188 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e938a497-fcb2-4616-892e-310644d6f9b2 service nova] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:49:09.609417 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6816e680-ec6d-4d62-b5fd-4c48789752d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f73d5a98be74242b45222df39fb6213', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:49:09.610489 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6816e680-ec6d-4d62-b5fd-4c48789752d2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:49:09.610776 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6816e680-ec6d-4d62-b5fd-4c48789752d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:49:09.611051 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6816e680-ec6d-4d62-b5fd-4c48789752d2 admin admin] PATH_INFO: `/v3/users/ea260ef0c06243658976af6efbcd0a58` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:49:09.612231 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6816e680-ec6d-4d62-b5fd-4c48789752d2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ea260ef0c06243658976af6efbcd0a58)` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:49:09.614183 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6816e680-ec6d-4d62-b5fd-4c48789752d2 admin admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:49:09.785003 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.notifications [None req-6816e680-ec6d-4d62-b5fd-4c48789752d2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ea260ef0c06243658976af6efbcd0a58'} {{(pid=80395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:49:09.857357 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.notifications [None req-6816e680-ec6d-4d62-b5fd-4c48789752d2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ea260ef0c06243658976af6efbcd0a58'} {{(pid=80395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:49:09.869966 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.notifications [None req-6816e680-ec6d-4d62-b5fd-4c48789752d2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ea260ef0c06243658976af6efbcd0a58'} {{(pid=80395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:49:09.870736 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.notifications [None req-6816e680-ec6d-4d62-b5fd-4c48789752d2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ea260ef0c06243658976af6efbcd0a58'} {{(pid=80395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:49:09.877626 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.notifications [None req-6816e680-ec6d-4d62-b5fd-4c48789752d2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ea260ef0c06243658976af6efbcd0a58'} {{(pid=80395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:49:09.883540 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 1358/2706] 10.222.0.59 () {58 vars in 1223 bytes} [Thu Jun 2 16:49:09 2022] DELETE /identity/v3/users/ea260ef0c06243658976af6efbcd0a58 => generated 0 bytes in 343 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 16:49:09.888282 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b25beeed-b7fa-4ec0-910a-535c43fadfc5 None None] REQUEST_METHOD: `POST` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:49:09.888779 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b25beeed-b7fa-4ec0-910a-535c43fadfc5 None None] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:49:09.888898 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b25beeed-b7fa-4ec0-910a-535c43fadfc5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:49:09.906989 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.auth.core [None req-b25beeed-b7fa-4ec0-910a-535c43fadfc5 None None] MFA Rules not processed for user `400d1f4db9de49638549e5db29a041e1`. Rule list: `[]` (Enabled: `True`). {{(pid=80396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 16:49:09.908183 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.fernet_utils [None req-b25beeed-b7fa-4ec0-910a-535c43fadfc5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:49:09.966547 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 1349/2707] 10.222.0.59 () {58 vars in 957 bytes} [Thu Jun 2 16:49:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 02 16:49:09.976329 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6816e680-ec6d-4d62-b5fd-4c48789752d2 admin admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:49:09.977748 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.fernet_utils [None req-6816e680-ec6d-4d62-b5fd-4c48789752d2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:49:10.036617 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6816e680-ec6d-4d62-b5fd-4c48789752d2 admin admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:49:10.040138 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a380124e-405a-4512-b966-a838ed1ebfe5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9af40ddfe9ff4be3887b068f13a28dc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c87c981909d4b8db02783421818c79b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:49:10.040774 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a380124e-405a-4512-b966-a838ed1ebfe5 service neutron] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:49:10.041051 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a380124e-405a-4512-b966-a838ed1ebfe5 service neutron] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:49:10.041324 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a380124e-405a-4512-b966-a838ed1ebfe5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:49:10.051080 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a380124e-405a-4512-b966-a838ed1ebfe5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:49:10.052507 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a380124e-405a-4512-b966-a838ed1ebfe5 service neutron] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:49:10.062085 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 1359/2708] 10.222.0.59 () {60 vars in 1365 bytes} [Thu Jun 2 16:49:09 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 16:49:10.521006 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b25beeed-b7fa-4ec0-910a-535c43fadfc5 None None] Authenticating user token {{(pid=80396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:49:10.522628 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.fernet_utils [None req-b25beeed-b7fa-4ec0-910a-535c43fadfc5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:49:10.535311 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b25beeed-b7fa-4ec0-910a-535c43fadfc5 None None] Validating token access rules against request {{(pid=80396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:49:10.548152 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-789b719a-72da-4355-8a06-36aa52e9eab1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f73d5a98be74242b45222df39fb6213', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:49:10.548152 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789b719a-72da-4355-8a06-36aa52e9eab1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:49:10.548152 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789b719a-72da-4355-8a06-36aa52e9eab1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:49:10.548152 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789b719a-72da-4355-8a06-36aa52e9eab1 admin admin] PATH_INFO: `/v3/projects/0004cbeb6b434542980502b997dfda08` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:49:10.549362 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-789b719a-72da-4355-8a06-36aa52e9eab1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0004cbeb6b434542980502b997dfda08)` {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:49:10.549362 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-789b719a-72da-4355-8a06-36aa52e9eab1 admin admin] RBAC: Authorization granted {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:49:10.653593 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.notifications [None req-789b719a-72da-4355-8a06-36aa52e9eab1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0004cbeb6b434542980502b997dfda08', 'request_id': 'req-789b719a-72da-4355-8a06-36aa52e9eab1'} {{(pid=80396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:49:10.659966 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.notifications [None req-789b719a-72da-4355-8a06-36aa52e9eab1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0004cbeb6b434542980502b997dfda08', 'request_id': 'req-789b719a-72da-4355-8a06-36aa52e9eab1'} {{(pid=80396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:49:10.737733 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.notifications [None req-789b719a-72da-4355-8a06-36aa52e9eab1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0004cbeb6b434542980502b997dfda08', 'request_id': 'req-789b719a-72da-4355-8a06-36aa52e9eab1'} {{(pid=80396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:49:10.749669 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.notifications [None req-789b719a-72da-4355-8a06-36aa52e9eab1 admin admin] The token cache is being invalidate because project 0004cbeb6b434542980502b997dfda08 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80396) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 02 16:49:10.749960 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.notifications [None req-789b719a-72da-4355-8a06-36aa52e9eab1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:49:10.750609 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.notifications [None req-789b719a-72da-4355-8a06-36aa52e9eab1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:49:10.752180 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 1350/2709] 10.222.0.59 () {58 vars in 1232 bytes} [Thu Jun 2 16:49:10 2022] DELETE /identity/v3/projects/0004cbeb6b434542980502b997dfda08 => generated 0 bytes in 232 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 16:49:10.756351 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a380124e-405a-4512-b966-a838ed1ebfe5 service neutron] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:49:10.766689 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a380124e-405a-4512-b966-a838ed1ebfe5 service neutron] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:49:10.784853 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 16:49:10.822190 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0874221-9d53-46d1-8a20-0301bc927878 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f73d5a98be74242b45222df39fb6213', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:49:10.822995 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0874221-9d53-46d1-8a20-0301bc927878 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:49:10.824380 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0874221-9d53-46d1-8a20-0301bc927878 admin admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:49:10.824669 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0874221-9d53-46d1-8a20-0301bc927878 admin admin] PATH_INFO: `/v3/users/3300255f011d4361b91fcd5e3191e002` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:49:10.825936 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0874221-9d53-46d1-8a20-0301bc927878 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3300255f011d4361b91fcd5e3191e002)` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:49:10.828083 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0874221-9d53-46d1-8a20-0301bc927878 admin admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:49:11.029574 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.notifications [None req-e0874221-9d53-46d1-8a20-0301bc927878 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3300255f011d4361b91fcd5e3191e002'} {{(pid=80395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:49:11.090315 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.notifications [None req-e0874221-9d53-46d1-8a20-0301bc927878 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3300255f011d4361b91fcd5e3191e002'} {{(pid=80395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:49:11.103527 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.notifications [None req-e0874221-9d53-46d1-8a20-0301bc927878 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3300255f011d4361b91fcd5e3191e002'} {{(pid=80395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:49:11.104212 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.notifications [None req-e0874221-9d53-46d1-8a20-0301bc927878 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3300255f011d4361b91fcd5e3191e002'} {{(pid=80395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:49:11.111534 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.notifications [None req-e0874221-9d53-46d1-8a20-0301bc927878 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3300255f011d4361b91fcd5e3191e002'} {{(pid=80395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:49:11.117409 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 1360/2710] 10.222.0.59 () {58 vars in 1223 bytes} [Thu Jun 2 16:49:10 2022] DELETE /identity/v3/users/3300255f011d4361b91fcd5e3191e002 => generated 0 bytes in 362 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 02 16:49:11.583207 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-789b719a-72da-4355-8a06-36aa52e9eab1 admin admin] Authenticating user token {{(pid=80396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:49:11.584632 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.fernet_utils [None req-789b719a-72da-4355-8a06-36aa52e9eab1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:49:11.598692 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-789b719a-72da-4355-8a06-36aa52e9eab1 admin admin] Validating token access rules against request {{(pid=80396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:49:11.666279 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a205ad5b-97d5-4591-884a-2aebb2eca767 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f73d5a98be74242b45222df39fb6213', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:49:11.667478 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a205ad5b-97d5-4591-884a-2aebb2eca767 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:49:11.667478 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a205ad5b-97d5-4591-884a-2aebb2eca767 admin admin] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:49:11.667881 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a205ad5b-97d5-4591-884a-2aebb2eca767 admin admin] PATH_INFO: `/v3/projects/356e28a7d8fa4034a7b4a00bfd55a273` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:49:11.669071 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a205ad5b-97d5-4591-884a-2aebb2eca767 admin admin] RBAC: Authorizing `identity:delete_project(project_id=356e28a7d8fa4034a7b4a00bfd55a273)` {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:49:11.671182 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a205ad5b-97d5-4591-884a-2aebb2eca767 admin admin] RBAC: Authorization granted {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:49:11.750845 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG dbcounter [-] [80396] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=80396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 16:49:11.767421 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.notifications [None req-a205ad5b-97d5-4591-884a-2aebb2eca767 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '356e28a7d8fa4034a7b4a00bfd55a273', 'request_id': 'req-a205ad5b-97d5-4591-884a-2aebb2eca767'} {{(pid=80396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:49:11.773538 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.notifications [None req-a205ad5b-97d5-4591-884a-2aebb2eca767 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '356e28a7d8fa4034a7b4a00bfd55a273', 'request_id': 'req-a205ad5b-97d5-4591-884a-2aebb2eca767'} {{(pid=80396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:49:11.857357 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.notifications [None req-a205ad5b-97d5-4591-884a-2aebb2eca767 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '356e28a7d8fa4034a7b4a00bfd55a273', 'request_id': 'req-a205ad5b-97d5-4591-884a-2aebb2eca767'} {{(pid=80396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:49:11.872438 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.notifications [None req-a205ad5b-97d5-4591-884a-2aebb2eca767 admin admin] The token cache is being invalidate because project 356e28a7d8fa4034a7b4a00bfd55a273 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80396) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 02 16:49:11.872799 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.notifications [None req-a205ad5b-97d5-4591-884a-2aebb2eca767 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:49:11.873756 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.notifications [None req-a205ad5b-97d5-4591-884a-2aebb2eca767 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:49:11.875493 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 1351/2711] 10.222.0.59 () {58 vars in 1232 bytes} [Thu Jun 2 16:49:11 2022] DELETE /identity/v3/projects/356e28a7d8fa4034a7b4a00bfd55a273 => generated 0 bytes in 293 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 16:49:11.880949 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d15c50-1005-4ef1-95c1-43fce960ea5f None None] REQUEST_METHOD: `POST` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:49:11.881407 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d15c50-1005-4ef1-95c1-43fce960ea5f None None] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:49:11.881535 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d15c50-1005-4ef1-95c1-43fce960ea5f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:49:11.899021 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.auth.core [None req-42d15c50-1005-4ef1-95c1-43fce960ea5f None None] MFA Rules not processed for user `400d1f4db9de49638549e5db29a041e1`. Rule list: `[]` (Enabled: `True`). {{(pid=80395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 16:49:11.900205 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.fernet_utils [None req-42d15c50-1005-4ef1-95c1-43fce960ea5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:49:11.960595 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 1361/2712] 10.222.0.59 () {58 vars in 957 bytes} [Thu Jun 2 16:49:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 16:49:11.969274 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f709be-b1c7-45c3-b1b3-23031338eb96 None None] REQUEST_METHOD: `POST` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:49:11.969564 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f709be-b1c7-45c3-b1b3-23031338eb96 None None] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:49:11.969846 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f709be-b1c7-45c3-b1b3-23031338eb96 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:49:11.993003 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.auth.core [None req-f2f709be-b1c7-45c3-b1b3-23031338eb96 None None] MFA Rules not processed for user `400d1f4db9de49638549e5db29a041e1`. Rule list: `[]` (Enabled: `True`). {{(pid=80396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 16:49:11.994276 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.fernet_utils [None req-f2f709be-b1c7-45c3-b1b3-23031338eb96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:49:12.003240 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 1352/2713] 10.222.0.59 () {58 vars in 957 bytes} [Thu Jun 2 16:49:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 16:49:12.007726 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42d15c50-1005-4ef1-95c1-43fce960ea5f None None] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:49:12.017475 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42d15c50-1005-4ef1-95c1-43fce960ea5f None None] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:49:12.022197 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7edc9925-216c-4996-8d15-08ed1c90a530 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f73d5a98be74242b45222df39fb6213', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:49:12.022847 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7edc9925-216c-4996-8d15-08ed1c90a530 admin admin] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:49:12.023133 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7edc9925-216c-4996-8d15-08ed1c90a530 admin admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:49:12.023416 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7edc9925-216c-4996-8d15-08ed1c90a530 admin admin] PATH_INFO: `/v3/domains` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:49:12.024143 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7edc9925-216c-4996-8d15-08ed1c90a530 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80395) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 16:49:12.024451 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7edc9925-216c-4996-8d15-08ed1c90a530 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:49:12.026039 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7edc9925-216c-4996-8d15-08ed1c90a530 admin admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:49:12.038389 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 1362/2714] 10.222.0.59 () {58 vars in 1152 bytes} [Thu Jun 2 16:49:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 16:49:12.043920 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2f709be-b1c7-45c3-b1b3-23031338eb96 None None] Authenticating user token {{(pid=80396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:49:12.053482 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2f709be-b1c7-45c3-b1b3-23031338eb96 None None] Validating token access rules against request {{(pid=80396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:49:12.058803 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a6bdcd4-3352-4883-8ec9-57c326bdd640 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f73d5a98be74242b45222df39fb6213', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:49:12.061631 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a6bdcd4-3352-4883-8ec9-57c326bdd640 admin admin] REQUEST_METHOD: `POST` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:49:12.061631 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a6bdcd4-3352-4883-8ec9-57c326bdd640 admin admin] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:49:12.061631 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a6bdcd4-3352-4883-8ec9-57c326bdd640 admin admin] PATH_INFO: `/v3/projects` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:49:12.061631 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a6bdcd4-3352-4883-8ec9-57c326bdd640 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:49:12.062643 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a6bdcd4-3352-4883-8ec9-57c326bdd640 admin admin] RBAC: Authorization granted {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:49:12.162654 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 1353/2715] 10.222.0.59 () {60 vars in 1152 bytes} [Thu Jun 2 16:49:12 2022] POST /identity/v3/projects => generated 385 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 16:49:12.166841 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7edc9925-216c-4996-8d15-08ed1c90a530 admin admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:49:12.188910 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7edc9925-216c-4996-8d15-08ed1c90a530 admin admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:49:12.220345 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 16:49:12.253810 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9910cac7-6978-485a-ad34-6202bbf3443b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f73d5a98be74242b45222df39fb6213', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:49:12.254525 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9910cac7-6978-485a-ad34-6202bbf3443b admin admin] REQUEST_METHOD: `POST` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:49:12.259567 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9910cac7-6978-485a-ad34-6202bbf3443b admin admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:49:12.259567 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9910cac7-6978-485a-ad34-6202bbf3443b admin admin] PATH_INFO: `/v3/users` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:49:12.259567 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9910cac7-6978-485a-ad34-6202bbf3443b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:49:12.259567 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9910cac7-6978-485a-ad34-6202bbf3443b admin admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:49:12.372919 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 1363/2716] 10.222.0.59 () {60 vars in 1143 bytes} [Thu Jun 2 16:49:12 2022] POST /identity/v3/users => generated 293 bytes in 207 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 16:49:12.377325 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a6bdcd4-3352-4883-8ec9-57c326bdd640 admin admin] Authenticating user token {{(pid=80396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:49:12.388202 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a6bdcd4-3352-4883-8ec9-57c326bdd640 admin admin] Validating token access rules against request {{(pid=80396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:49:12.392816 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-525726f5-a68c-4dbb-80d2-db9e8ef5f688 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f73d5a98be74242b45222df39fb6213', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:49:12.393521 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-525726f5-a68c-4dbb-80d2-db9e8ef5f688 admin admin] REQUEST_METHOD: `GET` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:49:12.393810 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-525726f5-a68c-4dbb-80d2-db9e8ef5f688 admin admin] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:49:12.394136 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-525726f5-a68c-4dbb-80d2-db9e8ef5f688 admin admin] PATH_INFO: `/v3/roles` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:49:12.394865 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-525726f5-a68c-4dbb-80d2-db9e8ef5f688 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:49:12.396521 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-525726f5-a68c-4dbb-80d2-db9e8ef5f688 admin admin] RBAC: Authorization granted {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:49:12.408452 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 1354/2717] 10.222.0.59 () {58 vars in 1121 bytes} [Thu Jun 2 16:49:12 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 16:49:12.412344 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9910cac7-6978-485a-ad34-6202bbf3443b admin admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:49:12.426099 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9910cac7-6978-485a-ad34-6202bbf3443b admin admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:49:12.427377 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0453252-f717-49c7-8cf8-bfc5e2c77534 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f73d5a98be74242b45222df39fb6213', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:49:12.428028 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0453252-f717-49c7-8cf8-bfc5e2c77534 admin admin] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:49:12.428313 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0453252-f717-49c7-8cf8-bfc5e2c77534 admin admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:49:12.428593 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0453252-f717-49c7-8cf8-bfc5e2c77534 admin admin] PATH_INFO: `/v3/roles` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:49:12.429321 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0453252-f717-49c7-8cf8-bfc5e2c77534 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:49:12.431011 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0453252-f717-49c7-8cf8-bfc5e2c77534 admin admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:49:12.441591 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 1364/2718] 10.222.0.59 () {58 vars in 1121 bytes} [Thu Jun 2 16:49:12 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 16:49:12.445560 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-525726f5-a68c-4dbb-80d2-db9e8ef5f688 admin admin] Authenticating user token {{(pid=80396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:49:12.460650 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-525726f5-a68c-4dbb-80d2-db9e8ef5f688 admin admin] Validating token access rules against request {{(pid=80396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:49:12.462499 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-189a804e-1704-4e8e-b941-26d660ef5993 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f73d5a98be74242b45222df39fb6213', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:49:12.463370 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-189a804e-1704-4e8e-b941-26d660ef5993 admin admin] REQUEST_METHOD: `PUT` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:49:12.463654 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-189a804e-1704-4e8e-b941-26d660ef5993 admin admin] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:49:12.465141 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-189a804e-1704-4e8e-b941-26d660ef5993 admin admin] PATH_INFO: `/v3/projects/f66b2ff0d7f740659c721c5d87bd8cfa/users/83bed9bc023e4856804712941395925a/roles/649e0f2b5a264c419ea6a1441f123a03` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:49:12.480497 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-189a804e-1704-4e8e-b941-26d660ef5993 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f66b2ff0d7f740659c721c5d87bd8cfa, user_id=83bed9bc023e4856804712941395925a, role_id=649e0f2b5a264c419ea6a1441f123a03)` {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:49:12.483152 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-189a804e-1704-4e8e-b941-26d660ef5993 admin admin] RBAC: Authorization granted {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:49:12.576960 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 1355/2719] 10.222.0.59 () {60 vars in 1482 bytes} [Thu Jun 2 16:49:12 2022] PUT /identity/v3/projects/f66b2ff0d7f740659c721c5d87bd8cfa/users/83bed9bc023e4856804712941395925a/roles/649e0f2b5a264c419ea6a1441f123a03 => generated 0 bytes in 132 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 16:49:12.587246 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc7f05a-2e82-4a79-b90b-23b57193943a None None] REQUEST_METHOD: `POST` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:49:12.587538 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc7f05a-2e82-4a79-b90b-23b57193943a None None] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:49:12.587818 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc7f05a-2e82-4a79-b90b-23b57193943a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:49:12.615327 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.auth.core [None req-2bc7f05a-2e82-4a79-b90b-23b57193943a None None] MFA Rules not processed for user `83bed9bc023e4856804712941395925a`. Rule list: `[]` (Enabled: `True`). {{(pid=80395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 16:49:12.616501 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.fernet_utils [None req-2bc7f05a-2e82-4a79-b90b-23b57193943a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:49:12.681462 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 1365/2720] 10.222.0.59 () {58 vars in 957 bytes} [Thu Jun 2 16:49:12 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 16:49:12.686288 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-189a804e-1704-4e8e-b941-26d660ef5993 admin admin] Authenticating user token {{(pid=80396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:49:12.749410 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-189a804e-1704-4e8e-b941-26d660ef5993 admin admin] Validating token access rules against request {{(pid=80396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:49:12.754042 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e71559c6-5a9d-4096-b68d-9540ad50f636 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f73d5a98be74242b45222df39fb6213', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:49:12.754716 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e71559c6-5a9d-4096-b68d-9540ad50f636 admin admin] REQUEST_METHOD: `POST` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:49:12.755003 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e71559c6-5a9d-4096-b68d-9540ad50f636 admin admin] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:49:12.755285 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e71559c6-5a9d-4096-b68d-9540ad50f636 admin admin] PATH_INFO: `/v3/projects` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:49:12.755987 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e71559c6-5a9d-4096-b68d-9540ad50f636 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:49:12.757888 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e71559c6-5a9d-4096-b68d-9540ad50f636 admin admin] RBAC: Authorization granted {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:49:12.841547 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 1356/2721] 10.222.0.59 () {60 vars in 1152 bytes} [Thu Jun 2 16:49:12 2022] POST /identity/v3/projects => generated 387 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 16:49:12.845624 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bc7f05a-2e82-4a79-b90b-23b57193943a None None] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:49:12.856249 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bc7f05a-2e82-4a79-b90b-23b57193943a None None] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:49:12.916627 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70daf697-97eb-4c24-bd01-267cd4abe36d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f73d5a98be74242b45222df39fb6213', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:49:12.917451 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70daf697-97eb-4c24-bd01-267cd4abe36d admin admin] REQUEST_METHOD: `POST` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:49:12.917736 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70daf697-97eb-4c24-bd01-267cd4abe36d admin admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:49:12.918010 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70daf697-97eb-4c24-bd01-267cd4abe36d admin admin] PATH_INFO: `/v3/users` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:49:12.918737 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70daf697-97eb-4c24-bd01-267cd4abe36d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:49:12.920646 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70daf697-97eb-4c24-bd01-267cd4abe36d admin admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:49:13.012959 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 1366/2722] 10.222.0.59 () {60 vars in 1143 bytes} [Thu Jun 2 16:49:12 2022] POST /identity/v3/users => generated 300 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 16:49:13.017018 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e71559c6-5a9d-4096-b68d-9540ad50f636 admin admin] Authenticating user token {{(pid=80396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:49:13.027505 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e71559c6-5a9d-4096-b68d-9540ad50f636 admin admin] Validating token access rules against request {{(pid=80396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:49:13.032417 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfb10bbf-a868-43ff-b286-d2e60ec0c5a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f73d5a98be74242b45222df39fb6213', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:49:13.033189 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb10bbf-a868-43ff-b286-d2e60ec0c5a7 admin admin] REQUEST_METHOD: `GET` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:49:13.033480 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb10bbf-a868-43ff-b286-d2e60ec0c5a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:49:13.033761 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb10bbf-a868-43ff-b286-d2e60ec0c5a7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:49:13.034552 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfb10bbf-a868-43ff-b286-d2e60ec0c5a7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:49:13.036170 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfb10bbf-a868-43ff-b286-d2e60ec0c5a7 admin admin] RBAC: Authorization granted {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:49:13.047345 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 1357/2723] 10.222.0.59 () {58 vars in 1121 bytes} [Thu Jun 2 16:49:13 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 16:49:13.051324 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70daf697-97eb-4c24-bd01-267cd4abe36d admin admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:49:13.061716 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70daf697-97eb-4c24-bd01-267cd4abe36d admin admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:49:13.066289 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6712f33f-29d8-4920-b36a-fd67a26008cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f73d5a98be74242b45222df39fb6213', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:49:13.067150 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6712f33f-29d8-4920-b36a-fd67a26008cf admin admin] REQUEST_METHOD: `PUT` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:49:13.067432 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6712f33f-29d8-4920-b36a-fd67a26008cf admin admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:49:13.067704 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6712f33f-29d8-4920-b36a-fd67a26008cf admin admin] PATH_INFO: `/v3/projects/73ac9e5fd4b94a0ba1bc0c7a1440bc8b/users/b5989912ebe646f899a997fbfaf874b1/roles/f1e0c25f6e9049e897cb7350c7e54ab3` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:49:13.083193 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6712f33f-29d8-4920-b36a-fd67a26008cf admin admin] RBAC: Authorizing `identity:create_grant(project_id=73ac9e5fd4b94a0ba1bc0c7a1440bc8b, user_id=b5989912ebe646f899a997fbfaf874b1, role_id=f1e0c25f6e9049e897cb7350c7e54ab3)` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:49:13.085808 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6712f33f-29d8-4920-b36a-fd67a26008cf admin admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:49:13.155230 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 1367/2724] 10.222.0.59 () {60 vars in 1482 bytes} [Thu Jun 2 16:49:13 2022] PUT /identity/v3/projects/73ac9e5fd4b94a0ba1bc0c7a1440bc8b/users/b5989912ebe646f899a997fbfaf874b1/roles/f1e0c25f6e9049e897cb7350c7e54ab3 => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 02 16:49:13.159052 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfb10bbf-a868-43ff-b286-d2e60ec0c5a7 admin admin] Authenticating user token {{(pid=80396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:49:13.170297 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfb10bbf-a868-43ff-b286-d2e60ec0c5a7 admin admin] Validating token access rules against request {{(pid=80396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:49:13.191785 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG dbcounter [-] [80396] Writing DB stats keystone:DELETE=6,keystone:SELECT=90,keystone:INSERT=4 {{(pid=80396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 16:49:13.228634 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61fa438f-cac4-4ef5-bdf2-bd8e786336c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f73d5a98be74242b45222df39fb6213', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:49:13.229298 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61fa438f-cac4-4ef5-bdf2-bd8e786336c6 admin admin] REQUEST_METHOD: `GET` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:49:13.229583 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61fa438f-cac4-4ef5-bdf2-bd8e786336c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:49:13.229863 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61fa438f-cac4-4ef5-bdf2-bd8e786336c6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:49:13.230624 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61fa438f-cac4-4ef5-bdf2-bd8e786336c6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:49:13.232216 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61fa438f-cac4-4ef5-bdf2-bd8e786336c6 admin admin] RBAC: Authorization granted {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:49:13.241913 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 1358/2725] 10.222.0.59 () {58 vars in 1121 bytes} [Thu Jun 2 16:49:13 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 16:49:13.246454 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6712f33f-29d8-4920-b36a-fd67a26008cf admin admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:49:13.251967 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 16:49:13.257379 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6712f33f-29d8-4920-b36a-fd67a26008cf admin admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:49:13.263361 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-940b0150-2dc0-4c58-aaa3-7bb96863ee21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f73d5a98be74242b45222df39fb6213', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:49:13.264162 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-940b0150-2dc0-4c58-aaa3-7bb96863ee21 admin admin] REQUEST_METHOD: `PUT` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:49:13.264449 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-940b0150-2dc0-4c58-aaa3-7bb96863ee21 admin admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:49:13.264726 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-940b0150-2dc0-4c58-aaa3-7bb96863ee21 admin admin] PATH_INFO: `/v3/projects/73ac9e5fd4b94a0ba1bc0c7a1440bc8b/users/b5989912ebe646f899a997fbfaf874b1/roles/f1e0c25f6e9049e897cb7350c7e54ab3` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:49:13.266851 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-940b0150-2dc0-4c58-aaa3-7bb96863ee21 admin admin] RBAC: Authorizing `identity:create_grant(project_id=73ac9e5fd4b94a0ba1bc0c7a1440bc8b, user_id=b5989912ebe646f899a997fbfaf874b1, role_id=f1e0c25f6e9049e897cb7350c7e54ab3)` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:49:13.269596 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-940b0150-2dc0-4c58-aaa3-7bb96863ee21 admin admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:49:13.281766 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 1368/2726] 10.222.0.59 () {60 vars in 1482 bytes} [Thu Jun 2 16:49:13 2022] PUT /identity/v3/projects/73ac9e5fd4b94a0ba1bc0c7a1440bc8b/users/b5989912ebe646f899a997fbfaf874b1/roles/f1e0c25f6e9049e897cb7350c7e54ab3 => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 16:49:13.292920 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe69d9e-aaf9-456e-8b2a-41759e61d295 None None] REQUEST_METHOD: `POST` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:49:13.293210 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe69d9e-aaf9-456e-8b2a-41759e61d295 None None] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:49:13.293484 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe69d9e-aaf9-456e-8b2a-41759e61d295 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:49:13.319025 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.auth.core [None req-bbe69d9e-aaf9-456e-8b2a-41759e61d295 None None] MFA Rules not processed for user `b5989912ebe646f899a997fbfaf874b1`. Rule list: `[]` (Enabled: `True`). {{(pid=80396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 16:49:13.320372 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.fernet_utils [None req-bbe69d9e-aaf9-456e-8b2a-41759e61d295 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:49:13.388115 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 1359/2727] 10.222.0.59 () {58 vars in 957 bytes} [Thu Jun 2 16:49:13 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 16:49:13.399515 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-940b0150-2dc0-4c58-aaa3-7bb96863ee21 admin admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:49:13.401892 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.fernet_utils [None req-940b0150-2dc0-4c58-aaa3-7bb96863ee21 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:49:13.459315 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-940b0150-2dc0-4c58-aaa3-7bb96863ee21 admin admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:49:13.463311 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-676a7e7b-58fe-4297-aec4-68c845172a8e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6534961c369940a5b88f310c6450250b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c87c981909d4b8db02783421818c79b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:49:13.464569 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-676a7e7b-58fe-4297-aec4-68c845172a8e service cinder] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:49:13.465124 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-676a7e7b-58fe-4297-aec4-68c845172a8e service cinder] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:49:13.465410 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-676a7e7b-58fe-4297-aec4-68c845172a8e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:49:13.474806 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-676a7e7b-58fe-4297-aec4-68c845172a8e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:49:13.476407 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-676a7e7b-58fe-4297-aec4-68c845172a8e service cinder] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:49:13.485989 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 1369/2728] 10.222.0.59 () {60 vars in 1365 bytes} [Thu Jun 2 16:49:13 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 02 16:49:13.549997 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbe69d9e-aaf9-456e-8b2a-41759e61d295 None None] Authenticating user token {{(pid=80396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:49:13.613880 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbe69d9e-aaf9-456e-8b2a-41759e61d295 None None] Validating token access rules against request {{(pid=80396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:49:13.618598 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5733c23a-1874-4fca-a18a-dff94af81bc9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f73d5a98be74242b45222df39fb6213', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:49:13.619458 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5733c23a-1874-4fca-a18a-dff94af81bc9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:49:13.619739 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5733c23a-1874-4fca-a18a-dff94af81bc9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:49:13.620803 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5733c23a-1874-4fca-a18a-dff94af81bc9 admin admin] PATH_INFO: `/v3/users/83bed9bc023e4856804712941395925a` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:49:13.622047 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5733c23a-1874-4fca-a18a-dff94af81bc9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=83bed9bc023e4856804712941395925a)` {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:49:13.623984 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5733c23a-1874-4fca-a18a-dff94af81bc9 admin admin] RBAC: Authorization granted {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:49:13.797068 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.notifications [None req-5733c23a-1874-4fca-a18a-dff94af81bc9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '83bed9bc023e4856804712941395925a'} {{(pid=80396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:49:13.797678 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.notifications [None req-5733c23a-1874-4fca-a18a-dff94af81bc9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '83bed9bc023e4856804712941395925a'} {{(pid=80396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:49:13.799289 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG dbcounter [-] [80396] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=80396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 16:49:13.874895 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.notifications [None req-5733c23a-1874-4fca-a18a-dff94af81bc9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '83bed9bc023e4856804712941395925a'} {{(pid=80396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:49:13.888193 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.notifications [None req-5733c23a-1874-4fca-a18a-dff94af81bc9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '83bed9bc023e4856804712941395925a'} {{(pid=80396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:49:13.895175 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.notifications [None req-5733c23a-1874-4fca-a18a-dff94af81bc9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '83bed9bc023e4856804712941395925a'} {{(pid=80396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:49:13.901161 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 1360/2729] 10.222.0.59 () {58 vars in 1223 bytes} [Thu Jun 2 16:49:13 2022] DELETE /identity/v3/users/83bed9bc023e4856804712941395925a => generated 0 bytes in 352 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 16:49:13.906019 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0957f5ed-f5ab-4123-bcbe-8abe24ac6cd2 None None] REQUEST_METHOD: `POST` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:49:13.906350 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0957f5ed-f5ab-4123-bcbe-8abe24ac6cd2 None None] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:49:13.906623 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0957f5ed-f5ab-4123-bcbe-8abe24ac6cd2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:49:13.923819 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.auth.core [None req-0957f5ed-f5ab-4123-bcbe-8abe24ac6cd2 None None] MFA Rules not processed for user `400d1f4db9de49638549e5db29a041e1`. Rule list: `[]` (Enabled: `True`). {{(pid=80395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 16:49:13.925004 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.fernet_utils [None req-0957f5ed-f5ab-4123-bcbe-8abe24ac6cd2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:49:13.985999 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 1370/2730] 10.222.0.59 () {58 vars in 957 bytes} [Thu Jun 2 16:49:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 16:49:13.996848 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5733c23a-1874-4fca-a18a-dff94af81bc9 admin admin] Authenticating user token {{(pid=80396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:49:13.998315 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.fernet_utils [None req-5733c23a-1874-4fca-a18a-dff94af81bc9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:49:14.056042 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5733c23a-1874-4fca-a18a-dff94af81bc9 admin admin] Validating token access rules against request {{(pid=80396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:49:14.060250 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6322cc0-1216-49c5-b448-d7558461bb5a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9af40ddfe9ff4be3887b068f13a28dc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c87c981909d4b8db02783421818c79b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:49:14.061689 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6322cc0-1216-49c5-b448-d7558461bb5a service neutron] REQUEST_METHOD: `GET` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:49:14.061977 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6322cc0-1216-49c5-b448-d7558461bb5a service neutron] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:49:14.062298 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6322cc0-1216-49c5-b448-d7558461bb5a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:49:14.071514 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6322cc0-1216-49c5-b448-d7558461bb5a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:49:14.072972 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6322cc0-1216-49c5-b448-d7558461bb5a service neutron] RBAC: Authorization granted {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:49:14.082408 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 1361/2731] 10.222.0.59 () {60 vars in 1365 bytes} [Thu Jun 2 16:49:13 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 16:49:14.483326 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0957f5ed-f5ab-4123-bcbe-8abe24ac6cd2 None None] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:49:14.484711 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.fernet_utils [None req-0957f5ed-f5ab-4123-bcbe-8abe24ac6cd2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:49:14.496677 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0957f5ed-f5ab-4123-bcbe-8abe24ac6cd2 None None] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:49:14.509662 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93cc2287-e8e8-4e08-ab81-c270f9bbf1f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f73d5a98be74242b45222df39fb6213', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:49:14.510479 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93cc2287-e8e8-4e08-ab81-c270f9bbf1f5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:49:14.510724 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93cc2287-e8e8-4e08-ab81-c270f9bbf1f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:49:14.511640 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93cc2287-e8e8-4e08-ab81-c270f9bbf1f5 admin admin] PATH_INFO: `/v3/projects/f66b2ff0d7f740659c721c5d87bd8cfa` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:49:14.513090 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93cc2287-e8e8-4e08-ab81-c270f9bbf1f5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f66b2ff0d7f740659c721c5d87bd8cfa)` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:49:14.515034 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93cc2287-e8e8-4e08-ab81-c270f9bbf1f5 admin admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:49:14.620551 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.notifications [None req-93cc2287-e8e8-4e08-ab81-c270f9bbf1f5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f66b2ff0d7f740659c721c5d87bd8cfa', 'request_id': 'req-93cc2287-e8e8-4e08-ab81-c270f9bbf1f5'} {{(pid=80395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:49:14.626620 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.notifications [None req-93cc2287-e8e8-4e08-ab81-c270f9bbf1f5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f66b2ff0d7f740659c721c5d87bd8cfa', 'request_id': 'req-93cc2287-e8e8-4e08-ab81-c270f9bbf1f5'} {{(pid=80395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:49:14.720771 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.notifications [None req-93cc2287-e8e8-4e08-ab81-c270f9bbf1f5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f66b2ff0d7f740659c721c5d87bd8cfa', 'request_id': 'req-93cc2287-e8e8-4e08-ab81-c270f9bbf1f5'} {{(pid=80395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:49:14.734271 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.notifications [None req-93cc2287-e8e8-4e08-ab81-c270f9bbf1f5 admin admin] The token cache is being invalidate because project f66b2ff0d7f740659c721c5d87bd8cfa was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80395) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 02 16:49:14.734271 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.notifications [None req-93cc2287-e8e8-4e08-ab81-c270f9bbf1f5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:49:14.734271 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.notifications [None req-93cc2287-e8e8-4e08-ab81-c270f9bbf1f5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:49:14.735332 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 1371/2732] 10.222.0.59 () {58 vars in 1232 bytes} [Thu Jun 2 16:49:14 2022] DELETE /identity/v3/projects/f66b2ff0d7f740659c721c5d87bd8cfa => generated 0 bytes in 253 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 16:49:14.739202 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6322cc0-1216-49c5-b448-d7558461bb5a service neutron] Authenticating user token {{(pid=80396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:49:14.749084 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6322cc0-1216-49c5-b448-d7558461bb5a service neutron] Validating token access rules against request {{(pid=80396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:49:14.807218 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d4d96c-e9a3-4c9a-a5e1-059906ed96fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f73d5a98be74242b45222df39fb6213', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:49:14.808156 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d4d96c-e9a3-4c9a-a5e1-059906ed96fe admin admin] REQUEST_METHOD: `DELETE` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:49:14.808445 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d4d96c-e9a3-4c9a-a5e1-059906ed96fe admin admin] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:49:14.808752 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d4d96c-e9a3-4c9a-a5e1-059906ed96fe admin admin] PATH_INFO: `/v3/users/b5989912ebe646f899a997fbfaf874b1` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:49:14.809939 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4d4d96c-e9a3-4c9a-a5e1-059906ed96fe admin admin] RBAC: Authorizing `identity:delete_user(user_id=b5989912ebe646f899a997fbfaf874b1)` {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:49:14.811874 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4d4d96c-e9a3-4c9a-a5e1-059906ed96fe admin admin] RBAC: Authorization granted {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:49:15.002232 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.notifications [None req-a4d4d96c-e9a3-4c9a-a5e1-059906ed96fe admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b5989912ebe646f899a997fbfaf874b1'} {{(pid=80396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:49:15.002909 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.notifications [None req-a4d4d96c-e9a3-4c9a-a5e1-059906ed96fe admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b5989912ebe646f899a997fbfaf874b1'} {{(pid=80396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:49:15.061473 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.notifications [None req-a4d4d96c-e9a3-4c9a-a5e1-059906ed96fe admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b5989912ebe646f899a997fbfaf874b1'} {{(pid=80396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:49:15.072774 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG dbcounter [-] [80396] Writing DB stats keystone:INSERT=2,keystone:DELETE=13,keystone:SELECT=85 {{(pid=80396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 16:49:15.074569 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.notifications [None req-a4d4d96c-e9a3-4c9a-a5e1-059906ed96fe admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b5989912ebe646f899a997fbfaf874b1'} {{(pid=80396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:49:15.081465 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.notifications [None req-a4d4d96c-e9a3-4c9a-a5e1-059906ed96fe admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b5989912ebe646f899a997fbfaf874b1'} {{(pid=80396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:49:15.087505 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 1362/2733] 10.222.0.59 () {58 vars in 1223 bytes} [Thu Jun 2 16:49:14 2022] DELETE /identity/v3/users/b5989912ebe646f899a997fbfaf874b1 => generated 0 bytes in 349 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 16:49:15.537595 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93cc2287-e8e8-4e08-ab81-c270f9bbf1f5 admin admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:49:15.539069 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.fernet_utils [None req-93cc2287-e8e8-4e08-ab81-c270f9bbf1f5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:49:15.555651 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93cc2287-e8e8-4e08-ab81-c270f9bbf1f5 admin admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:49:15.570362 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 16:49:15.616336 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed3e39a4-18b6-4405-b028-99e3cb0ffa72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f73d5a98be74242b45222df39fb6213', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:49:15.617229 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3e39a4-18b6-4405-b028-99e3cb0ffa72 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:49:15.617515 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3e39a4-18b6-4405-b028-99e3cb0ffa72 admin admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:49:15.617823 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3e39a4-18b6-4405-b028-99e3cb0ffa72 admin admin] PATH_INFO: `/v3/projects/73ac9e5fd4b94a0ba1bc0c7a1440bc8b` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:49:15.619037 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed3e39a4-18b6-4405-b028-99e3cb0ffa72 admin admin] RBAC: Authorizing `identity:delete_project(project_id=73ac9e5fd4b94a0ba1bc0c7a1440bc8b)` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:49:15.622562 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed3e39a4-18b6-4405-b028-99e3cb0ffa72 admin admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:49:15.754915 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.notifications [None req-ed3e39a4-18b6-4405-b028-99e3cb0ffa72 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '73ac9e5fd4b94a0ba1bc0c7a1440bc8b', 'request_id': 'req-ed3e39a4-18b6-4405-b028-99e3cb0ffa72'} {{(pid=80395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:49:15.760764 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.notifications [None req-ed3e39a4-18b6-4405-b028-99e3cb0ffa72 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '73ac9e5fd4b94a0ba1bc0c7a1440bc8b', 'request_id': 'req-ed3e39a4-18b6-4405-b028-99e3cb0ffa72'} {{(pid=80395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:49:15.851288 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.notifications [None req-ed3e39a4-18b6-4405-b028-99e3cb0ffa72 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '73ac9e5fd4b94a0ba1bc0c7a1440bc8b', 'request_id': 'req-ed3e39a4-18b6-4405-b028-99e3cb0ffa72'} {{(pid=80395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:49:15.863374 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.notifications [None req-ed3e39a4-18b6-4405-b028-99e3cb0ffa72 admin admin] The token cache is being invalidate because project 73ac9e5fd4b94a0ba1bc0c7a1440bc8b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80395) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 02 16:49:15.863668 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.notifications [None req-ed3e39a4-18b6-4405-b028-99e3cb0ffa72 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:49:15.864298 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.notifications [None req-ed3e39a4-18b6-4405-b028-99e3cb0ffa72 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:49:15.865842 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 1372/2734] 10.222.0.59 () {58 vars in 1232 bytes} [Thu Jun 2 16:49:15 2022] DELETE /identity/v3/projects/73ac9e5fd4b94a0ba1bc0c7a1440bc8b => generated 0 bytes in 329 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 16:49:15.871744 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48f5654-ac6d-400a-ac96-30fec3198543 None None] REQUEST_METHOD: `POST` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:49:15.877004 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48f5654-ac6d-400a-ac96-30fec3198543 None None] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:49:15.877004 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48f5654-ac6d-400a-ac96-30fec3198543 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:49:15.890879 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.auth.core [None req-c48f5654-ac6d-400a-ac96-30fec3198543 None None] MFA Rules not processed for user `400d1f4db9de49638549e5db29a041e1`. Rule list: `[]` (Enabled: `True`). {{(pid=80396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 16:49:15.892120 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.fernet_utils [None req-c48f5654-ac6d-400a-ac96-30fec3198543 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:49:15.951576 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 1363/2735] 10.222.0.59 () {58 vars in 957 bytes} [Thu Jun 2 16:49:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 16:49:15.959345 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e360e34e-d0fb-42a9-ac2c-9bd257fdf230 None None] REQUEST_METHOD: `POST` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:49:15.959635 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e360e34e-d0fb-42a9-ac2c-9bd257fdf230 None None] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:49:15.959913 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e360e34e-d0fb-42a9-ac2c-9bd257fdf230 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:49:15.979013 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.auth.core [None req-e360e34e-d0fb-42a9-ac2c-9bd257fdf230 None None] MFA Rules not processed for user `400d1f4db9de49638549e5db29a041e1`. Rule list: `[]` (Enabled: `True`). {{(pid=80395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 16:49:15.980853 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.fernet_utils [None req-e360e34e-d0fb-42a9-ac2c-9bd257fdf230 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:49:15.988764 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 1373/2736] 10.222.0.59 () {58 vars in 957 bytes} [Thu Jun 2 16:49:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 16:49:15.993042 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c48f5654-ac6d-400a-ac96-30fec3198543 None None] Authenticating user token {{(pid=80396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:49:16.003866 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c48f5654-ac6d-400a-ac96-30fec3198543 None None] Validating token access rules against request {{(pid=80396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:49:16.008498 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-640dc153-327f-4c4d-8a92-00487930f2f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f73d5a98be74242b45222df39fb6213', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:49:16.009141 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-640dc153-327f-4c4d-8a92-00487930f2f2 admin admin] REQUEST_METHOD: `GET` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:49:16.009427 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-640dc153-327f-4c4d-8a92-00487930f2f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:49:16.009706 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-640dc153-327f-4c4d-8a92-00487930f2f2 admin admin] PATH_INFO: `/v3/domains` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:49:16.010461 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-640dc153-327f-4c4d-8a92-00487930f2f2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80396) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 16:49:16.011125 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-640dc153-327f-4c4d-8a92-00487930f2f2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:49:16.012812 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-640dc153-327f-4c4d-8a92-00487930f2f2 admin admin] RBAC: Authorization granted {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:49:16.024411 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 1364/2737] 10.222.0.59 () {58 vars in 1152 bytes} [Thu Jun 2 16:49:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 16:49:16.029156 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e360e34e-d0fb-42a9-ac2c-9bd257fdf230 None None] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:49:16.038590 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e360e34e-d0fb-42a9-ac2c-9bd257fdf230 None None] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:49:16.044100 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e16890c4-5f3f-4afc-82e3-34661ab435f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f73d5a98be74242b45222df39fb6213', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:49:16.044737 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e16890c4-5f3f-4afc-82e3-34661ab435f3 admin admin] REQUEST_METHOD: `POST` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:49:16.045018 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e16890c4-5f3f-4afc-82e3-34661ab435f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:49:16.045290 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e16890c4-5f3f-4afc-82e3-34661ab435f3 admin admin] PATH_INFO: `/v3/projects` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:49:16.045988 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e16890c4-5f3f-4afc-82e3-34661ab435f3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:49:16.047880 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e16890c4-5f3f-4afc-82e3-34661ab435f3 admin admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:49:16.213673 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 1374/2738] 10.222.0.59 () {60 vars in 1152 bytes} [Thu Jun 2 16:49:16 2022] POST /identity/v3/projects => generated 387 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 16:49:16.218424 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-640dc153-327f-4c4d-8a92-00487930f2f2 admin admin] Authenticating user token {{(pid=80396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:49:16.228332 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-640dc153-327f-4c4d-8a92-00487930f2f2 admin admin] Validating token access rules against request {{(pid=80396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:49:16.284378 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a66b6dc7-368e-4f6f-bcf0-f8b7508cd8cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f73d5a98be74242b45222df39fb6213', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:49:16.285036 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a66b6dc7-368e-4f6f-bcf0-f8b7508cd8cc admin admin] REQUEST_METHOD: `POST` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:49:16.285321 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a66b6dc7-368e-4f6f-bcf0-f8b7508cd8cc admin admin] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:49:16.285596 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a66b6dc7-368e-4f6f-bcf0-f8b7508cd8cc admin admin] PATH_INFO: `/v3/users` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:49:16.286331 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a66b6dc7-368e-4f6f-bcf0-f8b7508cd8cc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:49:16.288228 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a66b6dc7-368e-4f6f-bcf0-f8b7508cd8cc admin admin] RBAC: Authorization granted {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:49:16.381604 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 1365/2739] 10.222.0.59 () {60 vars in 1143 bytes} [Thu Jun 2 16:49:16 2022] POST /identity/v3/users => generated 294 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 16:49:16.386191 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e16890c4-5f3f-4afc-82e3-34661ab435f3 admin admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:49:16.396486 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e16890c4-5f3f-4afc-82e3-34661ab435f3 admin admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:49:16.401154 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3093382f-77d8-45b9-985d-5e3ef3e579b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f73d5a98be74242b45222df39fb6213', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:49:16.402450 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3093382f-77d8-45b9-985d-5e3ef3e579b0 admin admin] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:49:16.402734 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3093382f-77d8-45b9-985d-5e3ef3e579b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:49:16.403007 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3093382f-77d8-45b9-985d-5e3ef3e579b0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:49:16.403729 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3093382f-77d8-45b9-985d-5e3ef3e579b0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:49:16.405310 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3093382f-77d8-45b9-985d-5e3ef3e579b0 admin admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:49:16.415630 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 1375/2740] 10.222.0.59 () {58 vars in 1121 bytes} [Thu Jun 2 16:49:16 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 16:49:16.419871 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a66b6dc7-368e-4f6f-bcf0-f8b7508cd8cc admin admin] Authenticating user token {{(pid=80396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:49:16.430122 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a66b6dc7-368e-4f6f-bcf0-f8b7508cd8cc admin admin] Validating token access rules against request {{(pid=80396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:49:16.435315 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-527f6904-7ed1-41e8-8f6a-2c44db255ab2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f73d5a98be74242b45222df39fb6213', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:49:16.435965 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527f6904-7ed1-41e8-8f6a-2c44db255ab2 admin admin] REQUEST_METHOD: `GET` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:49:16.436253 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527f6904-7ed1-41e8-8f6a-2c44db255ab2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:49:16.436534 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527f6904-7ed1-41e8-8f6a-2c44db255ab2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:49:16.437258 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-527f6904-7ed1-41e8-8f6a-2c44db255ab2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:49:16.438889 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-527f6904-7ed1-41e8-8f6a-2c44db255ab2 admin admin] RBAC: Authorization granted {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:49:16.449630 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 1366/2741] 10.222.0.59 () {58 vars in 1121 bytes} [Thu Jun 2 16:49:16 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 16:49:16.453555 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3093382f-77d8-45b9-985d-5e3ef3e579b0 admin admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:49:16.463443 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3093382f-77d8-45b9-985d-5e3ef3e579b0 admin admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:49:16.468850 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f1878ec-ed38-4bcb-af2d-9621f43b9739 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f73d5a98be74242b45222df39fb6213', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:49:16.469721 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1878ec-ed38-4bcb-af2d-9621f43b9739 admin admin] REQUEST_METHOD: `PUT` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:49:16.470004 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1878ec-ed38-4bcb-af2d-9621f43b9739 admin admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:49:16.470314 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1878ec-ed38-4bcb-af2d-9621f43b9739 admin admin] PATH_INFO: `/v3/projects/e26024222ac44d2789f44bb7106ef412/users/d1a32894e9864921850bd5ab7e3054b1/roles/649e0f2b5a264c419ea6a1441f123a03` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:49:16.484798 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f1878ec-ed38-4bcb-af2d-9621f43b9739 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e26024222ac44d2789f44bb7106ef412, user_id=d1a32894e9864921850bd5ab7e3054b1, role_id=649e0f2b5a264c419ea6a1441f123a03)` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:49:16.487485 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f1878ec-ed38-4bcb-af2d-9621f43b9739 admin admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:49:16.580625 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 1376/2742] 10.222.0.59 () {60 vars in 1482 bytes} [Thu Jun 2 16:49:16 2022] PUT /identity/v3/projects/e26024222ac44d2789f44bb7106ef412/users/d1a32894e9864921850bd5ab7e3054b1/roles/649e0f2b5a264c419ea6a1441f123a03 => generated 0 bytes in 128 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 02 16:49:16.591121 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed2de45c-90a6-405e-a858-1d214b3fceb6 None None] REQUEST_METHOD: `POST` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:49:16.591415 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed2de45c-90a6-405e-a858-1d214b3fceb6 None None] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:49:16.591697 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed2de45c-90a6-405e-a858-1d214b3fceb6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:49:16.618234 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.auth.core [None req-ed2de45c-90a6-405e-a858-1d214b3fceb6 None None] MFA Rules not processed for user `d1a32894e9864921850bd5ab7e3054b1`. Rule list: `[]` (Enabled: `True`). {{(pid=80396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 16:49:16.619447 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.fernet_utils [None req-ed2de45c-90a6-405e-a858-1d214b3fceb6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:49:16.661807 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG dbcounter [-] [80396] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 16:49:16.684403 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 1367/2743] 10.222.0.59 () {58 vars in 957 bytes} [Thu Jun 2 16:49:16 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 16:49:16.688782 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f1878ec-ed38-4bcb-af2d-9621f43b9739 admin admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:49:16.733628 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 16:49:16.751380 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f1878ec-ed38-4bcb-af2d-9621f43b9739 admin admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:49:16.756098 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ef1a003-6219-4cf1-9c3c-1a5444037ee2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f73d5a98be74242b45222df39fb6213', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:49:16.756768 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef1a003-6219-4cf1-9c3c-1a5444037ee2 admin admin] REQUEST_METHOD: `POST` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:49:16.757035 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef1a003-6219-4cf1-9c3c-1a5444037ee2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:49:16.757312 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef1a003-6219-4cf1-9c3c-1a5444037ee2 admin admin] PATH_INFO: `/v3/projects` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:49:16.757997 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ef1a003-6219-4cf1-9c3c-1a5444037ee2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:49:16.759952 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ef1a003-6219-4cf1-9c3c-1a5444037ee2 admin admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:49:16.859802 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 1377/2744] 10.222.0.59 () {60 vars in 1152 bytes} [Thu Jun 2 16:49:16 2022] POST /identity/v3/projects => generated 385 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 16:49:16.863722 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed2de45c-90a6-405e-a858-1d214b3fceb6 None None] Authenticating user token {{(pid=80396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:49:16.875724 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed2de45c-90a6-405e-a858-1d214b3fceb6 None None] Validating token access rules against request {{(pid=80396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:49:16.934060 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7c1007b-dd73-413c-9276-1844bad7e816 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f73d5a98be74242b45222df39fb6213', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:49:16.934800 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c1007b-dd73-413c-9276-1844bad7e816 admin admin] REQUEST_METHOD: `POST` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:49:16.935038 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c1007b-dd73-413c-9276-1844bad7e816 admin admin] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:49:16.935315 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c1007b-dd73-413c-9276-1844bad7e816 admin admin] PATH_INFO: `/v3/users` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:49:16.935999 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7c1007b-dd73-413c-9276-1844bad7e816 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:49:16.937940 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7c1007b-dd73-413c-9276-1844bad7e816 admin admin] RBAC: Authorization granted {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:49:17.022451 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 1368/2745] 10.222.0.59 () {60 vars in 1143 bytes} [Thu Jun 2 16:49:16 2022] POST /identity/v3/users => generated 293 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 16:49:17.026439 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ef1a003-6219-4cf1-9c3c-1a5444037ee2 admin admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:49:17.036710 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ef1a003-6219-4cf1-9c3c-1a5444037ee2 admin admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:49:17.041435 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47342a12-cada-4cea-a3b9-99a51812dd31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f73d5a98be74242b45222df39fb6213', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:49:17.042675 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47342a12-cada-4cea-a3b9-99a51812dd31 admin admin] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:49:17.042968 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47342a12-cada-4cea-a3b9-99a51812dd31 admin admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:49:17.043252 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47342a12-cada-4cea-a3b9-99a51812dd31 admin admin] PATH_INFO: `/v3/roles` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:49:17.043969 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47342a12-cada-4cea-a3b9-99a51812dd31 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:49:17.045623 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47342a12-cada-4cea-a3b9-99a51812dd31 admin admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:49:17.056283 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 1378/2746] 10.222.0.59 () {58 vars in 1121 bytes} [Thu Jun 2 16:49:17 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 16:49:17.060756 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7c1007b-dd73-413c-9276-1844bad7e816 admin admin] Authenticating user token {{(pid=80396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:49:17.070930 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7c1007b-dd73-413c-9276-1844bad7e816 admin admin] Validating token access rules against request {{(pid=80396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:49:17.075578 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23435430-455b-4b59-b107-48b09c249bd6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f73d5a98be74242b45222df39fb6213', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:49:17.076224 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23435430-455b-4b59-b107-48b09c249bd6 admin admin] REQUEST_METHOD: `GET` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:49:17.076509 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23435430-455b-4b59-b107-48b09c249bd6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:49:17.076787 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23435430-455b-4b59-b107-48b09c249bd6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:49:17.077508 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23435430-455b-4b59-b107-48b09c249bd6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:49:17.079121 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23435430-455b-4b59-b107-48b09c249bd6 admin admin] RBAC: Authorization granted {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:49:17.088927 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 1369/2747] 10.222.0.59 () {58 vars in 1121 bytes} [Thu Jun 2 16:49:17 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 16:49:17.092852 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47342a12-cada-4cea-a3b9-99a51812dd31 admin admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:49:17.102648 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47342a12-cada-4cea-a3b9-99a51812dd31 admin admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:49:17.107704 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fe617df-2eab-4b77-a5b9-080810f078d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f73d5a98be74242b45222df39fb6213', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:49:17.108564 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe617df-2eab-4b77-a5b9-080810f078d5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:49:17.108842 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe617df-2eab-4b77-a5b9-080810f078d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:49:17.109110 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe617df-2eab-4b77-a5b9-080810f078d5 admin admin] PATH_INFO: `/v3/projects/a3b82423b6434e1988fac1ab04562f5a/users/eff598d335e64841b76ab48486d135d1/roles/649e0f2b5a264c419ea6a1441f123a03` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:49:17.124175 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fe617df-2eab-4b77-a5b9-080810f078d5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a3b82423b6434e1988fac1ab04562f5a, user_id=eff598d335e64841b76ab48486d135d1, role_id=649e0f2b5a264c419ea6a1441f123a03)` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:49:17.126832 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fe617df-2eab-4b77-a5b9-080810f078d5 admin admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:49:17.200392 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 1379/2748] 10.222.0.59 () {60 vars in 1482 bytes} [Thu Jun 2 16:49:17 2022] PUT /identity/v3/projects/a3b82423b6434e1988fac1ab04562f5a/users/eff598d335e64841b76ab48486d135d1/roles/649e0f2b5a264c419ea6a1441f123a03 => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 16:49:17.207052 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a199ee1-9780-4121-a6d2-70dbcf8c05ef None None] REQUEST_METHOD: `POST` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:49:17.207340 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a199ee1-9780-4121-a6d2-70dbcf8c05ef None None] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:49:17.207617 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a199ee1-9780-4121-a6d2-70dbcf8c05ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:49:17.234261 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.auth.core [None req-1a199ee1-9780-4121-a6d2-70dbcf8c05ef None None] MFA Rules not processed for user `eff598d335e64841b76ab48486d135d1`. Rule list: `[]` (Enabled: `True`). {{(pid=80396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 16:49:17.235453 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.fernet_utils [None req-1a199ee1-9780-4121-a6d2-70dbcf8c05ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:49:17.298161 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 1370/2749] 10.222.0.59 () {58 vars in 957 bytes} [Thu Jun 2 16:49:17 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 16:49:17.302592 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fe617df-2eab-4b77-a5b9-080810f078d5 admin admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:49:17.363368 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fe617df-2eab-4b77-a5b9-080810f078d5 admin admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:49:17.367977 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1054d61a-1175-490e-a812-fa61f8138790 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f73d5a98be74242b45222df39fb6213', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:49:17.368625 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1054d61a-1175-490e-a812-fa61f8138790 admin admin] REQUEST_METHOD: `POST` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:49:17.368905 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1054d61a-1175-490e-a812-fa61f8138790 admin admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:49:17.369183 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1054d61a-1175-490e-a812-fa61f8138790 admin admin] PATH_INFO: `/v3/projects` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:49:17.369863 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1054d61a-1175-490e-a812-fa61f8138790 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:49:17.372071 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1054d61a-1175-490e-a812-fa61f8138790 admin admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:49:17.464407 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 1380/2750] 10.222.0.59 () {60 vars in 1152 bytes} [Thu Jun 2 16:49:17 2022] POST /identity/v3/projects => generated 385 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 16:49:17.465153 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a199ee1-9780-4121-a6d2-70dbcf8c05ef None None] Authenticating user token {{(pid=80396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:49:17.469240 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a199ee1-9780-4121-a6d2-70dbcf8c05ef None None] Validating token access rules against request {{(pid=80396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:49:17.517145 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG dbcounter [-] [80396] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 16:49:17.527232 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec748b54-4eae-47f1-9654-13a13c81e1a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f73d5a98be74242b45222df39fb6213', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:49:17.528032 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec748b54-4eae-47f1-9654-13a13c81e1a8 admin admin] REQUEST_METHOD: `POST` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:49:17.528310 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec748b54-4eae-47f1-9654-13a13c81e1a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:49:17.528584 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec748b54-4eae-47f1-9654-13a13c81e1a8 admin admin] PATH_INFO: `/v3/users` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:49:17.529263 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec748b54-4eae-47f1-9654-13a13c81e1a8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:49:17.531291 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec748b54-4eae-47f1-9654-13a13c81e1a8 admin admin] RBAC: Authorization granted {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:49:17.622004 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 1371/2751] 10.222.0.59 () {60 vars in 1143 bytes} [Thu Jun 2 16:49:17 2022] POST /identity/v3/users => generated 299 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 16:49:17.626004 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1054d61a-1175-490e-a812-fa61f8138790 admin admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:49:17.637670 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1054d61a-1175-490e-a812-fa61f8138790 admin admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:49:17.642521 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f1ea811-ac75-4799-8764-8d6908e2dfc2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f73d5a98be74242b45222df39fb6213', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:49:17.643209 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1ea811-ac75-4799-8764-8d6908e2dfc2 admin admin] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:49:17.643519 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1ea811-ac75-4799-8764-8d6908e2dfc2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:49:17.643804 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1ea811-ac75-4799-8764-8d6908e2dfc2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:49:17.644525 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f1ea811-ac75-4799-8764-8d6908e2dfc2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:49:17.646146 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f1ea811-ac75-4799-8764-8d6908e2dfc2 admin admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:49:17.659813 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 1381/2752] 10.222.0.59 () {58 vars in 1121 bytes} [Thu Jun 2 16:49:17 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 16:49:17.663956 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec748b54-4eae-47f1-9654-13a13c81e1a8 admin admin] Authenticating user token {{(pid=80396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:49:17.674451 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec748b54-4eae-47f1-9654-13a13c81e1a8 admin admin] Validating token access rules against request {{(pid=80396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:49:17.679104 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5eb0492-63db-4768-9d5b-9b83c38494a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f73d5a98be74242b45222df39fb6213', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:49:17.679973 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5eb0492-63db-4768-9d5b-9b83c38494a4 admin admin] REQUEST_METHOD: `PUT` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:49:17.680261 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5eb0492-63db-4768-9d5b-9b83c38494a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:49:17.680546 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5eb0492-63db-4768-9d5b-9b83c38494a4 admin admin] PATH_INFO: `/v3/projects/ea27e23cf6c14dcbbd9337b2a7aabfcf/users/964f183214f6467eb3f37a0213151e6c/roles/f1e0c25f6e9049e897cb7350c7e54ab3` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:49:17.696691 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5eb0492-63db-4768-9d5b-9b83c38494a4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ea27e23cf6c14dcbbd9337b2a7aabfcf, user_id=964f183214f6467eb3f37a0213151e6c, role_id=f1e0c25f6e9049e897cb7350c7e54ab3)` {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:49:17.700329 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5eb0492-63db-4768-9d5b-9b83c38494a4 admin admin] RBAC: Authorization granted {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:49:17.776935 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 1372/2753] 10.222.0.59 () {60 vars in 1482 bytes} [Thu Jun 2 16:49:17 2022] PUT /identity/v3/projects/ea27e23cf6c14dcbbd9337b2a7aabfcf/users/964f183214f6467eb3f37a0213151e6c/roles/f1e0c25f6e9049e897cb7350c7e54ab3 => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 16:49:17.781268 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f1ea811-ac75-4799-8764-8d6908e2dfc2 admin admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:49:17.791360 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f1ea811-ac75-4799-8764-8d6908e2dfc2 admin admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:49:17.847320 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcb315d7-4568-4adb-bd08-022cb509c9e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f73d5a98be74242b45222df39fb6213', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:49:17.847980 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb315d7-4568-4adb-bd08-022cb509c9e8 admin admin] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:49:17.848264 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb315d7-4568-4adb-bd08-022cb509c9e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:49:17.848537 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb315d7-4568-4adb-bd08-022cb509c9e8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:49:17.849251 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcb315d7-4568-4adb-bd08-022cb509c9e8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:49:17.850867 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcb315d7-4568-4adb-bd08-022cb509c9e8 admin admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:49:17.860287 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 1382/2754] 10.222.0.59 () {58 vars in 1121 bytes} [Thu Jun 2 16:49:17 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 16:49:17.864346 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5eb0492-63db-4768-9d5b-9b83c38494a4 admin admin] Authenticating user token {{(pid=80396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:49:17.875381 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5eb0492-63db-4768-9d5b-9b83c38494a4 admin admin] Validating token access rules against request {{(pid=80396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:49:17.879966 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e511590-3ddd-451e-8b28-2205c6151d64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f73d5a98be74242b45222df39fb6213', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:49:17.880838 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e511590-3ddd-451e-8b28-2205c6151d64 admin admin] REQUEST_METHOD: `PUT` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:49:17.881118 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e511590-3ddd-451e-8b28-2205c6151d64 admin admin] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:49:17.881393 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e511590-3ddd-451e-8b28-2205c6151d64 admin admin] PATH_INFO: `/v3/projects/ea27e23cf6c14dcbbd9337b2a7aabfcf/users/964f183214f6467eb3f37a0213151e6c/roles/f1e0c25f6e9049e897cb7350c7e54ab3` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:49:17.883346 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e511590-3ddd-451e-8b28-2205c6151d64 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ea27e23cf6c14dcbbd9337b2a7aabfcf, user_id=964f183214f6467eb3f37a0213151e6c, role_id=f1e0c25f6e9049e897cb7350c7e54ab3)` {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:49:17.886672 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e511590-3ddd-451e-8b28-2205c6151d64 admin admin] RBAC: Authorization granted {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:49:17.897210 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 1373/2755] 10.222.0.59 () {60 vars in 1482 bytes} [Thu Jun 2 16:49:17 2022] PUT /identity/v3/projects/ea27e23cf6c14dcbbd9337b2a7aabfcf/users/964f183214f6467eb3f37a0213151e6c/roles/f1e0c25f6e9049e897cb7350c7e54ab3 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 16:49:17.908019 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18fce465-a667-40d0-bcd4-c6944ded58a8 None None] REQUEST_METHOD: `POST` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:49:17.908503 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18fce465-a667-40d0-bcd4-c6944ded58a8 None None] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:49:17.908624 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18fce465-a667-40d0-bcd4-c6944ded58a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:49:17.914341 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 16:49:17.935335 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.auth.core [None req-18fce465-a667-40d0-bcd4-c6944ded58a8 None None] MFA Rules not processed for user `964f183214f6467eb3f37a0213151e6c`. Rule list: `[]` (Enabled: `True`). {{(pid=80395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 16:49:17.936534 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.fernet_utils [None req-18fce465-a667-40d0-bcd4-c6944ded58a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:49:18.006893 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 1383/2756] 10.222.0.59 () {58 vars in 957 bytes} [Thu Jun 2 16:49:17 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 16:49:18.018456 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e511590-3ddd-451e-8b28-2205c6151d64 admin admin] Authenticating user token {{(pid=80396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:49:18.020093 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.fernet_utils [None req-6e511590-3ddd-451e-8b28-2205c6151d64 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:49:18.077919 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e511590-3ddd-451e-8b28-2205c6151d64 admin admin] Validating token access rules against request {{(pid=80396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:49:18.081473 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07a4ea28-e401-483c-aaba-cba96eb93de5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6534961c369940a5b88f310c6450250b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c87c981909d4b8db02783421818c79b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:49:18.082130 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a4ea28-e401-483c-aaba-cba96eb93de5 service cinder] REQUEST_METHOD: `GET` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:49:18.082411 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a4ea28-e401-483c-aaba-cba96eb93de5 service cinder] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:49:18.082681 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a4ea28-e401-483c-aaba-cba96eb93de5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:49:18.091743 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07a4ea28-e401-483c-aaba-cba96eb93de5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:49:18.093184 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07a4ea28-e401-483c-aaba-cba96eb93de5 service cinder] RBAC: Authorization granted {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:49:18.102459 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 1374/2757] 10.222.0.59 () {60 vars in 1365 bytes} [Thu Jun 2 16:49:18 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 16:49:19.087539 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18fce465-a667-40d0-bcd4-c6944ded58a8 None None] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:49:19.087539 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.fernet_utils [None req-18fce465-a667-40d0-bcd4-c6944ded58a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:49:19.097222 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18fce465-a667-40d0-bcd4-c6944ded58a8 None None] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:49:19.100780 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14477607-4997-484d-be81-b3c8ea9407c8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6534961c369940a5b88f310c6450250b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c87c981909d4b8db02783421818c79b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:49:19.101415 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14477607-4997-484d-be81-b3c8ea9407c8 service cinder] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:49:19.101699 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14477607-4997-484d-be81-b3c8ea9407c8 service cinder] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:49:19.101977 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14477607-4997-484d-be81-b3c8ea9407c8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:49:19.159798 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14477607-4997-484d-be81-b3c8ea9407c8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:49:19.161234 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14477607-4997-484d-be81-b3c8ea9407c8 service cinder] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:49:19.171015 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 1384/2758] 10.222.0.59 () {60 vars in 1365 bytes} [Thu Jun 2 16:49:19 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 16:49:25.052608 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07a4ea28-e401-483c-aaba-cba96eb93de5 service cinder] Authenticating user token {{(pid=80396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:49:25.062134 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07a4ea28-e401-483c-aaba-cba96eb93de5 service cinder] Validating token access rules against request {{(pid=80396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:49:25.065786 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-919c9b4a-e660-4f7a-a6e8-b976e47f909d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6534961c369940a5b88f310c6450250b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c87c981909d4b8db02783421818c79b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:49:25.066471 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-919c9b4a-e660-4f7a-a6e8-b976e47f909d service cinder] REQUEST_METHOD: `GET` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:49:25.066784 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-919c9b4a-e660-4f7a-a6e8-b976e47f909d service cinder] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:49:25.067098 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-919c9b4a-e660-4f7a-a6e8-b976e47f909d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:49:25.129659 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-919c9b4a-e660-4f7a-a6e8-b976e47f909d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:49:25.131163 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-919c9b4a-e660-4f7a-a6e8-b976e47f909d service cinder] RBAC: Authorization granted {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:49:25.140876 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 1375/2759] 10.222.0.59 () {60 vars in 1365 bytes} [Thu Jun 2 16:49:25 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 16:49:29.114742 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14477607-4997-484d-be81-b3c8ea9407c8 service cinder] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:49:29.177734 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14477607-4997-484d-be81-b3c8ea9407c8 service cinder] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:49:29.182318 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe507c00-4d2b-4903-8efc-56e5e4000014 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f73d5a98be74242b45222df39fb6213', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:49:29.183861 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe507c00-4d2b-4903-8efc-56e5e4000014 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:49:29.184146 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe507c00-4d2b-4903-8efc-56e5e4000014 admin admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:49:29.184422 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe507c00-4d2b-4903-8efc-56e5e4000014 admin admin] PATH_INFO: `/v3/users/d1a32894e9864921850bd5ab7e3054b1` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:49:29.185662 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe507c00-4d2b-4903-8efc-56e5e4000014 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d1a32894e9864921850bd5ab7e3054b1)` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:49:29.187624 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe507c00-4d2b-4903-8efc-56e5e4000014 admin admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:49:29.265026 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 16:49:29.380740 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.notifications [None req-fe507c00-4d2b-4903-8efc-56e5e4000014 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd1a32894e9864921850bd5ab7e3054b1'} {{(pid=80395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:49:29.464286 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.notifications [None req-fe507c00-4d2b-4903-8efc-56e5e4000014 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd1a32894e9864921850bd5ab7e3054b1'} {{(pid=80395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:49:29.477362 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.notifications [None req-fe507c00-4d2b-4903-8efc-56e5e4000014 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd1a32894e9864921850bd5ab7e3054b1'} {{(pid=80395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:49:29.478010 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.notifications [None req-fe507c00-4d2b-4903-8efc-56e5e4000014 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd1a32894e9864921850bd5ab7e3054b1'} {{(pid=80395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:49:29.485984 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.notifications [None req-fe507c00-4d2b-4903-8efc-56e5e4000014 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd1a32894e9864921850bd5ab7e3054b1'} {{(pid=80395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:49:29.491950 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 1385/2760] 10.222.0.59 () {58 vars in 1223 bytes} [Thu Jun 2 16:49:29 2022] DELETE /identity/v3/users/d1a32894e9864921850bd5ab7e3054b1 => generated 0 bytes in 378 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 16:49:29.497082 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f3c38b7-90f7-4cdf-83d0-d8828266cb49 None None] REQUEST_METHOD: `POST` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:49:29.497559 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f3c38b7-90f7-4cdf-83d0-d8828266cb49 None None] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:49:29.497655 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f3c38b7-90f7-4cdf-83d0-d8828266cb49 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:49:29.515033 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.auth.core [None req-7f3c38b7-90f7-4cdf-83d0-d8828266cb49 None None] MFA Rules not processed for user `400d1f4db9de49638549e5db29a041e1`. Rule list: `[]` (Enabled: `True`). {{(pid=80396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 16:49:29.516215 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.fernet_utils [None req-7f3c38b7-90f7-4cdf-83d0-d8828266cb49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:49:29.555083 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG dbcounter [-] [80396] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 16:49:29.572962 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 1376/2761] 10.222.0.59 () {58 vars in 957 bytes} [Thu Jun 2 16:49:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 16:49:29.582761 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe507c00-4d2b-4903-8efc-56e5e4000014 admin admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:49:29.584164 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.fernet_utils [None req-fe507c00-4d2b-4903-8efc-56e5e4000014 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:49:29.642382 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe507c00-4d2b-4903-8efc-56e5e4000014 admin admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:49:29.645805 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6523b596-e89c-4af2-8784-92507cc82680 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9af40ddfe9ff4be3887b068f13a28dc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c87c981909d4b8db02783421818c79b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:49:29.646481 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6523b596-e89c-4af2-8784-92507cc82680 service neutron] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:49:29.646764 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6523b596-e89c-4af2-8784-92507cc82680 service neutron] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:49:29.647035 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6523b596-e89c-4af2-8784-92507cc82680 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:49:29.656593 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6523b596-e89c-4af2-8784-92507cc82680 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:49:29.658017 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6523b596-e89c-4af2-8784-92507cc82680 service neutron] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:49:29.667363 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 1386/2762] 10.222.0.59 () {60 vars in 1365 bytes} [Thu Jun 2 16:49:29 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 16:49:30.083378 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f3c38b7-90f7-4cdf-83d0-d8828266cb49 None None] Authenticating user token {{(pid=80396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:49:30.084796 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.fernet_utils [None req-7f3c38b7-90f7-4cdf-83d0-d8828266cb49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:49:30.096921 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f3c38b7-90f7-4cdf-83d0-d8828266cb49 None None] Validating token access rules against request {{(pid=80396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:49:30.101523 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6cf5d9b-3e56-40ea-8aef-dd683786007f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f73d5a98be74242b45222df39fb6213', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:49:30.102424 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6cf5d9b-3e56-40ea-8aef-dd683786007f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:49:30.102690 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6cf5d9b-3e56-40ea-8aef-dd683786007f admin admin] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:49:30.102964 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6cf5d9b-3e56-40ea-8aef-dd683786007f admin admin] PATH_INFO: `/v3/projects/e26024222ac44d2789f44bb7106ef412` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:49:30.104144 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6cf5d9b-3e56-40ea-8aef-dd683786007f admin admin] RBAC: Authorizing `identity:delete_project(project_id=e26024222ac44d2789f44bb7106ef412)` {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:49:30.106241 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6cf5d9b-3e56-40ea-8aef-dd683786007f admin admin] RBAC: Authorization granted {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:49:30.191789 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.notifications [None req-f6cf5d9b-3e56-40ea-8aef-dd683786007f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e26024222ac44d2789f44bb7106ef412', 'request_id': 'req-f6cf5d9b-3e56-40ea-8aef-dd683786007f'} {{(pid=80396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:49:30.199133 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.notifications [None req-f6cf5d9b-3e56-40ea-8aef-dd683786007f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e26024222ac44d2789f44bb7106ef412', 'request_id': 'req-f6cf5d9b-3e56-40ea-8aef-dd683786007f'} {{(pid=80396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:49:30.279144 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.notifications [None req-f6cf5d9b-3e56-40ea-8aef-dd683786007f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e26024222ac44d2789f44bb7106ef412', 'request_id': 'req-f6cf5d9b-3e56-40ea-8aef-dd683786007f'} {{(pid=80396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:49:30.290132 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.notifications [None req-f6cf5d9b-3e56-40ea-8aef-dd683786007f admin admin] The token cache is being invalidate because project e26024222ac44d2789f44bb7106ef412 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80396) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 02 16:49:30.290450 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.notifications [None req-f6cf5d9b-3e56-40ea-8aef-dd683786007f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:49:30.291067 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.notifications [None req-f6cf5d9b-3e56-40ea-8aef-dd683786007f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:49:30.292768 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 1377/2763] 10.222.0.59 () {58 vars in 1232 bytes} [Thu Jun 2 16:49:30 2022] DELETE /identity/v3/projects/e26024222ac44d2789f44bb7106ef412 => generated 0 bytes in 210 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 16:49:30.297582 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6523b596-e89c-4af2-8784-92507cc82680 service neutron] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:49:30.308704 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6523b596-e89c-4af2-8784-92507cc82680 service neutron] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:49:30.369833 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b6d8580-435b-49d0-967d-2544556bb582 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f73d5a98be74242b45222df39fb6213', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:49:30.371582 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6d8580-435b-49d0-967d-2544556bb582 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:49:30.371864 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6d8580-435b-49d0-967d-2544556bb582 admin admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:49:30.372140 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6d8580-435b-49d0-967d-2544556bb582 admin admin] PATH_INFO: `/v3/users/eff598d335e64841b76ab48486d135d1` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:49:30.373325 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b6d8580-435b-49d0-967d-2544556bb582 admin admin] RBAC: Authorizing `identity:delete_user(user_id=eff598d335e64841b76ab48486d135d1)` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:49:30.375290 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b6d8580-435b-49d0-967d-2544556bb582 admin admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:49:30.578740 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.notifications [None req-6b6d8580-435b-49d0-967d-2544556bb582 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'eff598d335e64841b76ab48486d135d1'} {{(pid=80395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:49:30.581271 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 16:49:30.684980 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.notifications [None req-6b6d8580-435b-49d0-967d-2544556bb582 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'eff598d335e64841b76ab48486d135d1'} {{(pid=80395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:49:30.697911 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.notifications [None req-6b6d8580-435b-49d0-967d-2544556bb582 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'eff598d335e64841b76ab48486d135d1'} {{(pid=80395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:49:30.698759 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.notifications [None req-6b6d8580-435b-49d0-967d-2544556bb582 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'eff598d335e64841b76ab48486d135d1'} {{(pid=80395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:49:30.705237 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.notifications [None req-6b6d8580-435b-49d0-967d-2544556bb582 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'eff598d335e64841b76ab48486d135d1'} {{(pid=80395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:49:30.711073 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 1387/2764] 10.222.0.59 () {58 vars in 1223 bytes} [Thu Jun 2 16:49:30 2022] DELETE /identity/v3/users/eff598d335e64841b76ab48486d135d1 => generated 0 bytes in 415 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 16:49:31.106063 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6cf5d9b-3e56-40ea-8aef-dd683786007f admin admin] Authenticating user token {{(pid=80396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:49:31.107946 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.fernet_utils [None req-f6cf5d9b-3e56-40ea-8aef-dd683786007f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:49:31.121933 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6cf5d9b-3e56-40ea-8aef-dd683786007f admin admin] Validating token access rules against request {{(pid=80396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:49:31.183756 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3af994c-607d-490d-b7eb-9618e20ab68c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f73d5a98be74242b45222df39fb6213', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:49:31.184629 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3af994c-607d-490d-b7eb-9618e20ab68c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:49:31.184917 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3af994c-607d-490d-b7eb-9618e20ab68c admin admin] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:49:31.185197 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3af994c-607d-490d-b7eb-9618e20ab68c admin admin] PATH_INFO: `/v3/projects/a3b82423b6434e1988fac1ab04562f5a` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:49:31.186501 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3af994c-607d-490d-b7eb-9618e20ab68c admin admin] RBAC: Authorizing `identity:delete_project(project_id=a3b82423b6434e1988fac1ab04562f5a)` {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:49:31.188455 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3af994c-607d-490d-b7eb-9618e20ab68c admin admin] RBAC: Authorization granted {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:49:31.300235 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.notifications [None req-a3af994c-607d-490d-b7eb-9618e20ab68c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a3b82423b6434e1988fac1ab04562f5a', 'request_id': 'req-a3af994c-607d-490d-b7eb-9618e20ab68c'} {{(pid=80396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:49:31.306375 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.notifications [None req-a3af994c-607d-490d-b7eb-9618e20ab68c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a3b82423b6434e1988fac1ab04562f5a', 'request_id': 'req-a3af994c-607d-490d-b7eb-9618e20ab68c'} {{(pid=80396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:49:31.389562 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.notifications [None req-a3af994c-607d-490d-b7eb-9618e20ab68c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a3b82423b6434e1988fac1ab04562f5a', 'request_id': 'req-a3af994c-607d-490d-b7eb-9618e20ab68c'} {{(pid=80396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:49:31.396451 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG dbcounter [-] [80396] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 16:49:31.401244 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.notifications [None req-a3af994c-607d-490d-b7eb-9618e20ab68c admin admin] The token cache is being invalidate because project a3b82423b6434e1988fac1ab04562f5a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80396) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 02 16:49:31.401660 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.notifications [None req-a3af994c-607d-490d-b7eb-9618e20ab68c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:49:31.402312 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.notifications [None req-a3af994c-607d-490d-b7eb-9618e20ab68c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:49:31.403872 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 1378/2765] 10.222.0.59 () {58 vars in 1232 bytes} [Thu Jun 2 16:49:31 2022] DELETE /identity/v3/projects/a3b82423b6434e1988fac1ab04562f5a => generated 0 bytes in 298 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 16:49:31.407821 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b6d8580-435b-49d0-967d-2544556bb582 admin admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:49:31.409247 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.fernet_utils [None req-6b6d8580-435b-49d0-967d-2544556bb582 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:49:31.422893 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b6d8580-435b-49d0-967d-2544556bb582 admin admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:49:31.480492 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98de9206-ac2b-49b8-a1cd-1d74caf866c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f73d5a98be74242b45222df39fb6213', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:49:31.481367 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98de9206-ac2b-49b8-a1cd-1d74caf866c4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:49:31.481651 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98de9206-ac2b-49b8-a1cd-1d74caf866c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:49:31.481928 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98de9206-ac2b-49b8-a1cd-1d74caf866c4 admin admin] PATH_INFO: `/v3/users/964f183214f6467eb3f37a0213151e6c` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:49:31.483199 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98de9206-ac2b-49b8-a1cd-1d74caf866c4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=964f183214f6467eb3f37a0213151e6c)` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:49:31.485150 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98de9206-ac2b-49b8-a1cd-1d74caf866c4 admin admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:49:31.694128 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.notifications [None req-98de9206-ac2b-49b8-a1cd-1d74caf866c4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '964f183214f6467eb3f37a0213151e6c'} {{(pid=80395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:49:31.766675 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.notifications [None req-98de9206-ac2b-49b8-a1cd-1d74caf866c4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '964f183214f6467eb3f37a0213151e6c'} {{(pid=80395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:49:31.779643 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.notifications [None req-98de9206-ac2b-49b8-a1cd-1d74caf866c4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '964f183214f6467eb3f37a0213151e6c'} {{(pid=80395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:49:31.780296 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.notifications [None req-98de9206-ac2b-49b8-a1cd-1d74caf866c4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '964f183214f6467eb3f37a0213151e6c'} {{(pid=80395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:49:31.787081 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.notifications [None req-98de9206-ac2b-49b8-a1cd-1d74caf866c4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '964f183214f6467eb3f37a0213151e6c'} {{(pid=80395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:49:31.793549 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 1388/2766] 10.222.0.59 () {58 vars in 1223 bytes} [Thu Jun 2 16:49:31 2022] DELETE /identity/v3/users/964f183214f6467eb3f37a0213151e6c => generated 0 bytes in 386 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 16:49:32.196762 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3af994c-607d-490d-b7eb-9618e20ab68c admin admin] Authenticating user token {{(pid=80396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:49:32.198930 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.fernet_utils [None req-a3af994c-607d-490d-b7eb-9618e20ab68c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:49:32.212265 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3af994c-607d-490d-b7eb-9618e20ab68c admin admin] Validating token access rules against request {{(pid=80396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:49:32.269423 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-111e94a5-7dd4-4652-990b-1a4022a16bae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f73d5a98be74242b45222df39fb6213', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:49:32.270305 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-111e94a5-7dd4-4652-990b-1a4022a16bae admin admin] REQUEST_METHOD: `DELETE` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:49:32.270591 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-111e94a5-7dd4-4652-990b-1a4022a16bae admin admin] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:49:32.270868 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-111e94a5-7dd4-4652-990b-1a4022a16bae admin admin] PATH_INFO: `/v3/projects/ea27e23cf6c14dcbbd9337b2a7aabfcf` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:49:32.272036 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-111e94a5-7dd4-4652-990b-1a4022a16bae admin admin] RBAC: Authorizing `identity:delete_project(project_id=ea27e23cf6c14dcbbd9337b2a7aabfcf)` {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:49:32.273960 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-111e94a5-7dd4-4652-990b-1a4022a16bae admin admin] RBAC: Authorization granted {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:49:32.418952 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.notifications [None req-111e94a5-7dd4-4652-990b-1a4022a16bae admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ea27e23cf6c14dcbbd9337b2a7aabfcf', 'request_id': 'req-111e94a5-7dd4-4652-990b-1a4022a16bae'} {{(pid=80396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:49:32.425374 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.notifications [None req-111e94a5-7dd4-4652-990b-1a4022a16bae admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ea27e23cf6c14dcbbd9337b2a7aabfcf', 'request_id': 'req-111e94a5-7dd4-4652-990b-1a4022a16bae'} {{(pid=80396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:49:32.502011 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.notifications [None req-111e94a5-7dd4-4652-990b-1a4022a16bae admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ea27e23cf6c14dcbbd9337b2a7aabfcf', 'request_id': 'req-111e94a5-7dd4-4652-990b-1a4022a16bae'} {{(pid=80396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:49:32.512946 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.notifications [None req-111e94a5-7dd4-4652-990b-1a4022a16bae admin admin] The token cache is being invalidate because project ea27e23cf6c14dcbbd9337b2a7aabfcf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80396) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 02 16:49:32.513237 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.notifications [None req-111e94a5-7dd4-4652-990b-1a4022a16bae admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:49:32.513932 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.notifications [None req-111e94a5-7dd4-4652-990b-1a4022a16bae admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:49:32.515574 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 1379/2767] 10.222.0.59 () {58 vars in 1232 bytes} [Thu Jun 2 16:49:32 2022] DELETE /identity/v3/projects/ea27e23cf6c14dcbbd9337b2a7aabfcf => generated 0 bytes in 319 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 16:49:32.521678 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ccc712-dcc8-428b-8a6b-d89cbc64987e None None] REQUEST_METHOD: `POST` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:49:32.522174 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ccc712-dcc8-428b-8a6b-d89cbc64987e None None] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:49:32.522272 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ccc712-dcc8-428b-8a6b-d89cbc64987e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:49:32.544384 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.auth.core [None req-75ccc712-dcc8-428b-8a6b-d89cbc64987e None None] MFA Rules not processed for user `400d1f4db9de49638549e5db29a041e1`. Rule list: `[]` (Enabled: `True`). {{(pid=80395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 16:49:32.545599 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.fernet_utils [None req-75ccc712-dcc8-428b-8a6b-d89cbc64987e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:49:32.588156 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writing DB stats keystone:DELETE=13,keystone:SELECT=86,keystone:INSERT=1 {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 16:49:32.606883 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 1389/2768] 10.222.0.59 () {58 vars in 957 bytes} [Thu Jun 2 16:49:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 16:49:32.616643 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65411faa-cc0b-463f-8305-e322f0ffbc52 None None] REQUEST_METHOD: `POST` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:49:32.621466 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65411faa-cc0b-463f-8305-e322f0ffbc52 None None] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:49:32.621466 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65411faa-cc0b-463f-8305-e322f0ffbc52 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:49:32.643442 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.auth.core [None req-65411faa-cc0b-463f-8305-e322f0ffbc52 None None] MFA Rules not processed for user `400d1f4db9de49638549e5db29a041e1`. Rule list: `[]` (Enabled: `True`). {{(pid=80396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 16:49:32.644676 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.fernet_utils [None req-65411faa-cc0b-463f-8305-e322f0ffbc52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:49:32.653459 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 1380/2769] 10.222.0.59 () {58 vars in 957 bytes} [Thu Jun 2 16:49:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 16:49:32.657703 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ccc712-dcc8-428b-8a6b-d89cbc64987e None None] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:49:32.667438 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ccc712-dcc8-428b-8a6b-d89cbc64987e None None] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:49:32.672084 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07d90d11-bfe6-4bbc-abf2-e898d0f818eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f73d5a98be74242b45222df39fb6213', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:49:32.672727 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d90d11-bfe6-4bbc-abf2-e898d0f818eb admin admin] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:49:32.673068 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d90d11-bfe6-4bbc-abf2-e898d0f818eb admin admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:49:32.673385 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d90d11-bfe6-4bbc-abf2-e898d0f818eb admin admin] PATH_INFO: `/v3/domains` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:49:32.674146 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07d90d11-bfe6-4bbc-abf2-e898d0f818eb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80395) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 16:49:32.674456 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07d90d11-bfe6-4bbc-abf2-e898d0f818eb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:49:32.676034 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07d90d11-bfe6-4bbc-abf2-e898d0f818eb admin admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:49:32.687513 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 1390/2770] 10.222.0.59 () {58 vars in 1152 bytes} [Thu Jun 2 16:49:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 16:49:32.691997 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65411faa-cc0b-463f-8305-e322f0ffbc52 None None] Authenticating user token {{(pid=80396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:49:32.701608 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65411faa-cc0b-463f-8305-e322f0ffbc52 None None] Validating token access rules against request {{(pid=80396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:49:32.706619 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fa936f0-42fe-456f-89c6-9982a6f2fda4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f73d5a98be74242b45222df39fb6213', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:49:32.707303 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa936f0-42fe-456f-89c6-9982a6f2fda4 admin admin] REQUEST_METHOD: `POST` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:49:32.707589 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa936f0-42fe-456f-89c6-9982a6f2fda4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:49:32.707868 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa936f0-42fe-456f-89c6-9982a6f2fda4 admin admin] PATH_INFO: `/v3/projects` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:49:32.708575 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fa936f0-42fe-456f-89c6-9982a6f2fda4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:49:32.710552 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fa936f0-42fe-456f-89c6-9982a6f2fda4 admin admin] RBAC: Authorization granted {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:49:32.791037 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 1381/2771] 10.222.0.59 () {60 vars in 1152 bytes} [Thu Jun 2 16:49:32 2022] POST /identity/v3/projects => generated 407 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 16:49:32.795460 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07d90d11-bfe6-4bbc-abf2-e898d0f818eb admin admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:49:32.805529 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07d90d11-bfe6-4bbc-abf2-e898d0f818eb admin admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:49:32.862223 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b9a13db-f79d-444c-9421-8ef50be3681d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f73d5a98be74242b45222df39fb6213', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:49:32.862886 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b9a13db-f79d-444c-9421-8ef50be3681d admin admin] REQUEST_METHOD: `POST` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:49:32.863173 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b9a13db-f79d-444c-9421-8ef50be3681d admin admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:49:32.863451 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b9a13db-f79d-444c-9421-8ef50be3681d admin admin] PATH_INFO: `/v3/users` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:49:32.864136 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b9a13db-f79d-444c-9421-8ef50be3681d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:49:32.866057 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b9a13db-f79d-444c-9421-8ef50be3681d admin admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:49:32.986016 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 1391/2772] 10.222.0.59 () {60 vars in 1143 bytes} [Thu Jun 2 16:49:32 2022] POST /identity/v3/users => generated 304 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 16:49:32.990272 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fa936f0-42fe-456f-89c6-9982a6f2fda4 admin admin] Authenticating user token {{(pid=80396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:49:33.001807 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fa936f0-42fe-456f-89c6-9982a6f2fda4 admin admin] Validating token access rules against request {{(pid=80396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:49:33.006423 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84513a48-f143-4980-bc6d-b5b4d5de57c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f73d5a98be74242b45222df39fb6213', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:49:33.007078 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84513a48-f143-4980-bc6d-b5b4d5de57c5 admin admin] REQUEST_METHOD: `GET` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:49:33.007361 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84513a48-f143-4980-bc6d-b5b4d5de57c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:49:33.007638 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84513a48-f143-4980-bc6d-b5b4d5de57c5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:49:33.008379 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84513a48-f143-4980-bc6d-b5b4d5de57c5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:49:33.010015 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84513a48-f143-4980-bc6d-b5b4d5de57c5 admin admin] RBAC: Authorization granted {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:49:33.022910 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 1382/2773] 10.222.0.59 () {58 vars in 1121 bytes} [Thu Jun 2 16:49:32 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 02 16:49:33.027097 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b9a13db-f79d-444c-9421-8ef50be3681d admin admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:49:33.036925 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b9a13db-f79d-444c-9421-8ef50be3681d admin admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:49:33.041482 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58df1e57-4bd3-4979-aa1f-c194561167de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f73d5a98be74242b45222df39fb6213', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:49:33.042451 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58df1e57-4bd3-4979-aa1f-c194561167de admin admin] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:49:33.042566 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58df1e57-4bd3-4979-aa1f-c194561167de admin admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:49:33.042837 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58df1e57-4bd3-4979-aa1f-c194561167de admin admin] PATH_INFO: `/v3/roles` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:49:33.043628 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58df1e57-4bd3-4979-aa1f-c194561167de admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:49:33.045201 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58df1e57-4bd3-4979-aa1f-c194561167de admin admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:49:33.055006 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 1392/2774] 10.222.0.59 () {58 vars in 1121 bytes} [Thu Jun 2 16:49:33 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 02 16:49:33.059551 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84513a48-f143-4980-bc6d-b5b4d5de57c5 admin admin] Authenticating user token {{(pid=80396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:49:33.069489 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84513a48-f143-4980-bc6d-b5b4d5de57c5 admin admin] Validating token access rules against request {{(pid=80396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:49:33.074885 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c191e239-47b9-4789-bcd6-a77807d4b4ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f73d5a98be74242b45222df39fb6213', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:49:33.075840 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c191e239-47b9-4789-bcd6-a77807d4b4ef admin admin] REQUEST_METHOD: `PUT` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:49:33.076127 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c191e239-47b9-4789-bcd6-a77807d4b4ef admin admin] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:49:33.076411 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c191e239-47b9-4789-bcd6-a77807d4b4ef admin admin] PATH_INFO: `/v3/projects/8b71eee589a64d3bac8376b065800782/users/e9e261da50ae49d2996ec79e5b760c07/roles/649e0f2b5a264c419ea6a1441f123a03` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:49:33.091379 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c191e239-47b9-4789-bcd6-a77807d4b4ef admin admin] RBAC: Authorizing `identity:create_grant(project_id=8b71eee589a64d3bac8376b065800782, user_id=e9e261da50ae49d2996ec79e5b760c07, role_id=649e0f2b5a264c419ea6a1441f123a03)` {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:49:33.094009 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c191e239-47b9-4789-bcd6-a77807d4b4ef admin admin] RBAC: Authorization granted {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:49:33.164894 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 1383/2775] 10.222.0.59 () {60 vars in 1482 bytes} [Thu Jun 2 16:49:33 2022] PUT /identity/v3/projects/8b71eee589a64d3bac8376b065800782/users/e9e261da50ae49d2996ec79e5b760c07/roles/649e0f2b5a264c419ea6a1441f123a03 => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 16:49:33.177171 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b34b275-8bf0-4e7f-a6db-5da90d7f94a6 None None] REQUEST_METHOD: `POST` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:49:33.177482 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b34b275-8bf0-4e7f-a6db-5da90d7f94a6 None None] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:49:33.182990 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b34b275-8bf0-4e7f-a6db-5da90d7f94a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:49:33.205836 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.auth.core [None req-1b34b275-8bf0-4e7f-a6db-5da90d7f94a6 None None] MFA Rules not processed for user `e9e261da50ae49d2996ec79e5b760c07`. Rule list: `[]` (Enabled: `True`). {{(pid=80395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 16:49:33.207217 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.fernet_utils [None req-1b34b275-8bf0-4e7f-a6db-5da90d7f94a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:49:33.272215 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 1393/2776] 10.222.0.59 () {58 vars in 957 bytes} [Thu Jun 2 16:49:33 2022] POST /identity/v3/auth/tokens => generated 3274 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 16:49:33.276785 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c191e239-47b9-4789-bcd6-a77807d4b4ef admin admin] Authenticating user token {{(pid=80396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:49:33.308677 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG dbcounter [-] [80396] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 16:49:33.339167 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c191e239-47b9-4789-bcd6-a77807d4b4ef admin admin] Validating token access rules against request {{(pid=80396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:49:33.344057 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f80df19f-512a-4755-8b57-a456a4164260 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f73d5a98be74242b45222df39fb6213', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:49:33.344699 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f80df19f-512a-4755-8b57-a456a4164260 admin admin] REQUEST_METHOD: `POST` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:49:33.344978 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f80df19f-512a-4755-8b57-a456a4164260 admin admin] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:49:33.345246 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f80df19f-512a-4755-8b57-a456a4164260 admin admin] PATH_INFO: `/v3/projects` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:49:33.345951 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f80df19f-512a-4755-8b57-a456a4164260 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:49:33.347918 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f80df19f-512a-4755-8b57-a456a4164260 admin admin] RBAC: Authorization granted {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:49:33.476748 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 1384/2777] 10.222.0.59 () {60 vars in 1152 bytes} [Thu Jun 2 16:49:33 2022] POST /identity/v3/projects => generated 407 bytes in 200 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 02 16:49:33.481731 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b34b275-8bf0-4e7f-a6db-5da90d7f94a6 None None] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:49:33.492751 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b34b275-8bf0-4e7f-a6db-5da90d7f94a6 None None] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:49:33.532490 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 16:49:33.548511 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-107a1864-6ebe-42c5-9048-07327b3592c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f73d5a98be74242b45222df39fb6213', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:49:33.549165 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-107a1864-6ebe-42c5-9048-07327b3592c7 admin admin] REQUEST_METHOD: `POST` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:49:33.550042 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-107a1864-6ebe-42c5-9048-07327b3592c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:49:33.550042 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-107a1864-6ebe-42c5-9048-07327b3592c7 admin admin] PATH_INFO: `/v3/users` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:49:33.550558 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-107a1864-6ebe-42c5-9048-07327b3592c7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:49:33.552492 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-107a1864-6ebe-42c5-9048-07327b3592c7 admin admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:49:33.655762 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 1394/2778] 10.222.0.59 () {60 vars in 1143 bytes} [Thu Jun 2 16:49:33 2022] POST /identity/v3/users => generated 310 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 16:49:33.662361 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f80df19f-512a-4755-8b57-a456a4164260 admin admin] Authenticating user token {{(pid=80396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:49:33.668632 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f80df19f-512a-4755-8b57-a456a4164260 admin admin] Validating token access rules against request {{(pid=80396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:49:33.670496 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-107a1864-6ebe-42c5-9048-07327b3592c7 admin admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:49:33.672148 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.fernet_utils [None req-107a1864-6ebe-42c5-9048-07327b3592c7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:49:33.673976 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9be7bb37-57a8-4a3e-89cd-f2b08ab6fd86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f73d5a98be74242b45222df39fb6213', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:49:33.674672 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be7bb37-57a8-4a3e-89cd-f2b08ab6fd86 admin admin] REQUEST_METHOD: `GET` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:49:33.674953 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be7bb37-57a8-4a3e-89cd-f2b08ab6fd86 admin admin] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:49:33.675229 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be7bb37-57a8-4a3e-89cd-f2b08ab6fd86 admin admin] PATH_INFO: `/v3/roles` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:49:33.675965 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9be7bb37-57a8-4a3e-89cd-f2b08ab6fd86 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:49:33.677563 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9be7bb37-57a8-4a3e-89cd-f2b08ab6fd86 admin admin] RBAC: Authorization granted {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:49:33.690179 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 1385/2779] 10.222.0.59 () {58 vars in 1121 bytes} [Thu Jun 2 16:49:33 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 16:49:33.694141 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9be7bb37-57a8-4a3e-89cd-f2b08ab6fd86 admin admin] Authenticating user token {{(pid=80396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:49:33.704535 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9be7bb37-57a8-4a3e-89cd-f2b08ab6fd86 admin admin] Validating token access rules against request {{(pid=80396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:49:33.709141 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f7cde3b-6748-4e89-bfbd-821a28dd9a4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f73d5a98be74242b45222df39fb6213', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:49:33.709991 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f7cde3b-6748-4e89-bfbd-821a28dd9a4f admin admin] REQUEST_METHOD: `PUT` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:49:33.710305 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f7cde3b-6748-4e89-bfbd-821a28dd9a4f admin admin] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:49:33.710579 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f7cde3b-6748-4e89-bfbd-821a28dd9a4f admin admin] PATH_INFO: `/v3/projects/cf9388c75cae49ecaf03f8205d909a6a/users/d6ce679511174f9fb811116b801935d0/roles/f1e0c25f6e9049e897cb7350c7e54ab3` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:49:33.725540 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f7cde3b-6748-4e89-bfbd-821a28dd9a4f admin admin] RBAC: Authorizing `identity:create_grant(project_id=cf9388c75cae49ecaf03f8205d909a6a, user_id=d6ce679511174f9fb811116b801935d0, role_id=f1e0c25f6e9049e897cb7350c7e54ab3)` {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:49:33.728259 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f7cde3b-6748-4e89-bfbd-821a28dd9a4f admin admin] RBAC: Authorization granted {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:49:33.733216 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-107a1864-6ebe-42c5-9048-07327b3592c7 admin admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:49:33.736901 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ae3a83-cb3c-4507-81ce-27eea0124721 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9af40ddfe9ff4be3887b068f13a28dc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c87c981909d4b8db02783421818c79b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:49:33.737546 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ae3a83-cb3c-4507-81ce-27eea0124721 service neutron] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:49:33.737831 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ae3a83-cb3c-4507-81ce-27eea0124721 service neutron] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:49:33.738135 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ae3a83-cb3c-4507-81ce-27eea0124721 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:49:33.739932 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.fernet_utils [None req-c4ae3a83-cb3c-4507-81ce-27eea0124721 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:49:33.752737 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4ae3a83-cb3c-4507-81ce-27eea0124721 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:49:33.754172 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4ae3a83-cb3c-4507-81ce-27eea0124721 service neutron] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:49:33.763740 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 1395/2780] 10.222.0.59 () {60 vars in 1365 bytes} [Thu Jun 2 16:49:33 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 02 16:49:33.813300 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 1386/2781] 10.222.0.59 () {60 vars in 1482 bytes} [Thu Jun 2 16:49:33 2022] PUT /identity/v3/projects/cf9388c75cae49ecaf03f8205d909a6a/users/d6ce679511174f9fb811116b801935d0/roles/f1e0c25f6e9049e897cb7350c7e54ab3 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 02 16:49:33.817065 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ae3a83-cb3c-4507-81ce-27eea0124721 service neutron] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:49:33.827095 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ae3a83-cb3c-4507-81ce-27eea0124721 service neutron] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:49:33.885991 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-297c87f9-0188-4709-9634-24db32430905 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f73d5a98be74242b45222df39fb6213', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:49:33.886607 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297c87f9-0188-4709-9634-24db32430905 admin admin] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:49:33.886891 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297c87f9-0188-4709-9634-24db32430905 admin admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:49:33.887162 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297c87f9-0188-4709-9634-24db32430905 admin admin] PATH_INFO: `/v3/roles` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:49:33.887884 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-297c87f9-0188-4709-9634-24db32430905 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:49:33.889480 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-297c87f9-0188-4709-9634-24db32430905 admin admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:49:33.899821 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 1396/2782] 10.222.0.59 () {58 vars in 1121 bytes} [Thu Jun 2 16:49:33 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 16:49:33.904522 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f7cde3b-6748-4e89-bfbd-821a28dd9a4f admin admin] Authenticating user token {{(pid=80396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:49:33.914906 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f7cde3b-6748-4e89-bfbd-821a28dd9a4f admin admin] Validating token access rules against request {{(pid=80396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:49:33.920268 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2026f19f-e858-449c-964f-55c08adebcbf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f73d5a98be74242b45222df39fb6213', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:49:33.921146 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2026f19f-e858-449c-964f-55c08adebcbf admin admin] REQUEST_METHOD: `PUT` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:49:33.921425 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2026f19f-e858-449c-964f-55c08adebcbf admin admin] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:49:33.921697 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2026f19f-e858-449c-964f-55c08adebcbf admin admin] PATH_INFO: `/v3/projects/cf9388c75cae49ecaf03f8205d909a6a/users/d6ce679511174f9fb811116b801935d0/roles/f1e0c25f6e9049e897cb7350c7e54ab3` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:49:33.923701 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2026f19f-e858-449c-964f-55c08adebcbf admin admin] RBAC: Authorizing `identity:create_grant(project_id=cf9388c75cae49ecaf03f8205d909a6a, user_id=d6ce679511174f9fb811116b801935d0, role_id=f1e0c25f6e9049e897cb7350c7e54ab3)` {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:49:33.926552 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2026f19f-e858-449c-964f-55c08adebcbf admin admin] RBAC: Authorization granted {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:49:33.937132 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 1387/2783] 10.222.0.59 () {60 vars in 1482 bytes} [Thu Jun 2 16:49:33 2022] PUT /identity/v3/projects/cf9388c75cae49ecaf03f8205d909a6a/users/d6ce679511174f9fb811116b801935d0/roles/f1e0c25f6e9049e897cb7350c7e54ab3 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 16:49:33.951000 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e75653-afec-4edc-944c-00d06fbc5c79 None None] REQUEST_METHOD: `POST` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:49:33.951293 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e75653-afec-4edc-944c-00d06fbc5c79 None None] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:49:33.951572 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e75653-afec-4edc-944c-00d06fbc5c79 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:49:33.978010 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.auth.core [None req-d9e75653-afec-4edc-944c-00d06fbc5c79 None None] MFA Rules not processed for user `d6ce679511174f9fb811116b801935d0`. Rule list: `[]` (Enabled: `True`). {{(pid=80395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 16:49:33.979240 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.fernet_utils [None req-d9e75653-afec-4edc-944c-00d06fbc5c79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:49:34.040175 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 16:49:34.050741 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 1397/2784] 10.222.0.59 () {58 vars in 957 bytes} [Thu Jun 2 16:49:33 2022] POST /identity/v3/auth/tokens => generated 3341 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 16:49:34.063099 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2026f19f-e858-449c-964f-55c08adebcbf admin admin] Authenticating user token {{(pid=80396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:49:34.064965 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.fernet_utils [None req-2026f19f-e858-449c-964f-55c08adebcbf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:49:34.129501 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2026f19f-e858-449c-964f-55c08adebcbf admin admin] Validating token access rules against request {{(pid=80396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:49:34.133108 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-109aa6d8-5c42-4f6f-ae2c-0266f5c29515 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6534961c369940a5b88f310c6450250b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c87c981909d4b8db02783421818c79b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:49:34.133753 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109aa6d8-5c42-4f6f-ae2c-0266f5c29515 service cinder] REQUEST_METHOD: `GET` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:49:34.134049 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109aa6d8-5c42-4f6f-ae2c-0266f5c29515 service cinder] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:49:34.134359 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109aa6d8-5c42-4f6f-ae2c-0266f5c29515 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:49:34.144972 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-109aa6d8-5c42-4f6f-ae2c-0266f5c29515 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:49:34.146399 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-109aa6d8-5c42-4f6f-ae2c-0266f5c29515 service cinder] RBAC: Authorization granted {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:49:34.156354 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 1388/2785] 10.222.0.59 () {60 vars in 1365 bytes} [Thu Jun 2 16:49:34 2022] GET /identity/v3/auth/tokens => generated 3341 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 16:49:34.292463 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9e75653-afec-4edc-944c-00d06fbc5c79 None None] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:49:34.294273 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.fernet_utils [None req-d9e75653-afec-4edc-944c-00d06fbc5c79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:49:34.369395 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9e75653-afec-4edc-944c-00d06fbc5c79 None None] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:49:34.374730 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dde52a38-228e-412d-8830-2dc1f973c11e service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b700f6d94374ba4b362a8f0d5b35796', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c87c981909d4b8db02783421818c79b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:49:34.375369 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde52a38-228e-412d-8830-2dc1f973c11e service placement] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:49:34.375652 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde52a38-228e-412d-8830-2dc1f973c11e service placement] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:49:34.375931 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde52a38-228e-412d-8830-2dc1f973c11e service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:49:34.377705 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.fernet_utils [None req-dde52a38-228e-412d-8830-2dc1f973c11e service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:49:34.390156 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dde52a38-228e-412d-8830-2dc1f973c11e service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:49:34.392561 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dde52a38-228e-412d-8830-2dc1f973c11e service placement] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:49:34.401899 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 1398/2786] 10.222.0.59 () {60 vars in 1365 bytes} [Thu Jun 2 16:49:34 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 16:49:34.424083 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-109aa6d8-5c42-4f6f-ae2c-0266f5c29515 service cinder] Authenticating user token {{(pid=80396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:49:34.425519 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.fernet_utils [None req-109aa6d8-5c42-4f6f-ae2c-0266f5c29515 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:49:34.500270 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-109aa6d8-5c42-4f6f-ae2c-0266f5c29515 service cinder] Validating token access rules against request {{(pid=80396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:49:34.504881 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af6efb0e-b5b9-4ede-a16c-518e20fdf35a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f73d5a98be74242b45222df39fb6213', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:49:34.505751 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af6efb0e-b5b9-4ede-a16c-518e20fdf35a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:49:34.506036 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af6efb0e-b5b9-4ede-a16c-518e20fdf35a admin admin] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:49:34.506349 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af6efb0e-b5b9-4ede-a16c-518e20fdf35a admin admin] PATH_INFO: `/v3/users/2910f2833ce24b17b248ad9106f19786` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:49:34.507632 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af6efb0e-b5b9-4ede-a16c-518e20fdf35a admin admin] RBAC: Authorizing `identity:delete_user(user_id=2910f2833ce24b17b248ad9106f19786)` {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:49:34.509660 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af6efb0e-b5b9-4ede-a16c-518e20fdf35a admin admin] RBAC: Authorization granted {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:49:34.514951 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG dbcounter [-] [80396] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 16:49:34.523978 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dde52a38-228e-412d-8830-2dc1f973c11e service placement] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:49:34.534365 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dde52a38-228e-412d-8830-2dc1f973c11e service placement] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:49:34.538358 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a7f750c-f860-4b92-8bd0-b0a3175a135a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6534961c369940a5b88f310c6450250b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c87c981909d4b8db02783421818c79b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:49:34.538997 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a7f750c-f860-4b92-8bd0-b0a3175a135a service cinder] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:49:34.539282 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a7f750c-f860-4b92-8bd0-b0a3175a135a service cinder] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:49:34.539559 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a7f750c-f860-4b92-8bd0-b0a3175a135a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:49:34.597245 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a7f750c-f860-4b92-8bd0-b0a3175a135a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:49:34.598718 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a7f750c-f860-4b92-8bd0-b0a3175a135a service cinder] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:49:34.607792 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 1399/2787] 10.222.0.59 () {60 vars in 1365 bytes} [Thu Jun 2 16:49:34 2022] GET /identity/v3/auth/tokens => generated 3274 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 02 16:49:34.674743 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.notifications [None req-af6efb0e-b5b9-4ede-a16c-518e20fdf35a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2910f2833ce24b17b248ad9106f19786'} {{(pid=80396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:49:34.675429 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.notifications [None req-af6efb0e-b5b9-4ede-a16c-518e20fdf35a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2910f2833ce24b17b248ad9106f19786'} {{(pid=80396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:49:34.738387 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.notifications [None req-af6efb0e-b5b9-4ede-a16c-518e20fdf35a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2910f2833ce24b17b248ad9106f19786'} {{(pid=80396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:49:34.751919 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.notifications [None req-af6efb0e-b5b9-4ede-a16c-518e20fdf35a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2910f2833ce24b17b248ad9106f19786'} {{(pid=80396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:49:34.758843 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.notifications [None req-af6efb0e-b5b9-4ede-a16c-518e20fdf35a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2910f2833ce24b17b248ad9106f19786'} {{(pid=80396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:49:34.765481 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 1389/2788] 10.222.0.59 () {58 vars in 1223 bytes} [Thu Jun 2 16:49:34 2022] DELETE /identity/v3/users/2910f2833ce24b17b248ad9106f19786 => generated 0 bytes in 342 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 16:49:35.020101 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a7f750c-f860-4b92-8bd0-b0a3175a135a service cinder] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:49:35.033273 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a7f750c-f860-4b92-8bd0-b0a3175a135a service cinder] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:49:35.095146 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58f9001b-7dbf-4aeb-9d2b-fafb341706d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f73d5a98be74242b45222df39fb6213', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:49:35.095999 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f9001b-7dbf-4aeb-9d2b-fafb341706d8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:49:35.096285 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f9001b-7dbf-4aeb-9d2b-fafb341706d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:49:35.096664 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f9001b-7dbf-4aeb-9d2b-fafb341706d8 admin admin] PATH_INFO: `/v3/projects/f556a2c3bb1c45f0a3607912effac5c8` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:49:35.098036 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58f9001b-7dbf-4aeb-9d2b-fafb341706d8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f556a2c3bb1c45f0a3607912effac5c8)` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:49:35.100439 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58f9001b-7dbf-4aeb-9d2b-fafb341706d8 admin admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:49:35.192198 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 16:49:35.209508 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.notifications [None req-58f9001b-7dbf-4aeb-9d2b-fafb341706d8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f556a2c3bb1c45f0a3607912effac5c8', 'request_id': 'req-58f9001b-7dbf-4aeb-9d2b-fafb341706d8'} {{(pid=80395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:49:35.216481 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.notifications [None req-58f9001b-7dbf-4aeb-9d2b-fafb341706d8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f556a2c3bb1c45f0a3607912effac5c8', 'request_id': 'req-58f9001b-7dbf-4aeb-9d2b-fafb341706d8'} {{(pid=80395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:49:35.296109 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.notifications [None req-58f9001b-7dbf-4aeb-9d2b-fafb341706d8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f556a2c3bb1c45f0a3607912effac5c8', 'request_id': 'req-58f9001b-7dbf-4aeb-9d2b-fafb341706d8'} {{(pid=80395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:49:35.308158 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.notifications [None req-58f9001b-7dbf-4aeb-9d2b-fafb341706d8 admin admin] The token cache is being invalidate because project f556a2c3bb1c45f0a3607912effac5c8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80395) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 02 16:49:35.308464 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.notifications [None req-58f9001b-7dbf-4aeb-9d2b-fafb341706d8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:49:35.309109 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.notifications [None req-58f9001b-7dbf-4aeb-9d2b-fafb341706d8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:49:35.310783 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 1400/2789] 10.222.0.59 () {58 vars in 1232 bytes} [Thu Jun 2 16:49:35 2022] DELETE /identity/v3/projects/f556a2c3bb1c45f0a3607912effac5c8 => generated 0 bytes in 291 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 16:49:44.845027 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG dbcounter [-] [80396] Writing DB stats keystone:SELECT=24,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 16:49:45.304724 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writing DB stats keystone:DELETE=6,keystone:SELECT=14,keystone:INSERT=1 {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 16:49:45.333055 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af6efb0e-b5b9-4ede-a16c-518e20fdf35a admin admin] Authenticating user token {{(pid=80396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:49:45.334480 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.fernet_utils [None req-af6efb0e-b5b9-4ede-a16c-518e20fdf35a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:49:45.347930 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af6efb0e-b5b9-4ede-a16c-518e20fdf35a admin admin] Validating token access rules against request {{(pid=80396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:49:45.406458 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd343cb-0365-4943-b6c8-22c3dfa3429c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f73d5a98be74242b45222df39fb6213', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:49:45.407316 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd343cb-0365-4943-b6c8-22c3dfa3429c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:49:45.407600 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd343cb-0365-4943-b6c8-22c3dfa3429c admin admin] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:49:45.407877 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd343cb-0365-4943-b6c8-22c3dfa3429c admin admin] PATH_INFO: `/v3/users/e9e261da50ae49d2996ec79e5b760c07` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:49:45.409058 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dd343cb-0365-4943-b6c8-22c3dfa3429c admin admin] RBAC: Authorizing `identity:delete_user(user_id=e9e261da50ae49d2996ec79e5b760c07)` {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:49:45.411003 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dd343cb-0365-4943-b6c8-22c3dfa3429c admin admin] RBAC: Authorization granted {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:49:45.614970 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.notifications [None req-5dd343cb-0365-4943-b6c8-22c3dfa3429c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e9e261da50ae49d2996ec79e5b760c07'} {{(pid=80396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:49:45.615547 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.notifications [None req-5dd343cb-0365-4943-b6c8-22c3dfa3429c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e9e261da50ae49d2996ec79e5b760c07'} {{(pid=80396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:49:45.663850 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.notifications [None req-5dd343cb-0365-4943-b6c8-22c3dfa3429c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e9e261da50ae49d2996ec79e5b760c07'} {{(pid=80396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:49:45.676295 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.notifications [None req-5dd343cb-0365-4943-b6c8-22c3dfa3429c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e9e261da50ae49d2996ec79e5b760c07'} {{(pid=80396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:49:45.683466 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.notifications [None req-5dd343cb-0365-4943-b6c8-22c3dfa3429c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e9e261da50ae49d2996ec79e5b760c07'} {{(pid=80396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:49:45.689408 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 1390/2790] 10.222.0.59 () {58 vars in 1223 bytes} [Thu Jun 2 16:49:45 2022] DELETE /identity/v3/users/e9e261da50ae49d2996ec79e5b760c07 => generated 0 bytes in 357 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 16:49:45.693918 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-758d4e5a-90ff-46a5-acf9-81bb8257407b None None] REQUEST_METHOD: `POST` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:49:45.694315 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-758d4e5a-90ff-46a5-acf9-81bb8257407b None None] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:49:45.694602 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-758d4e5a-90ff-46a5-acf9-81bb8257407b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:49:45.712683 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.auth.core [None req-758d4e5a-90ff-46a5-acf9-81bb8257407b None None] MFA Rules not processed for user `400d1f4db9de49638549e5db29a041e1`. Rule list: `[]` (Enabled: `True`). {{(pid=80395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 16:49:45.714822 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.fernet_utils [None req-758d4e5a-90ff-46a5-acf9-81bb8257407b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:49:45.774511 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 1401/2791] 10.222.0.59 () {58 vars in 957 bytes} [Thu Jun 2 16:49:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 02 16:49:45.784551 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd343cb-0365-4943-b6c8-22c3dfa3429c admin admin] Authenticating user token {{(pid=80396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:49:45.785991 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.fernet_utils [None req-5dd343cb-0365-4943-b6c8-22c3dfa3429c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:49:45.844050 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd343cb-0365-4943-b6c8-22c3dfa3429c admin admin] Validating token access rules against request {{(pid=80396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:49:45.847689 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef90ea86-3b89-4879-b887-db5177698192 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9af40ddfe9ff4be3887b068f13a28dc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c87c981909d4b8db02783421818c79b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:49:45.848329 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef90ea86-3b89-4879-b887-db5177698192 service neutron] REQUEST_METHOD: `GET` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:49:45.848614 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef90ea86-3b89-4879-b887-db5177698192 service neutron] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:49:45.848893 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef90ea86-3b89-4879-b887-db5177698192 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:49:45.857966 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef90ea86-3b89-4879-b887-db5177698192 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:49:45.859418 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef90ea86-3b89-4879-b887-db5177698192 service neutron] RBAC: Authorization granted {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:49:45.868852 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 1391/2792] 10.222.0.59 () {60 vars in 1365 bytes} [Thu Jun 2 16:49:45 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 16:49:46.283117 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-758d4e5a-90ff-46a5-acf9-81bb8257407b None None] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:49:46.284670 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.fernet_utils [None req-758d4e5a-90ff-46a5-acf9-81bb8257407b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:49:46.298655 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-758d4e5a-90ff-46a5-acf9-81bb8257407b None None] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:49:46.303308 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74f9dedb-cbb5-42ec-a9c9-bd3db399fbeb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f73d5a98be74242b45222df39fb6213', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:49:46.304162 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f9dedb-cbb5-42ec-a9c9-bd3db399fbeb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:49:46.304477 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f9dedb-cbb5-42ec-a9c9-bd3db399fbeb admin admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:49:46.304830 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f9dedb-cbb5-42ec-a9c9-bd3db399fbeb admin admin] PATH_INFO: `/v3/projects/8b71eee589a64d3bac8376b065800782` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:49:46.306260 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74f9dedb-cbb5-42ec-a9c9-bd3db399fbeb admin admin] RBAC: Authorizing `identity:delete_project(project_id=8b71eee589a64d3bac8376b065800782)` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:49:46.309002 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74f9dedb-cbb5-42ec-a9c9-bd3db399fbeb admin admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:49:46.418870 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.notifications [None req-74f9dedb-cbb5-42ec-a9c9-bd3db399fbeb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8b71eee589a64d3bac8376b065800782', 'request_id': 'req-74f9dedb-cbb5-42ec-a9c9-bd3db399fbeb'} {{(pid=80395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:49:46.425088 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.notifications [None req-74f9dedb-cbb5-42ec-a9c9-bd3db399fbeb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8b71eee589a64d3bac8376b065800782', 'request_id': 'req-74f9dedb-cbb5-42ec-a9c9-bd3db399fbeb'} {{(pid=80395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:49:46.490914 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.notifications [None req-74f9dedb-cbb5-42ec-a9c9-bd3db399fbeb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8b71eee589a64d3bac8376b065800782', 'request_id': 'req-74f9dedb-cbb5-42ec-a9c9-bd3db399fbeb'} {{(pid=80395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:49:46.503055 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.notifications [None req-74f9dedb-cbb5-42ec-a9c9-bd3db399fbeb admin admin] The token cache is being invalidate because project 8b71eee589a64d3bac8376b065800782 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80395) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 02 16:49:46.503344 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.notifications [None req-74f9dedb-cbb5-42ec-a9c9-bd3db399fbeb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:49:46.503964 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.notifications [None req-74f9dedb-cbb5-42ec-a9c9-bd3db399fbeb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:49:46.505558 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 1402/2793] 10.222.0.59 () {58 vars in 1232 bytes} [Thu Jun 2 16:49:46 2022] DELETE /identity/v3/projects/8b71eee589a64d3bac8376b065800782 => generated 0 bytes in 223 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 16:49:46.509708 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef90ea86-3b89-4879-b887-db5177698192 service neutron] Authenticating user token {{(pid=80396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:49:46.519433 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef90ea86-3b89-4879-b887-db5177698192 service neutron] Validating token access rules against request {{(pid=80396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:49:46.538250 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG dbcounter [-] [80396] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 16:49:46.578913 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54b35e8a-2072-4034-9db7-c1fee52b8287 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f73d5a98be74242b45222df39fb6213', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:49:46.579774 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b35e8a-2072-4034-9db7-c1fee52b8287 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:49:46.580056 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b35e8a-2072-4034-9db7-c1fee52b8287 admin admin] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:49:46.580336 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b35e8a-2072-4034-9db7-c1fee52b8287 admin admin] PATH_INFO: `/v3/users/d6ce679511174f9fb811116b801935d0` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:49:46.581523 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54b35e8a-2072-4034-9db7-c1fee52b8287 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d6ce679511174f9fb811116b801935d0)` {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:49:46.583848 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54b35e8a-2072-4034-9db7-c1fee52b8287 admin admin] RBAC: Authorization granted {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:49:46.778806 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.notifications [None req-54b35e8a-2072-4034-9db7-c1fee52b8287 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd6ce679511174f9fb811116b801935d0'} {{(pid=80396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:49:46.779447 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.notifications [None req-54b35e8a-2072-4034-9db7-c1fee52b8287 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd6ce679511174f9fb811116b801935d0'} {{(pid=80396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:49:46.856624 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.notifications [None req-54b35e8a-2072-4034-9db7-c1fee52b8287 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd6ce679511174f9fb811116b801935d0'} {{(pid=80396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:49:46.869644 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.notifications [None req-54b35e8a-2072-4034-9db7-c1fee52b8287 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd6ce679511174f9fb811116b801935d0'} {{(pid=80396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:49:46.877523 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.notifications [None req-54b35e8a-2072-4034-9db7-c1fee52b8287 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd6ce679511174f9fb811116b801935d0'} {{(pid=80396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:49:46.883480 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 1392/2794] 10.222.0.59 () {58 vars in 1223 bytes} [Thu Jun 2 16:49:46 2022] DELETE /identity/v3/users/d6ce679511174f9fb811116b801935d0 => generated 0 bytes in 374 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 16:49:47.305304 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74f9dedb-cbb5-42ec-a9c9-bd3db399fbeb admin admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:49:47.307045 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.fernet_utils [None req-74f9dedb-cbb5-42ec-a9c9-bd3db399fbeb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:49:47.320845 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74f9dedb-cbb5-42ec-a9c9-bd3db399fbeb admin admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:49:47.379625 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4ebea17-02d0-4a2d-9128-bdc197837655 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f73d5a98be74242b45222df39fb6213', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:49:47.380502 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ebea17-02d0-4a2d-9128-bdc197837655 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:49:47.380787 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ebea17-02d0-4a2d-9128-bdc197837655 admin admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:49:47.381066 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ebea17-02d0-4a2d-9128-bdc197837655 admin admin] PATH_INFO: `/v3/projects/cf9388c75cae49ecaf03f8205d909a6a` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:49:47.382278 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4ebea17-02d0-4a2d-9128-bdc197837655 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cf9388c75cae49ecaf03f8205d909a6a)` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:49:47.384168 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4ebea17-02d0-4a2d-9128-bdc197837655 admin admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:49:47.483082 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 16:49:47.500711 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.notifications [None req-d4ebea17-02d0-4a2d-9128-bdc197837655 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cf9388c75cae49ecaf03f8205d909a6a', 'request_id': 'req-d4ebea17-02d0-4a2d-9128-bdc197837655'} {{(pid=80395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:49:47.506829 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.notifications [None req-d4ebea17-02d0-4a2d-9128-bdc197837655 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cf9388c75cae49ecaf03f8205d909a6a', 'request_id': 'req-d4ebea17-02d0-4a2d-9128-bdc197837655'} {{(pid=80395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:49:47.572641 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.notifications [None req-d4ebea17-02d0-4a2d-9128-bdc197837655 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cf9388c75cae49ecaf03f8205d909a6a', 'request_id': 'req-d4ebea17-02d0-4a2d-9128-bdc197837655'} {{(pid=80395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:49:47.584373 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.notifications [None req-d4ebea17-02d0-4a2d-9128-bdc197837655 admin admin] The token cache is being invalidate because project cf9388c75cae49ecaf03f8205d909a6a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80395) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 02 16:49:47.584717 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.notifications [None req-d4ebea17-02d0-4a2d-9128-bdc197837655 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:49:47.585801 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.notifications [None req-d4ebea17-02d0-4a2d-9128-bdc197837655 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:49:47.587445 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 1403/2795] 10.222.0.59 () {58 vars in 1232 bytes} [Thu Jun 2 16:49:47 2022] DELETE /identity/v3/projects/cf9388c75cae49ecaf03f8205d909a6a => generated 0 bytes in 283 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 16:49:47.592383 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-132f4e84-8b26-4d30-8ded-a3cce2936876 None None] REQUEST_METHOD: `POST` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:49:47.592675 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-132f4e84-8b26-4d30-8ded-a3cce2936876 None None] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:49:47.593002 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-132f4e84-8b26-4d30-8ded-a3cce2936876 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:49:47.611825 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.auth.core [None req-132f4e84-8b26-4d30-8ded-a3cce2936876 None None] MFA Rules not processed for user `400d1f4db9de49638549e5db29a041e1`. Rule list: `[]` (Enabled: `True`). {{(pid=80396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 16:49:47.613079 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.fernet_utils [None req-132f4e84-8b26-4d30-8ded-a3cce2936876 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:49:47.671544 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 1393/2796] 10.222.0.59 () {58 vars in 957 bytes} [Thu Jun 2 16:49:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 16:49:47.679196 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e166df1-0e81-4bbc-9195-73890e508cc8 None None] REQUEST_METHOD: `POST` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:49:47.679513 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e166df1-0e81-4bbc-9195-73890e508cc8 None None] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:49:47.679790 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e166df1-0e81-4bbc-9195-73890e508cc8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:49:47.698506 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.auth.core [None req-7e166df1-0e81-4bbc-9195-73890e508cc8 None None] MFA Rules not processed for user `400d1f4db9de49638549e5db29a041e1`. Rule list: `[]` (Enabled: `True`). {{(pid=80395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 16:49:47.699699 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.fernet_utils [None req-7e166df1-0e81-4bbc-9195-73890e508cc8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:49:47.707656 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 1404/2797] 10.222.0.59 () {58 vars in 957 bytes} [Thu Jun 2 16:49:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 02 16:49:47.711602 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-132f4e84-8b26-4d30-8ded-a3cce2936876 None None] Authenticating user token {{(pid=80396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:49:47.721119 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-132f4e84-8b26-4d30-8ded-a3cce2936876 None None] Validating token access rules against request {{(pid=80396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:49:47.725613 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-558fa7b2-e79c-460e-b4de-71f98045efd4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f73d5a98be74242b45222df39fb6213', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:49:47.726276 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558fa7b2-e79c-460e-b4de-71f98045efd4 admin admin] REQUEST_METHOD: `GET` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:49:47.726557 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558fa7b2-e79c-460e-b4de-71f98045efd4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:49:47.726830 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558fa7b2-e79c-460e-b4de-71f98045efd4 admin admin] PATH_INFO: `/v3/domains` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:49:47.727541 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-558fa7b2-e79c-460e-b4de-71f98045efd4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80396) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 16:49:47.727845 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-558fa7b2-e79c-460e-b4de-71f98045efd4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:49:47.729914 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-558fa7b2-e79c-460e-b4de-71f98045efd4 admin admin] RBAC: Authorization granted {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:49:47.741115 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 1394/2798] 10.222.0.59 () {58 vars in 1152 bytes} [Thu Jun 2 16:49:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 16:49:47.745351 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e166df1-0e81-4bbc-9195-73890e508cc8 None None] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:49:47.754717 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e166df1-0e81-4bbc-9195-73890e508cc8 None None] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:49:47.759433 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67c91776-275d-45d6-8f4e-6aa0c11cfb4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f73d5a98be74242b45222df39fb6213', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:49:47.760069 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c91776-275d-45d6-8f4e-6aa0c11cfb4b admin admin] REQUEST_METHOD: `POST` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:49:47.760347 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c91776-275d-45d6-8f4e-6aa0c11cfb4b admin admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:49:47.761214 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c91776-275d-45d6-8f4e-6aa0c11cfb4b admin admin] PATH_INFO: `/v3/projects` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:49:47.761897 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67c91776-275d-45d6-8f4e-6aa0c11cfb4b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:49:47.763824 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67c91776-275d-45d6-8f4e-6aa0c11cfb4b admin admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:49:47.871102 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 1405/2799] 10.222.0.59 () {60 vars in 1152 bytes} [Thu Jun 2 16:49:47 2022] POST /identity/v3/projects => generated 373 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 16:49:47.875443 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-558fa7b2-e79c-460e-b4de-71f98045efd4 admin admin] Authenticating user token {{(pid=80396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:49:47.886040 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-558fa7b2-e79c-460e-b4de-71f98045efd4 admin admin] Validating token access rules against request {{(pid=80396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:49:47.913358 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG dbcounter [-] [80396] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 16:49:47.943657 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1816c05-fc5d-4a0c-a44a-13bdc319e0a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f73d5a98be74242b45222df39fb6213', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:49:47.944321 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1816c05-fc5d-4a0c-a44a-13bdc319e0a3 admin admin] REQUEST_METHOD: `POST` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:49:47.944608 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1816c05-fc5d-4a0c-a44a-13bdc319e0a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:49:47.944889 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1816c05-fc5d-4a0c-a44a-13bdc319e0a3 admin admin] PATH_INFO: `/v3/users` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:49:47.945588 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1816c05-fc5d-4a0c-a44a-13bdc319e0a3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:49:47.947535 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1816c05-fc5d-4a0c-a44a-13bdc319e0a3 admin admin] RBAC: Authorization granted {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:49:48.041543 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 1395/2800] 10.222.0.59 () {60 vars in 1143 bytes} [Thu Jun 2 16:49:47 2022] POST /identity/v3/users => generated 287 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 02 16:49:48.046259 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67c91776-275d-45d6-8f4e-6aa0c11cfb4b admin admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:49:48.056629 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67c91776-275d-45d6-8f4e-6aa0c11cfb4b admin admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:49:48.062644 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-982a8b22-be4f-423c-a92d-9f0b2d57904d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f73d5a98be74242b45222df39fb6213', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:49:48.063332 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-982a8b22-be4f-423c-a92d-9f0b2d57904d admin admin] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:49:48.063617 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-982a8b22-be4f-423c-a92d-9f0b2d57904d admin admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:49:48.063896 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-982a8b22-be4f-423c-a92d-9f0b2d57904d admin admin] PATH_INFO: `/v3/roles` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:49:48.064685 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-982a8b22-be4f-423c-a92d-9f0b2d57904d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:49:48.066317 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-982a8b22-be4f-423c-a92d-9f0b2d57904d admin admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:49:48.077560 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 1406/2801] 10.222.0.59 () {58 vars in 1121 bytes} [Thu Jun 2 16:49:48 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 16:49:48.081473 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1816c05-fc5d-4a0c-a44a-13bdc319e0a3 admin admin] Authenticating user token {{(pid=80396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:49:48.091680 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1816c05-fc5d-4a0c-a44a-13bdc319e0a3 admin admin] Validating token access rules against request {{(pid=80396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:49:48.096420 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-286a78aa-fa4d-41c8-9cad-4aa7c955326e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f73d5a98be74242b45222df39fb6213', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:49:48.097066 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-286a78aa-fa4d-41c8-9cad-4aa7c955326e admin admin] REQUEST_METHOD: `GET` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:49:48.097350 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-286a78aa-fa4d-41c8-9cad-4aa7c955326e admin admin] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:49:48.097625 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-286a78aa-fa4d-41c8-9cad-4aa7c955326e admin admin] PATH_INFO: `/v3/roles` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:49:48.098386 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-286a78aa-fa4d-41c8-9cad-4aa7c955326e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:49:48.100036 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-286a78aa-fa4d-41c8-9cad-4aa7c955326e admin admin] RBAC: Authorization granted {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:49:48.111000 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 1396/2802] 10.222.0.59 () {58 vars in 1121 bytes} [Thu Jun 2 16:49:48 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 02 16:49:48.114911 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-982a8b22-be4f-423c-a92d-9f0b2d57904d admin admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:49:48.125600 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-982a8b22-be4f-423c-a92d-9f0b2d57904d admin admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:49:48.130313 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-749f9b90-67d5-475c-9c7a-7733ca2b1b28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f73d5a98be74242b45222df39fb6213', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:49:48.131186 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749f9b90-67d5-475c-9c7a-7733ca2b1b28 admin admin] REQUEST_METHOD: `PUT` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:49:48.131468 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749f9b90-67d5-475c-9c7a-7733ca2b1b28 admin admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:49:48.131747 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749f9b90-67d5-475c-9c7a-7733ca2b1b28 admin admin] PATH_INFO: `/v3/projects/8bb714b3600146648b3052ead314cc83/users/93acaa0c86244cd2afb1b76292af4488/roles/649e0f2b5a264c419ea6a1441f123a03` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:49:48.146497 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-749f9b90-67d5-475c-9c7a-7733ca2b1b28 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8bb714b3600146648b3052ead314cc83, user_id=93acaa0c86244cd2afb1b76292af4488, role_id=649e0f2b5a264c419ea6a1441f123a03)` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:49:48.149133 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-749f9b90-67d5-475c-9c7a-7733ca2b1b28 admin admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:49:48.224198 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 1407/2803] 10.222.0.59 () {60 vars in 1482 bytes} [Thu Jun 2 16:49:48 2022] PUT /identity/v3/projects/8bb714b3600146648b3052ead314cc83/users/93acaa0c86244cd2afb1b76292af4488/roles/649e0f2b5a264c419ea6a1441f123a03 => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 16:49:48.234621 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68528334-4e67-46d6-b29b-f0c78fb4c5f4 None None] REQUEST_METHOD: `POST` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:49:48.234919 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68528334-4e67-46d6-b29b-f0c78fb4c5f4 None None] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:49:48.235199 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68528334-4e67-46d6-b29b-f0c78fb4c5f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:49:48.262403 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.auth.core [None req-68528334-4e67-46d6-b29b-f0c78fb4c5f4 None None] MFA Rules not processed for user `93acaa0c86244cd2afb1b76292af4488`. Rule list: `[]` (Enabled: `True`). {{(pid=80396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 16:49:48.263596 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.fernet_utils [None req-68528334-4e67-46d6-b29b-f0c78fb4c5f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:49:48.325180 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 1397/2804] 10.222.0.59 () {58 vars in 957 bytes} [Thu Jun 2 16:49:48 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 16:49:48.336099 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-749f9b90-67d5-475c-9c7a-7733ca2b1b28 admin admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:49:48.337836 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.fernet_utils [None req-749f9b90-67d5-475c-9c7a-7733ca2b1b28 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:49:48.393675 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-749f9b90-67d5-475c-9c7a-7733ca2b1b28 admin admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:49:48.397158 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe2578ab-0341-421c-968e-b7d7be9c271b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6534961c369940a5b88f310c6450250b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c87c981909d4b8db02783421818c79b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:49:48.397792 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2578ab-0341-421c-968e-b7d7be9c271b service cinder] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:49:48.398089 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2578ab-0341-421c-968e-b7d7be9c271b service cinder] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:49:48.398374 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2578ab-0341-421c-968e-b7d7be9c271b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:49:48.406556 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe2578ab-0341-421c-968e-b7d7be9c271b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:49:48.407980 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe2578ab-0341-421c-968e-b7d7be9c271b service cinder] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:49:48.416549 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 1408/2805] 10.222.0.59 () {60 vars in 1365 bytes} [Thu Jun 2 16:49:48 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 16:49:48.436850 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68528334-4e67-46d6-b29b-f0c78fb4c5f4 None None] Authenticating user token {{(pid=80396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:49:48.498984 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68528334-4e67-46d6-b29b-f0c78fb4c5f4 None None] Validating token access rules against request {{(pid=80396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:49:48.504642 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aa84827-09f7-418d-ba8d-1d571229dc18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f73d5a98be74242b45222df39fb6213', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:49:48.505504 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa84827-09f7-418d-ba8d-1d571229dc18 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:49:48.505788 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa84827-09f7-418d-ba8d-1d571229dc18 admin admin] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:49:48.506062 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa84827-09f7-418d-ba8d-1d571229dc18 admin admin] PATH_INFO: `/v3/users/93acaa0c86244cd2afb1b76292af4488` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:49:48.507284 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aa84827-09f7-418d-ba8d-1d571229dc18 admin admin] RBAC: Authorizing `identity:delete_user(user_id=93acaa0c86244cd2afb1b76292af4488)` {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:49:48.509190 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aa84827-09f7-418d-ba8d-1d571229dc18 admin admin] RBAC: Authorization granted {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:49:48.711621 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG dbcounter [-] [80396] Writing DB stats keystone:SELECT=92,keystone:INSERT=3,keystone:DELETE=5 {{(pid=80396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 16:49:48.718173 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.notifications [None req-8aa84827-09f7-418d-ba8d-1d571229dc18 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '93acaa0c86244cd2afb1b76292af4488'} {{(pid=80396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:49:48.718831 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.notifications [None req-8aa84827-09f7-418d-ba8d-1d571229dc18 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '93acaa0c86244cd2afb1b76292af4488'} {{(pid=80396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:49:48.823657 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.notifications [None req-8aa84827-09f7-418d-ba8d-1d571229dc18 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '93acaa0c86244cd2afb1b76292af4488'} {{(pid=80396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:49:48.836073 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.notifications [None req-8aa84827-09f7-418d-ba8d-1d571229dc18 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '93acaa0c86244cd2afb1b76292af4488'} {{(pid=80396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:49:48.843640 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.notifications [None req-8aa84827-09f7-418d-ba8d-1d571229dc18 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '93acaa0c86244cd2afb1b76292af4488'} {{(pid=80396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:49:48.850242 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 1398/2806] 10.222.0.59 () {58 vars in 1223 bytes} [Thu Jun 2 16:49:48 2022] DELETE /identity/v3/users/93acaa0c86244cd2afb1b76292af4488 => generated 0 bytes in 414 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 16:49:48.855820 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3ae607-6e84-4caf-be23-f04ed1430e58 None None] REQUEST_METHOD: `POST` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:49:48.856677 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3ae607-6e84-4caf-be23-f04ed1430e58 None None] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:49:48.856677 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3ae607-6e84-4caf-be23-f04ed1430e58 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:49:48.873268 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.auth.core [None req-0b3ae607-6e84-4caf-be23-f04ed1430e58 None None] MFA Rules not processed for user `400d1f4db9de49638549e5db29a041e1`. Rule list: `[]` (Enabled: `True`). {{(pid=80395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 16:49:48.874515 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.fernet_utils [None req-0b3ae607-6e84-4caf-be23-f04ed1430e58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:49:48.922038 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writing DB stats keystone:DELETE=6,keystone:SELECT=91,keystone:INSERT=3 {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 16:49:48.934128 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 1409/2807] 10.222.0.59 () {58 vars in 957 bytes} [Thu Jun 2 16:49:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 16:49:48.943759 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aa84827-09f7-418d-ba8d-1d571229dc18 admin admin] Authenticating user token {{(pid=80396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:49:48.945175 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.fernet_utils [None req-8aa84827-09f7-418d-ba8d-1d571229dc18 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:49:49.002867 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aa84827-09f7-418d-ba8d-1d571229dc18 admin admin] Validating token access rules against request {{(pid=80396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:49:49.006384 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59d032d0-dfb1-43cf-bb7d-770bc58715d1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9af40ddfe9ff4be3887b068f13a28dc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c87c981909d4b8db02783421818c79b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:49:49.007027 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d032d0-dfb1-43cf-bb7d-770bc58715d1 service neutron] REQUEST_METHOD: `GET` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:49:49.007310 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d032d0-dfb1-43cf-bb7d-770bc58715d1 service neutron] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:49:49.007590 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d032d0-dfb1-43cf-bb7d-770bc58715d1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:49:49.016718 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59d032d0-dfb1-43cf-bb7d-770bc58715d1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:49:49.018165 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59d032d0-dfb1-43cf-bb7d-770bc58715d1 service neutron] RBAC: Authorization granted {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:49:49.028218 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 1399/2808] 10.222.0.59 () {60 vars in 1365 bytes} [Thu Jun 2 16:49:48 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 16:49:49.435416 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b3ae607-6e84-4caf-be23-f04ed1430e58 None None] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:49:49.436904 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.fernet_utils [None req-0b3ae607-6e84-4caf-be23-f04ed1430e58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:49:49.449574 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b3ae607-6e84-4caf-be23-f04ed1430e58 None None] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:49:49.454938 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18f37ef8-b07e-45aa-bd2d-cd9f776897ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f73d5a98be74242b45222df39fb6213', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:49:49.455809 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f37ef8-b07e-45aa-bd2d-cd9f776897ea admin admin] REQUEST_METHOD: `DELETE` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:49:49.456099 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f37ef8-b07e-45aa-bd2d-cd9f776897ea admin admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:49:49.456370 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f37ef8-b07e-45aa-bd2d-cd9f776897ea admin admin] PATH_INFO: `/v3/projects/8bb714b3600146648b3052ead314cc83` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:49:49.457582 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18f37ef8-b07e-45aa-bd2d-cd9f776897ea admin admin] RBAC: Authorizing `identity:delete_project(project_id=8bb714b3600146648b3052ead314cc83)` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:49:49.459528 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18f37ef8-b07e-45aa-bd2d-cd9f776897ea admin admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:49:49.584479 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.notifications [None req-18f37ef8-b07e-45aa-bd2d-cd9f776897ea admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8bb714b3600146648b3052ead314cc83', 'request_id': 'req-18f37ef8-b07e-45aa-bd2d-cd9f776897ea'} {{(pid=80395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:49:49.590908 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.notifications [None req-18f37ef8-b07e-45aa-bd2d-cd9f776897ea admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8bb714b3600146648b3052ead314cc83', 'request_id': 'req-18f37ef8-b07e-45aa-bd2d-cd9f776897ea'} {{(pid=80395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:49:49.663819 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.notifications [None req-18f37ef8-b07e-45aa-bd2d-cd9f776897ea admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8bb714b3600146648b3052ead314cc83', 'request_id': 'req-18f37ef8-b07e-45aa-bd2d-cd9f776897ea'} {{(pid=80395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:49:49.674686 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.notifications [None req-18f37ef8-b07e-45aa-bd2d-cd9f776897ea admin admin] The token cache is being invalidate because project 8bb714b3600146648b3052ead314cc83 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80395) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 02 16:49:49.674972 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.notifications [None req-18f37ef8-b07e-45aa-bd2d-cd9f776897ea admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:49:49.675587 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.notifications [None req-18f37ef8-b07e-45aa-bd2d-cd9f776897ea admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:49:49.677100 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 1410/2809] 10.222.0.59 () {58 vars in 1232 bytes} [Thu Jun 2 16:49:49 2022] DELETE /identity/v3/projects/8bb714b3600146648b3052ead314cc83 => generated 0 bytes in 242 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 16:49:49.682142 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48cf2da7-bb68-4f5f-9ea7-b926ea592855 None None] REQUEST_METHOD: `POST` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:49:49.683083 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48cf2da7-bb68-4f5f-9ea7-b926ea592855 None None] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:49:49.683550 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48cf2da7-bb68-4f5f-9ea7-b926ea592855 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:49:49.702210 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.auth.core [None req-48cf2da7-bb68-4f5f-9ea7-b926ea592855 None None] MFA Rules not processed for user `400d1f4db9de49638549e5db29a041e1`. Rule list: `[]` (Enabled: `True`). {{(pid=80396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 16:49:49.703435 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.fernet_utils [None req-48cf2da7-bb68-4f5f-9ea7-b926ea592855 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:49:49.764314 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 1400/2810] 10.222.0.59 () {58 vars in 957 bytes} [Thu Jun 2 16:49:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 16:49:49.772789 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d9a279-6bac-4ff3-9b35-096bdb00c75a None None] REQUEST_METHOD: `POST` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:49:49.773084 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d9a279-6bac-4ff3-9b35-096bdb00c75a None None] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:49:49.773363 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d9a279-6bac-4ff3-9b35-096bdb00c75a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:49:49.791468 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.auth.core [None req-64d9a279-6bac-4ff3-9b35-096bdb00c75a None None] MFA Rules not processed for user `400d1f4db9de49638549e5db29a041e1`. Rule list: `[]` (Enabled: `True`). {{(pid=80395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 16:49:49.792683 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.fernet_utils [None req-64d9a279-6bac-4ff3-9b35-096bdb00c75a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:49:49.800498 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 1411/2811] 10.222.0.59 () {58 vars in 957 bytes} [Thu Jun 2 16:49:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 16:49:49.804574 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48cf2da7-bb68-4f5f-9ea7-b926ea592855 None None] Authenticating user token {{(pid=80396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:49:49.815135 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48cf2da7-bb68-4f5f-9ea7-b926ea592855 None None] Validating token access rules against request {{(pid=80396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:49:49.819816 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31b650f6-9f70-4025-aef4-9a4c74136622 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f73d5a98be74242b45222df39fb6213', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:49:49.820458 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b650f6-9f70-4025-aef4-9a4c74136622 admin admin] REQUEST_METHOD: `GET` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:49:49.820745 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b650f6-9f70-4025-aef4-9a4c74136622 admin admin] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:49:49.821025 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b650f6-9f70-4025-aef4-9a4c74136622 admin admin] PATH_INFO: `/v3/domains` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:49:49.821745 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31b650f6-9f70-4025-aef4-9a4c74136622 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80396) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 16:49:49.822056 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31b650f6-9f70-4025-aef4-9a4c74136622 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:49:49.824848 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31b650f6-9f70-4025-aef4-9a4c74136622 admin admin] RBAC: Authorization granted {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:49:49.836543 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 1401/2812] 10.222.0.59 () {58 vars in 1152 bytes} [Thu Jun 2 16:49:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 16:49:49.841141 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d9a279-6bac-4ff3-9b35-096bdb00c75a None None] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:49:49.850339 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d9a279-6bac-4ff3-9b35-096bdb00c75a None None] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:49:49.855935 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82497243-4421-451e-b979-d52b3feb1998 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f73d5a98be74242b45222df39fb6213', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:49:49.856576 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82497243-4421-451e-b979-d52b3feb1998 admin admin] REQUEST_METHOD: `POST` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:49:49.856863 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82497243-4421-451e-b979-d52b3feb1998 admin admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:49:49.857142 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82497243-4421-451e-b979-d52b3feb1998 admin admin] PATH_INFO: `/v3/projects` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:49:49.857828 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82497243-4421-451e-b979-d52b3feb1998 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:49:49.859759 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82497243-4421-451e-b979-d52b3feb1998 admin admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:49:49.940049 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 1412/2813] 10.222.0.59 () {60 vars in 1152 bytes} [Thu Jun 2 16:49:49 2022] POST /identity/v3/projects => generated 375 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 16:49:49.944406 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31b650f6-9f70-4025-aef4-9a4c74136622 admin admin] Authenticating user token {{(pid=80396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:49:49.955142 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31b650f6-9f70-4025-aef4-9a4c74136622 admin admin] Validating token access rules against request {{(pid=80396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:49:50.001621 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG dbcounter [-] [80396] Writing DB stats keystone:DELETE=5,keystone:SELECT=94,keystone:INSERT=1 {{(pid=80396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 16:49:50.014605 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dfcdef5-45f2-49e0-bbe6-5be6d890ebde admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f73d5a98be74242b45222df39fb6213', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:49:50.015262 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dfcdef5-45f2-49e0-bbe6-5be6d890ebde admin admin] REQUEST_METHOD: `POST` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:49:50.015545 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dfcdef5-45f2-49e0-bbe6-5be6d890ebde admin admin] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:49:50.015820 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dfcdef5-45f2-49e0-bbe6-5be6d890ebde admin admin] PATH_INFO: `/v3/users` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:49:50.016515 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dfcdef5-45f2-49e0-bbe6-5be6d890ebde admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:49:50.018475 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dfcdef5-45f2-49e0-bbe6-5be6d890ebde admin admin] RBAC: Authorization granted {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:49:50.099182 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 1402/2814] 10.222.0.59 () {60 vars in 1143 bytes} [Thu Jun 2 16:49:49 2022] POST /identity/v3/users => generated 288 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 02 16:49:50.102519 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82497243-4421-451e-b979-d52b3feb1998 admin admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:49:50.112870 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82497243-4421-451e-b979-d52b3feb1998 admin admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:49:50.117988 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aacedf8a-9959-4be4-83b5-40c19226ec46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f73d5a98be74242b45222df39fb6213', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:49:50.119037 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aacedf8a-9959-4be4-83b5-40c19226ec46 admin admin] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:49:50.119321 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aacedf8a-9959-4be4-83b5-40c19226ec46 admin admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:49:50.119598 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aacedf8a-9959-4be4-83b5-40c19226ec46 admin admin] PATH_INFO: `/v3/roles` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:49:50.120637 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aacedf8a-9959-4be4-83b5-40c19226ec46 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:49:50.122550 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aacedf8a-9959-4be4-83b5-40c19226ec46 admin admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:49:50.132902 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 1413/2815] 10.222.0.59 () {58 vars in 1121 bytes} [Thu Jun 2 16:49:50 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 16:49:50.137272 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dfcdef5-45f2-49e0-bbe6-5be6d890ebde admin admin] Authenticating user token {{(pid=80396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:49:50.147081 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dfcdef5-45f2-49e0-bbe6-5be6d890ebde admin admin] Validating token access rules against request {{(pid=80396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:49:50.152197 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e9e8b0f-e43c-45aa-bf15-3beca73b578e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f73d5a98be74242b45222df39fb6213', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:49:50.152838 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e9e8b0f-e43c-45aa-bf15-3beca73b578e admin admin] REQUEST_METHOD: `GET` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:49:50.153116 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e9e8b0f-e43c-45aa-bf15-3beca73b578e admin admin] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:49:50.153389 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e9e8b0f-e43c-45aa-bf15-3beca73b578e admin admin] PATH_INFO: `/v3/roles` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:49:50.154131 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e9e8b0f-e43c-45aa-bf15-3beca73b578e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:49:50.155736 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e9e8b0f-e43c-45aa-bf15-3beca73b578e admin admin] RBAC: Authorization granted {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:49:50.165769 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 1403/2816] 10.222.0.59 () {58 vars in 1121 bytes} [Thu Jun 2 16:49:50 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 16:49:50.169812 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aacedf8a-9959-4be4-83b5-40c19226ec46 admin admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:49:50.183337 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aacedf8a-9959-4be4-83b5-40c19226ec46 admin admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:49:50.188043 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8233af71-4073-4e8f-b9fb-9deed6f1227f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f73d5a98be74242b45222df39fb6213', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:49:50.193661 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8233af71-4073-4e8f-b9fb-9deed6f1227f admin admin] REQUEST_METHOD: `PUT` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:49:50.193661 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8233af71-4073-4e8f-b9fb-9deed6f1227f admin admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:49:50.193661 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8233af71-4073-4e8f-b9fb-9deed6f1227f admin admin] PATH_INFO: `/v3/projects/f97dd513af884a4f8ed4cf9cfdb7ab6c/users/e190ae90ab8f4dcbbb3d5e14ef8dffd2/roles/649e0f2b5a264c419ea6a1441f123a03` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:49:50.205818 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8233af71-4073-4e8f-b9fb-9deed6f1227f admin admin] RBAC: Authorizing `identity:create_grant(project_id=f97dd513af884a4f8ed4cf9cfdb7ab6c, user_id=e190ae90ab8f4dcbbb3d5e14ef8dffd2, role_id=649e0f2b5a264c419ea6a1441f123a03)` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:49:50.208523 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8233af71-4073-4e8f-b9fb-9deed6f1227f admin admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:49:50.304441 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 1414/2817] 10.222.0.59 () {60 vars in 1482 bytes} [Thu Jun 2 16:49:50 2022] PUT /identity/v3/projects/f97dd513af884a4f8ed4cf9cfdb7ab6c/users/e190ae90ab8f4dcbbb3d5e14ef8dffd2/roles/649e0f2b5a264c419ea6a1441f123a03 => generated 0 bytes in 135 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 16:49:50.315859 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea569b0-893e-4d82-80c8-83b19be73b65 None None] REQUEST_METHOD: `POST` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:49:50.316181 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea569b0-893e-4d82-80c8-83b19be73b65 None None] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:49:50.316632 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea569b0-893e-4d82-80c8-83b19be73b65 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:49:50.344018 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.auth.core [None req-aea569b0-893e-4d82-80c8-83b19be73b65 None None] MFA Rules not processed for user `e190ae90ab8f4dcbbb3d5e14ef8dffd2`. Rule list: `[]` (Enabled: `True`). {{(pid=80396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 16:49:50.345214 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.fernet_utils [None req-aea569b0-893e-4d82-80c8-83b19be73b65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:49:50.409031 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 1404/2818] 10.222.0.59 () {58 vars in 957 bytes} [Thu Jun 2 16:49:50 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 16:49:50.413659 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8233af71-4073-4e8f-b9fb-9deed6f1227f admin admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:49:50.477381 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8233af71-4073-4e8f-b9fb-9deed6f1227f admin admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:49:50.482191 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f4bedef-08ce-4bc4-9393-30feb5ef9829 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f73d5a98be74242b45222df39fb6213', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:49:50.482849 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4bedef-08ce-4bc4-9393-30feb5ef9829 admin admin] REQUEST_METHOD: `POST` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:49:50.483132 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4bedef-08ce-4bc4-9393-30feb5ef9829 admin admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:49:50.483430 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4bedef-08ce-4bc4-9393-30feb5ef9829 admin admin] PATH_INFO: `/v3/projects` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:49:50.484122 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f4bedef-08ce-4bc4-9393-30feb5ef9829 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:49:50.486052 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f4bedef-08ce-4bc4-9393-30feb5ef9829 admin admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:49:50.571322 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 16:49:50.579258 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 1415/2819] 10.222.0.59 () {60 vars in 1152 bytes} [Thu Jun 2 16:49:50 2022] POST /identity/v3/projects => generated 373 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 02 16:49:50.583931 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aea569b0-893e-4d82-80c8-83b19be73b65 None None] Authenticating user token {{(pid=80396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:49:50.594328 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aea569b0-893e-4d82-80c8-83b19be73b65 None None] Validating token access rules against request {{(pid=80396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:49:50.651164 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce4650b6-7d9d-478e-8389-d40f06283f2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f73d5a98be74242b45222df39fb6213', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:49:50.651937 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4650b6-7d9d-478e-8389-d40f06283f2a admin admin] REQUEST_METHOD: `POST` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:49:50.652215 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4650b6-7d9d-478e-8389-d40f06283f2a admin admin] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:49:50.652489 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4650b6-7d9d-478e-8389-d40f06283f2a admin admin] PATH_INFO: `/v3/users` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:49:50.653248 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce4650b6-7d9d-478e-8389-d40f06283f2a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:49:50.655180 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce4650b6-7d9d-478e-8389-d40f06283f2a admin admin] RBAC: Authorization granted {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:49:50.733770 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 1405/2820] 10.222.0.59 () {60 vars in 1143 bytes} [Thu Jun 2 16:49:50 2022] POST /identity/v3/users => generated 293 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 16:49:50.737843 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f4bedef-08ce-4bc4-9393-30feb5ef9829 admin admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:49:50.749732 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f4bedef-08ce-4bc4-9393-30feb5ef9829 admin admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:49:50.754488 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d3b5610-77ba-463c-b0ec-1b9cd41e47bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f73d5a98be74242b45222df39fb6213', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:49:50.755140 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3b5610-77ba-463c-b0ec-1b9cd41e47bc admin admin] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:49:50.755420 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3b5610-77ba-463c-b0ec-1b9cd41e47bc admin admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:49:50.755696 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3b5610-77ba-463c-b0ec-1b9cd41e47bc admin admin] PATH_INFO: `/v3/roles` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:49:50.756417 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d3b5610-77ba-463c-b0ec-1b9cd41e47bc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:49:50.758038 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d3b5610-77ba-463c-b0ec-1b9cd41e47bc admin admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:49:50.768434 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 1416/2821] 10.222.0.59 () {58 vars in 1121 bytes} [Thu Jun 2 16:49:50 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 02 16:49:50.772475 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce4650b6-7d9d-478e-8389-d40f06283f2a admin admin] Authenticating user token {{(pid=80396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:49:50.782935 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce4650b6-7d9d-478e-8389-d40f06283f2a admin admin] Validating token access rules against request {{(pid=80396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:49:50.787556 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-590e04d8-ebb5-47fa-a387-9ce68a9d0d4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f73d5a98be74242b45222df39fb6213', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:49:50.788427 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-590e04d8-ebb5-47fa-a387-9ce68a9d0d4c admin admin] REQUEST_METHOD: `PUT` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:49:50.788708 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-590e04d8-ebb5-47fa-a387-9ce68a9d0d4c admin admin] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:49:50.788981 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-590e04d8-ebb5-47fa-a387-9ce68a9d0d4c admin admin] PATH_INFO: `/v3/projects/e6f536be3b324b6fa4dfccff674867da/users/0b6fc7b527c0470c9a406e0a822da39c/roles/f1e0c25f6e9049e897cb7350c7e54ab3` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:49:50.804525 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-590e04d8-ebb5-47fa-a387-9ce68a9d0d4c admin admin] RBAC: Authorizing `identity:create_grant(project_id=e6f536be3b324b6fa4dfccff674867da, user_id=0b6fc7b527c0470c9a406e0a822da39c, role_id=f1e0c25f6e9049e897cb7350c7e54ab3)` {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:49:50.807373 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-590e04d8-ebb5-47fa-a387-9ce68a9d0d4c admin admin] RBAC: Authorization granted {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:49:50.879243 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 1406/2822] 10.222.0.59 () {60 vars in 1482 bytes} [Thu Jun 2 16:49:50 2022] PUT /identity/v3/projects/e6f536be3b324b6fa4dfccff674867da/users/0b6fc7b527c0470c9a406e0a822da39c/roles/f1e0c25f6e9049e897cb7350c7e54ab3 => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 16:49:50.883149 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d3b5610-77ba-463c-b0ec-1b9cd41e47bc admin admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:49:50.892946 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d3b5610-77ba-463c-b0ec-1b9cd41e47bc admin admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:49:50.949075 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d768308-2755-4e4a-81ed-09ec62613c26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f73d5a98be74242b45222df39fb6213', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:49:50.949746 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d768308-2755-4e4a-81ed-09ec62613c26 admin admin] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:49:50.950031 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d768308-2755-4e4a-81ed-09ec62613c26 admin admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:49:50.950339 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d768308-2755-4e4a-81ed-09ec62613c26 admin admin] PATH_INFO: `/v3/roles` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:49:50.951062 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d768308-2755-4e4a-81ed-09ec62613c26 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:49:50.952668 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d768308-2755-4e4a-81ed-09ec62613c26 admin admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:49:50.962556 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 1417/2823] 10.222.0.59 () {58 vars in 1121 bytes} [Thu Jun 2 16:49:50 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 02 16:49:50.966820 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-590e04d8-ebb5-47fa-a387-9ce68a9d0d4c admin admin] Authenticating user token {{(pid=80396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:49:50.977109 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-590e04d8-ebb5-47fa-a387-9ce68a9d0d4c admin admin] Validating token access rules against request {{(pid=80396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:49:50.982565 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c28f417d-e768-4105-8fa0-4f3be267e8ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f73d5a98be74242b45222df39fb6213', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:49:50.983447 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28f417d-e768-4105-8fa0-4f3be267e8ee admin admin] REQUEST_METHOD: `PUT` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:49:50.983718 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28f417d-e768-4105-8fa0-4f3be267e8ee admin admin] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:49:50.984042 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28f417d-e768-4105-8fa0-4f3be267e8ee admin admin] PATH_INFO: `/v3/projects/e6f536be3b324b6fa4dfccff674867da/users/0b6fc7b527c0470c9a406e0a822da39c/roles/f1e0c25f6e9049e897cb7350c7e54ab3` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:49:50.985939 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c28f417d-e768-4105-8fa0-4f3be267e8ee admin admin] RBAC: Authorizing `identity:create_grant(project_id=e6f536be3b324b6fa4dfccff674867da, user_id=0b6fc7b527c0470c9a406e0a822da39c, role_id=f1e0c25f6e9049e897cb7350c7e54ab3)` {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:49:50.988639 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c28f417d-e768-4105-8fa0-4f3be267e8ee admin admin] RBAC: Authorization granted {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:49:50.999386 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 1407/2824] 10.222.0.59 () {60 vars in 1482 bytes} [Thu Jun 2 16:49:50 2022] PUT /identity/v3/projects/e6f536be3b324b6fa4dfccff674867da/users/0b6fc7b527c0470c9a406e0a822da39c/roles/f1e0c25f6e9049e897cb7350c7e54ab3 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 16:49:51.009439 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14d2808-b0df-4ebb-811b-85623c8c6640 None None] REQUEST_METHOD: `POST` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:49:51.009737 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14d2808-b0df-4ebb-811b-85623c8c6640 None None] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:49:51.010021 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14d2808-b0df-4ebb-811b-85623c8c6640 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:49:51.036485 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.auth.core [None req-d14d2808-b0df-4ebb-811b-85623c8c6640 None None] MFA Rules not processed for user `0b6fc7b527c0470c9a406e0a822da39c`. Rule list: `[]` (Enabled: `True`). {{(pid=80395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 16:49:51.037762 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.fernet_utils [None req-d14d2808-b0df-4ebb-811b-85623c8c6640 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:49:51.105136 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 1418/2825] 10.222.0.59 () {58 vars in 957 bytes} [Thu Jun 2 16:49:51 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 16:49:51.116345 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c28f417d-e768-4105-8fa0-4f3be267e8ee admin admin] Authenticating user token {{(pid=80396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:49:51.117992 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.fernet_utils [None req-c28f417d-e768-4105-8fa0-4f3be267e8ee admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:49:51.128018 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG dbcounter [-] [80396] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=80396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 16:49:51.176912 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c28f417d-e768-4105-8fa0-4f3be267e8ee admin admin] Validating token access rules against request {{(pid=80396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:49:51.180868 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec261132-2cfc-49a4-9182-98b14390803a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6534961c369940a5b88f310c6450250b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c87c981909d4b8db02783421818c79b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:49:51.181511 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec261132-2cfc-49a4-9182-98b14390803a service cinder] REQUEST_METHOD: `GET` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:49:51.181797 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec261132-2cfc-49a4-9182-98b14390803a service cinder] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:49:51.182099 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec261132-2cfc-49a4-9182-98b14390803a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:49:51.241323 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec261132-2cfc-49a4-9182-98b14390803a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:49:51.242715 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec261132-2cfc-49a4-9182-98b14390803a service cinder] RBAC: Authorization granted {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:49:51.252214 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 1408/2826] 10.222.0.59 () {60 vars in 1365 bytes} [Thu Jun 2 16:49:51 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 136 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 16:49:54.191511 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d14d2808-b0df-4ebb-811b-85623c8c6640 None None] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:49:54.252633 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d14d2808-b0df-4ebb-811b-85623c8c6640 None None] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:49:54.257080 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdfbc6bc-91eb-4b34-9533-691d4b5ca0d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f73d5a98be74242b45222df39fb6213', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:49:54.257931 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdfbc6bc-91eb-4b34-9533-691d4b5ca0d5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:49:54.258243 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdfbc6bc-91eb-4b34-9533-691d4b5ca0d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:49:54.258521 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdfbc6bc-91eb-4b34-9533-691d4b5ca0d5 admin admin] PATH_INFO: `/v3/users/e190ae90ab8f4dcbbb3d5e14ef8dffd2` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:49:54.259695 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdfbc6bc-91eb-4b34-9533-691d4b5ca0d5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e190ae90ab8f4dcbbb3d5e14ef8dffd2)` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:49:54.262450 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdfbc6bc-91eb-4b34-9533-691d4b5ca0d5 admin admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:49:54.272532 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writing DB stats keystone:SELECT=100 {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 16:49:54.438815 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.notifications [None req-cdfbc6bc-91eb-4b34-9533-691d4b5ca0d5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e190ae90ab8f4dcbbb3d5e14ef8dffd2'} {{(pid=80395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:49:54.515686 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.notifications [None req-cdfbc6bc-91eb-4b34-9533-691d4b5ca0d5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e190ae90ab8f4dcbbb3d5e14ef8dffd2'} {{(pid=80395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:49:54.528794 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.notifications [None req-cdfbc6bc-91eb-4b34-9533-691d4b5ca0d5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e190ae90ab8f4dcbbb3d5e14ef8dffd2'} {{(pid=80395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:49:54.529454 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.notifications [None req-cdfbc6bc-91eb-4b34-9533-691d4b5ca0d5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e190ae90ab8f4dcbbb3d5e14ef8dffd2'} {{(pid=80395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:49:54.537047 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.notifications [None req-cdfbc6bc-91eb-4b34-9533-691d4b5ca0d5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e190ae90ab8f4dcbbb3d5e14ef8dffd2'} {{(pid=80395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:49:54.543850 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 1419/2827] 10.222.0.59 () {58 vars in 1223 bytes} [Thu Jun 2 16:49:54 2022] DELETE /identity/v3/users/e190ae90ab8f4dcbbb3d5e14ef8dffd2 => generated 0 bytes in 353 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 16:49:54.549347 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5536fbb-3e31-461e-add9-b6aa23151b7c None None] REQUEST_METHOD: `POST` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:49:54.549837 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5536fbb-3e31-461e-add9-b6aa23151b7c None None] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:49:54.549925 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5536fbb-3e31-461e-add9-b6aa23151b7c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:49:54.567940 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.auth.core [None req-a5536fbb-3e31-461e-add9-b6aa23151b7c None None] MFA Rules not processed for user `400d1f4db9de49638549e5db29a041e1`. Rule list: `[]` (Enabled: `True`). {{(pid=80396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 16:49:54.569148 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.fernet_utils [None req-a5536fbb-3e31-461e-add9-b6aa23151b7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:49:54.629988 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 1409/2828] 10.222.0.59 () {58 vars in 957 bytes} [Thu Jun 2 16:49:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 02 16:49:54.640026 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdfbc6bc-91eb-4b34-9533-691d4b5ca0d5 admin admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:49:54.641468 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.fernet_utils [None req-cdfbc6bc-91eb-4b34-9533-691d4b5ca0d5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:49:54.699231 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdfbc6bc-91eb-4b34-9533-691d4b5ca0d5 admin admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:49:54.703030 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-314125b7-b71c-48f2-b82b-27b239184e0a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9af40ddfe9ff4be3887b068f13a28dc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c87c981909d4b8db02783421818c79b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:49:54.703669 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314125b7-b71c-48f2-b82b-27b239184e0a service neutron] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:49:54.703952 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314125b7-b71c-48f2-b82b-27b239184e0a service neutron] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:49:54.704232 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314125b7-b71c-48f2-b82b-27b239184e0a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:49:54.713156 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-314125b7-b71c-48f2-b82b-27b239184e0a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:49:54.715416 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-314125b7-b71c-48f2-b82b-27b239184e0a service neutron] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:49:54.724643 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 1420/2829] 10.222.0.59 () {60 vars in 1365 bytes} [Thu Jun 2 16:49:54 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 16:49:55.105389 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5536fbb-3e31-461e-add9-b6aa23151b7c None None] Authenticating user token {{(pid=80396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:49:55.107044 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.fernet_utils [None req-a5536fbb-3e31-461e-add9-b6aa23151b7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:49:55.122612 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5536fbb-3e31-461e-add9-b6aa23151b7c None None] Validating token access rules against request {{(pid=80396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:49:55.127649 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d972fa-629d-4db2-ada4-07a5032323c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f73d5a98be74242b45222df39fb6213', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:49:55.128175 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d972fa-629d-4db2-ada4-07a5032323c1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:49:55.128459 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d972fa-629d-4db2-ada4-07a5032323c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:49:55.128732 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d972fa-629d-4db2-ada4-07a5032323c1 admin admin] PATH_INFO: `/v3/projects/f97dd513af884a4f8ed4cf9cfdb7ab6c` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:49:55.129977 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4d972fa-629d-4db2-ada4-07a5032323c1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f97dd513af884a4f8ed4cf9cfdb7ab6c)` {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:49:55.131946 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4d972fa-629d-4db2-ada4-07a5032323c1 admin admin] RBAC: Authorization granted {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:49:55.241572 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.notifications [None req-a4d972fa-629d-4db2-ada4-07a5032323c1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f97dd513af884a4f8ed4cf9cfdb7ab6c', 'request_id': 'req-a4d972fa-629d-4db2-ada4-07a5032323c1'} {{(pid=80396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:49:55.248199 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.notifications [None req-a4d972fa-629d-4db2-ada4-07a5032323c1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f97dd513af884a4f8ed4cf9cfdb7ab6c', 'request_id': 'req-a4d972fa-629d-4db2-ada4-07a5032323c1'} {{(pid=80396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:49:55.250716 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG dbcounter [-] [80396] Writing DB stats keystone:SELECT=95,keystone:DELETE=4,keystone:INSERT=1 {{(pid=80396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 16:49:55.321229 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.notifications [None req-a4d972fa-629d-4db2-ada4-07a5032323c1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f97dd513af884a4f8ed4cf9cfdb7ab6c', 'request_id': 'req-a4d972fa-629d-4db2-ada4-07a5032323c1'} {{(pid=80396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:49:55.332841 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.notifications [None req-a4d972fa-629d-4db2-ada4-07a5032323c1 admin admin] The token cache is being invalidate because project f97dd513af884a4f8ed4cf9cfdb7ab6c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80396) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 02 16:49:55.333350 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.notifications [None req-a4d972fa-629d-4db2-ada4-07a5032323c1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:49:55.334319 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.notifications [None req-a4d972fa-629d-4db2-ada4-07a5032323c1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:49:55.336043 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 1410/2830] 10.222.0.59 () {58 vars in 1232 bytes} [Thu Jun 2 16:49:55 2022] DELETE /identity/v3/projects/f97dd513af884a4f8ed4cf9cfdb7ab6c => generated 0 bytes in 231 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 16:49:55.347356 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-314125b7-b71c-48f2-b82b-27b239184e0a service neutron] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:49:55.357096 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-314125b7-b71c-48f2-b82b-27b239184e0a service neutron] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:49:55.414645 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de0cbe98-85f0-40f3-b80c-4bcfff1ead89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f73d5a98be74242b45222df39fb6213', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:49:55.415503 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de0cbe98-85f0-40f3-b80c-4bcfff1ead89 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:49:55.415780 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de0cbe98-85f0-40f3-b80c-4bcfff1ead89 admin admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:49:55.416051 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de0cbe98-85f0-40f3-b80c-4bcfff1ead89 admin admin] PATH_INFO: `/v3/users/0b6fc7b527c0470c9a406e0a822da39c` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:49:55.417218 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de0cbe98-85f0-40f3-b80c-4bcfff1ead89 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0b6fc7b527c0470c9a406e0a822da39c)` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:49:55.419185 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de0cbe98-85f0-40f3-b80c-4bcfff1ead89 admin admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:49:55.595438 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writing DB stats keystone:DELETE=15,keystone:SELECT=84,keystone:INSERT=1 {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 16:49:55.607862 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.notifications [None req-de0cbe98-85f0-40f3-b80c-4bcfff1ead89 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0b6fc7b527c0470c9a406e0a822da39c'} {{(pid=80395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:49:55.679180 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.notifications [None req-de0cbe98-85f0-40f3-b80c-4bcfff1ead89 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0b6fc7b527c0470c9a406e0a822da39c'} {{(pid=80395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:49:55.691994 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.notifications [None req-de0cbe98-85f0-40f3-b80c-4bcfff1ead89 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0b6fc7b527c0470c9a406e0a822da39c'} {{(pid=80395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:49:55.692624 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.notifications [None req-de0cbe98-85f0-40f3-b80c-4bcfff1ead89 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0b6fc7b527c0470c9a406e0a822da39c'} {{(pid=80395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:49:55.699839 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.notifications [None req-de0cbe98-85f0-40f3-b80c-4bcfff1ead89 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0b6fc7b527c0470c9a406e0a822da39c'} {{(pid=80395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:49:55.705833 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 1421/2831] 10.222.0.59 () {58 vars in 1223 bytes} [Thu Jun 2 16:49:55 2022] DELETE /identity/v3/users/0b6fc7b527c0470c9a406e0a822da39c => generated 0 bytes in 359 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 16:49:56.112483 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d972fa-629d-4db2-ada4-07a5032323c1 admin admin] Authenticating user token {{(pid=80396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:49:56.113995 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.fernet_utils [None req-a4d972fa-629d-4db2-ada4-07a5032323c1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:49:56.130438 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d972fa-629d-4db2-ada4-07a5032323c1 admin admin] Validating token access rules against request {{(pid=80396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:49:56.189059 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1dc3c30-00e7-445a-a970-aa9ce16634b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f73d5a98be74242b45222df39fb6213', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:49:56.189917 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1dc3c30-00e7-445a-a970-aa9ce16634b5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:49:56.190239 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1dc3c30-00e7-445a-a970-aa9ce16634b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:49:56.190521 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1dc3c30-00e7-445a-a970-aa9ce16634b5 admin admin] PATH_INFO: `/v3/projects/e6f536be3b324b6fa4dfccff674867da` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:49:56.191726 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1dc3c30-00e7-445a-a970-aa9ce16634b5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e6f536be3b324b6fa4dfccff674867da)` {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:49:56.193613 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1dc3c30-00e7-445a-a970-aa9ce16634b5 admin admin] RBAC: Authorization granted {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:49:56.302389 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.notifications [None req-d1dc3c30-00e7-445a-a970-aa9ce16634b5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e6f536be3b324b6fa4dfccff674867da', 'request_id': 'req-d1dc3c30-00e7-445a-a970-aa9ce16634b5'} {{(pid=80396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:49:56.308467 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.notifications [None req-d1dc3c30-00e7-445a-a970-aa9ce16634b5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e6f536be3b324b6fa4dfccff674867da', 'request_id': 'req-d1dc3c30-00e7-445a-a970-aa9ce16634b5'} {{(pid=80396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:49:56.365024 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.notifications [None req-d1dc3c30-00e7-445a-a970-aa9ce16634b5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e6f536be3b324b6fa4dfccff674867da', 'request_id': 'req-d1dc3c30-00e7-445a-a970-aa9ce16634b5'} {{(pid=80396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:49:56.375873 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.notifications [None req-d1dc3c30-00e7-445a-a970-aa9ce16634b5 admin admin] The token cache is being invalidate because project e6f536be3b324b6fa4dfccff674867da was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80396) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 02 16:49:56.376158 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.notifications [None req-d1dc3c30-00e7-445a-a970-aa9ce16634b5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:49:56.376779 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.notifications [None req-d1dc3c30-00e7-445a-a970-aa9ce16634b5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:49:56.378328 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 1411/2832] 10.222.0.59 () {58 vars in 1232 bytes} [Thu Jun 2 16:49:56 2022] DELETE /identity/v3/projects/e6f536be3b324b6fa4dfccff674867da => generated 0 bytes in 266 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 16:49:56.383178 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dac83ab-ab54-4cad-bfbc-ab6c2168ee4b None None] REQUEST_METHOD: `POST` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:49:56.383630 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dac83ab-ab54-4cad-bfbc-ab6c2168ee4b None None] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:49:56.383730 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dac83ab-ab54-4cad-bfbc-ab6c2168ee4b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:49:56.401486 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.auth.core [None req-3dac83ab-ab54-4cad-bfbc-ab6c2168ee4b None None] MFA Rules not processed for user `400d1f4db9de49638549e5db29a041e1`. Rule list: `[]` (Enabled: `True`). {{(pid=80395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 16:49:56.403357 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.fernet_utils [None req-3dac83ab-ab54-4cad-bfbc-ab6c2168ee4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:49:56.461979 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 1422/2833] 10.222.0.59 () {58 vars in 957 bytes} [Thu Jun 2 16:49:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 16:49:56.471299 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343a435f-cb0b-4f5c-b7e0-146d697f2041 None None] REQUEST_METHOD: `POST` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:49:56.471584 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343a435f-cb0b-4f5c-b7e0-146d697f2041 None None] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:49:56.471864 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343a435f-cb0b-4f5c-b7e0-146d697f2041 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:49:56.490501 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.auth.core [None req-343a435f-cb0b-4f5c-b7e0-146d697f2041 None None] MFA Rules not processed for user `400d1f4db9de49638549e5db29a041e1`. Rule list: `[]` (Enabled: `True`). {{(pid=80396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 16:49:56.491685 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.fernet_utils [None req-343a435f-cb0b-4f5c-b7e0-146d697f2041 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:49:56.499754 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 1412/2834] 10.222.0.59 () {58 vars in 957 bytes} [Thu Jun 2 16:49:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 16:49:56.503834 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dac83ab-ab54-4cad-bfbc-ab6c2168ee4b None None] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:49:56.513533 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dac83ab-ab54-4cad-bfbc-ab6c2168ee4b None None] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:49:56.518098 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0f99500-b6b5-4d41-a6c6-f8150040a5fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f73d5a98be74242b45222df39fb6213', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:49:56.518770 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f99500-b6b5-4d41-a6c6-f8150040a5fb admin admin] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:49:56.519052 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f99500-b6b5-4d41-a6c6-f8150040a5fb admin admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:49:56.519328 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f99500-b6b5-4d41-a6c6-f8150040a5fb admin admin] PATH_INFO: `/v3/domains` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:49:56.520048 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0f99500-b6b5-4d41-a6c6-f8150040a5fb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80395) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 16:49:56.520353 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0f99500-b6b5-4d41-a6c6-f8150040a5fb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:49:56.521946 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0f99500-b6b5-4d41-a6c6-f8150040a5fb admin admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:49:56.534278 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 1423/2835] 10.222.0.59 () {58 vars in 1152 bytes} [Thu Jun 2 16:49:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 16:49:56.538952 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-343a435f-cb0b-4f5c-b7e0-146d697f2041 None None] Authenticating user token {{(pid=80396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:49:56.549235 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-343a435f-cb0b-4f5c-b7e0-146d697f2041 None None] Validating token access rules against request {{(pid=80396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:49:56.553869 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5136c62-0ce3-4520-b758-9306797c5901 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f73d5a98be74242b45222df39fb6213', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:49:56.554549 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5136c62-0ce3-4520-b758-9306797c5901 admin admin] REQUEST_METHOD: `POST` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:49:56.554839 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5136c62-0ce3-4520-b758-9306797c5901 admin admin] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:49:56.555120 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5136c62-0ce3-4520-b758-9306797c5901 admin admin] PATH_INFO: `/v3/projects` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:49:56.555832 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5136c62-0ce3-4520-b758-9306797c5901 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:49:56.557724 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5136c62-0ce3-4520-b758-9306797c5901 admin admin] RBAC: Authorization granted {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:49:56.641461 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 1413/2836] 10.222.0.59 () {60 vars in 1152 bytes} [Thu Jun 2 16:49:56 2022] POST /identity/v3/projects => generated 397 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 16:49:56.645905 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0f99500-b6b5-4d41-a6c6-f8150040a5fb admin admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:49:56.656844 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0f99500-b6b5-4d41-a6c6-f8150040a5fb admin admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:49:56.713007 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9072993-3653-462e-b6c3-8a70a8294201 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f73d5a98be74242b45222df39fb6213', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:49:56.713673 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9072993-3653-462e-b6c3-8a70a8294201 admin admin] REQUEST_METHOD: `POST` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:49:56.713959 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9072993-3653-462e-b6c3-8a70a8294201 admin admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:49:56.714274 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9072993-3653-462e-b6c3-8a70a8294201 admin admin] PATH_INFO: `/v3/users` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:49:56.714966 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9072993-3653-462e-b6c3-8a70a8294201 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:49:56.717465 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9072993-3653-462e-b6c3-8a70a8294201 admin admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:49:56.806922 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 1424/2837] 10.222.0.59 () {60 vars in 1143 bytes} [Thu Jun 2 16:49:56 2022] POST /identity/v3/users => generated 299 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 16:49:56.811331 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5136c62-0ce3-4520-b758-9306797c5901 admin admin] Authenticating user token {{(pid=80396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:49:56.821531 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5136c62-0ce3-4520-b758-9306797c5901 admin admin] Validating token access rules against request {{(pid=80396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:49:56.826624 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8727748-d137-413a-861c-52fa48073291 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f73d5a98be74242b45222df39fb6213', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:49:56.827266 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8727748-d137-413a-861c-52fa48073291 admin admin] REQUEST_METHOD: `GET` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:49:56.827547 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8727748-d137-413a-861c-52fa48073291 admin admin] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:49:56.827821 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8727748-d137-413a-861c-52fa48073291 admin admin] PATH_INFO: `/v3/roles` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:49:56.828542 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8727748-d137-413a-861c-52fa48073291 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:49:56.830144 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8727748-d137-413a-861c-52fa48073291 admin admin] RBAC: Authorization granted {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:49:56.841232 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 1414/2838] 10.222.0.59 () {58 vars in 1121 bytes} [Thu Jun 2 16:49:56 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 02 16:49:56.845197 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9072993-3653-462e-b6c3-8a70a8294201 admin admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:49:56.855178 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9072993-3653-462e-b6c3-8a70a8294201 admin admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:49:56.859827 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4814c67-1cf2-44dc-9f95-949fd36b0715 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f73d5a98be74242b45222df39fb6213', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:49:56.860654 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4814c67-1cf2-44dc-9f95-949fd36b0715 admin admin] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:49:56.860944 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4814c67-1cf2-44dc-9f95-949fd36b0715 admin admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:49:56.861220 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4814c67-1cf2-44dc-9f95-949fd36b0715 admin admin] PATH_INFO: `/v3/roles` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:49:56.861943 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4814c67-1cf2-44dc-9f95-949fd36b0715 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:49:56.863564 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4814c67-1cf2-44dc-9f95-949fd36b0715 admin admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:49:56.873837 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 1425/2839] 10.222.0.59 () {58 vars in 1121 bytes} [Thu Jun 2 16:49:56 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 16:49:56.877816 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8727748-d137-413a-861c-52fa48073291 admin admin] Authenticating user token {{(pid=80396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:49:56.887943 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8727748-d137-413a-861c-52fa48073291 admin admin] Validating token access rules against request {{(pid=80396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:49:56.892403 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06b0ffaf-57e2-496f-b169-4cf4017aa2e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f73d5a98be74242b45222df39fb6213', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:49:56.893258 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b0ffaf-57e2-496f-b169-4cf4017aa2e4 admin admin] REQUEST_METHOD: `PUT` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:49:56.893536 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b0ffaf-57e2-496f-b169-4cf4017aa2e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:49:56.893810 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b0ffaf-57e2-496f-b169-4cf4017aa2e4 admin admin] PATH_INFO: `/v3/projects/9fd1158ea8f34f6080ac96804e617c11/users/f0353db062ef4878b8af303736a30324/roles/649e0f2b5a264c419ea6a1441f123a03` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:49:56.908645 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06b0ffaf-57e2-496f-b169-4cf4017aa2e4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9fd1158ea8f34f6080ac96804e617c11, user_id=f0353db062ef4878b8af303736a30324, role_id=649e0f2b5a264c419ea6a1441f123a03)` {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:49:56.911223 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06b0ffaf-57e2-496f-b169-4cf4017aa2e4 admin admin] RBAC: Authorization granted {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:49:56.972867 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 1415/2840] 10.222.0.59 () {60 vars in 1482 bytes} [Thu Jun 2 16:49:56 2022] PUT /identity/v3/projects/9fd1158ea8f34f6080ac96804e617c11/users/f0353db062ef4878b8af303736a30324/roles/649e0f2b5a264c419ea6a1441f123a03 => generated 0 bytes in 95 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 02 16:49:56.983723 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e4afd1-5eb6-4992-9478-47fa0c8233ff None None] REQUEST_METHOD: `POST` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:49:56.984016 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e4afd1-5eb6-4992-9478-47fa0c8233ff None None] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:49:56.984294 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e4afd1-5eb6-4992-9478-47fa0c8233ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:49:57.011634 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.auth.core [None req-23e4afd1-5eb6-4992-9478-47fa0c8233ff None None] MFA Rules not processed for user `f0353db062ef4878b8af303736a30324`. Rule list: `[]` (Enabled: `True`). {{(pid=80395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 16:49:57.013677 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.fernet_utils [None req-23e4afd1-5eb6-4992-9478-47fa0c8233ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:49:57.017716 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writing DB stats keystone:SELECT=91,keystone:DELETE=5,keystone:INSERT=4 {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 16:49:57.078144 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 1426/2841] 10.222.0.59 () {58 vars in 957 bytes} [Thu Jun 2 16:49:56 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 16:49:57.089440 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06b0ffaf-57e2-496f-b169-4cf4017aa2e4 admin admin] Authenticating user token {{(pid=80396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:49:57.091191 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.fernet_utils [None req-06b0ffaf-57e2-496f-b169-4cf4017aa2e4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:49:57.104610 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG dbcounter [-] [80396] Writing DB stats keystone:DELETE=10,keystone:SELECT=87,keystone:INSERT=3 {{(pid=80396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 16:49:57.148224 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06b0ffaf-57e2-496f-b169-4cf4017aa2e4 admin admin] Validating token access rules against request {{(pid=80396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:49:57.151896 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8369477d-7da1-4a82-9407-d3443fa7f6a5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6534961c369940a5b88f310c6450250b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c87c981909d4b8db02783421818c79b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:49:57.152545 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8369477d-7da1-4a82-9407-d3443fa7f6a5 service cinder] REQUEST_METHOD: `GET` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:49:57.153026 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8369477d-7da1-4a82-9407-d3443fa7f6a5 service cinder] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:49:57.153519 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8369477d-7da1-4a82-9407-d3443fa7f6a5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:49:57.161934 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8369477d-7da1-4a82-9407-d3443fa7f6a5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:49:57.163365 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8369477d-7da1-4a82-9407-d3443fa7f6a5 service cinder] RBAC: Authorization granted {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:49:57.173119 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 1416/2842] 10.222.0.59 () {60 vars in 1365 bytes} [Thu Jun 2 16:49:57 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 16:50:07.024480 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23e4afd1-5eb6-4992-9478-47fa0c8233ff None None] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:50:07.086558 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23e4afd1-5eb6-4992-9478-47fa0c8233ff None None] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:50:07.090982 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11116571-1fb4-493d-b63f-2d36fc047122 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f73d5a98be74242b45222df39fb6213', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:50:07.091836 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11116571-1fb4-493d-b63f-2d36fc047122 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:50:07.092115 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11116571-1fb4-493d-b63f-2d36fc047122 admin admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:50:07.092383 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11116571-1fb4-493d-b63f-2d36fc047122 admin admin] PATH_INFO: `/v3/users/f0353db062ef4878b8af303736a30324` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:50:07.093597 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11116571-1fb4-493d-b63f-2d36fc047122 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f0353db062ef4878b8af303736a30324)` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:50:07.095538 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11116571-1fb4-493d-b63f-2d36fc047122 admin admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:50:07.201853 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG dbcounter [-] [80396] Writing DB stats keystone:SELECT=21 {{(pid=80396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 16:50:07.232713 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.notifications [None req-11116571-1fb4-493d-b63f-2d36fc047122 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f0353db062ef4878b8af303736a30324'} {{(pid=80395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:50:07.286875 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.notifications [None req-11116571-1fb4-493d-b63f-2d36fc047122 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f0353db062ef4878b8af303736a30324'} {{(pid=80395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:50:07.299776 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.notifications [None req-11116571-1fb4-493d-b63f-2d36fc047122 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f0353db062ef4878b8af303736a30324'} {{(pid=80395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:50:07.307596 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.notifications [None req-11116571-1fb4-493d-b63f-2d36fc047122 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f0353db062ef4878b8af303736a30324'} {{(pid=80395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:50:07.307596 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.notifications [None req-11116571-1fb4-493d-b63f-2d36fc047122 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f0353db062ef4878b8af303736a30324'} {{(pid=80395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:50:07.313858 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 1427/2843] 10.222.0.59 () {58 vars in 1223 bytes} [Thu Jun 2 16:50:07 2022] DELETE /identity/v3/users/f0353db062ef4878b8af303736a30324 => generated 0 bytes in 290 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 16:50:07.318357 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ed6504-f9ed-47d5-abf3-3b3f10146868 None None] REQUEST_METHOD: `POST` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:50:07.318648 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ed6504-f9ed-47d5-abf3-3b3f10146868 None None] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:50:07.318943 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ed6504-f9ed-47d5-abf3-3b3f10146868 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:50:07.345901 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.auth.core [None req-89ed6504-f9ed-47d5-abf3-3b3f10146868 None None] MFA Rules not processed for user `400d1f4db9de49638549e5db29a041e1`. Rule list: `[]` (Enabled: `True`). {{(pid=80396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 16:50:07.347154 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.fernet_utils [None req-89ed6504-f9ed-47d5-abf3-3b3f10146868 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:50:07.407376 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 1417/2844] 10.222.0.59 () {58 vars in 957 bytes} [Thu Jun 2 16:50:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 16:50:07.417033 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11116571-1fb4-493d-b63f-2d36fc047122 admin admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:50:07.418583 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.fernet_utils [None req-11116571-1fb4-493d-b63f-2d36fc047122 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:50:07.447960 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 16:50:07.487303 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11116571-1fb4-493d-b63f-2d36fc047122 admin admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:50:07.490989 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25a46d8f-36c1-490a-8800-b7163358fd97 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9af40ddfe9ff4be3887b068f13a28dc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c87c981909d4b8db02783421818c79b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:50:07.491624 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a46d8f-36c1-490a-8800-b7163358fd97 service neutron] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:50:07.491906 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a46d8f-36c1-490a-8800-b7163358fd97 service neutron] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:50:07.492180 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a46d8f-36c1-490a-8800-b7163358fd97 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:50:07.501597 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25a46d8f-36c1-490a-8800-b7163358fd97 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:50:07.503109 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25a46d8f-36c1-490a-8800-b7163358fd97 service neutron] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:50:07.513469 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 1428/2845] 10.222.0.59 () {60 vars in 1365 bytes} [Thu Jun 2 16:50:07 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 16:50:07.977296 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89ed6504-f9ed-47d5-abf3-3b3f10146868 None None] Authenticating user token {{(pid=80396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:50:07.977296 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.fernet_utils [None req-89ed6504-f9ed-47d5-abf3-3b3f10146868 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:50:07.978395 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25a46d8f-36c1-490a-8800-b7163358fd97 service neutron] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:50:07.978395 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.fernet_utils [None req-25a46d8f-36c1-490a-8800-b7163358fd97 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:50:07.978395 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25a46d8f-36c1-490a-8800-b7163358fd97 service neutron] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:50:07.979007 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16890558-5ddc-42b8-abab-445282d613a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f73d5a98be74242b45222df39fb6213', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:50:07.979007 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16890558-5ddc-42b8-abab-445282d613a1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:50:07.979007 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16890558-5ddc-42b8-abab-445282d613a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:50:07.979007 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16890558-5ddc-42b8-abab-445282d613a1 admin admin] PATH_INFO: `/v3/projects/9fd1158ea8f34f6080ac96804e617c11` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:50:07.979670 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16890558-5ddc-42b8-abab-445282d613a1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9fd1158ea8f34f6080ac96804e617c11)` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:50:07.979670 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16890558-5ddc-42b8-abab-445282d613a1 admin admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:50:08.008305 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89ed6504-f9ed-47d5-abf3-3b3f10146868 None None] Validating token access rules against request {{(pid=80396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:50:08.013355 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d71a185-8cec-43b8-9e3b-1106ceae7e7d service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b700f6d94374ba4b362a8f0d5b35796', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c87c981909d4b8db02783421818c79b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:50:08.014001 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d71a185-8cec-43b8-9e3b-1106ceae7e7d service placement] REQUEST_METHOD: `GET` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:50:08.014329 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d71a185-8cec-43b8-9e3b-1106ceae7e7d service placement] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:50:08.014607 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d71a185-8cec-43b8-9e3b-1106ceae7e7d service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:50:08.016581 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.fernet_utils [None req-5d71a185-8cec-43b8-9e3b-1106ceae7e7d service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:50:08.028198 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d71a185-8cec-43b8-9e3b-1106ceae7e7d service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:50:08.029917 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d71a185-8cec-43b8-9e3b-1106ceae7e7d service placement] RBAC: Authorization granted {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:50:08.039844 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 1418/2846] 10.222.0.59 () {60 vars in 1365 bytes} [Thu Jun 2 16:50:07 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 151 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 16:50:08.065630 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.notifications [None req-16890558-5ddc-42b8-abab-445282d613a1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9fd1158ea8f34f6080ac96804e617c11', 'request_id': 'req-16890558-5ddc-42b8-abab-445282d613a1'} {{(pid=80395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:50:08.071788 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.notifications [None req-16890558-5ddc-42b8-abab-445282d613a1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9fd1158ea8f34f6080ac96804e617c11', 'request_id': 'req-16890558-5ddc-42b8-abab-445282d613a1'} {{(pid=80395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:50:08.136863 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.notifications [None req-16890558-5ddc-42b8-abab-445282d613a1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9fd1158ea8f34f6080ac96804e617c11', 'request_id': 'req-16890558-5ddc-42b8-abab-445282d613a1'} {{(pid=80395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:50:08.147815 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.notifications [None req-16890558-5ddc-42b8-abab-445282d613a1 admin admin] The token cache is being invalidate because project 9fd1158ea8f34f6080ac96804e617c11 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80395) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 02 16:50:08.148107 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.notifications [None req-16890558-5ddc-42b8-abab-445282d613a1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:50:08.148780 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.notifications [None req-16890558-5ddc-42b8-abab-445282d613a1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:50:08.150360 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 1429/2847] 10.222.0.59 () {58 vars in 1232 bytes} [Thu Jun 2 16:50:07 2022] DELETE /identity/v3/projects/9fd1158ea8f34f6080ac96804e617c11 => generated 0 bytes in 216 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 02 16:50:18.035632 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG dbcounter [-] [80396] Writing DB stats keystone:SELECT=72 {{(pid=80396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 16:50:18.144669 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writing DB stats keystone:SELECT=46,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 16:50:45.699224 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d71a185-8cec-43b8-9e3b-1106ceae7e7d service placement] Authenticating user token {{(pid=80396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:50:45.700586 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.fernet_utils [None req-5d71a185-8cec-43b8-9e3b-1106ceae7e7d service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:50:45.759770 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16890558-5ddc-42b8-abab-445282d613a1 admin admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:50:45.760306 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d71a185-8cec-43b8-9e3b-1106ceae7e7d service placement] Validating token access rules against request {{(pid=80396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:50:45.761336 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.fernet_utils [None req-16890558-5ddc-42b8-abab-445282d613a1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:50:45.810873 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bcefd72-f3fe-4472-909a-982b205790f4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6534961c369940a5b88f310c6450250b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c87c981909d4b8db02783421818c79b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:50:45.811538 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bcefd72-f3fe-4472-909a-982b205790f4 service cinder] REQUEST_METHOD: `GET` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:50:45.811812 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bcefd72-f3fe-4472-909a-982b205790f4 service cinder] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:50:45.812080 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bcefd72-f3fe-4472-909a-982b205790f4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:50:45.813921 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.fernet_utils [None req-6bcefd72-f3fe-4472-909a-982b205790f4 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:50:45.819838 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16890558-5ddc-42b8-abab-445282d613a1 admin admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:50:45.824096 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6256160-0b5c-4d8d-8150-b123f374f2b6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6534961c369940a5b88f310c6450250b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c87c981909d4b8db02783421818c79b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:50:45.824945 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6256160-0b5c-4d8d-8150-b123f374f2b6 service cinder] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:50:45.825233 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6256160-0b5c-4d8d-8150-b123f374f2b6 service cinder] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:50:45.825511 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6256160-0b5c-4d8d-8150-b123f374f2b6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:50:45.827300 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.fernet_utils [None req-c6256160-0b5c-4d8d-8150-b123f374f2b6 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:50:45.875873 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bcefd72-f3fe-4472-909a-982b205790f4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:50:45.878045 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bcefd72-f3fe-4472-909a-982b205790f4 service cinder] RBAC: Authorization granted {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:50:45.887619 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 1419/2848] 10.222.0.59 () {60 vars in 1365 bytes} [Thu Jun 2 16:50:45 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 189 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 16:50:45.888201 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6256160-0b5c-4d8d-8150-b123f374f2b6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:50:45.889660 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6256160-0b5c-4d8d-8150-b123f374f2b6 service cinder] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:50:45.899412 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 1430/2849] 10.222.0.59 () {60 vars in 1365 bytes} [Thu Jun 2 16:50:45 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 140 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 02 16:50:55.883712 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG dbcounter [-] [80396] Writing DB stats keystone:SELECT=68 {{(pid=80396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 16:50:55.895042 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writing DB stats keystone:SELECT=48 {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 16:50:59.543335 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bcefd72-f3fe-4472-909a-982b205790f4 service cinder] Authenticating user token {{(pid=80396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:50:59.544760 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.fernet_utils [None req-6bcefd72-f3fe-4472-909a-982b205790f4 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:50:59.602285 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bcefd72-f3fe-4472-909a-982b205790f4 service cinder] Validating token access rules against request {{(pid=80396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:50:59.605820 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-333a7b9c-2f7b-4d5e-a5ce-b0509492bf37 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9af40ddfe9ff4be3887b068f13a28dc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c87c981909d4b8db02783421818c79b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:50:59.606497 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333a7b9c-2f7b-4d5e-a5ce-b0509492bf37 service neutron] REQUEST_METHOD: `GET` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:50:59.606784 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333a7b9c-2f7b-4d5e-a5ce-b0509492bf37 service neutron] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:50:59.607062 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333a7b9c-2f7b-4d5e-a5ce-b0509492bf37 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:50:59.608840 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.fernet_utils [None req-333a7b9c-2f7b-4d5e-a5ce-b0509492bf37 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:50:59.672738 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-333a7b9c-2f7b-4d5e-a5ce-b0509492bf37 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:50:59.674186 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-333a7b9c-2f7b-4d5e-a5ce-b0509492bf37 service neutron] RBAC: Authorization granted {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:50:59.683609 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 1420/2850] 10.222.0.59 () {60 vars in 1365 bytes} [Thu Jun 2 16:50:59 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 141 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 16:51:03.262493 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6256160-0b5c-4d8d-8150-b123f374f2b6 service cinder] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:51:03.264043 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.fernet_utils [None req-c6256160-0b5c-4d8d-8150-b123f374f2b6 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:51:03.277863 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6256160-0b5c-4d8d-8150-b123f374f2b6 service cinder] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:51:03.282695 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d995f1-7bbe-4330-8088-15bf80ab0701 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f73d5a98be74242b45222df39fb6213', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:51:03.293438 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d995f1-7bbe-4330-8088-15bf80ab0701 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:51:03.293438 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d995f1-7bbe-4330-8088-15bf80ab0701 admin admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:51:03.293438 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d995f1-7bbe-4330-8088-15bf80ab0701 admin admin] PATH_INFO: `/v3/users/f8503989cb4a4d9c8db260b403e07226` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:51:03.293438 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4d995f1-7bbe-4330-8088-15bf80ab0701 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f8503989cb4a4d9c8db260b403e07226)` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:51:03.293438 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4d995f1-7bbe-4330-8088-15bf80ab0701 admin admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:51:03.421975 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.notifications [None req-a4d995f1-7bbe-4330-8088-15bf80ab0701 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f8503989cb4a4d9c8db260b403e07226'} {{(pid=80395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:51:03.474829 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.notifications [None req-a4d995f1-7bbe-4330-8088-15bf80ab0701 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f8503989cb4a4d9c8db260b403e07226'} {{(pid=80395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:51:03.489053 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.notifications [None req-a4d995f1-7bbe-4330-8088-15bf80ab0701 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f8503989cb4a4d9c8db260b403e07226'} {{(pid=80395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:51:03.490256 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.notifications [None req-a4d995f1-7bbe-4330-8088-15bf80ab0701 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f8503989cb4a4d9c8db260b403e07226'} {{(pid=80395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:51:03.497596 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.notifications [None req-a4d995f1-7bbe-4330-8088-15bf80ab0701 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f8503989cb4a4d9c8db260b403e07226'} {{(pid=80395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:51:03.503995 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 1431/2851] 10.222.0.59 () {58 vars in 1223 bytes} [Thu Jun 2 16:51:03 2022] DELETE /identity/v3/users/f8503989cb4a4d9c8db260b403e07226 => generated 0 bytes in 242 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 16:51:03.763745 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-333a7b9c-2f7b-4d5e-a5ce-b0509492bf37 service neutron] Authenticating user token {{(pid=80396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:51:03.774467 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-333a7b9c-2f7b-4d5e-a5ce-b0509492bf37 service neutron] Validating token access rules against request {{(pid=80396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:51:03.833142 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4202dc12-61f2-408d-ae97-cf532b9f4d0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f73d5a98be74242b45222df39fb6213', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:51:03.833937 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4202dc12-61f2-408d-ae97-cf532b9f4d0c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:51:03.834253 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4202dc12-61f2-408d-ae97-cf532b9f4d0c admin admin] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:51:03.834530 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4202dc12-61f2-408d-ae97-cf532b9f4d0c admin admin] PATH_INFO: `/v3/projects/17568d6be8f640359bd4c6ec666ea168` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:51:03.835709 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4202dc12-61f2-408d-ae97-cf532b9f4d0c admin admin] RBAC: Authorizing `identity:delete_project(project_id=17568d6be8f640359bd4c6ec666ea168)` {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:51:03.837604 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4202dc12-61f2-408d-ae97-cf532b9f4d0c admin admin] RBAC: Authorization granted {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:51:03.938930 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.notifications [None req-4202dc12-61f2-408d-ae97-cf532b9f4d0c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '17568d6be8f640359bd4c6ec666ea168', 'request_id': 'req-4202dc12-61f2-408d-ae97-cf532b9f4d0c'} {{(pid=80396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:51:03.940759 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG dbcounter [-] [80396] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=80396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 16:51:03.945610 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.notifications [None req-4202dc12-61f2-408d-ae97-cf532b9f4d0c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '17568d6be8f640359bd4c6ec666ea168', 'request_id': 'req-4202dc12-61f2-408d-ae97-cf532b9f4d0c'} {{(pid=80396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:51:04.002063 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.notifications [None req-4202dc12-61f2-408d-ae97-cf532b9f4d0c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '17568d6be8f640359bd4c6ec666ea168', 'request_id': 'req-4202dc12-61f2-408d-ae97-cf532b9f4d0c'} {{(pid=80396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:51:04.012934 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.notifications [None req-4202dc12-61f2-408d-ae97-cf532b9f4d0c admin admin] The token cache is being invalidate because project 17568d6be8f640359bd4c6ec666ea168 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80396) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 02 16:51:04.015318 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.notifications [None req-4202dc12-61f2-408d-ae97-cf532b9f4d0c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:51:04.015318 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.notifications [None req-4202dc12-61f2-408d-ae97-cf532b9f4d0c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:51:04.016011 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 1421/2852] 10.222.0.59 () {58 vars in 1232 bytes} [Thu Jun 2 16:51:03 2022] DELETE /identity/v3/projects/17568d6be8f640359bd4c6ec666ea168 => generated 0 bytes in 253 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 16:51:04.021014 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c02ea2f-7db6-446a-a9a6-8aade5bb7768 None None] REQUEST_METHOD: `POST` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:51:04.021359 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c02ea2f-7db6-446a-a9a6-8aade5bb7768 None None] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:51:04.021633 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c02ea2f-7db6-446a-a9a6-8aade5bb7768 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:51:04.039187 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.auth.core [None req-9c02ea2f-7db6-446a-a9a6-8aade5bb7768 None None] MFA Rules not processed for user `400d1f4db9de49638549e5db29a041e1`. Rule list: `[]` (Enabled: `True`). {{(pid=80395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 16:51:04.040374 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.fernet_utils [None req-9c02ea2f-7db6-446a-a9a6-8aade5bb7768 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:51:04.099083 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 1432/2853] 10.222.0.59 () {58 vars in 957 bytes} [Thu Jun 2 16:51:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 02 16:51:04.106808 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f5d995-1a1f-490d-adab-6e9d65399f0b None None] REQUEST_METHOD: `POST` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:51:04.107211 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f5d995-1a1f-490d-adab-6e9d65399f0b None None] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:51:04.107489 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f5d995-1a1f-490d-adab-6e9d65399f0b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:51:04.126880 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.auth.core [None req-68f5d995-1a1f-490d-adab-6e9d65399f0b None None] MFA Rules not processed for user `400d1f4db9de49638549e5db29a041e1`. Rule list: `[]` (Enabled: `True`). {{(pid=80396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 16:51:04.128059 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.fernet_utils [None req-68f5d995-1a1f-490d-adab-6e9d65399f0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:51:04.136998 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 1422/2854] 10.222.0.59 () {58 vars in 957 bytes} [Thu Jun 2 16:51:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 16:51:04.141211 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c02ea2f-7db6-446a-a9a6-8aade5bb7768 None None] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:51:04.151226 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c02ea2f-7db6-446a-a9a6-8aade5bb7768 None None] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:51:04.155770 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-311441c2-e0b9-448c-a115-0ca4eb66b004 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f73d5a98be74242b45222df39fb6213', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:51:04.156415 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-311441c2-e0b9-448c-a115-0ca4eb66b004 admin admin] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:51:04.156699 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-311441c2-e0b9-448c-a115-0ca4eb66b004 admin admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:51:04.156976 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-311441c2-e0b9-448c-a115-0ca4eb66b004 admin admin] PATH_INFO: `/v3/domains` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:51:04.157704 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-311441c2-e0b9-448c-a115-0ca4eb66b004 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80395) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 16:51:04.158013 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-311441c2-e0b9-448c-a115-0ca4eb66b004 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:51:04.159647 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-311441c2-e0b9-448c-a115-0ca4eb66b004 admin admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:51:04.171696 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 1433/2855] 10.222.0.59 () {58 vars in 1152 bytes} [Thu Jun 2 16:51:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 16:51:04.175984 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68f5d995-1a1f-490d-adab-6e9d65399f0b None None] Authenticating user token {{(pid=80396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:51:04.185900 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68f5d995-1a1f-490d-adab-6e9d65399f0b None None] Validating token access rules against request {{(pid=80396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:51:04.190767 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-272ffc98-c654-4a8f-a4d8-785cfd76bab9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f73d5a98be74242b45222df39fb6213', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:51:04.191450 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-272ffc98-c654-4a8f-a4d8-785cfd76bab9 admin admin] REQUEST_METHOD: `POST` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:51:04.191839 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-272ffc98-c654-4a8f-a4d8-785cfd76bab9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:51:04.192331 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-272ffc98-c654-4a8f-a4d8-785cfd76bab9 admin admin] PATH_INFO: `/v3/projects` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:51:04.193078 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-272ffc98-c654-4a8f-a4d8-785cfd76bab9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:51:04.195115 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-272ffc98-c654-4a8f-a4d8-785cfd76bab9 admin admin] RBAC: Authorization granted {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:51:04.275558 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 1423/2856] 10.222.0.59 () {60 vars in 1152 bytes} [Thu Jun 2 16:51:04 2022] POST /identity/v3/projects => generated 365 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 16:51:04.279592 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-311441c2-e0b9-448c-a115-0ca4eb66b004 admin admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:51:04.289986 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-311441c2-e0b9-448c-a115-0ca4eb66b004 admin admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:51:04.344516 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4e09862-761b-4b1e-ace6-8fe8733ed8e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f73d5a98be74242b45222df39fb6213', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:51:04.345178 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e09862-761b-4b1e-ace6-8fe8733ed8e5 admin admin] REQUEST_METHOD: `POST` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:51:04.345460 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e09862-761b-4b1e-ace6-8fe8733ed8e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:51:04.345733 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e09862-761b-4b1e-ace6-8fe8733ed8e5 admin admin] PATH_INFO: `/v3/users` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:51:04.346441 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4e09862-761b-4b1e-ace6-8fe8733ed8e5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:51:04.348935 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4e09862-761b-4b1e-ace6-8fe8733ed8e5 admin admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:51:04.355520 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 16:51:04.414600 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 1434/2857] 10.222.0.59 () {60 vars in 1143 bytes} [Thu Jun 2 16:51:04 2022] POST /identity/v3/users => generated 283 bytes in 135 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 16:51:04.418731 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-272ffc98-c654-4a8f-a4d8-785cfd76bab9 admin admin] Authenticating user token {{(pid=80396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:51:04.429721 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-272ffc98-c654-4a8f-a4d8-785cfd76bab9 admin admin] Validating token access rules against request {{(pid=80396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:51:04.434360 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da089992-21e2-469f-bc11-a63f1a30a01b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f73d5a98be74242b45222df39fb6213', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:51:04.435007 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da089992-21e2-469f-bc11-a63f1a30a01b admin admin] REQUEST_METHOD: `GET` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:51:04.440667 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da089992-21e2-469f-bc11-a63f1a30a01b admin admin] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:51:04.440667 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da089992-21e2-469f-bc11-a63f1a30a01b admin admin] PATH_INFO: `/v3/roles` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:51:04.440667 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da089992-21e2-469f-bc11-a63f1a30a01b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:51:04.440667 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da089992-21e2-469f-bc11-a63f1a30a01b admin admin] RBAC: Authorization granted {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:51:04.449080 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 1424/2858] 10.222.0.59 () {58 vars in 1121 bytes} [Thu Jun 2 16:51:04 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 16:51:04.453021 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4e09862-761b-4b1e-ace6-8fe8733ed8e5 admin admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:51:04.463278 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4e09862-761b-4b1e-ace6-8fe8733ed8e5 admin admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:51:04.467775 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b223f756-988f-471a-95c7-de18abce27d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f73d5a98be74242b45222df39fb6213', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:51:04.469394 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b223f756-988f-471a-95c7-de18abce27d4 admin admin] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:51:04.469394 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b223f756-988f-471a-95c7-de18abce27d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:51:04.469394 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b223f756-988f-471a-95c7-de18abce27d4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:51:04.469756 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b223f756-988f-471a-95c7-de18abce27d4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:51:04.471227 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b223f756-988f-471a-95c7-de18abce27d4 admin admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:51:04.482264 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 1435/2859] 10.222.0.59 () {58 vars in 1121 bytes} [Thu Jun 2 16:51:04 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 16:51:04.486675 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da089992-21e2-469f-bc11-a63f1a30a01b admin admin] Authenticating user token {{(pid=80396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:51:04.497338 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da089992-21e2-469f-bc11-a63f1a30a01b admin admin] Validating token access rules against request {{(pid=80396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:51:04.502250 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6481a271-640f-4df5-b495-e79a1215bfdd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f73d5a98be74242b45222df39fb6213', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:51:04.503128 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6481a271-640f-4df5-b495-e79a1215bfdd admin admin] REQUEST_METHOD: `PUT` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:51:04.503407 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6481a271-640f-4df5-b495-e79a1215bfdd admin admin] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:51:04.503684 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6481a271-640f-4df5-b495-e79a1215bfdd admin admin] PATH_INFO: `/v3/projects/13c790cf499940eaa26f1a923468f9fc/users/6fb491fc6305458a8a78fa2f616f9b38/roles/649e0f2b5a264c419ea6a1441f123a03` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:51:04.518229 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6481a271-640f-4df5-b495-e79a1215bfdd admin admin] RBAC: Authorizing `identity:create_grant(project_id=13c790cf499940eaa26f1a923468f9fc, user_id=6fb491fc6305458a8a78fa2f616f9b38, role_id=649e0f2b5a264c419ea6a1441f123a03)` {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:51:04.521367 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6481a271-640f-4df5-b495-e79a1215bfdd admin admin] RBAC: Authorization granted {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:51:04.585994 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 1425/2860] 10.222.0.59 () {60 vars in 1482 bytes} [Thu Jun 2 16:51:04 2022] PUT /identity/v3/projects/13c790cf499940eaa26f1a923468f9fc/users/6fb491fc6305458a8a78fa2f616f9b38/roles/649e0f2b5a264c419ea6a1441f123a03 => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 02 16:51:04.596082 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22244ebc-3c75-4b21-950c-6a0ca1243e7b None None] REQUEST_METHOD: `POST` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:51:04.596369 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22244ebc-3c75-4b21-950c-6a0ca1243e7b None None] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:51:04.596660 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22244ebc-3c75-4b21-950c-6a0ca1243e7b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:51:04.622992 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.auth.core [None req-22244ebc-3c75-4b21-950c-6a0ca1243e7b None None] MFA Rules not processed for user `6fb491fc6305458a8a78fa2f616f9b38`. Rule list: `[]` (Enabled: `True`). {{(pid=80395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 16:51:04.624382 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.fernet_utils [None req-22244ebc-3c75-4b21-950c-6a0ca1243e7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:51:04.687823 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 1436/2861] 10.222.0.59 () {58 vars in 957 bytes} [Thu Jun 2 16:51:04 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 16:51:04.692937 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6481a271-640f-4df5-b495-e79a1215bfdd admin admin] Authenticating user token {{(pid=80396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:51:04.753526 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6481a271-640f-4df5-b495-e79a1215bfdd admin admin] Validating token access rules against request {{(pid=80396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:51:04.758785 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fec554ec-684a-4b19-ac9a-eba73af67487 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f73d5a98be74242b45222df39fb6213', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:51:04.759427 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec554ec-684a-4b19-ac9a-eba73af67487 admin admin] REQUEST_METHOD: `POST` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:51:04.759708 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec554ec-684a-4b19-ac9a-eba73af67487 admin admin] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:51:04.759984 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec554ec-684a-4b19-ac9a-eba73af67487 admin admin] PATH_INFO: `/v3/projects` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:51:04.760674 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fec554ec-684a-4b19-ac9a-eba73af67487 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:51:04.762750 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fec554ec-684a-4b19-ac9a-eba73af67487 admin admin] RBAC: Authorization granted {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:51:04.843720 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 1426/2862] 10.222.0.59 () {60 vars in 1152 bytes} [Thu Jun 2 16:51:04 2022] POST /identity/v3/projects => generated 365 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 02 16:51:04.848095 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22244ebc-3c75-4b21-950c-6a0ca1243e7b None None] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:51:04.858548 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22244ebc-3c75-4b21-950c-6a0ca1243e7b None None] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:51:04.915029 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47ce709e-52c0-4dc0-910e-13ba060a172e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f73d5a98be74242b45222df39fb6213', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:51:04.915628 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ce709e-52c0-4dc0-910e-13ba060a172e admin admin] REQUEST_METHOD: `POST` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:51:04.915915 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ce709e-52c0-4dc0-910e-13ba060a172e admin admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:51:04.916200 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ce709e-52c0-4dc0-910e-13ba060a172e admin admin] PATH_INFO: `/v3/users` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:51:04.916894 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47ce709e-52c0-4dc0-910e-13ba060a172e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:51:04.918854 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47ce709e-52c0-4dc0-910e-13ba060a172e admin admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:51:05.013467 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 1437/2863] 10.222.0.59 () {60 vars in 1143 bytes} [Thu Jun 2 16:51:04 2022] POST /identity/v3/users => generated 289 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 02 16:51:05.017335 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fec554ec-684a-4b19-ac9a-eba73af67487 admin admin] Authenticating user token {{(pid=80396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:51:05.028326 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fec554ec-684a-4b19-ac9a-eba73af67487 admin admin] Validating token access rules against request {{(pid=80396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:51:05.032946 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8be042f9-16ae-4213-8b49-beef86f24652 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f73d5a98be74242b45222df39fb6213', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:51:05.033596 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be042f9-16ae-4213-8b49-beef86f24652 admin admin] REQUEST_METHOD: `GET` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:51:05.033883 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be042f9-16ae-4213-8b49-beef86f24652 admin admin] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:51:05.034200 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be042f9-16ae-4213-8b49-beef86f24652 admin admin] PATH_INFO: `/v3/roles` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:51:05.034927 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8be042f9-16ae-4213-8b49-beef86f24652 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:51:05.036542 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8be042f9-16ae-4213-8b49-beef86f24652 admin admin] RBAC: Authorization granted {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:51:05.046986 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 1427/2864] 10.222.0.59 () {58 vars in 1121 bytes} [Thu Jun 2 16:51:05 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 16:51:05.051614 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47ce709e-52c0-4dc0-910e-13ba060a172e admin admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:51:05.061419 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47ce709e-52c0-4dc0-910e-13ba060a172e admin admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:51:05.065897 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40fcb092-fef1-40dd-9d8f-fdcd43164d39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f73d5a98be74242b45222df39fb6213', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:51:05.067400 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40fcb092-fef1-40dd-9d8f-fdcd43164d39 admin admin] REQUEST_METHOD: `PUT` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:51:05.067675 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40fcb092-fef1-40dd-9d8f-fdcd43164d39 admin admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:51:05.067943 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40fcb092-fef1-40dd-9d8f-fdcd43164d39 admin admin] PATH_INFO: `/v3/projects/1bae76c28f35403c89a0794e3dd30888/users/96a94ad178614e36a624eebd3b12c153/roles/f1e0c25f6e9049e897cb7350c7e54ab3` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:51:05.082300 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40fcb092-fef1-40dd-9d8f-fdcd43164d39 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1bae76c28f35403c89a0794e3dd30888, user_id=96a94ad178614e36a624eebd3b12c153, role_id=f1e0c25f6e9049e897cb7350c7e54ab3)` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:51:05.084917 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40fcb092-fef1-40dd-9d8f-fdcd43164d39 admin admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:51:05.153958 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 1438/2865] 10.222.0.59 () {60 vars in 1482 bytes} [Thu Jun 2 16:51:05 2022] PUT /identity/v3/projects/1bae76c28f35403c89a0794e3dd30888/users/96a94ad178614e36a624eebd3b12c153/roles/f1e0c25f6e9049e897cb7350c7e54ab3 => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 16:51:05.158150 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8be042f9-16ae-4213-8b49-beef86f24652 admin admin] Authenticating user token {{(pid=80396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:51:05.168422 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8be042f9-16ae-4213-8b49-beef86f24652 admin admin] Validating token access rules against request {{(pid=80396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:51:05.216840 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG dbcounter [-] [80396] Writing DB stats keystone:SELECT=93,keystone:INSERT=4,keystone:DELETE=3 {{(pid=80396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 16:51:05.226945 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c114521-818b-4310-9d3d-7c25a371a18a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f73d5a98be74242b45222df39fb6213', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:51:05.227604 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c114521-818b-4310-9d3d-7c25a371a18a admin admin] REQUEST_METHOD: `GET` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:51:05.227889 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c114521-818b-4310-9d3d-7c25a371a18a admin admin] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:51:05.232070 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c114521-818b-4310-9d3d-7c25a371a18a admin admin] PATH_INFO: `/v3/roles` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:51:05.232070 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c114521-818b-4310-9d3d-7c25a371a18a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:51:05.232070 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c114521-818b-4310-9d3d-7c25a371a18a admin admin] RBAC: Authorization granted {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:51:05.240532 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 1428/2866] 10.222.0.59 () {58 vars in 1121 bytes} [Thu Jun 2 16:51:05 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 16:51:05.244793 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40fcb092-fef1-40dd-9d8f-fdcd43164d39 admin admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:51:05.256305 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40fcb092-fef1-40dd-9d8f-fdcd43164d39 admin admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:51:05.260955 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a6d08ea-d8f5-4f46-9c92-4e7df034392f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f73d5a98be74242b45222df39fb6213', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:51:05.261828 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6d08ea-d8f5-4f46-9c92-4e7df034392f admin admin] REQUEST_METHOD: `PUT` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:51:05.262135 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6d08ea-d8f5-4f46-9c92-4e7df034392f admin admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:51:05.262414 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6d08ea-d8f5-4f46-9c92-4e7df034392f admin admin] PATH_INFO: `/v3/projects/1bae76c28f35403c89a0794e3dd30888/users/96a94ad178614e36a624eebd3b12c153/roles/f1e0c25f6e9049e897cb7350c7e54ab3` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:51:05.264400 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a6d08ea-d8f5-4f46-9c92-4e7df034392f admin admin] RBAC: Authorizing `identity:create_grant(project_id=1bae76c28f35403c89a0794e3dd30888, user_id=96a94ad178614e36a624eebd3b12c153, role_id=f1e0c25f6e9049e897cb7350c7e54ab3)` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:51:05.267182 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a6d08ea-d8f5-4f46-9c92-4e7df034392f admin admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:51:05.277767 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 1439/2867] 10.222.0.59 () {60 vars in 1482 bytes} [Thu Jun 2 16:51:05 2022] PUT /identity/v3/projects/1bae76c28f35403c89a0794e3dd30888/users/96a94ad178614e36a624eebd3b12c153/roles/f1e0c25f6e9049e897cb7350c7e54ab3 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 16:51:05.288773 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed28e509-eca4-44a1-8123-6c22b2b08347 None None] REQUEST_METHOD: `POST` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:51:05.289093 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed28e509-eca4-44a1-8123-6c22b2b08347 None None] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:51:05.289401 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed28e509-eca4-44a1-8123-6c22b2b08347 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:51:05.315600 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.auth.core [None req-ed28e509-eca4-44a1-8123-6c22b2b08347 None None] MFA Rules not processed for user `96a94ad178614e36a624eebd3b12c153`. Rule list: `[]` (Enabled: `True`). {{(pid=80396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 16:51:05.317464 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.fernet_utils [None req-ed28e509-eca4-44a1-8123-6c22b2b08347 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:51:05.385984 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 1429/2868] 10.222.0.59 () {58 vars in 957 bytes} [Thu Jun 2 16:51:05 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 16:51:05.397475 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a6d08ea-d8f5-4f46-9c92-4e7df034392f admin admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:51:05.399248 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.fernet_utils [None req-2a6d08ea-d8f5-4f46-9c92-4e7df034392f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:51:05.421805 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writing DB stats keystone:INSERT=8,keystone:SELECT=92 {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 16:51:05.457874 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a6d08ea-d8f5-4f46-9c92-4e7df034392f admin admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:51:05.462056 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01f9deca-ee6b-4ce1-915a-ca7418854355 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6534961c369940a5b88f310c6450250b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c87c981909d4b8db02783421818c79b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:51:05.462724 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f9deca-ee6b-4ce1-915a-ca7418854355 service cinder] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:51:05.463008 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f9deca-ee6b-4ce1-915a-ca7418854355 service cinder] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:51:05.463285 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f9deca-ee6b-4ce1-915a-ca7418854355 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:51:05.472452 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01f9deca-ee6b-4ce1-915a-ca7418854355 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:51:05.474362 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01f9deca-ee6b-4ce1-915a-ca7418854355 service cinder] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:51:05.484227 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 1440/2869] 10.222.0.59 () {60 vars in 1365 bytes} [Thu Jun 2 16:51:05 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 16:51:05.655643 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed28e509-eca4-44a1-8123-6c22b2b08347 None None] Authenticating user token {{(pid=80396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:51:05.665669 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed28e509-eca4-44a1-8123-6c22b2b08347 None None] Validating token access rules against request {{(pid=80396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:51:05.669321 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e601a5de-9322-496d-a9c0-089e0e78a6ff service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6534961c369940a5b88f310c6450250b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c87c981909d4b8db02783421818c79b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:51:05.669956 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e601a5de-9322-496d-a9c0-089e0e78a6ff service cinder] REQUEST_METHOD: `GET` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:51:05.670282 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e601a5de-9322-496d-a9c0-089e0e78a6ff service cinder] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:51:05.670563 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e601a5de-9322-496d-a9c0-089e0e78a6ff service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:51:05.727350 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e601a5de-9322-496d-a9c0-089e0e78a6ff service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:51:05.728763 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e601a5de-9322-496d-a9c0-089e0e78a6ff service cinder] RBAC: Authorization granted {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:51:05.737650 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 1430/2870] 10.222.0.59 () {60 vars in 1365 bytes} [Thu Jun 2 16:51:05 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 16:51:15.480033 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writing DB stats keystone:SELECT=17 {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 16:51:15.733614 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG dbcounter [-] [80396] Writing DB stats keystone:SELECT=68 {{(pid=80396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 16:51:18.303867 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01f9deca-ee6b-4ce1-915a-ca7418854355 service cinder] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:51:18.363948 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01f9deca-ee6b-4ce1-915a-ca7418854355 service cinder] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:51:18.369175 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b298055-a9ef-45b4-a01c-95e6861e408d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f73d5a98be74242b45222df39fb6213', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:51:18.370026 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b298055-a9ef-45b4-a01c-95e6861e408d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:51:18.370336 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b298055-a9ef-45b4-a01c-95e6861e408d admin admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:51:18.370608 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b298055-a9ef-45b4-a01c-95e6861e408d admin admin] PATH_INFO: `/v3/users/6fb491fc6305458a8a78fa2f616f9b38` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:51:18.371766 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b298055-a9ef-45b4-a01c-95e6861e408d admin admin] RBAC: Authorizing `identity:delete_user(user_id=6fb491fc6305458a8a78fa2f616f9b38)` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:51:18.373707 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b298055-a9ef-45b4-a01c-95e6861e408d admin admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:51:18.576257 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.notifications [None req-3b298055-a9ef-45b4-a01c-95e6861e408d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6fb491fc6305458a8a78fa2f616f9b38'} {{(pid=80395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:51:18.653522 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.notifications [None req-3b298055-a9ef-45b4-a01c-95e6861e408d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6fb491fc6305458a8a78fa2f616f9b38'} {{(pid=80395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:51:18.666650 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.notifications [None req-3b298055-a9ef-45b4-a01c-95e6861e408d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6fb491fc6305458a8a78fa2f616f9b38'} {{(pid=80395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:51:18.671235 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.notifications [None req-3b298055-a9ef-45b4-a01c-95e6861e408d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6fb491fc6305458a8a78fa2f616f9b38'} {{(pid=80395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:51:18.674175 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.notifications [None req-3b298055-a9ef-45b4-a01c-95e6861e408d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6fb491fc6305458a8a78fa2f616f9b38'} {{(pid=80395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:51:18.680145 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 1441/2871] 10.222.0.59 () {58 vars in 1223 bytes} [Thu Jun 2 16:51:18 2022] DELETE /identity/v3/users/6fb491fc6305458a8a78fa2f616f9b38 => generated 0 bytes in 377 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 16:51:18.684747 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ecb3bcf-bca9-4273-a038-747dc353ea0e None None] REQUEST_METHOD: `POST` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:51:18.685229 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ecb3bcf-bca9-4273-a038-747dc353ea0e None None] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:51:18.685329 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ecb3bcf-bca9-4273-a038-747dc353ea0e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:51:18.703230 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.auth.core [None req-7ecb3bcf-bca9-4273-a038-747dc353ea0e None None] MFA Rules not processed for user `400d1f4db9de49638549e5db29a041e1`. Rule list: `[]` (Enabled: `True`). {{(pid=80396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 16:51:18.704423 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.fernet_utils [None req-7ecb3bcf-bca9-4273-a038-747dc353ea0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:51:18.761791 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 1431/2872] 10.222.0.59 () {58 vars in 957 bytes} [Thu Jun 2 16:51:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 16:51:18.771432 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b298055-a9ef-45b4-a01c-95e6861e408d admin admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:51:18.773456 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.fernet_utils [None req-3b298055-a9ef-45b4-a01c-95e6861e408d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:51:18.832745 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b298055-a9ef-45b4-a01c-95e6861e408d admin admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:51:18.836658 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70fc920e-3ba0-4348-9a2f-dd440df67763 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9af40ddfe9ff4be3887b068f13a28dc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c87c981909d4b8db02783421818c79b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:51:18.837308 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70fc920e-3ba0-4348-9a2f-dd440df67763 service neutron] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:51:18.837598 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70fc920e-3ba0-4348-9a2f-dd440df67763 service neutron] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:51:18.837876 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70fc920e-3ba0-4348-9a2f-dd440df67763 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:51:18.846788 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70fc920e-3ba0-4348-9a2f-dd440df67763 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:51:18.848224 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70fc920e-3ba0-4348-9a2f-dd440df67763 service neutron] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:51:18.858200 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 1442/2873] 10.222.0.59 () {60 vars in 1365 bytes} [Thu Jun 2 16:51:18 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 16:51:19.278327 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ecb3bcf-bca9-4273-a038-747dc353ea0e None None] Authenticating user token {{(pid=80396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:51:19.278327 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.fernet_utils [None req-7ecb3bcf-bca9-4273-a038-747dc353ea0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:51:19.291124 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ecb3bcf-bca9-4273-a038-747dc353ea0e None None] Validating token access rules against request {{(pid=80396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:51:19.295767 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f09bda9-9b7a-4953-ba68-e21765c4322a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f73d5a98be74242b45222df39fb6213', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:51:19.301013 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f09bda9-9b7a-4953-ba68-e21765c4322a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:51:19.301013 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f09bda9-9b7a-4953-ba68-e21765c4322a admin admin] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:51:19.301013 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f09bda9-9b7a-4953-ba68-e21765c4322a admin admin] PATH_INFO: `/v3/projects/13c790cf499940eaa26f1a923468f9fc` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:51:19.301013 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f09bda9-9b7a-4953-ba68-e21765c4322a admin admin] RBAC: Authorizing `identity:delete_project(project_id=13c790cf499940eaa26f1a923468f9fc)` {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:51:19.301013 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f09bda9-9b7a-4953-ba68-e21765c4322a admin admin] RBAC: Authorization granted {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:51:19.416867 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.notifications [None req-7f09bda9-9b7a-4953-ba68-e21765c4322a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '13c790cf499940eaa26f1a923468f9fc', 'request_id': 'req-7f09bda9-9b7a-4953-ba68-e21765c4322a'} {{(pid=80396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:51:19.423038 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.notifications [None req-7f09bda9-9b7a-4953-ba68-e21765c4322a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '13c790cf499940eaa26f1a923468f9fc', 'request_id': 'req-7f09bda9-9b7a-4953-ba68-e21765c4322a'} {{(pid=80396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:51:19.487541 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.notifications [None req-7f09bda9-9b7a-4953-ba68-e21765c4322a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '13c790cf499940eaa26f1a923468f9fc', 'request_id': 'req-7f09bda9-9b7a-4953-ba68-e21765c4322a'} {{(pid=80396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:51:19.498726 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.notifications [None req-7f09bda9-9b7a-4953-ba68-e21765c4322a admin admin] The token cache is being invalidate because project 13c790cf499940eaa26f1a923468f9fc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80396) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 02 16:51:19.499018 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.notifications [None req-7f09bda9-9b7a-4953-ba68-e21765c4322a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:51:19.499891 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.notifications [None req-7f09bda9-9b7a-4953-ba68-e21765c4322a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:51:19.501425 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 1432/2874] 10.222.0.59 () {58 vars in 1232 bytes} [Thu Jun 2 16:51:19 2022] DELETE /identity/v3/projects/13c790cf499940eaa26f1a923468f9fc => generated 0 bytes in 226 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 16:51:19.505421 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70fc920e-3ba0-4348-9a2f-dd440df67763 service neutron] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:51:19.515466 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70fc920e-3ba0-4348-9a2f-dd440df67763 service neutron] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:51:19.533243 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 16:51:19.572119 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da4950d6-1fce-49d0-a525-6052760403d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f73d5a98be74242b45222df39fb6213', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:51:19.572987 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4950d6-1fce-49d0-a525-6052760403d0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:51:19.573351 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4950d6-1fce-49d0-a525-6052760403d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:51:19.573632 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4950d6-1fce-49d0-a525-6052760403d0 admin admin] PATH_INFO: `/v3/users/96a94ad178614e36a624eebd3b12c153` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:51:19.574838 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da4950d6-1fce-49d0-a525-6052760403d0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=96a94ad178614e36a624eebd3b12c153)` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:51:19.576770 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da4950d6-1fce-49d0-a525-6052760403d0 admin admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:51:19.718014 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.notifications [None req-da4950d6-1fce-49d0-a525-6052760403d0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '96a94ad178614e36a624eebd3b12c153'} {{(pid=80395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:51:19.761883 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.notifications [None req-da4950d6-1fce-49d0-a525-6052760403d0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '96a94ad178614e36a624eebd3b12c153'} {{(pid=80395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:51:19.774500 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.notifications [None req-da4950d6-1fce-49d0-a525-6052760403d0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '96a94ad178614e36a624eebd3b12c153'} {{(pid=80395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:51:19.775132 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.notifications [None req-da4950d6-1fce-49d0-a525-6052760403d0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '96a94ad178614e36a624eebd3b12c153'} {{(pid=80395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:51:19.782301 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.notifications [None req-da4950d6-1fce-49d0-a525-6052760403d0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '96a94ad178614e36a624eebd3b12c153'} {{(pid=80395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:51:19.788975 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 1443/2875] 10.222.0.59 () {58 vars in 1223 bytes} [Thu Jun 2 16:51:19 2022] DELETE /identity/v3/users/96a94ad178614e36a624eebd3b12c153 => generated 0 bytes in 284 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 16:51:20.484492 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f09bda9-9b7a-4953-ba68-e21765c4322a admin admin] Authenticating user token {{(pid=80396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:51:20.485955 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.fernet_utils [None req-7f09bda9-9b7a-4953-ba68-e21765c4322a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:51:20.499856 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f09bda9-9b7a-4953-ba68-e21765c4322a admin admin] Validating token access rules against request {{(pid=80396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:51:20.560161 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53f17176-a78c-4dca-9054-b8da30a28dcc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f73d5a98be74242b45222df39fb6213', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:51:20.561011 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f17176-a78c-4dca-9054-b8da30a28dcc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:51:20.561297 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f17176-a78c-4dca-9054-b8da30a28dcc admin admin] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:51:20.561576 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f17176-a78c-4dca-9054-b8da30a28dcc admin admin] PATH_INFO: `/v3/projects/1bae76c28f35403c89a0794e3dd30888` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:51:20.562770 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53f17176-a78c-4dca-9054-b8da30a28dcc admin admin] RBAC: Authorizing `identity:delete_project(project_id=1bae76c28f35403c89a0794e3dd30888)` {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:51:20.564830 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53f17176-a78c-4dca-9054-b8da30a28dcc admin admin] RBAC: Authorization granted {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:51:20.652912 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG dbcounter [-] [80396] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=80396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 16:51:20.669101 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.notifications [None req-53f17176-a78c-4dca-9054-b8da30a28dcc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1bae76c28f35403c89a0794e3dd30888', 'request_id': 'req-53f17176-a78c-4dca-9054-b8da30a28dcc'} {{(pid=80396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:51:20.675185 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.notifications [None req-53f17176-a78c-4dca-9054-b8da30a28dcc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1bae76c28f35403c89a0794e3dd30888', 'request_id': 'req-53f17176-a78c-4dca-9054-b8da30a28dcc'} {{(pid=80396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:51:20.760555 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.notifications [None req-53f17176-a78c-4dca-9054-b8da30a28dcc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1bae76c28f35403c89a0794e3dd30888', 'request_id': 'req-53f17176-a78c-4dca-9054-b8da30a28dcc'} {{(pid=80396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:51:20.770982 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.notifications [None req-53f17176-a78c-4dca-9054-b8da30a28dcc admin admin] The token cache is being invalidate because project 1bae76c28f35403c89a0794e3dd30888 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80396) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 02 16:51:20.771274 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.notifications [None req-53f17176-a78c-4dca-9054-b8da30a28dcc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:51:20.771966 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.notifications [None req-53f17176-a78c-4dca-9054-b8da30a28dcc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:51:20.773463 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 1433/2876] 10.222.0.59 () {58 vars in 1232 bytes} [Thu Jun 2 16:51:20 2022] DELETE /identity/v3/projects/1bae76c28f35403c89a0794e3dd30888 => generated 0 bytes in 290 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 16:51:20.778462 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878b1a92-cab8-4f2f-8eb6-81dec46731ef None None] REQUEST_METHOD: `POST` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:51:20.778952 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878b1a92-cab8-4f2f-8eb6-81dec46731ef None None] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:51:20.779051 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878b1a92-cab8-4f2f-8eb6-81dec46731ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:51:20.796803 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.auth.core [None req-878b1a92-cab8-4f2f-8eb6-81dec46731ef None None] MFA Rules not processed for user `400d1f4db9de49638549e5db29a041e1`. Rule list: `[]` (Enabled: `True`). {{(pid=80395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 16:51:20.798016 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.fernet_utils [None req-878b1a92-cab8-4f2f-8eb6-81dec46731ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:51:20.858410 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 1444/2877] 10.222.0.59 () {58 vars in 957 bytes} [Thu Jun 2 16:51:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 16:51:20.866805 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6879a7e0-385e-4190-8003-dcb69e58ac1c None None] REQUEST_METHOD: `POST` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:51:20.867097 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6879a7e0-385e-4190-8003-dcb69e58ac1c None None] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:51:20.867380 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6879a7e0-385e-4190-8003-dcb69e58ac1c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:51:20.886875 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.auth.core [None req-6879a7e0-385e-4190-8003-dcb69e58ac1c None None] MFA Rules not processed for user `400d1f4db9de49638549e5db29a041e1`. Rule list: `[]` (Enabled: `True`). {{(pid=80396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 16:51:20.889681 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.fernet_utils [None req-6879a7e0-385e-4190-8003-dcb69e58ac1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:51:20.895937 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 1434/2878] 10.222.0.59 () {58 vars in 957 bytes} [Thu Jun 2 16:51:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 16:51:20.900084 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-878b1a92-cab8-4f2f-8eb6-81dec46731ef None None] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:51:20.909627 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-878b1a92-cab8-4f2f-8eb6-81dec46731ef None None] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:51:20.914874 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74570db4-6350-4de5-8b4c-668057f21c98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f73d5a98be74242b45222df39fb6213', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:51:20.915522 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74570db4-6350-4de5-8b4c-668057f21c98 admin admin] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:51:20.915801 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74570db4-6350-4de5-8b4c-668057f21c98 admin admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:51:20.916070 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74570db4-6350-4de5-8b4c-668057f21c98 admin admin] PATH_INFO: `/v3/domains` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:51:20.916786 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74570db4-6350-4de5-8b4c-668057f21c98 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80395) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 16:51:20.917086 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74570db4-6350-4de5-8b4c-668057f21c98 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:51:20.918719 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74570db4-6350-4de5-8b4c-668057f21c98 admin admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:51:20.930623 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 1445/2879] 10.222.0.59 () {58 vars in 1152 bytes} [Thu Jun 2 16:51:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 16:51:20.934825 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6879a7e0-385e-4190-8003-dcb69e58ac1c None None] Authenticating user token {{(pid=80396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:51:20.945128 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6879a7e0-385e-4190-8003-dcb69e58ac1c None None] Validating token access rules against request {{(pid=80396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:51:20.950005 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54ebddbf-9d40-46be-b977-9a821a5a0e33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f73d5a98be74242b45222df39fb6213', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:51:20.950677 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ebddbf-9d40-46be-b977-9a821a5a0e33 admin admin] REQUEST_METHOD: `POST` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:51:20.950965 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ebddbf-9d40-46be-b977-9a821a5a0e33 admin admin] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:51:20.951242 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ebddbf-9d40-46be-b977-9a821a5a0e33 admin admin] PATH_INFO: `/v3/projects` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:51:20.951940 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54ebddbf-9d40-46be-b977-9a821a5a0e33 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:51:20.953829 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54ebddbf-9d40-46be-b977-9a821a5a0e33 admin admin] RBAC: Authorization granted {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:51:21.043334 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 1435/2880] 10.222.0.59 () {60 vars in 1152 bytes} [Thu Jun 2 16:51:20 2022] POST /identity/v3/projects => generated 363 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 02 16:51:21.047557 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74570db4-6350-4de5-8b4c-668057f21c98 admin admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:51:21.058146 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74570db4-6350-4de5-8b4c-668057f21c98 admin admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:51:21.084866 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 16:51:21.113937 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07cf436a-751d-488f-babd-5be28870222f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f73d5a98be74242b45222df39fb6213', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:51:21.114622 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07cf436a-751d-488f-babd-5be28870222f admin admin] REQUEST_METHOD: `POST` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:51:21.114903 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07cf436a-751d-488f-babd-5be28870222f admin admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:51:21.115309 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07cf436a-751d-488f-babd-5be28870222f admin admin] PATH_INFO: `/v3/users` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:51:21.116434 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07cf436a-751d-488f-babd-5be28870222f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:51:21.118348 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07cf436a-751d-488f-babd-5be28870222f admin admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:51:21.208451 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 1446/2881] 10.222.0.59 () {60 vars in 1143 bytes} [Thu Jun 2 16:51:21 2022] POST /identity/v3/users => generated 282 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 16:51:21.213834 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54ebddbf-9d40-46be-b977-9a821a5a0e33 admin admin] Authenticating user token {{(pid=80396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:51:21.224360 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54ebddbf-9d40-46be-b977-9a821a5a0e33 admin admin] Validating token access rules against request {{(pid=80396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:51:21.229294 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49ada017-0347-48fc-931b-690c9dad33e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f73d5a98be74242b45222df39fb6213', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:51:21.229946 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ada017-0347-48fc-931b-690c9dad33e2 admin admin] REQUEST_METHOD: `GET` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:51:21.230271 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ada017-0347-48fc-931b-690c9dad33e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:51:21.230553 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ada017-0347-48fc-931b-690c9dad33e2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:51:21.231277 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49ada017-0347-48fc-931b-690c9dad33e2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:51:21.232871 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49ada017-0347-48fc-931b-690c9dad33e2 admin admin] RBAC: Authorization granted {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:51:21.243852 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 1436/2882] 10.222.0.59 () {58 vars in 1121 bytes} [Thu Jun 2 16:51:21 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 16:51:21.247701 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07cf436a-751d-488f-babd-5be28870222f admin admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:51:21.259216 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07cf436a-751d-488f-babd-5be28870222f admin admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:51:21.264040 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abf7e634-9517-4328-bfbc-56806703c73a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f73d5a98be74242b45222df39fb6213', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:51:21.264685 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf7e634-9517-4328-bfbc-56806703c73a admin admin] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:51:21.264966 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf7e634-9517-4328-bfbc-56806703c73a admin admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:51:21.265239 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf7e634-9517-4328-bfbc-56806703c73a admin admin] PATH_INFO: `/v3/roles` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:51:21.265956 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abf7e634-9517-4328-bfbc-56806703c73a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:51:21.267596 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abf7e634-9517-4328-bfbc-56806703c73a admin admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:51:21.278253 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 1447/2883] 10.222.0.59 () {58 vars in 1121 bytes} [Thu Jun 2 16:51:21 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 16:51:21.282330 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49ada017-0347-48fc-931b-690c9dad33e2 admin admin] Authenticating user token {{(pid=80396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:51:21.292331 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49ada017-0347-48fc-931b-690c9dad33e2 admin admin] Validating token access rules against request {{(pid=80396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:51:21.296874 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dffa7af-bb94-4f07-8716-30cf3add800e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f73d5a98be74242b45222df39fb6213', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:51:21.297737 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dffa7af-bb94-4f07-8716-30cf3add800e admin admin] REQUEST_METHOD: `PUT` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:51:21.298016 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dffa7af-bb94-4f07-8716-30cf3add800e admin admin] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:51:21.298395 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dffa7af-bb94-4f07-8716-30cf3add800e admin admin] PATH_INFO: `/v3/projects/2054d1b2b94e416ca3ec1ea6c127c0f4/users/a7f886c608db4e4a9774c02ca8bfee52/roles/649e0f2b5a264c419ea6a1441f123a03` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:51:21.312866 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dffa7af-bb94-4f07-8716-30cf3add800e admin admin] RBAC: Authorizing `identity:create_grant(project_id=2054d1b2b94e416ca3ec1ea6c127c0f4, user_id=a7f886c608db4e4a9774c02ca8bfee52, role_id=649e0f2b5a264c419ea6a1441f123a03)` {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:51:21.315578 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dffa7af-bb94-4f07-8716-30cf3add800e admin admin] RBAC: Authorization granted {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:51:21.383569 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 1437/2884] 10.222.0.59 () {60 vars in 1482 bytes} [Thu Jun 2 16:51:21 2022] PUT /identity/v3/projects/2054d1b2b94e416ca3ec1ea6c127c0f4/users/a7f886c608db4e4a9774c02ca8bfee52/roles/649e0f2b5a264c419ea6a1441f123a03 => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 16:51:21.394791 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77869242-4a4a-452f-b784-f2d335f69fc4 None None] REQUEST_METHOD: `POST` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:51:21.395086 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77869242-4a4a-452f-b784-f2d335f69fc4 None None] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:51:21.395366 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77869242-4a4a-452f-b784-f2d335f69fc4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:51:21.421998 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.auth.core [None req-77869242-4a4a-452f-b784-f2d335f69fc4 None None] MFA Rules not processed for user `a7f886c608db4e4a9774c02ca8bfee52`. Rule list: `[]` (Enabled: `True`). {{(pid=80395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 16:51:21.423236 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.fernet_utils [None req-77869242-4a4a-452f-b784-f2d335f69fc4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:51:21.488039 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 1448/2885] 10.222.0.59 () {58 vars in 957 bytes} [Thu Jun 2 16:51:21 2022] POST /identity/v3/auth/tokens => generated 3230 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 02 16:51:21.495616 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dffa7af-bb94-4f07-8716-30cf3add800e admin admin] Authenticating user token {{(pid=80396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:51:21.560742 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dffa7af-bb94-4f07-8716-30cf3add800e admin admin] Validating token access rules against request {{(pid=80396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:51:21.565369 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79eb1dcc-3577-4230-974a-2d22beba1491 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f73d5a98be74242b45222df39fb6213', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:51:21.568999 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79eb1dcc-3577-4230-974a-2d22beba1491 admin admin] REQUEST_METHOD: `POST` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:51:21.568999 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79eb1dcc-3577-4230-974a-2d22beba1491 admin admin] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:51:21.568999 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79eb1dcc-3577-4230-974a-2d22beba1491 admin admin] PATH_INFO: `/v3/projects` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:51:21.568999 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79eb1dcc-3577-4230-974a-2d22beba1491 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:51:21.569395 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79eb1dcc-3577-4230-974a-2d22beba1491 admin admin] RBAC: Authorization granted {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:51:21.667428 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 1438/2886] 10.222.0.59 () {60 vars in 1152 bytes} [Thu Jun 2 16:51:21 2022] POST /identity/v3/projects => generated 365 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 16:51:21.671571 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77869242-4a4a-452f-b784-f2d335f69fc4 None None] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:51:21.682655 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77869242-4a4a-452f-b784-f2d335f69fc4 None None] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:51:21.738642 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e46d213c-a614-49ea-a349-ab61a395cf0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f73d5a98be74242b45222df39fb6213', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:51:21.739236 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e46d213c-a614-49ea-a349-ab61a395cf0d admin admin] REQUEST_METHOD: `POST` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:51:21.739521 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e46d213c-a614-49ea-a349-ab61a395cf0d admin admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:51:21.739795 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e46d213c-a614-49ea-a349-ab61a395cf0d admin admin] PATH_INFO: `/v3/users` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:51:21.740515 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e46d213c-a614-49ea-a349-ab61a395cf0d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:51:21.742464 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e46d213c-a614-49ea-a349-ab61a395cf0d admin admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:51:21.808261 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 1449/2887] 10.222.0.59 () {60 vars in 1143 bytes} [Thu Jun 2 16:51:21 2022] POST /identity/v3/users => generated 289 bytes in 137 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 16:51:21.812232 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79eb1dcc-3577-4230-974a-2d22beba1491 admin admin] Authenticating user token {{(pid=80396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:51:21.822595 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79eb1dcc-3577-4230-974a-2d22beba1491 admin admin] Validating token access rules against request {{(pid=80396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:51:21.827433 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c27c13-5087-44fa-b832-646aba54b0d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f73d5a98be74242b45222df39fb6213', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:51:21.828086 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c27c13-5087-44fa-b832-646aba54b0d9 admin admin] REQUEST_METHOD: `GET` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:51:21.828374 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c27c13-5087-44fa-b832-646aba54b0d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:51:21.828656 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c27c13-5087-44fa-b832-646aba54b0d9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:51:21.829378 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54c27c13-5087-44fa-b832-646aba54b0d9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:51:21.831018 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54c27c13-5087-44fa-b832-646aba54b0d9 admin admin] RBAC: Authorization granted {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:51:21.842387 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 1439/2888] 10.222.0.59 () {58 vars in 1121 bytes} [Thu Jun 2 16:51:21 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 16:51:21.846364 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e46d213c-a614-49ea-a349-ab61a395cf0d admin admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:51:21.857164 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e46d213c-a614-49ea-a349-ab61a395cf0d admin admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:51:21.861673 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f6a41ad-7204-4475-9951-a7ef1242e9e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f73d5a98be74242b45222df39fb6213', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:51:21.862576 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f6a41ad-7204-4475-9951-a7ef1242e9e0 admin admin] REQUEST_METHOD: `PUT` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:51:21.862857 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f6a41ad-7204-4475-9951-a7ef1242e9e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:51:21.863134 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f6a41ad-7204-4475-9951-a7ef1242e9e0 admin admin] PATH_INFO: `/v3/projects/dfea2703bd184da592b07c9d0761394a/users/f8af326efa404d8cb5e4c2f8a26ab185/roles/f1e0c25f6e9049e897cb7350c7e54ab3` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:51:21.878380 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f6a41ad-7204-4475-9951-a7ef1242e9e0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=dfea2703bd184da592b07c9d0761394a, user_id=f8af326efa404d8cb5e4c2f8a26ab185, role_id=f1e0c25f6e9049e897cb7350c7e54ab3)` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:51:21.881629 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f6a41ad-7204-4475-9951-a7ef1242e9e0 admin admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:51:21.957066 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 1450/2889] 10.222.0.59 () {60 vars in 1482 bytes} [Thu Jun 2 16:51:21 2022] PUT /identity/v3/projects/dfea2703bd184da592b07c9d0761394a/users/f8af326efa404d8cb5e4c2f8a26ab185/roles/f1e0c25f6e9049e897cb7350c7e54ab3 => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 16:51:21.961771 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c27c13-5087-44fa-b832-646aba54b0d9 admin admin] Authenticating user token {{(pid=80396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:51:21.971786 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c27c13-5087-44fa-b832-646aba54b0d9 admin admin] Validating token access rules against request {{(pid=80396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:51:21.992160 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG dbcounter [-] [80396] Writing DB stats keystone:DELETE=6,keystone:SELECT=90,keystone:INSERT=4 {{(pid=80396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 16:51:22.031169 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13db6340-411e-4bd4-98fc-e361dba37899 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f73d5a98be74242b45222df39fb6213', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:51:22.031830 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13db6340-411e-4bd4-98fc-e361dba37899 admin admin] REQUEST_METHOD: `GET` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:51:22.032115 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13db6340-411e-4bd4-98fc-e361dba37899 admin admin] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:51:22.032437 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13db6340-411e-4bd4-98fc-e361dba37899 admin admin] PATH_INFO: `/v3/roles` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:51:22.033166 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13db6340-411e-4bd4-98fc-e361dba37899 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:51:22.034803 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13db6340-411e-4bd4-98fc-e361dba37899 admin admin] RBAC: Authorization granted {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:51:22.044779 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 1440/2890] 10.222.0.59 () {58 vars in 1121 bytes} [Thu Jun 2 16:51:21 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 16:51:22.049035 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f6a41ad-7204-4475-9951-a7ef1242e9e0 admin admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:51:22.054474 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 16:51:22.059765 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f6a41ad-7204-4475-9951-a7ef1242e9e0 admin admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:51:22.064370 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-512850d9-13fd-482f-90fa-e38cd72a34fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f73d5a98be74242b45222df39fb6213', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:51:22.065695 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-512850d9-13fd-482f-90fa-e38cd72a34fc admin admin] REQUEST_METHOD: `PUT` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:51:22.065695 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-512850d9-13fd-482f-90fa-e38cd72a34fc admin admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:51:22.065867 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-512850d9-13fd-482f-90fa-e38cd72a34fc admin admin] PATH_INFO: `/v3/projects/dfea2703bd184da592b07c9d0761394a/users/f8af326efa404d8cb5e4c2f8a26ab185/roles/f1e0c25f6e9049e897cb7350c7e54ab3` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:51:22.067752 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-512850d9-13fd-482f-90fa-e38cd72a34fc admin admin] RBAC: Authorizing `identity:create_grant(project_id=dfea2703bd184da592b07c9d0761394a, user_id=f8af326efa404d8cb5e4c2f8a26ab185, role_id=f1e0c25f6e9049e897cb7350c7e54ab3)` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:51:22.070918 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-512850d9-13fd-482f-90fa-e38cd72a34fc admin admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:51:22.081668 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 1451/2891] 10.222.0.59 () {60 vars in 1482 bytes} [Thu Jun 2 16:51:22 2022] PUT /identity/v3/projects/dfea2703bd184da592b07c9d0761394a/users/f8af326efa404d8cb5e4c2f8a26ab185/roles/f1e0c25f6e9049e897cb7350c7e54ab3 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 16:51:22.092292 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d706eb00-f2b9-41ba-9b8e-de2f8525c5a7 None None] REQUEST_METHOD: `POST` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:51:22.092591 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d706eb00-f2b9-41ba-9b8e-de2f8525c5a7 None None] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:51:22.092873 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d706eb00-f2b9-41ba-9b8e-de2f8525c5a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:51:22.119746 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.auth.core [None req-d706eb00-f2b9-41ba-9b8e-de2f8525c5a7 None None] MFA Rules not processed for user `f8af326efa404d8cb5e4c2f8a26ab185`. Rule list: `[]` (Enabled: `True`). {{(pid=80396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 16:51:22.120955 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.fernet_utils [None req-d706eb00-f2b9-41ba-9b8e-de2f8525c5a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:51:22.192903 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 1441/2892] 10.222.0.59 () {58 vars in 957 bytes} [Thu Jun 2 16:51:22 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 16:51:22.204187 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-512850d9-13fd-482f-90fa-e38cd72a34fc admin admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:51:22.205907 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.fernet_utils [None req-512850d9-13fd-482f-90fa-e38cd72a34fc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:51:22.271279 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-512850d9-13fd-482f-90fa-e38cd72a34fc admin admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:51:22.275378 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cf379d5-08a8-417a-a3c4-84319bfaba25 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6534961c369940a5b88f310c6450250b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c87c981909d4b8db02783421818c79b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:51:22.276024 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf379d5-08a8-417a-a3c4-84319bfaba25 service cinder] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:51:22.276310 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf379d5-08a8-417a-a3c4-84319bfaba25 service cinder] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:51:22.276591 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf379d5-08a8-417a-a3c4-84319bfaba25 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:51:22.290057 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cf379d5-08a8-417a-a3c4-84319bfaba25 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:51:22.291556 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cf379d5-08a8-417a-a3c4-84319bfaba25 service cinder] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:51:22.301225 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 1452/2893] 10.222.0.59 () {60 vars in 1365 bytes} [Thu Jun 2 16:51:22 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 16:51:24.849529 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d706eb00-f2b9-41ba-9b8e-de2f8525c5a7 None None] Authenticating user token {{(pid=80396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:51:24.911634 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d706eb00-f2b9-41ba-9b8e-de2f8525c5a7 None None] Validating token access rules against request {{(pid=80396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:51:24.916905 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b928b14-4164-498e-9ade-14bcfcab07de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f73d5a98be74242b45222df39fb6213', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:51:24.917771 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b928b14-4164-498e-9ade-14bcfcab07de admin admin] REQUEST_METHOD: `DELETE` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:51:24.918057 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b928b14-4164-498e-9ade-14bcfcab07de admin admin] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:51:24.918363 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b928b14-4164-498e-9ade-14bcfcab07de admin admin] PATH_INFO: `/v3/users/a7f886c608db4e4a9774c02ca8bfee52` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:51:24.919547 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b928b14-4164-498e-9ade-14bcfcab07de admin admin] RBAC: Authorizing `identity:delete_user(user_id=a7f886c608db4e4a9774c02ca8bfee52)` {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:51:24.921494 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b928b14-4164-498e-9ade-14bcfcab07de admin admin] RBAC: Authorization granted {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:51:25.087578 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.notifications [None req-6b928b14-4164-498e-9ade-14bcfcab07de admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a7f886c608db4e4a9774c02ca8bfee52'} {{(pid=80396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:51:25.088162 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.notifications [None req-6b928b14-4164-498e-9ade-14bcfcab07de admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a7f886c608db4e4a9774c02ca8bfee52'} {{(pid=80396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:51:25.089869 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG dbcounter [-] [80396] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=80396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 16:51:25.185201 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.notifications [None req-6b928b14-4164-498e-9ade-14bcfcab07de admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a7f886c608db4e4a9774c02ca8bfee52'} {{(pid=80396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:51:25.198059 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.notifications [None req-6b928b14-4164-498e-9ade-14bcfcab07de admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a7f886c608db4e4a9774c02ca8bfee52'} {{(pid=80396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:51:25.205017 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.notifications [None req-6b928b14-4164-498e-9ade-14bcfcab07de admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a7f886c608db4e4a9774c02ca8bfee52'} {{(pid=80396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:51:25.211608 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 1442/2894] 10.222.0.59 () {58 vars in 1223 bytes} [Thu Jun 2 16:51:24 2022] DELETE /identity/v3/users/a7f886c608db4e4a9774c02ca8bfee52 => generated 0 bytes in 363 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 02 16:51:25.216076 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f740c77f-f732-49e4-b2a8-ce11f91fc865 None None] REQUEST_METHOD: `POST` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:51:25.216543 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f740c77f-f732-49e4-b2a8-ce11f91fc865 None None] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:51:25.216747 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f740c77f-f732-49e4-b2a8-ce11f91fc865 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:51:25.234851 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.auth.core [None req-f740c77f-f732-49e4-b2a8-ce11f91fc865 None None] MFA Rules not processed for user `400d1f4db9de49638549e5db29a041e1`. Rule list: `[]` (Enabled: `True`). {{(pid=80395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 16:51:25.236032 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.fernet_utils [None req-f740c77f-f732-49e4-b2a8-ce11f91fc865 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:51:25.298166 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 1453/2895] 10.222.0.59 () {58 vars in 957 bytes} [Thu Jun 2 16:51:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 16:51:25.307954 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b928b14-4164-498e-9ade-14bcfcab07de admin admin] Authenticating user token {{(pid=80396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:51:25.309332 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.fernet_utils [None req-6b928b14-4164-498e-9ade-14bcfcab07de admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:51:25.366787 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b928b14-4164-498e-9ade-14bcfcab07de admin admin] Validating token access rules against request {{(pid=80396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:51:25.370305 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-841bf222-0e8f-4bfd-af82-a438b4d9d1ef service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9af40ddfe9ff4be3887b068f13a28dc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c87c981909d4b8db02783421818c79b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:51:25.370953 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-841bf222-0e8f-4bfd-af82-a438b4d9d1ef service neutron] REQUEST_METHOD: `GET` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:51:25.371239 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-841bf222-0e8f-4bfd-af82-a438b4d9d1ef service neutron] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:51:25.371519 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-841bf222-0e8f-4bfd-af82-a438b4d9d1ef service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:51:25.381099 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-841bf222-0e8f-4bfd-af82-a438b4d9d1ef service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:51:25.382729 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-841bf222-0e8f-4bfd-af82-a438b4d9d1ef service neutron] RBAC: Authorization granted {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:51:25.392182 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 1443/2896] 10.222.0.59 () {60 vars in 1365 bytes} [Thu Jun 2 16:51:25 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 16:51:25.792688 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f740c77f-f732-49e4-b2a8-ce11f91fc865 None None] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:51:25.794151 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.fernet_utils [None req-f740c77f-f732-49e4-b2a8-ce11f91fc865 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:51:25.807589 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f740c77f-f732-49e4-b2a8-ce11f91fc865 None None] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:51:25.812227 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3295ea57-a944-4eea-af64-8d411cdd239d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f73d5a98be74242b45222df39fb6213', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:51:25.813516 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3295ea57-a944-4eea-af64-8d411cdd239d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:51:25.814349 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3295ea57-a944-4eea-af64-8d411cdd239d admin admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:51:25.814634 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3295ea57-a944-4eea-af64-8d411cdd239d admin admin] PATH_INFO: `/v3/projects/2054d1b2b94e416ca3ec1ea6c127c0f4` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:51:25.816030 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3295ea57-a944-4eea-af64-8d411cdd239d admin admin] RBAC: Authorizing `identity:delete_project(project_id=2054d1b2b94e416ca3ec1ea6c127c0f4)` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:51:25.817926 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3295ea57-a944-4eea-af64-8d411cdd239d admin admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:51:25.928863 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.notifications [None req-3295ea57-a944-4eea-af64-8d411cdd239d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2054d1b2b94e416ca3ec1ea6c127c0f4', 'request_id': 'req-3295ea57-a944-4eea-af64-8d411cdd239d'} {{(pid=80395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:51:25.935141 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.notifications [None req-3295ea57-a944-4eea-af64-8d411cdd239d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2054d1b2b94e416ca3ec1ea6c127c0f4', 'request_id': 'req-3295ea57-a944-4eea-af64-8d411cdd239d'} {{(pid=80395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:51:26.005428 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.notifications [None req-3295ea57-a944-4eea-af64-8d411cdd239d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2054d1b2b94e416ca3ec1ea6c127c0f4', 'request_id': 'req-3295ea57-a944-4eea-af64-8d411cdd239d'} {{(pid=80395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:51:26.017119 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.notifications [None req-3295ea57-a944-4eea-af64-8d411cdd239d admin admin] The token cache is being invalidate because project 2054d1b2b94e416ca3ec1ea6c127c0f4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80395) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 02 16:51:26.017409 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.notifications [None req-3295ea57-a944-4eea-af64-8d411cdd239d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:51:26.018040 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.notifications [None req-3295ea57-a944-4eea-af64-8d411cdd239d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:51:26.019678 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 1454/2897] 10.222.0.59 () {58 vars in 1232 bytes} [Thu Jun 2 16:51:25 2022] DELETE /identity/v3/projects/2054d1b2b94e416ca3ec1ea6c127c0f4 => generated 0 bytes in 228 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 16:51:26.024299 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-841bf222-0e8f-4bfd-af82-a438b4d9d1ef service neutron] Authenticating user token {{(pid=80396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:51:26.033911 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-841bf222-0e8f-4bfd-af82-a438b4d9d1ef service neutron] Validating token access rules against request {{(pid=80396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:51:26.091075 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6461a75-f403-4536-9060-898e14fc0e7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f73d5a98be74242b45222df39fb6213', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:51:26.091935 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6461a75-f403-4536-9060-898e14fc0e7e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:51:26.092225 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6461a75-f403-4536-9060-898e14fc0e7e admin admin] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:51:26.092622 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6461a75-f403-4536-9060-898e14fc0e7e admin admin] PATH_INFO: `/v3/users/f8af326efa404d8cb5e4c2f8a26ab185` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:51:26.093806 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6461a75-f403-4536-9060-898e14fc0e7e admin admin] RBAC: Authorizing `identity:delete_user(user_id=f8af326efa404d8cb5e4c2f8a26ab185)` {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:51:26.095770 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6461a75-f403-4536-9060-898e14fc0e7e admin admin] RBAC: Authorization granted {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:51:26.256442 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.notifications [None req-e6461a75-f403-4536-9060-898e14fc0e7e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f8af326efa404d8cb5e4c2f8a26ab185'} {{(pid=80396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:51:26.257109 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.notifications [None req-e6461a75-f403-4536-9060-898e14fc0e7e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f8af326efa404d8cb5e4c2f8a26ab185'} {{(pid=80396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:51:26.323039 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.notifications [None req-e6461a75-f403-4536-9060-898e14fc0e7e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f8af326efa404d8cb5e4c2f8a26ab185'} {{(pid=80396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:51:26.335756 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG dbcounter [-] [80396] Writing DB stats keystone:INSERT=2,keystone:DELETE=13,keystone:SELECT=85 {{(pid=80396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 16:51:26.336991 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.notifications [None req-e6461a75-f403-4536-9060-898e14fc0e7e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f8af326efa404d8cb5e4c2f8a26ab185'} {{(pid=80396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:51:26.343823 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.notifications [None req-e6461a75-f403-4536-9060-898e14fc0e7e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f8af326efa404d8cb5e4c2f8a26ab185'} {{(pid=80396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:51:26.350492 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 1444/2898] 10.222.0.59 () {58 vars in 1223 bytes} [Thu Jun 2 16:51:26 2022] DELETE /identity/v3/users/f8af326efa404d8cb5e4c2f8a26ab185 => generated 0 bytes in 327 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 16:51:26.820653 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3295ea57-a944-4eea-af64-8d411cdd239d admin admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:51:26.822641 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.fernet_utils [None req-3295ea57-a944-4eea-af64-8d411cdd239d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:51:26.836451 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3295ea57-a944-4eea-af64-8d411cdd239d admin admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:51:26.848912 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 16:51:26.905820 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f52b08b0-0aa9-4791-ae24-5dd0e2f543e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f73d5a98be74242b45222df39fb6213', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:51:26.906712 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f52b08b0-0aa9-4791-ae24-5dd0e2f543e4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:51:26.907015 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f52b08b0-0aa9-4791-ae24-5dd0e2f543e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:51:26.907321 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f52b08b0-0aa9-4791-ae24-5dd0e2f543e4 admin admin] PATH_INFO: `/v3/projects/dfea2703bd184da592b07c9d0761394a` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:51:26.908533 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f52b08b0-0aa9-4791-ae24-5dd0e2f543e4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=dfea2703bd184da592b07c9d0761394a)` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:51:26.910501 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f52b08b0-0aa9-4791-ae24-5dd0e2f543e4 admin admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:51:27.010681 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.notifications [None req-f52b08b0-0aa9-4791-ae24-5dd0e2f543e4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dfea2703bd184da592b07c9d0761394a', 'request_id': 'req-f52b08b0-0aa9-4791-ae24-5dd0e2f543e4'} {{(pid=80395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:51:27.016980 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.notifications [None req-f52b08b0-0aa9-4791-ae24-5dd0e2f543e4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dfea2703bd184da592b07c9d0761394a', 'request_id': 'req-f52b08b0-0aa9-4791-ae24-5dd0e2f543e4'} {{(pid=80395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:51:27.076997 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.notifications [None req-f52b08b0-0aa9-4791-ae24-5dd0e2f543e4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dfea2703bd184da592b07c9d0761394a', 'request_id': 'req-f52b08b0-0aa9-4791-ae24-5dd0e2f543e4'} {{(pid=80395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:51:27.088733 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.notifications [None req-f52b08b0-0aa9-4791-ae24-5dd0e2f543e4 admin admin] The token cache is being invalidate because project dfea2703bd184da592b07c9d0761394a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80395) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 02 16:51:27.089339 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.notifications [None req-f52b08b0-0aa9-4791-ae24-5dd0e2f543e4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:51:27.090042 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.notifications [None req-f52b08b0-0aa9-4791-ae24-5dd0e2f543e4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:51:27.091653 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 1455/2899] 10.222.0.59 () {58 vars in 1232 bytes} [Thu Jun 2 16:51:26 2022] DELETE /identity/v3/projects/dfea2703bd184da592b07c9d0761394a => generated 0 bytes in 272 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 16:51:27.096693 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303b5f2e-195d-4a41-a48c-39b36e81aee1 None None] REQUEST_METHOD: `POST` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:51:27.097169 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303b5f2e-195d-4a41-a48c-39b36e81aee1 None None] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:51:27.097257 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303b5f2e-195d-4a41-a48c-39b36e81aee1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:51:27.116116 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.auth.core [None req-303b5f2e-195d-4a41-a48c-39b36e81aee1 None None] MFA Rules not processed for user `400d1f4db9de49638549e5db29a041e1`. Rule list: `[]` (Enabled: `True`). {{(pid=80396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 16:51:27.119509 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.fernet_utils [None req-303b5f2e-195d-4a41-a48c-39b36e81aee1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:51:27.177109 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 1445/2900] 10.222.0.59 () {58 vars in 957 bytes} [Thu Jun 2 16:51:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 16:51:27.184815 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d6ea8f-6773-400a-a6b9-c6ec3989cfb1 None None] REQUEST_METHOD: `POST` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:51:27.185223 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d6ea8f-6773-400a-a6b9-c6ec3989cfb1 None None] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:51:27.185378 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d6ea8f-6773-400a-a6b9-c6ec3989cfb1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:51:27.204628 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.auth.core [None req-c8d6ea8f-6773-400a-a6b9-c6ec3989cfb1 None None] MFA Rules not processed for user `400d1f4db9de49638549e5db29a041e1`. Rule list: `[]` (Enabled: `True`). {{(pid=80395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 16:51:27.205811 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.fernet_utils [None req-c8d6ea8f-6773-400a-a6b9-c6ec3989cfb1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:51:27.215061 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 1456/2901] 10.222.0.59 () {58 vars in 957 bytes} [Thu Jun 2 16:51:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 16:51:27.219292 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-303b5f2e-195d-4a41-a48c-39b36e81aee1 None None] Authenticating user token {{(pid=80396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:51:27.228975 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-303b5f2e-195d-4a41-a48c-39b36e81aee1 None None] Validating token access rules against request {{(pid=80396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:51:27.233449 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ba3aa26-c8c7-4938-b16b-ce5d0533b214 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f73d5a98be74242b45222df39fb6213', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:51:27.234117 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba3aa26-c8c7-4938-b16b-ce5d0533b214 admin admin] REQUEST_METHOD: `GET` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:51:27.234403 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba3aa26-c8c7-4938-b16b-ce5d0533b214 admin admin] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:51:27.234680 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba3aa26-c8c7-4938-b16b-ce5d0533b214 admin admin] PATH_INFO: `/v3/domains` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:51:27.235400 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ba3aa26-c8c7-4938-b16b-ce5d0533b214 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80396) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 16:51:27.235705 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ba3aa26-c8c7-4938-b16b-ce5d0533b214 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:51:27.237289 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ba3aa26-c8c7-4938-b16b-ce5d0533b214 admin admin] RBAC: Authorization granted {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:51:27.248844 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 1446/2902] 10.222.0.59 () {58 vars in 1152 bytes} [Thu Jun 2 16:51:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 16:51:27.258977 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8d6ea8f-6773-400a-a6b9-c6ec3989cfb1 None None] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:51:27.268344 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8d6ea8f-6773-400a-a6b9-c6ec3989cfb1 None None] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:51:27.273724 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89e2d1ba-9bf7-455a-832f-b2e17a3f5b85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f73d5a98be74242b45222df39fb6213', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:51:27.274415 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e2d1ba-9bf7-455a-832f-b2e17a3f5b85 admin admin] REQUEST_METHOD: `POST` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:51:27.274703 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e2d1ba-9bf7-455a-832f-b2e17a3f5b85 admin admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:51:27.274982 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e2d1ba-9bf7-455a-832f-b2e17a3f5b85 admin admin] PATH_INFO: `/v3/projects` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:51:27.275694 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89e2d1ba-9bf7-455a-832f-b2e17a3f5b85 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:51:27.277632 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89e2d1ba-9bf7-455a-832f-b2e17a3f5b85 admin admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:51:27.373697 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 1457/2903] 10.222.0.59 () {60 vars in 1152 bytes} [Thu Jun 2 16:51:27 2022] POST /identity/v3/projects => generated 385 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 16:51:27.378323 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ba3aa26-c8c7-4938-b16b-ce5d0533b214 admin admin] Authenticating user token {{(pid=80396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:51:27.388766 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ba3aa26-c8c7-4938-b16b-ce5d0533b214 admin admin] Validating token access rules against request {{(pid=80396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:51:27.447658 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f5be5cb-3799-4ee9-8486-28cf1488d5b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f73d5a98be74242b45222df39fb6213', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:51:27.448327 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f5be5cb-3799-4ee9-8486-28cf1488d5b0 admin admin] REQUEST_METHOD: `POST` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:51:27.448614 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f5be5cb-3799-4ee9-8486-28cf1488d5b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:51:27.448894 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f5be5cb-3799-4ee9-8486-28cf1488d5b0 admin admin] PATH_INFO: `/v3/users` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:51:27.449605 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f5be5cb-3799-4ee9-8486-28cf1488d5b0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:51:27.451585 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f5be5cb-3799-4ee9-8486-28cf1488d5b0 admin admin] RBAC: Authorization granted {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:51:27.548393 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 1447/2904] 10.222.0.59 () {60 vars in 1143 bytes} [Thu Jun 2 16:51:27 2022] POST /identity/v3/users => generated 293 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 16:51:27.552410 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89e2d1ba-9bf7-455a-832f-b2e17a3f5b85 admin admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:51:27.563398 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89e2d1ba-9bf7-455a-832f-b2e17a3f5b85 admin admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:51:27.568004 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a48e666f-2a08-4697-a308-563dd7bb962a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f73d5a98be74242b45222df39fb6213', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:51:27.569490 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a48e666f-2a08-4697-a308-563dd7bb962a admin admin] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:51:27.569806 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a48e666f-2a08-4697-a308-563dd7bb962a admin admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:51:27.570119 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a48e666f-2a08-4697-a308-563dd7bb962a admin admin] PATH_INFO: `/v3/roles` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:51:27.570915 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a48e666f-2a08-4697-a308-563dd7bb962a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:51:27.572507 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a48e666f-2a08-4697-a308-563dd7bb962a admin admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:51:27.582886 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 1458/2905] 10.222.0.59 () {58 vars in 1121 bytes} [Thu Jun 2 16:51:27 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 16:51:27.586726 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f5be5cb-3799-4ee9-8486-28cf1488d5b0 admin admin] Authenticating user token {{(pid=80396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:51:27.596440 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f5be5cb-3799-4ee9-8486-28cf1488d5b0 admin admin] Validating token access rules against request {{(pid=80396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:51:27.600946 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7670925f-04a1-4558-ac4b-443e150ca169 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f73d5a98be74242b45222df39fb6213', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:51:27.601582 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7670925f-04a1-4558-ac4b-443e150ca169 admin admin] REQUEST_METHOD: `GET` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:51:27.601870 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7670925f-04a1-4558-ac4b-443e150ca169 admin admin] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:51:27.602175 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7670925f-04a1-4558-ac4b-443e150ca169 admin admin] PATH_INFO: `/v3/roles` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:51:27.602890 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7670925f-04a1-4558-ac4b-443e150ca169 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:51:27.604454 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7670925f-04a1-4558-ac4b-443e150ca169 admin admin] RBAC: Authorization granted {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:51:27.614131 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 1448/2906] 10.222.0.59 () {58 vars in 1121 bytes} [Thu Jun 2 16:51:27 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 16:51:27.618532 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a48e666f-2a08-4697-a308-563dd7bb962a admin admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:51:27.628619 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a48e666f-2a08-4697-a308-563dd7bb962a admin admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:51:27.633792 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da8c0f82-636a-4306-953c-8b67e875d4f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f73d5a98be74242b45222df39fb6213', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:51:27.634740 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da8c0f82-636a-4306-953c-8b67e875d4f8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:51:27.635021 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da8c0f82-636a-4306-953c-8b67e875d4f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:51:27.635295 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da8c0f82-636a-4306-953c-8b67e875d4f8 admin admin] PATH_INFO: `/v3/projects/57e216d22acb46b7b23f786a57914f51/users/d106c6d6bd4347d6af31fd5f139f4588/roles/649e0f2b5a264c419ea6a1441f123a03` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:51:27.649488 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da8c0f82-636a-4306-953c-8b67e875d4f8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=57e216d22acb46b7b23f786a57914f51, user_id=d106c6d6bd4347d6af31fd5f139f4588, role_id=649e0f2b5a264c419ea6a1441f123a03)` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:51:27.652188 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da8c0f82-636a-4306-953c-8b67e875d4f8 admin admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:51:27.765477 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 1459/2907] 10.222.0.59 () {60 vars in 1482 bytes} [Thu Jun 2 16:51:27 2022] PUT /identity/v3/projects/57e216d22acb46b7b23f786a57914f51/users/d106c6d6bd4347d6af31fd5f139f4588/roles/649e0f2b5a264c419ea6a1441f123a03 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 02 16:51:27.776533 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba94b5f-a156-4fc4-a87a-deabd89859e9 None None] REQUEST_METHOD: `POST` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:51:27.776819 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba94b5f-a156-4fc4-a87a-deabd89859e9 None None] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:51:27.777098 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba94b5f-a156-4fc4-a87a-deabd89859e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:51:27.805589 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.auth.core [None req-1ba94b5f-a156-4fc4-a87a-deabd89859e9 None None] MFA Rules not processed for user `d106c6d6bd4347d6af31fd5f139f4588`. Rule list: `[]` (Enabled: `True`). {{(pid=80396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 16:51:27.806841 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.fernet_utils [None req-1ba94b5f-a156-4fc4-a87a-deabd89859e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:51:27.848117 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG dbcounter [-] [80396] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 16:51:27.871699 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 1449/2908] 10.222.0.59 () {58 vars in 957 bytes} [Thu Jun 2 16:51:27 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 16:51:27.876585 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da8c0f82-636a-4306-953c-8b67e875d4f8 admin admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:51:27.920946 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 16:51:27.937957 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da8c0f82-636a-4306-953c-8b67e875d4f8 admin admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:51:27.942632 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ba0eb97-e3fe-4dca-af7d-241d2e332216 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f73d5a98be74242b45222df39fb6213', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:51:27.943300 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba0eb97-e3fe-4dca-af7d-241d2e332216 admin admin] REQUEST_METHOD: `POST` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:51:27.943593 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba0eb97-e3fe-4dca-af7d-241d2e332216 admin admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:51:27.943915 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba0eb97-e3fe-4dca-af7d-241d2e332216 admin admin] PATH_INFO: `/v3/projects` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:51:27.944666 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ba0eb97-e3fe-4dca-af7d-241d2e332216 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:51:27.946599 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ba0eb97-e3fe-4dca-af7d-241d2e332216 admin admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:51:28.081320 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 1460/2909] 10.222.0.59 () {60 vars in 1152 bytes} [Thu Jun 2 16:51:27 2022] POST /identity/v3/projects => generated 385 bytes in 205 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 16:51:28.085344 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ba94b5f-a156-4fc4-a87a-deabd89859e9 None None] Authenticating user token {{(pid=80396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:51:28.095835 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ba94b5f-a156-4fc4-a87a-deabd89859e9 None None] Validating token access rules against request {{(pid=80396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:51:28.150738 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-463b61ed-4562-4c15-811d-8455ca9e0962 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f73d5a98be74242b45222df39fb6213', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:51:28.151376 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-463b61ed-4562-4c15-811d-8455ca9e0962 admin admin] REQUEST_METHOD: `POST` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:51:28.151658 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-463b61ed-4562-4c15-811d-8455ca9e0962 admin admin] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:51:28.151938 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-463b61ed-4562-4c15-811d-8455ca9e0962 admin admin] PATH_INFO: `/v3/users` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:51:28.152622 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-463b61ed-4562-4c15-811d-8455ca9e0962 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:51:28.154538 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-463b61ed-4562-4c15-811d-8455ca9e0962 admin admin] RBAC: Authorization granted {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:51:28.251952 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 1450/2910] 10.222.0.59 () {60 vars in 1143 bytes} [Thu Jun 2 16:51:28 2022] POST /identity/v3/users => generated 299 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 02 16:51:28.255939 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ba0eb97-e3fe-4dca-af7d-241d2e332216 admin admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:51:28.266470 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ba0eb97-e3fe-4dca-af7d-241d2e332216 admin admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:51:28.271071 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c16a71f7-97fe-400b-82d8-d67d5acaf64e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f73d5a98be74242b45222df39fb6213', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:51:28.272213 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16a71f7-97fe-400b-82d8-d67d5acaf64e admin admin] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:51:28.272538 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16a71f7-97fe-400b-82d8-d67d5acaf64e admin admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:51:28.272811 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16a71f7-97fe-400b-82d8-d67d5acaf64e admin admin] PATH_INFO: `/v3/roles` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:51:28.273567 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c16a71f7-97fe-400b-82d8-d67d5acaf64e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:51:28.275192 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c16a71f7-97fe-400b-82d8-d67d5acaf64e admin admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:51:28.285658 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 1461/2911] 10.222.0.59 () {58 vars in 1121 bytes} [Thu Jun 2 16:51:28 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 16:51:28.290380 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-463b61ed-4562-4c15-811d-8455ca9e0962 admin admin] Authenticating user token {{(pid=80396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:51:28.300244 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-463b61ed-4562-4c15-811d-8455ca9e0962 admin admin] Validating token access rules against request {{(pid=80396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:51:28.305016 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcd78c8b-27d9-4044-af73-9c3fe2d361de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f73d5a98be74242b45222df39fb6213', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:51:28.305885 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd78c8b-27d9-4044-af73-9c3fe2d361de admin admin] REQUEST_METHOD: `PUT` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:51:28.306356 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd78c8b-27d9-4044-af73-9c3fe2d361de admin admin] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:51:28.313697 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd78c8b-27d9-4044-af73-9c3fe2d361de admin admin] PATH_INFO: `/v3/projects/15fa874eec464850ac1dbcca324c0ca9/users/c48605afb5e84bb4b08459d0180b72f6/roles/f1e0c25f6e9049e897cb7350c7e54ab3` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:51:28.321438 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcd78c8b-27d9-4044-af73-9c3fe2d361de admin admin] RBAC: Authorizing `identity:create_grant(project_id=15fa874eec464850ac1dbcca324c0ca9, user_id=c48605afb5e84bb4b08459d0180b72f6, role_id=f1e0c25f6e9049e897cb7350c7e54ab3)` {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:51:28.324150 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcd78c8b-27d9-4044-af73-9c3fe2d361de admin admin] RBAC: Authorization granted {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:51:28.400405 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 1451/2912] 10.222.0.59 () {60 vars in 1482 bytes} [Thu Jun 2 16:51:28 2022] PUT /identity/v3/projects/15fa874eec464850ac1dbcca324c0ca9/users/c48605afb5e84bb4b08459d0180b72f6/roles/f1e0c25f6e9049e897cb7350c7e54ab3 => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 16:51:28.404363 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c16a71f7-97fe-400b-82d8-d67d5acaf64e admin admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:51:28.416244 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c16a71f7-97fe-400b-82d8-d67d5acaf64e admin admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:51:28.471901 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1aa5dea-d478-4e05-be2a-49e08c6d4bf5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f73d5a98be74242b45222df39fb6213', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:51:28.472482 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1aa5dea-d478-4e05-be2a-49e08c6d4bf5 admin admin] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:51:28.472766 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1aa5dea-d478-4e05-be2a-49e08c6d4bf5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:51:28.473044 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1aa5dea-d478-4e05-be2a-49e08c6d4bf5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:51:28.473780 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1aa5dea-d478-4e05-be2a-49e08c6d4bf5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:51:28.475968 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1aa5dea-d478-4e05-be2a-49e08c6d4bf5 admin admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:51:28.485412 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 1462/2913] 10.222.0.59 () {58 vars in 1121 bytes} [Thu Jun 2 16:51:28 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 02 16:51:28.489505 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcd78c8b-27d9-4044-af73-9c3fe2d361de admin admin] Authenticating user token {{(pid=80396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:51:28.500148 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcd78c8b-27d9-4044-af73-9c3fe2d361de admin admin] Validating token access rules against request {{(pid=80396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:51:28.504692 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47c2a788-d9f9-483f-b2d4-8e9b611e90c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f73d5a98be74242b45222df39fb6213', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:51:28.505557 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c2a788-d9f9-483f-b2d4-8e9b611e90c9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:51:28.505876 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c2a788-d9f9-483f-b2d4-8e9b611e90c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:51:28.506174 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c2a788-d9f9-483f-b2d4-8e9b611e90c9 admin admin] PATH_INFO: `/v3/projects/15fa874eec464850ac1dbcca324c0ca9/users/c48605afb5e84bb4b08459d0180b72f6/roles/f1e0c25f6e9049e897cb7350c7e54ab3` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:51:28.508130 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47c2a788-d9f9-483f-b2d4-8e9b611e90c9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=15fa874eec464850ac1dbcca324c0ca9, user_id=c48605afb5e84bb4b08459d0180b72f6, role_id=f1e0c25f6e9049e897cb7350c7e54ab3)` {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:51:28.510775 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47c2a788-d9f9-483f-b2d4-8e9b611e90c9 admin admin] RBAC: Authorization granted {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:51:28.520819 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 1452/2914] 10.222.0.59 () {60 vars in 1482 bytes} [Thu Jun 2 16:51:28 2022] PUT /identity/v3/projects/15fa874eec464850ac1dbcca324c0ca9/users/c48605afb5e84bb4b08459d0180b72f6/roles/f1e0c25f6e9049e897cb7350c7e54ab3 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 16:51:28.531139 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16d3e7c-d655-4faa-a508-673b53bb1c8e None None] REQUEST_METHOD: `POST` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:51:28.531433 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16d3e7c-d655-4faa-a508-673b53bb1c8e None None] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:51:28.531712 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16d3e7c-d655-4faa-a508-673b53bb1c8e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:51:28.558066 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.auth.core [None req-c16d3e7c-d655-4faa-a508-673b53bb1c8e None None] MFA Rules not processed for user `c48605afb5e84bb4b08459d0180b72f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 16:51:28.559285 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.fernet_utils [None req-c16d3e7c-d655-4faa-a508-673b53bb1c8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:51:28.625988 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 1463/2915] 10.222.0.59 () {58 vars in 957 bytes} [Thu Jun 2 16:51:28 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 16:51:28.637648 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47c2a788-d9f9-483f-b2d4-8e9b611e90c9 admin admin] Authenticating user token {{(pid=80396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:51:28.639364 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.fernet_utils [None req-47c2a788-d9f9-483f-b2d4-8e9b611e90c9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:51:28.698105 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47c2a788-d9f9-483f-b2d4-8e9b611e90c9 admin admin] Validating token access rules against request {{(pid=80396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:51:28.701807 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9161fdf2-7f06-4895-99e7-0fd7c22f476c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6534961c369940a5b88f310c6450250b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c87c981909d4b8db02783421818c79b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:51:28.702526 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9161fdf2-7f06-4895-99e7-0fd7c22f476c service cinder] REQUEST_METHOD: `GET` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:51:28.702812 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9161fdf2-7f06-4895-99e7-0fd7c22f476c service cinder] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:51:28.703087 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9161fdf2-7f06-4895-99e7-0fd7c22f476c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:51:28.713349 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9161fdf2-7f06-4895-99e7-0fd7c22f476c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:51:28.714804 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9161fdf2-7f06-4895-99e7-0fd7c22f476c service cinder] RBAC: Authorization granted {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:51:28.724237 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 1453/2916] 10.222.0.59 () {60 vars in 1365 bytes} [Thu Jun 2 16:51:28 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 16:51:28.752079 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c16d3e7c-d655-4faa-a508-673b53bb1c8e None None] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:51:28.792488 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 16:51:28.813318 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c16d3e7c-d655-4faa-a508-673b53bb1c8e None None] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:51:28.817983 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c4d94e6-3279-41dc-9496-70399b1eeb3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f73d5a98be74242b45222df39fb6213', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:51:28.819461 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c4d94e6-3279-41dc-9496-70399b1eeb3f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:51:28.819738 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c4d94e6-3279-41dc-9496-70399b1eeb3f admin admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:51:28.820010 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c4d94e6-3279-41dc-9496-70399b1eeb3f admin admin] PATH_INFO: `/v3/users/d106c6d6bd4347d6af31fd5f139f4588` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:51:28.821218 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c4d94e6-3279-41dc-9496-70399b1eeb3f admin admin] RBAC: Authorizing `identity:delete_user(user_id=d106c6d6bd4347d6af31fd5f139f4588)` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:51:28.823510 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c4d94e6-3279-41dc-9496-70399b1eeb3f admin admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:51:29.015079 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.notifications [None req-3c4d94e6-3279-41dc-9496-70399b1eeb3f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd106c6d6bd4347d6af31fd5f139f4588'} {{(pid=80395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:51:29.082396 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.notifications [None req-3c4d94e6-3279-41dc-9496-70399b1eeb3f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd106c6d6bd4347d6af31fd5f139f4588'} {{(pid=80395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:51:29.095511 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.notifications [None req-3c4d94e6-3279-41dc-9496-70399b1eeb3f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd106c6d6bd4347d6af31fd5f139f4588'} {{(pid=80395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:51:29.096199 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.notifications [None req-3c4d94e6-3279-41dc-9496-70399b1eeb3f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd106c6d6bd4347d6af31fd5f139f4588'} {{(pid=80395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:51:29.103795 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.notifications [None req-3c4d94e6-3279-41dc-9496-70399b1eeb3f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd106c6d6bd4347d6af31fd5f139f4588'} {{(pid=80395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:51:29.109699 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 1464/2917] 10.222.0.59 () {58 vars in 1223 bytes} [Thu Jun 2 16:51:28 2022] DELETE /identity/v3/users/d106c6d6bd4347d6af31fd5f139f4588 => generated 0 bytes in 358 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 16:51:29.114207 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab84ae31-f32d-4765-9749-3b87c25f2348 None None] REQUEST_METHOD: `POST` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:51:29.114499 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab84ae31-f32d-4765-9749-3b87c25f2348 None None] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:51:29.114777 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab84ae31-f32d-4765-9749-3b87c25f2348 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:51:29.132626 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.auth.core [None req-ab84ae31-f32d-4765-9749-3b87c25f2348 None None] MFA Rules not processed for user `400d1f4db9de49638549e5db29a041e1`. Rule list: `[]` (Enabled: `True`). {{(pid=80396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 16:51:29.133832 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.fernet_utils [None req-ab84ae31-f32d-4765-9749-3b87c25f2348 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:51:29.167512 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG dbcounter [-] [80396] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 16:51:29.193690 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 1454/2918] 10.222.0.59 () {58 vars in 957 bytes} [Thu Jun 2 16:51:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 16:51:29.206426 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c4d94e6-3279-41dc-9496-70399b1eeb3f admin admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:51:29.206426 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.fernet_utils [None req-3c4d94e6-3279-41dc-9496-70399b1eeb3f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:51:29.262296 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c4d94e6-3279-41dc-9496-70399b1eeb3f admin admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:51:29.268141 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d9576d-2598-43e7-b533-c29201c2e322 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9af40ddfe9ff4be3887b068f13a28dc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c87c981909d4b8db02783421818c79b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:51:29.268141 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d9576d-2598-43e7-b533-c29201c2e322 service neutron] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:51:29.268141 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d9576d-2598-43e7-b533-c29201c2e322 service neutron] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:51:29.268141 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d9576d-2598-43e7-b533-c29201c2e322 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:51:29.276647 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70d9576d-2598-43e7-b533-c29201c2e322 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:51:29.278095 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70d9576d-2598-43e7-b533-c29201c2e322 service neutron] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:51:29.287500 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 1465/2919] 10.222.0.59 () {60 vars in 1365 bytes} [Thu Jun 2 16:51:29 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 02 16:51:29.764204 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab84ae31-f32d-4765-9749-3b87c25f2348 None None] Authenticating user token {{(pid=80396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:51:29.765756 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.fernet_utils [None req-ab84ae31-f32d-4765-9749-3b87c25f2348 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:51:29.779397 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab84ae31-f32d-4765-9749-3b87c25f2348 None None] Validating token access rules against request {{(pid=80396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:51:29.784014 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41ed0ba1-1cb1-44a8-bcc2-04df0db13a87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f73d5a98be74242b45222df39fb6213', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:51:29.784880 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ed0ba1-1cb1-44a8-bcc2-04df0db13a87 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:51:29.785169 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ed0ba1-1cb1-44a8-bcc2-04df0db13a87 admin admin] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:51:29.785446 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ed0ba1-1cb1-44a8-bcc2-04df0db13a87 admin admin] PATH_INFO: `/v3/projects/57e216d22acb46b7b23f786a57914f51` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:51:29.786673 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41ed0ba1-1cb1-44a8-bcc2-04df0db13a87 admin admin] RBAC: Authorizing `identity:delete_project(project_id=57e216d22acb46b7b23f786a57914f51)` {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:51:29.793476 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41ed0ba1-1cb1-44a8-bcc2-04df0db13a87 admin admin] RBAC: Authorization granted {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:51:29.889125 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.notifications [None req-41ed0ba1-1cb1-44a8-bcc2-04df0db13a87 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '57e216d22acb46b7b23f786a57914f51', 'request_id': 'req-41ed0ba1-1cb1-44a8-bcc2-04df0db13a87'} {{(pid=80396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:51:29.895282 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.notifications [None req-41ed0ba1-1cb1-44a8-bcc2-04df0db13a87 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '57e216d22acb46b7b23f786a57914f51', 'request_id': 'req-41ed0ba1-1cb1-44a8-bcc2-04df0db13a87'} {{(pid=80396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:51:29.967541 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.notifications [None req-41ed0ba1-1cb1-44a8-bcc2-04df0db13a87 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '57e216d22acb46b7b23f786a57914f51', 'request_id': 'req-41ed0ba1-1cb1-44a8-bcc2-04df0db13a87'} {{(pid=80396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:51:29.978702 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.notifications [None req-41ed0ba1-1cb1-44a8-bcc2-04df0db13a87 admin admin] The token cache is being invalidate because project 57e216d22acb46b7b23f786a57914f51 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80396) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 02 16:51:29.978990 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.notifications [None req-41ed0ba1-1cb1-44a8-bcc2-04df0db13a87 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:51:29.979625 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.notifications [None req-41ed0ba1-1cb1-44a8-bcc2-04df0db13a87 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:51:29.981162 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 1455/2920] 10.222.0.59 () {58 vars in 1232 bytes} [Thu Jun 2 16:51:29 2022] DELETE /identity/v3/projects/57e216d22acb46b7b23f786a57914f51 => generated 0 bytes in 218 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 16:51:29.985063 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d9576d-2598-43e7-b533-c29201c2e322 service neutron] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:51:29.994822 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d9576d-2598-43e7-b533-c29201c2e322 service neutron] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:51:30.051895 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4eb85cc-66a0-4581-94c9-8131f95af613 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f73d5a98be74242b45222df39fb6213', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:51:30.052695 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4eb85cc-66a0-4581-94c9-8131f95af613 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:51:30.053522 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4eb85cc-66a0-4581-94c9-8131f95af613 admin admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:51:30.053811 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4eb85cc-66a0-4581-94c9-8131f95af613 admin admin] PATH_INFO: `/v3/users/c48605afb5e84bb4b08459d0180b72f6` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:51:30.055092 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4eb85cc-66a0-4581-94c9-8131f95af613 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c48605afb5e84bb4b08459d0180b72f6)` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:51:30.057017 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4eb85cc-66a0-4581-94c9-8131f95af613 admin admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:51:30.058604 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 16:51:30.224885 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.notifications [None req-b4eb85cc-66a0-4581-94c9-8131f95af613 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c48605afb5e84bb4b08459d0180b72f6'} {{(pid=80395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:51:30.314260 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.notifications [None req-b4eb85cc-66a0-4581-94c9-8131f95af613 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c48605afb5e84bb4b08459d0180b72f6'} {{(pid=80395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:51:30.328653 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.notifications [None req-b4eb85cc-66a0-4581-94c9-8131f95af613 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c48605afb5e84bb4b08459d0180b72f6'} {{(pid=80395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:51:30.329660 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.notifications [None req-b4eb85cc-66a0-4581-94c9-8131f95af613 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c48605afb5e84bb4b08459d0180b72f6'} {{(pid=80395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:51:30.340029 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.notifications [None req-b4eb85cc-66a0-4581-94c9-8131f95af613 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c48605afb5e84bb4b08459d0180b72f6'} {{(pid=80395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:51:30.346044 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 1466/2921] 10.222.0.59 () {58 vars in 1223 bytes} [Thu Jun 2 16:51:29 2022] DELETE /identity/v3/users/c48605afb5e84bb4b08459d0180b72f6 => generated 0 bytes in 361 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 16:51:30.784646 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41ed0ba1-1cb1-44a8-bcc2-04df0db13a87 admin admin] Authenticating user token {{(pid=80396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:51:30.786959 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.fernet_utils [None req-41ed0ba1-1cb1-44a8-bcc2-04df0db13a87 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:51:30.802729 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41ed0ba1-1cb1-44a8-bcc2-04df0db13a87 admin admin] Validating token access rules against request {{(pid=80396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:51:30.867944 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d994662d-6ce2-4217-b34c-2e11b6a52739 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f73d5a98be74242b45222df39fb6213', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:51:30.868790 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d994662d-6ce2-4217-b34c-2e11b6a52739 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:51:30.869070 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d994662d-6ce2-4217-b34c-2e11b6a52739 admin admin] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:51:30.869399 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d994662d-6ce2-4217-b34c-2e11b6a52739 admin admin] PATH_INFO: `/v3/projects/15fa874eec464850ac1dbcca324c0ca9` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:51:30.870532 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d994662d-6ce2-4217-b34c-2e11b6a52739 admin admin] RBAC: Authorizing `identity:delete_project(project_id=15fa874eec464850ac1dbcca324c0ca9)` {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:51:30.872407 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d994662d-6ce2-4217-b34c-2e11b6a52739 admin admin] RBAC: Authorization granted {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:51:30.980250 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.notifications [None req-d994662d-6ce2-4217-b34c-2e11b6a52739 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '15fa874eec464850ac1dbcca324c0ca9', 'request_id': 'req-d994662d-6ce2-4217-b34c-2e11b6a52739'} {{(pid=80396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:51:30.986438 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.notifications [None req-d994662d-6ce2-4217-b34c-2e11b6a52739 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '15fa874eec464850ac1dbcca324c0ca9', 'request_id': 'req-d994662d-6ce2-4217-b34c-2e11b6a52739'} {{(pid=80396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:51:31.062861 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.notifications [None req-d994662d-6ce2-4217-b34c-2e11b6a52739 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '15fa874eec464850ac1dbcca324c0ca9', 'request_id': 'req-d994662d-6ce2-4217-b34c-2e11b6a52739'} {{(pid=80396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:51:31.064931 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG dbcounter [-] [80396] Writing DB stats keystone:SELECT=85,keystone:DELETE=13,keystone:INSERT=2 {{(pid=80396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 16:51:31.075677 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.notifications [None req-d994662d-6ce2-4217-b34c-2e11b6a52739 admin admin] The token cache is being invalidate because project 15fa874eec464850ac1dbcca324c0ca9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80396) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 02 16:51:31.075677 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.notifications [None req-d994662d-6ce2-4217-b34c-2e11b6a52739 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:51:31.075677 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.notifications [None req-d994662d-6ce2-4217-b34c-2e11b6a52739 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:51:31.076340 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 1456/2922] 10.222.0.59 () {58 vars in 1232 bytes} [Thu Jun 2 16:51:30 2022] DELETE /identity/v3/projects/15fa874eec464850ac1dbcca324c0ca9 => generated 0 bytes in 292 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 16:51:31.081394 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-525d4bd2-5ed7-4764-a759-d44fd532d367 None None] REQUEST_METHOD: `POST` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:51:31.081851 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-525d4bd2-5ed7-4764-a759-d44fd532d367 None None] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:51:31.081958 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-525d4bd2-5ed7-4764-a759-d44fd532d367 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:51:31.099529 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.auth.core [None req-525d4bd2-5ed7-4764-a759-d44fd532d367 None None] MFA Rules not processed for user `400d1f4db9de49638549e5db29a041e1`. Rule list: `[]` (Enabled: `True`). {{(pid=80395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 16:51:31.101580 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.fernet_utils [None req-525d4bd2-5ed7-4764-a759-d44fd532d367 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:51:31.160846 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 1467/2923] 10.222.0.59 () {58 vars in 957 bytes} [Thu Jun 2 16:51:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 16:51:31.169406 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6a26af-ca97-4729-b775-3ed2827ad203 None None] REQUEST_METHOD: `POST` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:51:31.169716 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6a26af-ca97-4729-b775-3ed2827ad203 None None] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:51:31.169987 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6a26af-ca97-4729-b775-3ed2827ad203 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:51:31.189410 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.auth.core [None req-6b6a26af-ca97-4729-b775-3ed2827ad203 None None] MFA Rules not processed for user `400d1f4db9de49638549e5db29a041e1`. Rule list: `[]` (Enabled: `True`). {{(pid=80396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 16:51:31.190623 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.fernet_utils [None req-6b6a26af-ca97-4729-b775-3ed2827ad203 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:51:31.199202 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 1457/2924] 10.222.0.59 () {58 vars in 957 bytes} [Thu Jun 2 16:51:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 16:51:31.203427 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-525d4bd2-5ed7-4764-a759-d44fd532d367 None None] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:51:31.213717 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-525d4bd2-5ed7-4764-a759-d44fd532d367 None None] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:51:31.218235 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1432f9fd-369f-4ead-9049-299edf4bb508 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f73d5a98be74242b45222df39fb6213', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:51:31.218883 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1432f9fd-369f-4ead-9049-299edf4bb508 admin admin] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:51:31.219164 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1432f9fd-369f-4ead-9049-299edf4bb508 admin admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:51:31.219435 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1432f9fd-369f-4ead-9049-299edf4bb508 admin admin] PATH_INFO: `/v3/domains` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:51:31.220153 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1432f9fd-369f-4ead-9049-299edf4bb508 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80395) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 16:51:31.220455 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1432f9fd-369f-4ead-9049-299edf4bb508 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:51:31.222036 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1432f9fd-369f-4ead-9049-299edf4bb508 admin admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:51:31.234115 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 1468/2925] 10.222.0.59 () {58 vars in 1152 bytes} [Thu Jun 2 16:51:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 16:51:31.238320 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b6a26af-ca97-4729-b775-3ed2827ad203 None None] Authenticating user token {{(pid=80396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:51:31.247709 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b6a26af-ca97-4729-b775-3ed2827ad203 None None] Validating token access rules against request {{(pid=80396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:51:31.252551 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af15c966-2e1a-4505-85e3-10ca63e7d967 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f73d5a98be74242b45222df39fb6213', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:51:31.253365 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af15c966-2e1a-4505-85e3-10ca63e7d967 admin admin] REQUEST_METHOD: `POST` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:51:31.253657 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af15c966-2e1a-4505-85e3-10ca63e7d967 admin admin] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:51:31.253936 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af15c966-2e1a-4505-85e3-10ca63e7d967 admin admin] PATH_INFO: `/v3/projects` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:51:31.254655 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af15c966-2e1a-4505-85e3-10ca63e7d967 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:51:31.256629 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af15c966-2e1a-4505-85e3-10ca63e7d967 admin admin] RBAC: Authorization granted {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:51:31.359312 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 1458/2926] 10.222.0.59 () {60 vars in 1152 bytes} [Thu Jun 2 16:51:31 2022] POST /identity/v3/projects => generated 373 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 16:51:31.363255 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1432f9fd-369f-4ead-9049-299edf4bb508 admin admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:51:31.373422 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1432f9fd-369f-4ead-9049-299edf4bb508 admin admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:51:31.429652 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eea3fbbd-4fcd-4123-9202-2dad4a62a4e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f73d5a98be74242b45222df39fb6213', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:51:31.430349 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea3fbbd-4fcd-4123-9202-2dad4a62a4e7 admin admin] REQUEST_METHOD: `POST` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:51:31.430629 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea3fbbd-4fcd-4123-9202-2dad4a62a4e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:51:31.430902 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea3fbbd-4fcd-4123-9202-2dad4a62a4e7 admin admin] PATH_INFO: `/v3/users` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:51:31.431578 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eea3fbbd-4fcd-4123-9202-2dad4a62a4e7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:51:31.433489 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eea3fbbd-4fcd-4123-9202-2dad4a62a4e7 admin admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:51:31.443027 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writing DB stats keystone:SELECT=86,keystone:DELETE=10,keystone:INSERT=4 {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 16:51:31.520146 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 1469/2927] 10.222.0.59 () {60 vars in 1143 bytes} [Thu Jun 2 16:51:31 2022] POST /identity/v3/users => generated 287 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 16:51:31.524776 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af15c966-2e1a-4505-85e3-10ca63e7d967 admin admin] Authenticating user token {{(pid=80396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:51:31.535456 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af15c966-2e1a-4505-85e3-10ca63e7d967 admin admin] Validating token access rules against request {{(pid=80396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:51:31.540855 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c825b491-8288-4c9d-86aa-76b04952595c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f73d5a98be74242b45222df39fb6213', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:51:31.541550 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c825b491-8288-4c9d-86aa-76b04952595c admin admin] REQUEST_METHOD: `GET` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:51:31.541835 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c825b491-8288-4c9d-86aa-76b04952595c admin admin] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:51:31.542141 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c825b491-8288-4c9d-86aa-76b04952595c admin admin] PATH_INFO: `/v3/roles` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:51:31.542870 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c825b491-8288-4c9d-86aa-76b04952595c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:51:31.544457 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c825b491-8288-4c9d-86aa-76b04952595c admin admin] RBAC: Authorization granted {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:51:31.555953 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 1459/2928] 10.222.0.59 () {58 vars in 1121 bytes} [Thu Jun 2 16:51:31 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 16:51:31.559966 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eea3fbbd-4fcd-4123-9202-2dad4a62a4e7 admin admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:51:31.570282 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eea3fbbd-4fcd-4123-9202-2dad4a62a4e7 admin admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:51:31.574913 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb5d003e-d231-4ca0-aee7-b80dcf4923cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f73d5a98be74242b45222df39fb6213', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:51:31.575572 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb5d003e-d231-4ca0-aee7-b80dcf4923cc admin admin] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:51:31.576062 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb5d003e-d231-4ca0-aee7-b80dcf4923cc admin admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:51:31.576497 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb5d003e-d231-4ca0-aee7-b80dcf4923cc admin admin] PATH_INFO: `/v3/roles` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:51:31.577600 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb5d003e-d231-4ca0-aee7-b80dcf4923cc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:51:31.579286 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb5d003e-d231-4ca0-aee7-b80dcf4923cc admin admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:51:31.590438 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 1470/2929] 10.222.0.59 () {58 vars in 1121 bytes} [Thu Jun 2 16:51:31 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 16:51:31.594494 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c825b491-8288-4c9d-86aa-76b04952595c admin admin] Authenticating user token {{(pid=80396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:51:31.604873 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c825b491-8288-4c9d-86aa-76b04952595c admin admin] Validating token access rules against request {{(pid=80396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:51:31.609489 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f910a66a-3761-4faf-b979-de59f2c29fec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f73d5a98be74242b45222df39fb6213', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:51:31.610333 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f910a66a-3761-4faf-b979-de59f2c29fec admin admin] REQUEST_METHOD: `PUT` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:51:31.610618 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f910a66a-3761-4faf-b979-de59f2c29fec admin admin] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:51:31.610897 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f910a66a-3761-4faf-b979-de59f2c29fec admin admin] PATH_INFO: `/v3/projects/24b36cc8e4834fce80a1419ed3eb7181/users/853dab87e3884ea294da24a0df055a4b/roles/649e0f2b5a264c419ea6a1441f123a03` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:51:31.625440 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f910a66a-3761-4faf-b979-de59f2c29fec admin admin] RBAC: Authorizing `identity:create_grant(project_id=24b36cc8e4834fce80a1419ed3eb7181, user_id=853dab87e3884ea294da24a0df055a4b, role_id=649e0f2b5a264c419ea6a1441f123a03)` {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:51:31.628133 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f910a66a-3761-4faf-b979-de59f2c29fec admin admin] RBAC: Authorization granted {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:51:31.737277 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 1460/2930] 10.222.0.59 () {60 vars in 1482 bytes} [Thu Jun 2 16:51:31 2022] PUT /identity/v3/projects/24b36cc8e4834fce80a1419ed3eb7181/users/853dab87e3884ea294da24a0df055a4b/roles/649e0f2b5a264c419ea6a1441f123a03 => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 16:51:31.748458 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5417c5ac-ec0f-4707-af54-6cf263370b37 None None] REQUEST_METHOD: `POST` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:51:31.748734 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5417c5ac-ec0f-4707-af54-6cf263370b37 None None] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:51:31.749014 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5417c5ac-ec0f-4707-af54-6cf263370b37 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:51:31.777812 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.auth.core [None req-5417c5ac-ec0f-4707-af54-6cf263370b37 None None] MFA Rules not processed for user `853dab87e3884ea294da24a0df055a4b`. Rule list: `[]` (Enabled: `True`). {{(pid=80395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 16:51:31.779067 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.fernet_utils [None req-5417c5ac-ec0f-4707-af54-6cf263370b37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:51:31.847201 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 1471/2931] 10.222.0.59 () {58 vars in 957 bytes} [Thu Jun 2 16:51:31 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 16:51:31.858484 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f910a66a-3761-4faf-b979-de59f2c29fec admin admin] Authenticating user token {{(pid=80396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:51:31.860283 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.fernet_utils [None req-f910a66a-3761-4faf-b979-de59f2c29fec admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:51:31.916825 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f910a66a-3761-4faf-b979-de59f2c29fec admin admin] Validating token access rules against request {{(pid=80396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:51:31.920388 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20acdf74-cef5-4d03-9a27-fea06bfe5974 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6534961c369940a5b88f310c6450250b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c87c981909d4b8db02783421818c79b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:51:31.921011 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20acdf74-cef5-4d03-9a27-fea06bfe5974 service cinder] REQUEST_METHOD: `GET` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:51:31.921290 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20acdf74-cef5-4d03-9a27-fea06bfe5974 service cinder] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:51:31.921563 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20acdf74-cef5-4d03-9a27-fea06bfe5974 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:51:31.929718 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20acdf74-cef5-4d03-9a27-fea06bfe5974 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:51:31.931156 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20acdf74-cef5-4d03-9a27-fea06bfe5974 service cinder] RBAC: Authorization granted {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:51:31.939801 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 1461/2932] 10.222.0.59 () {60 vars in 1365 bytes} [Thu Jun 2 16:51:31 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 16:51:35.897808 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5417c5ac-ec0f-4707-af54-6cf263370b37 None None] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:51:35.962255 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5417c5ac-ec0f-4707-af54-6cf263370b37 None None] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:51:35.966634 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b11c97c2-ed05-4d4a-960c-7c995cb16abb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f73d5a98be74242b45222df39fb6213', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:51:35.967490 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b11c97c2-ed05-4d4a-960c-7c995cb16abb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:51:35.967785 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b11c97c2-ed05-4d4a-960c-7c995cb16abb admin admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:51:35.968044 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b11c97c2-ed05-4d4a-960c-7c995cb16abb admin admin] PATH_INFO: `/v3/users/853dab87e3884ea294da24a0df055a4b` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:51:35.969205 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b11c97c2-ed05-4d4a-960c-7c995cb16abb admin admin] RBAC: Authorizing `identity:delete_user(user_id=853dab87e3884ea294da24a0df055a4b)` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:51:35.971145 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b11c97c2-ed05-4d4a-960c-7c995cb16abb admin admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:51:36.125183 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.notifications [None req-b11c97c2-ed05-4d4a-960c-7c995cb16abb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '853dab87e3884ea294da24a0df055a4b'} {{(pid=80395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:51:36.194938 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.notifications [None req-b11c97c2-ed05-4d4a-960c-7c995cb16abb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '853dab87e3884ea294da24a0df055a4b'} {{(pid=80395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:51:36.207977 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.notifications [None req-b11c97c2-ed05-4d4a-960c-7c995cb16abb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '853dab87e3884ea294da24a0df055a4b'} {{(pid=80395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:51:36.208622 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.notifications [None req-b11c97c2-ed05-4d4a-960c-7c995cb16abb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '853dab87e3884ea294da24a0df055a4b'} {{(pid=80395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:51:36.213474 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 16:51:36.216352 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.notifications [None req-b11c97c2-ed05-4d4a-960c-7c995cb16abb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '853dab87e3884ea294da24a0df055a4b'} {{(pid=80395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:51:36.222359 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 1472/2933] 10.222.0.59 () {58 vars in 1223 bytes} [Thu Jun 2 16:51:35 2022] DELETE /identity/v3/users/853dab87e3884ea294da24a0df055a4b => generated 0 bytes in 325 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 16:51:36.227739 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c772da80-c273-45f8-87ef-7a777072ca84 None None] REQUEST_METHOD: `POST` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:51:36.228224 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c772da80-c273-45f8-87ef-7a777072ca84 None None] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:51:36.228314 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c772da80-c273-45f8-87ef-7a777072ca84 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:51:36.246299 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.auth.core [None req-c772da80-c273-45f8-87ef-7a777072ca84 None None] MFA Rules not processed for user `400d1f4db9de49638549e5db29a041e1`. Rule list: `[]` (Enabled: `True`). {{(pid=80396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 16:51:36.247500 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.fernet_utils [None req-c772da80-c273-45f8-87ef-7a777072ca84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:51:36.305662 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 1462/2934] 10.222.0.59 () {58 vars in 957 bytes} [Thu Jun 2 16:51:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 16:51:36.320801 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b11c97c2-ed05-4d4a-960c-7c995cb16abb admin admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:51:36.322256 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.fernet_utils [None req-b11c97c2-ed05-4d4a-960c-7c995cb16abb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:51:36.380293 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b11c97c2-ed05-4d4a-960c-7c995cb16abb admin admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:51:36.384261 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f715d26d-06ca-4ee8-a1c2-3155024bc518 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9af40ddfe9ff4be3887b068f13a28dc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c87c981909d4b8db02783421818c79b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:51:36.386352 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f715d26d-06ca-4ee8-a1c2-3155024bc518 service neutron] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:51:36.386648 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f715d26d-06ca-4ee8-a1c2-3155024bc518 service neutron] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:51:36.387006 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f715d26d-06ca-4ee8-a1c2-3155024bc518 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:51:36.396970 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f715d26d-06ca-4ee8-a1c2-3155024bc518 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:51:36.398479 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f715d26d-06ca-4ee8-a1c2-3155024bc518 service neutron] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:51:36.408824 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 1473/2935] 10.222.0.59 () {60 vars in 1365 bytes} [Thu Jun 2 16:51:36 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 02 16:51:36.807218 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c772da80-c273-45f8-87ef-7a777072ca84 None None] Authenticating user token {{(pid=80396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:51:36.808618 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.fernet_utils [None req-c772da80-c273-45f8-87ef-7a777072ca84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:51:36.822476 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c772da80-c273-45f8-87ef-7a777072ca84 None None] Validating token access rules against request {{(pid=80396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:51:36.827165 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62684b9d-c9fc-488a-8cbc-15c8c3b722f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f73d5a98be74242b45222df39fb6213', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:51:36.828012 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62684b9d-c9fc-488a-8cbc-15c8c3b722f1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:51:36.828295 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62684b9d-c9fc-488a-8cbc-15c8c3b722f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:51:36.828598 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62684b9d-c9fc-488a-8cbc-15c8c3b722f1 admin admin] PATH_INFO: `/v3/projects/24b36cc8e4834fce80a1419ed3eb7181` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:51:36.829746 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62684b9d-c9fc-488a-8cbc-15c8c3b722f1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=24b36cc8e4834fce80a1419ed3eb7181)` {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:51:36.834113 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62684b9d-c9fc-488a-8cbc-15c8c3b722f1 admin admin] RBAC: Authorization granted {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:51:36.921194 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG dbcounter [-] [80396] Writing DB stats keystone:SELECT=96,keystone:DELETE=2,keystone:INSERT=2 {{(pid=80396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 16:51:36.940241 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.notifications [None req-62684b9d-c9fc-488a-8cbc-15c8c3b722f1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '24b36cc8e4834fce80a1419ed3eb7181', 'request_id': 'req-62684b9d-c9fc-488a-8cbc-15c8c3b722f1'} {{(pid=80396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:51:36.942888 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.notifications [None req-62684b9d-c9fc-488a-8cbc-15c8c3b722f1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '24b36cc8e4834fce80a1419ed3eb7181', 'request_id': 'req-62684b9d-c9fc-488a-8cbc-15c8c3b722f1'} {{(pid=80396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:51:37.014058 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.notifications [None req-62684b9d-c9fc-488a-8cbc-15c8c3b722f1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '24b36cc8e4834fce80a1419ed3eb7181', 'request_id': 'req-62684b9d-c9fc-488a-8cbc-15c8c3b722f1'} {{(pid=80396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:51:37.025851 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.notifications [None req-62684b9d-c9fc-488a-8cbc-15c8c3b722f1 admin admin] The token cache is being invalidate because project 24b36cc8e4834fce80a1419ed3eb7181 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80396) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 02 16:51:37.026181 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.notifications [None req-62684b9d-c9fc-488a-8cbc-15c8c3b722f1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:51:37.026936 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.notifications [None req-62684b9d-c9fc-488a-8cbc-15c8c3b722f1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:51:37.028567 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 1463/2936] 10.222.0.59 () {58 vars in 1232 bytes} [Thu Jun 2 16:51:36 2022] DELETE /identity/v3/projects/24b36cc8e4834fce80a1419ed3eb7181 => generated 0 bytes in 222 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 16:51:37.033517 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf294433-121f-4349-a4e3-4394a9caee1f None None] REQUEST_METHOD: `POST` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:51:37.034012 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf294433-121f-4349-a4e3-4394a9caee1f None None] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:51:37.034148 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf294433-121f-4349-a4e3-4394a9caee1f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:51:37.053021 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.auth.core [None req-bf294433-121f-4349-a4e3-4394a9caee1f None None] MFA Rules not processed for user `400d1f4db9de49638549e5db29a041e1`. Rule list: `[]` (Enabled: `True`). {{(pid=80395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 16:51:37.054465 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.fernet_utils [None req-bf294433-121f-4349-a4e3-4394a9caee1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:51:37.114726 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 1474/2937] 10.222.0.59 () {58 vars in 957 bytes} [Thu Jun 2 16:51:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 16:51:37.122432 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22856dcd-0b97-4206-a676-49f159a2c185 None None] REQUEST_METHOD: `POST` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:51:37.122726 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22856dcd-0b97-4206-a676-49f159a2c185 None None] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:51:37.123010 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22856dcd-0b97-4206-a676-49f159a2c185 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:51:37.141857 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.auth.core [None req-22856dcd-0b97-4206-a676-49f159a2c185 None None] MFA Rules not processed for user `400d1f4db9de49638549e5db29a041e1`. Rule list: `[]` (Enabled: `True`). {{(pid=80396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 16:51:37.143093 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.fernet_utils [None req-22856dcd-0b97-4206-a676-49f159a2c185 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:51:37.151609 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 1464/2938] 10.222.0.59 () {58 vars in 957 bytes} [Thu Jun 2 16:51:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 16:51:37.155657 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf294433-121f-4349-a4e3-4394a9caee1f None None] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:51:37.165281 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf294433-121f-4349-a4e3-4394a9caee1f None None] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:51:37.169832 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c7c0911-52fb-434d-9cd8-22afaf3073d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f73d5a98be74242b45222df39fb6213', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:51:37.170519 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7c0911-52fb-434d-9cd8-22afaf3073d7 admin admin] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:51:37.170808 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7c0911-52fb-434d-9cd8-22afaf3073d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:51:37.171083 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7c0911-52fb-434d-9cd8-22afaf3073d7 admin admin] PATH_INFO: `/v3/domains` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:51:37.171812 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c7c0911-52fb-434d-9cd8-22afaf3073d7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80395) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 16:51:37.172115 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c7c0911-52fb-434d-9cd8-22afaf3073d7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:51:37.173725 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c7c0911-52fb-434d-9cd8-22afaf3073d7 admin admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:51:37.186319 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 1475/2939] 10.222.0.59 () {58 vars in 1152 bytes} [Thu Jun 2 16:51:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 16:51:37.190677 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22856dcd-0b97-4206-a676-49f159a2c185 None None] Authenticating user token {{(pid=80396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:51:37.200332 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22856dcd-0b97-4206-a676-49f159a2c185 None None] Validating token access rules against request {{(pid=80396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:51:37.204868 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb60be1b-9db3-4283-a3be-bb71aac97d53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f73d5a98be74242b45222df39fb6213', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:51:37.205501 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb60be1b-9db3-4283-a3be-bb71aac97d53 admin admin] REQUEST_METHOD: `POST` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:51:37.205778 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb60be1b-9db3-4283-a3be-bb71aac97d53 admin admin] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:51:37.206049 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb60be1b-9db3-4283-a3be-bb71aac97d53 admin admin] PATH_INFO: `/v3/projects` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:51:37.206769 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb60be1b-9db3-4283-a3be-bb71aac97d53 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:51:37.208651 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb60be1b-9db3-4283-a3be-bb71aac97d53 admin admin] RBAC: Authorization granted {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:51:37.293000 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 1465/2940] 10.222.0.59 () {60 vars in 1152 bytes} [Thu Jun 2 16:51:37 2022] POST /identity/v3/projects => generated 363 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 16:51:37.297208 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c7c0911-52fb-434d-9cd8-22afaf3073d7 admin admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:51:37.307957 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c7c0911-52fb-434d-9cd8-22afaf3073d7 admin admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:51:37.363465 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77fa3c32-4ade-4cd0-99e9-9d6fabaac5ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f73d5a98be74242b45222df39fb6213', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:51:37.364124 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77fa3c32-4ade-4cd0-99e9-9d6fabaac5ec admin admin] REQUEST_METHOD: `POST` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:51:37.364408 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77fa3c32-4ade-4cd0-99e9-9d6fabaac5ec admin admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:51:37.364682 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77fa3c32-4ade-4cd0-99e9-9d6fabaac5ec admin admin] PATH_INFO: `/v3/users` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:51:37.365394 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77fa3c32-4ade-4cd0-99e9-9d6fabaac5ec admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:51:37.368897 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77fa3c32-4ade-4cd0-99e9-9d6fabaac5ec admin admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:51:37.459809 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 1476/2941] 10.222.0.59 () {60 vars in 1143 bytes} [Thu Jun 2 16:51:37 2022] POST /identity/v3/users => generated 282 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 16:51:37.463968 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb60be1b-9db3-4283-a3be-bb71aac97d53 admin admin] Authenticating user token {{(pid=80396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:51:37.474170 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb60be1b-9db3-4283-a3be-bb71aac97d53 admin admin] Validating token access rules against request {{(pid=80396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:51:37.478772 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4679ac9-041e-425a-9713-28fe129035d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f73d5a98be74242b45222df39fb6213', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:51:37.479416 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4679ac9-041e-425a-9713-28fe129035d0 admin admin] REQUEST_METHOD: `GET` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:51:37.479699 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4679ac9-041e-425a-9713-28fe129035d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:51:37.479975 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4679ac9-041e-425a-9713-28fe129035d0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:51:37.480695 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4679ac9-041e-425a-9713-28fe129035d0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:51:37.482330 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4679ac9-041e-425a-9713-28fe129035d0 admin admin] RBAC: Authorization granted {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:51:37.493245 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 1466/2942] 10.222.0.59 () {58 vars in 1121 bytes} [Thu Jun 2 16:51:37 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 16:51:37.497068 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77fa3c32-4ade-4cd0-99e9-9d6fabaac5ec admin admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:51:37.507838 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77fa3c32-4ade-4cd0-99e9-9d6fabaac5ec admin admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:51:37.512466 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc004f43-6126-4234-872d-768bfeb87a10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f73d5a98be74242b45222df39fb6213', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:51:37.513125 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc004f43-6126-4234-872d-768bfeb87a10 admin admin] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:51:37.513410 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc004f43-6126-4234-872d-768bfeb87a10 admin admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:51:37.513687 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc004f43-6126-4234-872d-768bfeb87a10 admin admin] PATH_INFO: `/v3/roles` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:51:37.514478 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc004f43-6126-4234-872d-768bfeb87a10 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:51:37.516070 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc004f43-6126-4234-872d-768bfeb87a10 admin admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:51:37.526061 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 1477/2943] 10.222.0.59 () {58 vars in 1121 bytes} [Thu Jun 2 16:51:37 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 16:51:37.530010 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4679ac9-041e-425a-9713-28fe129035d0 admin admin] Authenticating user token {{(pid=80396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:51:37.540069 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4679ac9-041e-425a-9713-28fe129035d0 admin admin] Validating token access rules against request {{(pid=80396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:51:37.544862 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-093d4904-55d5-4101-98b0-c8883d11d9dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f73d5a98be74242b45222df39fb6213', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:51:37.545782 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-093d4904-55d5-4101-98b0-c8883d11d9dc admin admin] REQUEST_METHOD: `PUT` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:51:37.546059 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-093d4904-55d5-4101-98b0-c8883d11d9dc admin admin] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:51:37.546365 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-093d4904-55d5-4101-98b0-c8883d11d9dc admin admin] PATH_INFO: `/v3/projects/11fd396e7b5e449e8a54498216cec462/users/61d47f3159ff4764b5509999f59a5be1/roles/649e0f2b5a264c419ea6a1441f123a03` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:51:37.561134 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-093d4904-55d5-4101-98b0-c8883d11d9dc admin admin] RBAC: Authorizing `identity:create_grant(project_id=11fd396e7b5e449e8a54498216cec462, user_id=61d47f3159ff4764b5509999f59a5be1, role_id=649e0f2b5a264c419ea6a1441f123a03)` {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:51:37.563989 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-093d4904-55d5-4101-98b0-c8883d11d9dc admin admin] RBAC: Authorization granted {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:51:37.656955 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 1467/2944] 10.222.0.59 () {60 vars in 1482 bytes} [Thu Jun 2 16:51:37 2022] PUT /identity/v3/projects/11fd396e7b5e449e8a54498216cec462/users/61d47f3159ff4764b5509999f59a5be1/roles/649e0f2b5a264c419ea6a1441f123a03 => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 16:51:37.668833 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a2002a0-94e6-424e-915b-e40a2c1c26a4 None None] REQUEST_METHOD: `POST` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:51:37.669129 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a2002a0-94e6-424e-915b-e40a2c1c26a4 None None] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:51:37.669411 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a2002a0-94e6-424e-915b-e40a2c1c26a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:51:37.675229 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 16:51:37.696780 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.auth.core [None req-9a2002a0-94e6-424e-915b-e40a2c1c26a4 None None] MFA Rules not processed for user `61d47f3159ff4764b5509999f59a5be1`. Rule list: `[]` (Enabled: `True`). {{(pid=80395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 16:51:37.698047 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.fernet_utils [None req-9a2002a0-94e6-424e-915b-e40a2c1c26a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:51:37.762565 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 1478/2945] 10.222.0.59 () {58 vars in 957 bytes} [Thu Jun 2 16:51:37 2022] POST /identity/v3/auth/tokens => generated 3230 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 16:51:37.773475 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-093d4904-55d5-4101-98b0-c8883d11d9dc admin admin] Authenticating user token {{(pid=80396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:51:37.775140 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.fernet_utils [None req-093d4904-55d5-4101-98b0-c8883d11d9dc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:51:37.831397 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-093d4904-55d5-4101-98b0-c8883d11d9dc admin admin] Validating token access rules against request {{(pid=80396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:51:37.834992 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-146a2cf3-afbe-45fb-a93f-78a83c847b8b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6534961c369940a5b88f310c6450250b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c87c981909d4b8db02783421818c79b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:51:37.835731 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-146a2cf3-afbe-45fb-a93f-78a83c847b8b service cinder] REQUEST_METHOD: `GET` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:51:37.836014 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-146a2cf3-afbe-45fb-a93f-78a83c847b8b service cinder] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:51:37.836289 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-146a2cf3-afbe-45fb-a93f-78a83c847b8b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:51:37.844500 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-146a2cf3-afbe-45fb-a93f-78a83c847b8b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:51:37.845912 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-146a2cf3-afbe-45fb-a93f-78a83c847b8b service cinder] RBAC: Authorization granted {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:51:37.855092 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 1468/2946] 10.222.0.59 () {60 vars in 1365 bytes} [Thu Jun 2 16:51:37 2022] GET /identity/v3/auth/tokens => generated 3230 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 16:51:47.759573 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writing DB stats keystone:SELECT=31 {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 16:51:47.850628 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG dbcounter [-] [80396] Writing DB stats keystone:DELETE=6,keystone:SELECT=67,keystone:INSERT=3 {{(pid=80396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 16:52:27.727186 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a2002a0-94e6-424e-915b-e40a2c1c26a4 None None] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:52:27.804367 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a2002a0-94e6-424e-915b-e40a2c1c26a4 None None] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:52:27.808762 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbe6bf08-c557-4332-bceb-dcf2eda5450c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f73d5a98be74242b45222df39fb6213', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:52:27.809625 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe6bf08-c557-4332-bceb-dcf2eda5450c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:52:27.809906 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe6bf08-c557-4332-bceb-dcf2eda5450c admin admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:52:27.810211 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe6bf08-c557-4332-bceb-dcf2eda5450c admin admin] PATH_INFO: `/v3/users/61d47f3159ff4764b5509999f59a5be1` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:52:27.811390 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbe6bf08-c557-4332-bceb-dcf2eda5450c admin admin] RBAC: Authorizing `identity:delete_user(user_id=61d47f3159ff4764b5509999f59a5be1)` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:52:27.813846 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbe6bf08-c557-4332-bceb-dcf2eda5450c admin admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:52:28.013777 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.notifications [None req-cbe6bf08-c557-4332-bceb-dcf2eda5450c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '61d47f3159ff4764b5509999f59a5be1'} {{(pid=80395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:52:28.097047 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.notifications [None req-cbe6bf08-c557-4332-bceb-dcf2eda5450c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '61d47f3159ff4764b5509999f59a5be1'} {{(pid=80395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:52:28.110114 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.notifications [None req-cbe6bf08-c557-4332-bceb-dcf2eda5450c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '61d47f3159ff4764b5509999f59a5be1'} {{(pid=80395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:52:28.110742 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.notifications [None req-cbe6bf08-c557-4332-bceb-dcf2eda5450c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '61d47f3159ff4764b5509999f59a5be1'} {{(pid=80395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:52:28.117417 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.notifications [None req-cbe6bf08-c557-4332-bceb-dcf2eda5450c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '61d47f3159ff4764b5509999f59a5be1'} {{(pid=80395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:52:28.123382 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 1479/2947] 10.222.0.59 () {58 vars in 1223 bytes} [Thu Jun 2 16:52:27 2022] DELETE /identity/v3/users/61d47f3159ff4764b5509999f59a5be1 => generated 0 bytes in 397 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 16:52:28.128222 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bbdbe7f-5e09-4e07-a6d7-b6eb972d3ac9 None None] REQUEST_METHOD: `POST` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:52:28.128744 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bbdbe7f-5e09-4e07-a6d7-b6eb972d3ac9 None None] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:52:28.128843 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bbdbe7f-5e09-4e07-a6d7-b6eb972d3ac9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:52:28.146669 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.auth.core [None req-7bbdbe7f-5e09-4e07-a6d7-b6eb972d3ac9 None None] MFA Rules not processed for user `400d1f4db9de49638549e5db29a041e1`. Rule list: `[]` (Enabled: `True`). {{(pid=80396) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 16:52:28.147841 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.fernet_utils [None req-7bbdbe7f-5e09-4e07-a6d7-b6eb972d3ac9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:52:28.206425 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 1469/2948] 10.222.0.59 () {58 vars in 957 bytes} [Thu Jun 2 16:52:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 16:52:28.215965 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbe6bf08-c557-4332-bceb-dcf2eda5450c admin admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:52:28.217346 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.fernet_utils [None req-cbe6bf08-c557-4332-bceb-dcf2eda5450c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:52:28.281221 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbe6bf08-c557-4332-bceb-dcf2eda5450c admin admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:52:28.284933 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c472a52-830c-46e1-8be9-2e7aed4e8be0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9af40ddfe9ff4be3887b068f13a28dc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c87c981909d4b8db02783421818c79b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:52:28.285574 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c472a52-830c-46e1-8be9-2e7aed4e8be0 service neutron] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:52:28.285858 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c472a52-830c-46e1-8be9-2e7aed4e8be0 service neutron] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:52:28.286164 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c472a52-830c-46e1-8be9-2e7aed4e8be0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:52:28.295216 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c472a52-830c-46e1-8be9-2e7aed4e8be0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:52:28.297257 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c472a52-830c-46e1-8be9-2e7aed4e8be0 service neutron] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:52:28.306723 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 1480/2949] 10.222.0.59 () {60 vars in 1365 bytes} [Thu Jun 2 16:52:28 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 16:52:28.712580 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bbdbe7f-5e09-4e07-a6d7-b6eb972d3ac9 None None] Authenticating user token {{(pid=80396) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:52:28.713989 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.fernet_utils [None req-7bbdbe7f-5e09-4e07-a6d7-b6eb972d3ac9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80396) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:52:28.726624 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bbdbe7f-5e09-4e07-a6d7-b6eb972d3ac9 None None] Validating token access rules against request {{(pid=80396) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:52:28.731242 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01884633-75d0-4573-9779-cb517e7a8b63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '400d1f4db9de49638549e5db29a041e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f73d5a98be74242b45222df39fb6213', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80396) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:52:28.732127 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01884633-75d0-4573-9779-cb517e7a8b63 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:52:28.732414 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01884633-75d0-4573-9779-cb517e7a8b63 admin admin] SCRIPT_NAME: `/identity` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:52:28.732693 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01884633-75d0-4573-9779-cb517e7a8b63 admin admin] PATH_INFO: `/v3/projects/11fd396e7b5e449e8a54498216cec462` {{(pid=80396) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:52:28.733948 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01884633-75d0-4573-9779-cb517e7a8b63 admin admin] RBAC: Authorizing `identity:delete_project(project_id=11fd396e7b5e449e8a54498216cec462)` {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:52:28.738008 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01884633-75d0-4573-9779-cb517e7a8b63 admin admin] RBAC: Authorization granted {{(pid=80396) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:52:28.859225 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.notifications [None req-01884633-75d0-4573-9779-cb517e7a8b63 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '11fd396e7b5e449e8a54498216cec462', 'request_id': 'req-01884633-75d0-4573-9779-cb517e7a8b63'} {{(pid=80396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:52:28.865260 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.notifications [None req-01884633-75d0-4573-9779-cb517e7a8b63 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '11fd396e7b5e449e8a54498216cec462', 'request_id': 'req-01884633-75d0-4573-9779-cb517e7a8b63'} {{(pid=80396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:52:28.922471 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.notifications [None req-01884633-75d0-4573-9779-cb517e7a8b63 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '11fd396e7b5e449e8a54498216cec462', 'request_id': 'req-01884633-75d0-4573-9779-cb517e7a8b63'} {{(pid=80396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:52:28.933168 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.notifications [None req-01884633-75d0-4573-9779-cb517e7a8b63 admin admin] The token cache is being invalidate because project 11fd396e7b5e449e8a54498216cec462 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80396) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 02 16:52:28.933455 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.notifications [None req-01884633-75d0-4573-9779-cb517e7a8b63 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:52:28.934097 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG keystone.notifications [None req-01884633-75d0-4573-9779-cb517e7a8b63 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80396) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:52:28.935633 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: [pid: 80396|app: 0|req: 1470/2950] 10.222.0.59 () {58 vars in 1232 bytes} [Thu Jun 2 16:52:28 2022] DELETE /identity/v3/projects/11fd396e7b5e449e8a54498216cec462 => generated 0 bytes in 224 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 16:52:38.302416 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writing DB stats keystone:SELECT=84,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 16:52:38.930020 dv-cinder-797608-27-iscsi devstack@keystone.service[80396]: DEBUG dbcounter [-] [80396] Writing DB stats keystone:SELECT=54,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 16:55:12.868219 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c472a52-830c-46e1-8be9-2e7aed4e8be0 service neutron] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:55:12.869606 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.fernet_utils [None req-9c472a52-830c-46e1-8be9-2e7aed4e8be0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:55:12.938060 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c472a52-830c-46e1-8be9-2e7aed4e8be0 service neutron] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:55:12.997098 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c2f881a-5afb-4d19-b417-7bb709e37d0c service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b700f6d94374ba4b362a8f0d5b35796', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c87c981909d4b8db02783421818c79b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:55:12.997738 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2f881a-5afb-4d19-b417-7bb709e37d0c service placement] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:55:12.998019 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2f881a-5afb-4d19-b417-7bb709e37d0c service placement] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:55:12.998323 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2f881a-5afb-4d19-b417-7bb709e37d0c service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:55:13.000090 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.fernet_utils [None req-9c2f881a-5afb-4d19-b417-7bb709e37d0c service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:55:13.011671 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c2f881a-5afb-4d19-b417-7bb709e37d0c service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:55:13.013254 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c2f881a-5afb-4d19-b417-7bb709e37d0c service placement] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:55:13.023519 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 1481/2951] 10.222.0.59 () {60 vars in 1365 bytes} [Thu Jun 2 16:55:12 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 156 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 16:55:23.019091 dv-cinder-797608-27-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writing DB stats keystone:SELECT=58 {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}